Show Me How: Build Streaming Data Pipelines for Real-Time Data Warehousing | Register Today
Author: Martin Kleppmann
Should You Put Several Event Types in the Same Kafka Topic?
If you adopt a streaming platform such as Apache Kafka, one of the most important questions to answer is: what topics are you going to use? In particular, if you […]
Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
One of the things I realised while doing research for my book is that contemporary software engineering still has a lot to learn from the 1970s. As we’re in such […]
Using logs to build a solid data infrastructure (or: why dual writes are a bad idea)
This is an edited transcript of a talk I gave at the Craft Conference 2015. The video and slides are also available.
Bottled Water: Real-time integration of PostgreSQL and Kafka
Summary: Confluent is starting to explore the integration of databases with event streams. As part of the first step in this exploration, Martin Kleppmann has made a new open source […]
Real-time full-text search with Luwak and Samza
This is an edited transcript of a talk given by Alan Woodward and Martin Kleppmann at FOSDEM 2015. Traditionally, search works like this: you have a large corpus of documents, […]
Turning the database inside-out with Apache Samza
This is an edited and expanded transcript of a talk I gave at Strange Loop 2014. The video recording (embedded below) has been watched over 8,000 times. For those of […]
Stream Processing, CEP, Event Sourcing, and Data Streaming Explained
Some people call it stream processing. Others call it event streaming, complex event processing (CEP), or CQRS event sourcing. Sometimes, such buzzwords are just smoke and mirrors, invented by companies […]