Streams
Journey to Event Driven – Part 3: The Affinity Between Events, Streams and Serverless
With serverless being all the rage, it brings with it a tidal change of innovation. Given that it is at a relatively early stage, developers are still trying to grok […]
Noise Mapping with KSQL, a Raspberry Pi and a Software-Defined Radio
Our new cat, Snowy, is waking early. She is startled by the noise of jets flying over our house. Can I determine which plane is upsetting her by utilizing Apache […]
Streams and Tables: Two Sides of the Same Coin
We are happy to announce that our paper Streams and Tables: Two Sides of the Same Coin is published and available for free download. The paper was presented at the […]
Transactions in Apache Kafka
Note For the latest, check out Building Systems Using Transactions in Apache Kafka on Confluent Developer.
Running Kafka Streams Applications in AWS
This guest blog post is the second in a series about the use of Apache Kafka’s Streams API by Zalando, Europe’s largest online fashion retailer. See Ranking Websites in Real-time […]
Predicting Flight Arrivals with the Apache Kafka Streams API
Kafka Streams makes it easy to write scalable, fault-tolerant, and real-time production apps and microservices. This post builds upon a previous post that covered scalable machine learning with Apache Kafka, […]
Upgrading Apache Kafka Clients Just Got Easier
This is a very exciting time to be part of the Apache Kafka® community! Every four months, a new Apache Kafka release brings additional features and improvements. We’re particularly excited […]
Building a Real-Time Streaming ETL Pipeline in 20 Minutes
There has been a lot of talk recently that traditional ETL is dead. In the traditional ETL paradigm, data warehouses were king, ETL jobs were batch-driven, everything talked to everything […]
The Future of ETL Isn’t What It Used To Be
In his book Design Patterns Explained, Alan Shalloway compares his car to an umbrella. After all, he uses both to stay dry in the rain. The umbrella has an advantage […]
Getting Started with the Kafka Streams API using Confluent Docker Images
Introduction What’s great about the Kafka Streams API is not just how fast your application can process data with it, but also how fast you can get up and running […]
Watermarks, Tables, Event Time, and the Dataflow Model
The Google Dataflow team has done a fantastic job in evangelizing their model of handling time for stream processing. Their key observation is that in most cases you can’t globally […]
Join us for Kafka Summit Hackathon in New York City
I’m happy to announce Confluent will be hosting another Kafka Summit Hackathon on May 7th in New York City! The free hackathon will take place a day prior to Kafka […]
Data Reprocessing with the Streams API in Kafka: Resetting a Streams Application
This blog post is the third in a series about the Streams API of Apache Kafka, the new stream processing library of the Apache Kafka project, which was introduced in Kafka v0.10.
Distributed, Real-time Joins and Aggregations on User Activity Events using Kafka Streams
In previous blog posts we introduced Kafka Streams and demonstrated an end-to-end Hello World streaming application that analyzes Wikipedia real-time updates through a combination of Kafka Streams and Kafka Connect. […]