Crossing the Streams – Joins in Apache Kafka
This post was originally published at the Codecentric blog with a focus on “old” join semantics in Apache Kafka versions 0.10.0 and 0.10.1. Version 0.10.0 of the popular distributed streaming […]
Kafka Connect Sink for PostgreSQL from JustOne Database
The following post was written by guest blogger Duncan Pauly from JustOne. JustOne is a member of the Confluent partner program. Duncan is the Chief Technology Officer at JustOne and possesses over two decades of senior technical […]
Introducing Kafka Streams: Stream Processing Made Simple
I’m really excited to announce a major new feature in Apache Kafka v0.10: Kafka’s Streams API. The Streams API, available as a Java library that is part of the official […]
Apache Kafka Security 101
TLS, Kerberos, SASL, and Authorizer in Apache Kafka 0.9 – Enabling New Encryption, Authorization, and Authentication Features Apache Kafka is frequently used to store critical data making it one of […]
Confluent at Apache: Big Data Europe | Being Ready for Apache Kafka
Many of today’s most popular Big Data software projects such as Apache Hadoop and Apache Kafka are managed under the umbrella of the Apache Software Foundation. Hence a formidable way […]
Apache Kafka Hits 1.1 Trillion Messages Per Day – Joins the 4 Comma Club
I am very excited that LinkedIn’s deployment of Apache Kafka has surpassed 1.1 trillion (yes, trillion with a “t”, and 4 commas) messages per day. This is the largest deployment of Apache […]
Distributed Consensus Reloaded: Apache ZooKeeper and Replication in Apache Kafka
This post was jointly written by Neha Narkhede, co-creator of Apache Kafka, and Flavio Junqueira, co-creator of Apache ZooKeeper. Many distributed systems that we build and use currently rely on dependencies like […]
Confluent at VLDB 2015 | Building a Replicated Logging System with Apache Kafka
There has been much renewed interest in using log-centric architectures to scale distributed systems that provide efficient durability and high availability. In this approach, a collection of distributed servers can […]
Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
One of the things I realised while doing research for my book is that contemporary software engineering still has a lot to learn from the 1970s. As we’re in such […]
Compression in Apache Kafka is now 34% faster
Apache Kafka is widely used to enable a number of data intensive operations from collecting log data for analysis to acting as a storage layer for large scale real-time stream […]