Learn why trusted, real-time data is critical for scaling AI and driving business value | Learn More
Consumer
Implement a Cross-Platform Apache Kafka Producer and Consumer with C# and .NET
Sometimes you’d like to write your own code for producing data to an Apache Kafka® topic and connecting to a Kafka cluster programmatically. Confluent provides client libraries for several different […]
Debuting a Modern C++ API for Apache Kafka
Morgan Stanley uses Apache Kafka® to publish market data to internal clients and to persist it for replay purposes. We started out using librdkafka’s C++ API, which maintains C++98 compatibility. […]
Node.js ❤️ Apache Kafka – Getting Started with KafkaJS
One of the great things about using an Apache Kafka® based architecture is that it naturally decouples systems and allows you to use the best tool for the job. While […]
Introducing the Confluent Parallel Consumer
Consuming messages in parallel is what Apache Kafka® is all about, so you may well wonder, why would we want anything else? It turns out that, in practice, there are […]
Getting Started with Scala and Apache Kafka
If you’re getting started with Apache Kafka® and event streaming applications, you’ll be pleased to see the variety of languages available to start interacting with the event streaming platform. It […]
Advanced Testing Techniques for Spring for Apache Kafka
Asynchronous boundaries. Frameworks. Configuring frameworks. Apache Kafka®. All of these share one thing in common: complexity in testing. Now imagine them combined—it gets much harder. This is the final blog […]
Top 5 Things Every Apache Kafka Developer Should Know
Apache Kafka® is an event streaming platform used by more than 30% of the Fortune 500 today. There are numerous features of Kafka that make it the de-facto standard for […]
Implementing Message Prioritization in Apache Kafka
Users of messaging technologies such as JMS and AMQP often use message prioritization so that messages can be processed in a different order based on their importance. It doesn’t take […]
Multi-Threaded Message Consumption with the Apache Kafka Consumer
Multithreading is “the ability of a central processing unit (CPU) (or a single core in a multi-core processor) to provide multiple threads of execution concurrently, supported by the operating system.” […]
From Eager to Smarter in Apache Kafka Consumer Rebalances
Everyone wants their infrastructure to be highly available, and ksqlDB is no different. But crucial properties like high availability don’t come without a thoughtful, rigorous design. We thought hard about […]
What’s New in Apache Kafka 2.5
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.5.0. The community has created another exciting release. We are making progress […]
99th Percentile Latency at Scale with Apache Kafka
Fraud detection, payment systems, and stock trading platforms are only a few of many Apache Kafka® use cases that require both fast and predictable delivery of data. For example, detecting […]
What’s New in Apache Kafka 2.4
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.4.0. This release includes a number of key new features and improvements […]
Integrating Apache Kafka With Python Asyncio Web Applications
Modern Python has very good support for cooperative multitasking. Coroutines were first added to the language in version 2.5 with PEP 342 and their use is becoming mainstream following the […]