Welcome to the first edition of Log Compaction, a monthly digest of highlights in the Apache Kafka and stream processing community. Today’s edition are the highlights from July and early August 2015. Got a newsworthy item? Let us know.
Breaking news! Apache Kafka no longer supports Java 6 and Scala 2.9. This will allow us to use some of the language and API improvements that were introduced in later Java and Scala versions – Diamond operators, NIO improvements, Scala Futures, Scala string interpolation and more.
Apache Kafka community is now accepting contributions via Github pull requests, transitioning from the old “Attach patches to JIRA” process. We documented the new code contribution process here: https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes We also welcome non-code contribution such as bug reports, feature requests and documentation improvements. We are planning to move our documentation to Github too so it will be easier to contribute documentation changes.
Gwen Shapira is a Software Enginner at Confluent. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. She currently specialises in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, an author of books including “Kafka, the Definitive Guide”, and a frequent presenter at data related conferences. Gwen is also a committer on the Apache Kafka and Apache Sqoop projects.
Apache Kafka 3.4 includes early access to ZooKeeper to KRaft migrations, enabling existing Kafka clusters to migrate to KRaft mode and gain scalability and resiliency benefits. Additionally, 3.4 includes several updates to Kafka Core, Streams, Connect, and more.
Learn why configuring consumer Group IDs are a crucial part of designing your consumer application. By the end of this post, you’ll understand the impact they have on three areas: work sharing, new data detection, and data recovery.