Apache Kafka's Next-Gen Rebalance Protocol: Towards More Stable and Scalable Consumer Groups

At Current 2022, we introduced KIP-848: The Next Generation of the Consumer Rebalance Protocol. Almost a year after, its development is well under way! In this talk, we will dive into all aspects of the new protocol, look into the architecture of Apache Kafka's brand new group coordinator, discuss the upgrade path for both the consumers and the brokers, and finally update the community about where we stand in the development.