For several years, Apache Kafka has supported running without Apache ZooKeeper. This new mode, called KRaft mode, brings many scalability and manageability benefits, and has been production-ready since AK 3.5. This talk is about how to migrate existing ZooKeeper-based Kafka clusters to KRaft mode.
From an architectural point of view, we'll discuss how Kafka implemented zero-downtime migation. We will also outline the operational lessons we learned from migrating thousands of Kafka clusters to KRaft. Finally, we'll discuss our plans for the future.
Presenter
David Arthur
ConfluentDavid Arthur is a software engineer on the Core Kafka Team at Confluent. He has 10 years of experience designing and developing software for a wide variety of industries. David was an early user of Kafka and became a committer around the time Kafka became a top-level project at the Apache Software Foundation. He also authored a popular Python client for Kafka which received wide adoption, although he now recommends Confluent’s client 😊. Apart from software and open source, David enjoys spending time in his gardening, operating amateur radio, and spending time with his wife and three children.
Presenter
Colin McCabe
ConfluentColin McCabe currently works for Confluent to improve the performance, scalability, and general awesomeness of Apache Kafka. Previously, he worked on the Apache™ Hadoop® Distributed Filesystem. Colin studied computer science and computer engineering at Carnegie Mellon University, and he enjoys homebrewing and scuba diving.