Project Metamorphosis: Unveiling the next-gen event streaming platformLearn More

Running Hundreds of Kafka Clusters with 5 People

Watch Video

Kafka Summit NYC 2017 | Systems Track

Kafka’s an interesting distributed system. It’s pretty ops friendly! But, running lots of clusters requires heavy levels of automation and careful takes on operations. This talk will cover lessons learned in running hundreds of different clusters, with different workloads, war stories from same, and ways Kafka could be more friendly towards automation.

Thomas Crayford, Engineer, Heroku