Migrating a core technology like Kafka can be daunting. Whether it is moving from queues to stream processing, Apache Kafka to Confluent Platform or even Confluent Platform to Confluent Cloud there are many obstacles that need to be overcome, both expected and unexpected.
In this talk we will go over our experience in migrating all these technologies and the pitfalls and powerups that we encountered along the way.
We will touch on the planning processes we went through for each migration and the time we needed to get each migration from conception to deployment in production. We will also look at:
Lastly, we will touch on the business conversations that were needed to get the green light for each of these migrations, and the decisions made for migrating to each technology.
We will analyze the things we did right along our migration journeys and the things we would improve for the next time we need to migrate a system.
Presenter
Bhavesh Sooka
Synthesis Software TechnologiesBhavesh is a Data Engineer specializing in Kafka. He joined the Synthesis family in 2019, where he was first introduced to Apache Kafka and Confluent. He has been involved in teams which have diversely utilized Kafka, ranging from a personalization campaign management system to an triggers based credit scoring system. He has also been involved in migrating systems from self managed to fully managed clusters. With his primary interest in streaming data and event driven systems, he has achieved both Confluent Certifications, and is currently focused on building teams specializing in Kafka and it's ecosystem.
Presenter
Jonathan Lew
Synthesis Software TechnologiesJonathan has worked for Synthesis since 2019 as a Kafkateer, a team of Kafka engineers that supports companies in their Kafka and event streaming journeys. He has been working with Kafka since Jan 2019 supporting, deploying, and automating Kafka environments and developing Kafka producer and consumers. He has been involved in migrating companies from Apache Kafka to Confluent, TIBCO EMS to Confluent Platform and Confluent Platform to Confluent Cloud. He has done the CCAAK. He has also written automation scripts for deploying Confluent Cloud and Confluent Platform products with ease.