Handle Millions of IoT Devices Connected to Kafka via MQTT

From vehicle communication to predictive maintenance, real-time ingestion, analysis and control has become an increasingly important characteristic of the machines we use in everyday life.

You have a fleet of IoT devices deployed in your customer environments and need to integrate with your event-driven architecture in real-time. You already have an MQTT broker infrastructure in place and need to integrate with your Kafka data plane.

IoT devices use specific protocols such as MQTT and cannot connect directly to Apache Kafka. Various solutions are possible, including data replication between MQTT and Kafka using technologies such as Kafka Connect, as well as proxying MQTT protocol to and from Kafka via a protocol translation gateway.

I will discuss the performance, security and scalability characteristics of these approaches to help you decide what works best for you.

This session is targeted towards developers interested in learning how to use Kafka as the data plane for their MQTT broker infrastructure, without needing to run separate MQTT brokers.