How to Build a Data Mesh with Stream Governance | Join Webinar


Writing Kafka applications without Kafka server access

« Kafka Summit Europe 2021

Developers creating Apache Kafka client applications to be used with ""locked down"" (for example they're in a Cloud deployment) Kafka service endpoints have a unique problem: These developers do not have access to the Kafka server backends! Therefore the client applications have to be designed with this in mind. They have to tolerate brokers becoming temporarily unavailable while their Kafka provider automatically upgrades or rolls the brokers. They also have to instrument and monitor their Kafka client applications, so that they have a better understanding of their clients' interactions with the brokers. Zoltan's talk will introduce these challenges and will guide you through some important design principles for writing fault tolerant and cloud-ready Kafka client applications. He'll also discuss the instrumentation (logging, metrics) of these applications so that you can identify bottlenecks or issues without having access to broker specific backend debug data.

Related Links

How Confluent Completes Apache Kafka eBook

Leverage a cloud-native service 10x better than Apache Kafka

Confluent Developer Center

Spend less on Kafka with Confluent, come see how