Mastering Kafka Producer Configs: A Guide to Optimizing Performance

In this talk, we will dive into the world of Kafka producer configs and explore how to understand and optimize them for better performance. We will cover the different types of configs, their impact on performance, and how to tune them to achieve the best results. Whether you're new to Kafka or a seasoned pro, this session will provide valuable insights and practical tips for improving your Kafka producer performance.

• Introduction to Kafka producer internal and workflow
• Understanding the producer configs like linger.ms, batch.size, buffer.memory and their impact on performance
• Learning about producer configs like max.block.ms, delivery.timeout.ms, request.timeout.ms and retries to make producer more resilient.
• Discuss configs like enable.idempotence, max.in.flight.requests.per.connection and transaction related configs to achieve delivery guarantees.
• Q&A session with attendees to address specific questions and concerns.