You build your streaming applications and event-driven microservices using Apache Kafka. Are your systems observable enough without depending only on the broker-side metrics and application logs? Can you track down the root cause during incidents, or do you hope everything will be fine after a restart? In this talk, Tim & Kosta will take you on their observability journey by sharing pitfalls and knowledge our team gained over the last couple of years.
We are going to answer questions like:
• Do you understand how to expose and use your client-side Kafka metrics?
• JMX, Metric interceptors, Micrometer where to start?
• Why is there a difference between the values of client-side and broker-side metrics?
• Learn how client-side consumer lag metrics can differ from the lag calculated on the cluster.
• What is the right way to use and interpret them?
• Can you measure latency through your complete stack using distributed tracing?
• OpenTelemetry, Jaeger & Zipkin, what to pick?
During a step-by-step demo, we will look into different real-life examples and scenarios to demonstrate how to bring the observability of your Kafka applications to the next level.
Presenter
Kosta Chuturkov
INGKosta Chuturkov is an accomplished software engineer with a passion for building high-performance and scalable applications. With over 8 years of experience in the industry, he has become an expert in developing multi-region systems that can handle high throughput workloads.
Kosta joined the ING Eventbus Kafka team in 2020, and since then, he has been a driving force behind their successful implementation of Kafka in the bank. His work has contributed to ING's ability to process millions of transactions every day with low latency and high availability. Kosta's focus on quality and best practices has also made him an invaluable resource for coaching and mentoring other developers.
Beyond his technical expertise, Kosta is deeply committed to agile methodologies and is passionate about improving the way development teams work. He has successfully led many teams in adopting agile practices and has helped them to become more efficient, productive, and collaborative.
Presenter
Tim van Baarsen
INGTim van Baarsen is a creative software developer at ING Bank in the Netherlands and has been in the software development business for almost 15 years. He is a strong proponent of open source technology, a big fan of the Spring Framework since the early versions, and his interests lie in building scalable distributed systems. Tim enjoys speaking about his passion for the Spring ecosystem and Apache Kafka at both internal ING events as well at meetups and conferences.