Elevating Kafka: Driving operational excellence with Albertsons + Forrester | Watch Webinar


Scaling your Kafka streaming pipeline can be a pain - but it doesnโ€™t have to be!!

ยซ Kafka Summit London 2022

Kafka data pipeline maintenance can be painful. It usually comes with complicated and lengthy recovery processes, scaling difficulties, traffic โ€˜moodinessโ€™, and latency issues after downtimes and outages.

It doesnโ€™t have to be that way!

Weโ€™ll examine one of our multi-petabyte scale Kafka pipelines, and go over some of the pitfalls weโ€™ve encountered. Weโ€™ll offer solutions that alleviate those problems, and go over comparisons between the before and after . Weโ€™ll then explain why some common sense solutions do not work well and offer an improved, scalable and resilient way of processing your stream.

Weโ€™ll cover: โ€ข Costs of processing in stream compared to in batch โ€ข Scaling out for bursts and reprocessing โ€ข Making the tradeoff between wait times and costs โ€ข Recovering from outages โ€ข And much moreโ€ฆ

Related Links

How Confluent Completes Apache Kafka eBook

Leverage a cloud-native service 10x better than Apache Kafka

Confluent Developer Center

Spend less on Kafka with Confluent, come see how