์‹ค์‹œ๊ฐ„ ์›€์ง์ด๋Š” ๋ฐ์ดํ„ฐ๊ฐ€ ๊ฐ€์ ธ๋‹ค ์ค„ ๊ฐ€์น˜, Data in Motion Tour์—์„œ ํ™•์ธํ•˜์„ธ์š”!

Scaling your Kafka streaming pipeline can be a pain - but it doesnโ€™t have to be!!

ยซ Kafka Summit London 2022

Kafka data pipeline maintenance can be painful. It usually comes with complicated and lengthy recovery processes, scaling difficulties, traffic โ€˜moodinessโ€™, and latency issues after downtimes and outages.

It doesnโ€™t have to be that way!

Weโ€™ll examine one of our multi-petabyte scale Kafka pipelines, and go over some of the pitfalls weโ€™ve encountered. Weโ€™ll offer solutions that alleviate those problems, and go over comparisons between the before and after . Weโ€™ll then explain why some common sense solutions do not work well and offer an improved, scalable and resilient way of processing your stream.

Weโ€™ll cover: โ€ข Costs of processing in stream compared to in batch โ€ข Scaling out for bursts and reprocessing โ€ข Making the tradeoff between wait times and costs โ€ข Recovering from outages โ€ข And much moreโ€ฆ

Related Links

How Confluent Completes Apache Kafka eBook

Leverage a cloud-native service 10x better than Apache Kafka

Confluent Developer Center

Spend less on Kafka with Confluent, come see how