What Are We Waiting for in the Kafka Tiered Storage Early Access Release?

With Kafka 3.6.0, Apache Kafka brings a long anticipated feature ”tiered storage” with early access release. But the users are interested in knowing what we are waiting for in this early access release, and what we will have for tiered storage in the following releases. In this talk we will cover:

• Introduction of tiered storage in Apache Kafka
• Current set of features and limitations (3.6.0)
• What were added as part of 3.7.0
• What is planned to come in the next release (3.8.0)
• Enable/Disable tiered storage gracefully on a topic
• Quota controls on remote storage operations for better reliability
• and more improvements
• Future plans (after 3.8.0)

This feature has been already running in production in companies like Uber, AWS. The community has been working on contributing the changes and making enhancements to drive towards production ready.

This talk will give the audience a good understanding about the feature, its current scope and what the community has been working on and what to expect for Kafka tiered storage.