I’ve been using KSQL from Confluent since its first developer preview in 2017. Reading, writing, and transforming data in Apache Kafka® using KSQL is an effective way to rapidly deliver event streaming applications for clients (e.g., streaming insurance events). Plus, I’ve also had the opportunity to deploy KSQL in some not-so-serious hobby projects (see Noise Mapping with KSQL, a Raspberry Pi and a Software-Defined Radio and ML and KSQL Let Me Know When I’ve Left the Heater Running).
KSQL has been growing in features and popularity since its early releases. To inspire and help developers embrace this fantastic event streaming technology, Stéphane Maarek and I authored a new KSQL course. For a KSQL newbie the practical exercises show you how to process data in Apache Kafka using an interactive SQL interface. The more experienced KSQL developer will benefit from production deployment lessons. Either way, we are thrilled to be able to offer the course for USD $9.99 using this special coupon for our blog readers.
Through this hands-on course, you will build an entire taxi-booking application using KSQL and Apache Kafka. This project approach means that students first start with the building blocks of streams and tables and then proceed onto advanced KSQL areas, such as topic rekeying, data encoding (CSV, JSON, and Avro), stream merging, and time-based windowing. The course also shows students how to use geospatial extensions and extend KSQL with user-defined functions.
The production deployment lectures allow you to confidently scale a cluster, visualize a topology and demonstrate resilience in a multi-server configuration. It can be very satisfying to destroy nodes on your laptop and see your KSQL application continue unaffected!
The course consists of 33 lectures in total. We aim for each lesson to be under 10 minutes—enough time to cover the theory and build a component, yet quick enough to keep the momentum going. KSQL has a heap of terrific features, so we wanted to keep a good pace during the video lessons.
I really enjoyed having the opportunity to co-create KSQL for Stream Processing – Hands On! course with Stéphane. We both hope you’ll find the course a great way to get up and running quickly with KSQL. We can’t wait to see what amazing projects are created with KSQL by the fantastic community of developers.
Learn about ksqlDB, the successor to KSQL.
At a high level, bad data is data that doesn’t conform to what is expected, and it can cause serious issues and outages for all downstream data users. This blog looks at how bad data may come to be, and how we can deal with it when it comes to event streams.
Versioned key-value state stores, introduced to Kafka Streams in 3.5, enhance stateful processing capabilities by allowing users to store multiple record versions per key, rather than only the single latest version per key as is the case for existing key-value stores today...