Single Message Transformations Are Not the Transformations You’re Looking For

In this Kafka Summit 2017 session, Ewen Cheslack-Postava provides an overview of Single Message Transformations (SMTs) within the Kafka Connect framework. The sessions covers the common use cases for SMTs when sending data to and from a Kafka cluster, including masking sensitive information, storing lineage data, remove unnecessary columns, and more. It also explains when to use SMTs and when to instead use Kafka Streams or another stream processing framework for more complex processing workloads that involve aggregations, windowing, and joins.