In this talk, we go over the history and future of Apache Flink adoption at Shopify.
We’ll talk about how and why we went from choosing Apache Flink as the replacement for our existing streaming technologies in 2021, to a year later with a flourishing streaming community. Today, we have tens of prototypes and several large use-cases running production.
Along the way, we’ll overview the Flink ecosystem at Shopify, the tools and libraries Shopify built, the decision to fork Flink, how we drove adoption of streaming at the company, and what’s next for the platform.