Streaming Data Pipelines- From Monolith to Event-Driven Microservices

Monday, October 31, 2022

10 AM PDT | 1 PM EDT | 10 AM BST | 10:30 AM IST | 1 PM SGT | 3 PM AEST

Data pipelines perform much of the heavy lifting when it comes to data integration: combining and transforming data from multiple sources and systems, or exchanging data between microservices in the instance of an event-driven microservices architecture. And yet, despite being critical to the data value stream, pipelines remain an overlooked component of the modern data stack.

During this session, you’ll hear about our unique approach to this: Streaming Data Pipelines which is a better way to build real-time pipelines for operational, analytical, and SaaS application integration use cases.

Join us for a session on October 31st, 2022 during which we’ll break down the concept of event-driven microservices and how streaming data pipelines play a critical role in interservice communication. In this session, you’ll learn about:

• The history of data pipelines
• The challenges with monolithic apps and the rise of event-driven microservices
• Demo of an Application Modernization use-case using a Strangler Fig pattern which includes:
  • Confluent’s fully managed connectors for PostgresSQL CDC Source and PostgresSQL Sink to maintain data consistency during the application modernization process
  • ksqlDB to process data in real time, join different streams of data together and perform real-time aggregations to detect fraudulent credit card activity
  • The fully managed Elasticsearch Sink connector to load and update the Kibana dashboard in real time to show records flagged by ksqlDB for suspicious activity
• Customer stories and use-cases

Register today and learn to build your own data streaming pipeline for event-driven microservices!

Additional resources:

• Github repo: for demo shown today
• Solutions page: Microservices
• Whitepaper: Event-Driven Microservices Architecture
• Pre-built ksqlDB recipe: Change Data Capture