How to Build Streaming Pipelines for Cloud Databases

Available On-demand

Data pipelines do much of the heavy lifting in organizations for integrating and transforming and preparing the data for subsequent use in downstream systems for operational use cases. Despite being critical to the data value stream, data pipelines fundamentally haven’t evolved in the last few decades. These legacy pipelines are holding organizations back from really getting value out of their data as real-time streaming becomes essential.

This webinar will walk through a story of a bank that uses an Oracle database to store sensitive customer information and RabbitMQ as the message broker for credit card transaction events. Their goal is to perform real-time analysis on credit card transactions to flag fraudulent transactions and push suspicious activity flags to MongoDB Atlas, their modern cloud-native database that powers their in-app mobile notifications.

To illustrate this use case, you’ll see a demo of:

Confluent’s fully managed connectors for Oracle CDC Source and RabbitMQ Source to stream the data in real time
ksqlDB to merge the two data sources, generating a unified view of customers and their credit card activity and flagging fraudulent transactions
The fully managed MongoDB Atlas sink connector to load the aggregated and transformed data into MongoDB Atlas

You’ll also learn about the challenges with batch-based data pipelines and the benefits of streaming data pipelines to power modern data flows.

Learn to build your own data streaming pipelines to push data to multiple downstream systems, including MongoDB, in order to power real-time operational use cases. Register today!

Resources: