Kafka In the Cloud: Why It’s 10x Better With Confluent | Get free eBook

Fan-out, Fan-in & the Multiplexer: Replication Recipes for Global Platform Distribution

This session will dive into our most successful (and unsuccessful!) multi-cluster event replication patterns.

An x-ray of the cross cluster distribution model that powers our globally distributed APIs will touch on the benefits that this model has provided in terms of client API experience, delivery agility and developer experience.

We will focus on recipes for effective use of Mirror Maker event replication to power platform distribution including the challenges of managing a 'fan in' event replication workflow - pulling events created in satellite clusters back to a mothership cluster for processing.

We will introduce the elegant technique of replication event multiplexing - which can be used to simplify the burden of managing a 'fan-in' replication topology by eliminating regional awareness from the application domain and improving replication health monitoring & observability.


Alex Hilton

Currently based in Melbourne & working as the Engineering Manager for the Airwallex Foreign Exchange team.

I am an event streaming enthusiast - keen to share the lessons learned from the last few years building an event driven global foreign exchange platform. https://medium.com/@alex.hilton

My software engineering career has given me the opportunity to build financial technology for Lehman Brothers, Nomura, Goldman Sachs and ANZ and work from London, Tokyo and most recently Melbourne.