Show Me How: Build Streaming Data Pipelines for Real-Time Data Warehousing | Register Today

eBook

Designing Event-Driven Systems

Concepts and Patterns for Streaming Services with Apache Kafka

Many forces affect software today: larger datasets, geographical disparities, complex company structures, and the growing need to be fast and nimble in the face of change.

Proven approaches such as service-oriented and event-driven architectures are joined by newer techniques such as microservices, reactive architectures, DevOps, and stream processing. Many of these patterns are successful by themselves, but as this practical ebook demonstrates, they provide a more holistic and compelling approach when applied together.

Author Ben Stopford explains how service-based architectures and stream processing tools such as Apache Kafka® can help you build business-critical systems.

  • Learn why streaming beats request-response based architectures in complex, contemporary use cases
  • Understand why replayable logs such as Kafka provide a backbone for both service communication and shared datasets
  • Explore how event collaboration and event sourcing patterns increase safety and recoverability with functional, event-driven approaches
  • Apply patterns including Event Sourcing and CQRS, and how to build multi-team systems with microservices and SOA using patterns such as “inside out databases” and “event streams as a source of truth”
  • Build service ecosystems that blend event-driven and request-driven interfaces using a replayable log and Kafka's Streams API
  • Scale beyond individual teams into larger, department- and company-sized architectures, using event streams as a source of truth

Author

Ben Stopford

Lead Technologist, Office of the CTO

Ben is the lead technologist in the Office of the CTO at Confluent where he has worked on a wide range of projects, from implementing the latest version of Apache Kafka’s replication protocol through to developing strategies for streaming applications. Before Confluent Ben led the design and build of a company-wide data platform for a large financial institution, as well as working on a number of early service-oriented systems, both in finance and at Thoughtworks.

Get the Ebook

Additional Resources

cc demo
kafka microservices
Image-Event-Driven Microservices-01

Additional Resources

cc demo
kafka microservices
microservices-and-apache-kafka