Introducing Streamhouse: the open data architecture for AI | Learn More

Online Talk

The Allied and Joint Doctrine Demands for Real-Time Data

Watch Now

Available On-Demand



Today's geo-political environment draws focus on the importance of our Alliances perhaps more than any time in the past. In the context of Great Power competition, no one force can stand alone. Combined Joint All-Domain Command and Control (CJADC2) and U.S. Joint Doctrine focuses on integrating capabilities across Joint, Inter-Agency, Inter-Government, and Multi-National forces to address emerging threats quickly. Joint Fires (and maneuver to fire) requires interoperability between Allies and coalition partners for a unified defense. Executing joint fires requires real-time track custody management and contextually-consistent, secured data flow to maintain a unified operational picture among allies.

Open-Source Apache Kafka® powers this need for real-time data by enabling scaling and flexible data ingestion and distribution. Kafka's ability to handle large volumes of data with low-latency ensures critical information reaches decision-makers, enhancing situational awareness and coordination. As real-world deployments leave the air-conditioned data center for the forward-deployed vessels, airframes, and tents, the technology must also endure Denied Disrupted Intermittent and Latent (DDIL) comms channels, prioritize data synchronization in order of criticality when recovering from outage or EMCON. Data sharing must be secured at the finest granularity as we share data dynamically with non-traditional partners and dynamic security-policy enforced in real-time. These capabilities are key to maintaining readiness and agility and aligning U.S. and Australian defense strategies in the dynamic global security landscape.

Apache Kafka®, Kafka®, Apache Flink®, Flink®, and associated open source project names are trademarks of the Apache Software Foundation

Will LaForest is Field CTO for Confluent. In his current position, LaForest works with customers across a broad spectrum of industries and government, enabling them to realize the benefits of a data in motion architecture with event streaming. He is passionate about data technology innovation and has spent 26 years helping customers wrangle data at massive scale. His technical career spans diverse areas from software engineering, NoSQL, data science, cloud computing, machine learning, and building statistical visualization software but began with code slinging at DARPA as a teenager. LaForest holds degrees in mathematics and physics from the University of Virginia.