[Webinar] How to Implement Data Contracts: A Shift Left to First-Class Data Products | Register Now
FourKites has the largest supply chain data network on the planet and patented AI that provides 1200+ of the world’s biggest brands visibility into transportation, inventory, order management, yard management and more.
In 2023, FourKites launched the MyWorkspace product which provides centralized intelligence to executives and operators to help them manage their supply chain. With MyWorkspace, customers can create tailored dashboards and insights to help them make interconnected decisions using enterprise data and supply chain data.
Arpit Garg, Senior Principal Architect at FourKites and Goutham Elangesh, Staff Data Engineer at FourKites, walk through how the engineering team designed and implemented MyWorkspace leveraging Confluent Cloud Kafka (in addition to self managed kafka clusters) and Rockset. The talk covers several design aspects including:
Crafting a streaming data ingestion pipeline that could transform data for analytics in less than a second
Scaling streaming data ingestion to 8,000 writes per minute
Joining data from across the supply chain in milliseconds. Providing responsive ad-hoc, customizable in-application dashboards to customers.
Designing for multi-tenant applications that require high availability and scalability
They will also share the efficiencies, both in compute and engineering operations, that have been achieved by investing in cloud-native, fully-managed solutions.