Build your real-time bridge to the cloud with Confluent Platform 7.0 and Cluster Linking | Read the blog

What Does an Event Mean? Manage the Meaning of Your Data!

Van Oord, a 150 year old family owned business, build windmill parks in the sea, lay cables on sea surface, dredging, as well as infrastructure (Dike, etc) operates world-wide, often facilitating self-owned specialized vessels. A well-known prestigious project is the creation of the palm island at the coast of Dubai. Data Management in Van Oord is still in its infancy. The current operation is based on bilateral data exchange, without an Enterprise Service Bus or mayor data warehouse infrastructure. In 2020 Van Oord started a PoC with Confluent Kafka, executing a wide range of uses cases and requirements, followed by the formal program implementing a sustainable data platform. Data owners are publishing an information product, i.e. a set of Kafka topics to communicate change (a la CDC) and topics for sharing state of a data source (Kafka tables). The information product owner is responsible for granting access, assuring data quality, data linage and governance. The set of all information products forms the enterprise data model. This talk outlines why Van Oord requires data governance and enterprise architecture models integrated with Confluent Kafka, and demo how an open-source based data governance tool is integrated with Confluent Kafka to fulfil these requirements.

Presenters

Andreas Wombacher

Andreas Wombacher PhD: Andreas has extensive expertise in workflow and data management. Ranging from data integration, sensor data fusion, data mining, event based systems, and data analysis. Andreas has worked with data on different scales and abstraction levels from time series sensor data to information system or human event data.

Marlon Hiralal

Marlon has extensive experience with (real-time) data management, and have led several Industrial Digital Transformation initiatives, such as Smart Factory/End2End Digital Supply Chain, IT-OT Architecture and Industrial Internet of Things/Connected Machines Things. Marlon worked on several streaming platforms as product manager and system/enterprise architect.