Friday, November 22, 2019
10:00am - 11:30am EST
Kafka Connect is a framework for connecting Kafka with external systems such as databases, key-value stores, search indexes, and file systems. Using Kafka Connect you can use existing connector implementations for common data sources and sinks to move data into and out of Kafka. This talk will give an introduction the architecture of Kafka Connect, how to build custom Kafka Connectors, and how Kafka Connect can integrate with Kafka and Stream Processing for modern, real-time ETL and micro services workloads. We will also examine:
- Connectors demonstrating how easy it is to get data into/out of Kafka topics with minimal coding.
- Differences of running standalone Kafka client apps vs. running in connector framework.
- Connector framework benefits and capabilities around HA/failover, scaling up/down etc.
- Provide examples of building custom connectors.
Author
Robin Moffatt
Partner Technology Evangelist, EMEA
Robin is a Developer Advocate at Confluent, the company founded by the original creators of Apache Kafka, as well as an Oracle Groundbreaker Ambassador. His career has always involved data, from the old worlds of COBOL and DB2, through the worlds of Oracle and Hadoop, and into the current world with Kafka. His particular interests are analytics, systems architecture, performance testing and optimization. He blogs at http://cnfl.io/rmoff and http://rmoff.net/ and can be found tweeting grumpy geek thoughts as @rmoff. Outside of work he enjoys drinking good beer and eating fried breakfasts, although generally not at the same time.