Kafka Connect JDBC

By Confluent, Inc.

confluentinc/kafka-connect-jdbc:4.1.1
100%
Version

4.1.1

Features

  • Single Message Transform
  • Control Center Integration
  • Kafka Connect API

Tags

Kafka Connect JDBC

Confluent, Inc.

confluentinc/kafka-connect-jdbc:4.1.1
100%

The JDBC source connector allows you to import data from any relational database with a JDBC driver into Kafka topics By using JDBC, this connector can support a wide variety of databases without requiring custom code for each one.

Data is loaded by periodically executing a SQL query and creating an output record for each row in the result set

By default, all tables in a database are copied, each to its own output topic The database is monitored for new or deleted tables and adapts automatically When copying data from a table, the connector can load only new or modified rows by specifying which columns should be used to detect new or modified data.

The JDBC sink connector allows you to export data from Kafka topics to any relational database with a JDBC driver By using JDBC, this connector can support a wide variety of databases without requiring a dedicated connector for each one The connector polls data from Kafka to write to the database based on the topics subscription It is possible to achieve idempotent writes with upserts Auto-creation of tables, and limited auto-evolution is also supported.

More......Less

Install your connector

Use the Confluent Hub client to install this connector with:

confluent-hub install confluentinc/kafka-connect-jdbc:4.1.1

Or download the ZIP file and extract it into one of the directories that is listed on the Connect worker's plugin.path configuration properties. This must be done on each of the installations where Connect will be run. See here for more detailed instructions.

Configure an instance of your connector

Once installed, you can then create a connector configuration file with the connector's settings, and deploy that to a Connect worker. See here for more detailed instructions.

The source code is located in this repository.

For more information, see the documentation.

Confluent supports the JDBC sink and source connectors alongside community members as part of its Confluent Platform open source offering.
Rate this connector

We use cookies to understand how you use our site and to improve your experience. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.