Replicator allows you to easily and reliably replicate topics from one Kafka cluster to another. It continuously copies the messages in multiple topics, when necessary creating the topics in the destination cluster using the same topic configuration in the source cluster.
This includes preserving the number of partitions, the replication factor, and any configuration overrides specified for individual topics.
Replicator is included in Confluent Enterprise Platform, or can be downloaded and installed separately.
It can be used for free for 30 days, but after that does require an Enterprise license. Contact Confluent for more details.
Use the Confluent Hub client to install this connector with:
confluent-hub install confluentinc/kafka-connect-replicator:5.1.0
Or download the ZIP file and extract it into one of the directories that is listed on the Connect worker's plugin.path configuration properties. This must be done on each of the installations where Connect will be run. See here for more detailed instructions.
Once installed, you can then create a connector configuration file with the connector's settings, and deploy that to a Connect worker. See here for more detailed instructions.
The source code is located in this repository.
For more information, see the documentation.