FileSystem Source Connector
Kafka Connect FileSystem Connector is a source connector for reading records from different sort of file formats and from different file system types and load them into Kafka. The following file types are supported: Parquet, Avro, ORC, SequenceFile, Cobol / EBCDIC, other binary files, CSV, TSV, Fixed-width, JSON, XML, YAML and Text.
Confluent Hub CLI installation
Use the Confluent Hub client to install this connector with:
confluent-hub install mmolimar/kafka-connect-fs:1.3.0
Download installationOr download the ZIP file and extract it into one of the directories that is listed on the Connect worker's plugin.path configuration properties. This must be done on each of the installations where Connect will be run.
Configure an instance of your connectorOnce installed, you can then create a connector configuration file with the connector's settings, and deploy that to a Connect worker.See here for more detailed instructions.
This connector is supported by the open source community.