Version 2.10.0
Plugin type:
Source
Enterprise support:
None
Verification:
None
License:
The Apache Software License, Version 2.0
Author:
StreamThoughts
DocumentationSource code

FilePulse Source Connector

The Kafka Connect FilePulse Connector is a powerful source connector that makes it easy to parse, transform, and load data from the local filesystem, Amazon S3, Azure Blob Storage and Google Cloud Storage. This connector supports a variety of formats equally for all storage systems, e.g., text files, CSV, XML, JSON, Avro, Log4j, etc.

Installation

Confluent Hub CLI installation

Use the Confluent Hub client to install this connector with:
confluent-hub install streamthoughts/kafka-connect-file-pulse:2.10.0
Shared.Button.Copy

Download installation

Or download the ZIP file and extract it into one of the directories that is listed on the Connect worker's plugin.path configuration properties. This must be done on each of the installations where Connect will be run.
By downloading you agree to the terms of use and software license agreement.

Configure an instance of your connector

Once installed, you can then create a connector configuration file with the connector's settings, and deploy that to a Connect worker.See here for more detailed instructions.

Support

This connector is supported by the open source community and StreamThoughts as part of its open source offering.