Confluent OEM Program: Grow faster with enterprise-grade data streaming | Learn More
Kafka Connect
Creating a Data Pipeline with the Kafka Connect API – from Architecture to Operations
Pandora began adoption of Apache Kafka® in 2016 to orient its infrastructure around real-time stream processing analytics. As a data-driven company, we have a several thousand node Hadoop clusters with hundreds of Hive tables critical to Pandora’s operational and reporting success...
Confluent Event Streaming Platform and Syncsort Data Management: Bringing Big Data to Life
I talk to a lot of folks in the big data industry about the challenges they’re tackling with big data technology. I’m endlessly fascinated with how each company chooses a unique architecture based on their distinctive needs, and yet, there are always patterns in the chaos...
Streaming Data from Oracle using Oracle GoldenGate and the Connect API in Kafka
Note As of February 2021, Confluent has launched its own Oracle CDC connector. Read this blog post for the latest information.
Want to migrate to AWS Cloud? Use Apache Kafka.
Amazon’s AWS cloud is doing really well. Doing well to the tune of making $2.57 Billion in Q1 2016. That’s 64% up from Q1 last year. Clearly a lot of […]
The Connect API in Kafka Cassandra Sink: The Perfect Match
The Connect API in Kafka is a scalable and robust framework for streaming data into and out of Apache Kafka, the engine powering modern streaming platforms. At DataMountaineer, we have worked on many big data and fast data projects across many industries from financial...
Build and monitor Kafka pipelines with Confluent Control Center
On May 24, we announced Confluent Control Center, an application for managing and monitoring a Kafka-based streaming platform. Control Center has a beautiful user interface, and under the surface we […]
Kafka Connect Sink for PostgreSQL from JustOne Database
Introducing a Kafka Sink Connector for PostgreSQL from JustOne Database, Inc. JustOne Database is great at providing agile analytics against streaming data and Confluent is an ideal complementary platform for delivering those messages...
Announcing Apache Kafka 0.10 and Confluent Platform 3.0
I am very excited to announce the availability of the 0.10 release of Apache Kafka and the 3.0 release of the Confluent Platform. This release marks the availability of Kafka […]
Log Compaction | Kafka Summit Edition | May 2016
Last week, Confluent hosted Kafka Summit, the first ever conference to focus on Apache Kafka and stream processing. It was exciting to see the stream processing community coming together in […]
Join us for the Inaugural Stream Data Hackathon
I’m happy to announce that Confluent will be hosting the first Stream Data Hackathon this April 25th in San Francisco! Apache Kafka has recently introduced two new major features: Kafka […]
Hello World, Kafka Connect + Kafka Streams
Important: The information in this article is outdated. With recent Kafka versions the integration between Kafka Connect and Kafka Streams as well as KSQL has become much simpler and easier. […]
Announcing Apache Kafka 0.9.0.1 and Confluent Platform 2.0.1
A few months ago, we announced the major release of Apache Kafka 0.9, which added several new features like Security, Kafka Connect, the new Java consumer and also critical bug […]
Announcing Kafka Connect: Building large-scale low-latency data pipelines
For a long time, a substantial portion of data processing that companies did ran as big batch jobs — CSV files dumped out of databases, log files collected at the […]
Log Compaction | Highlights in the Kafka and Stream Processing Community | January 2016
Happy 2016! Wishing you a wonderful, highly scalable, and very reliable year. Log Compaction is a monthly digest of highlights in the Apache Kafka and stream processing community. Got a newsworthy item? Let us […]