Unlock the full power of your event streams with Stream Governance | Learn More

Confluent and Elastic Partner to Deliver Optimized Search and Real-Time Analytics

Today, I am delighted to announce an expanded partnership with Elastic. Together, we’re enabling our joint customers to set data in motion, and through that, deliver optimized search, real-time analytics, and data-driven applications that rely upon these capabilities.

Confluent and Elastic are excited to work together to make it easier than ever to integrate Apache Kafka® and Elasticsearch. This gives organizations the ability to seamlessly stream data moving through Kafka into Elasticsearch, opening up log analysis, full-text search, and more.

We’ve done this by building a fully managed Elasticsearch Service Sink Connector in Confluent Cloud. This connector eliminates the need to manage your own Kafka Connect cluster, reducing the operational burden of connecting Elasticsearch to the Kafka ecosystem. This capability is available across all major cloud providers, including Amazon Web Services (AWS), Microsoft Azure, and Google Cloud.

Elasticsearch Sink Connector in Confluent Cloud

See how easy it is to get started with the connector in the quick demo video below.

A common example where our partnership and easy connectivity enables a new generation of use cases is the augmentation of traditional SIEM systems. We’ve helped multiple customers protect their environments from constantly evolving threats with the flexibility, scalability, interoperability, and data portability that preemptive threat mitigation requires—and we do it all in real time.

This approach includes the ability to:

  • Integrate security event and sensor data into a single distributed, scalable, and persistent platform
  • Blend varied data streams using ksqlDB or Kafka Streams for richer threat detection, investigation, and real-time analysis
  • Send aggregated data to any connected source, including SIEM indexes, search, and custom apps
  • Unlock insights in SIEM data by running new machine learning and artificial intelligence models

However, our partnership goes well beyond the ability to implement a SIEM use case. The real-time capabilities that we deliver are helping companies tackle use cases as varied as:

  • Delivering faster and more customized search and recommendations for retail and media consumers
  • Improving application and infrastructure performance through real-time monitoring
  • Driving better visibility into real-time user behavior, trends, and content

We look forward to continuing to work with Elastic to deliver new capabilities that make processing, visualizing, and searching data streams even easier. As organizations around the world adapt to an increasingly real-time, event-driven world, Confluent—along with our broad ecosystem of partners—is ready to help them put their data in motion.

To learn more about our partnership, check out Elastic’s announcement.

Stream Data into Elastic Now

Jay Kreps is the CEO of Confluent as well as one of the original co-creators of Apache Kafka. He was previously a senior architect at LinkedIn.

Did you like this blog post? Share it now

Subscribe to the Confluent blog

More Articles Like This

Confluent and Red Hat Collaborate to Deliver a Cloud-Native Data in Motion Platform for Hybrid Cloud

Today, we are delighted to announce Confluent’s collaboration with Red Hat. This results in a complete, cloud-native experience for application developers and platform operators to set data in motion everywhere

Extracting Value from IoT Using Azure Cosmos DB, Azure Synapse Analytics, and Confluent Cloud

Today, an organization’s strategic objective is to deliver innovations for a connected life and to improve the quality of life worldwide. With connected devices comes data, and with data comes

Join Us at Google Next to See What’s Next for Confluent

Here at Confluent, we’re excited to once again be participating in Google Cloud Next, taking place from Oct 12-14, and we hope to see you at our virtual booth to