In this 30-minute session, hear from top Kafka experts who will show you how to easily create your own Kafka cluster and use out-of-the-box components like ksqlDB to rapidly develop event streaming applications.
We live in a world of exponential data growth, and businesses are increasingly built around events - the real-time data in a company.
Microservices have become a dominant architectural paradigm for building systems in the enterprise, but they are not without their tradeoffs.
Join Confluent & Google Cloud for a Google Virtual Lab Game Day , a 2 day online hands-on lab beginning on Wednesday, December 8th at 9:00am PST / 12:00pm EST.
Kafka is now a technology developers and architects are adopting with enthusiasm. And it’s often not just a good choice, but a technology enabling meaningful improvements in complex, evolvable systems that need to respond to the world in real time. But surely it’s possible to do wrong!
In this webinar, we'll introduce you to Confluent Platform 7.0, which offers Cluster Linking to enable you to leverage modern cloud-based platforms and build hybrid architectures with a secure, reliable, and cost-effective bridge between on-prem and cloud environments.
Optimize your SIEM to Build Tomorrow’s Cyber Defense with Confluent
Learn how to break data silos and accelerate time to market for new applications by connecting valuable data from your existing systems on-prem to your AWS environment using Confluent.
Today, with Confluent, enterprises can stream data across hybrid and multicloud environments to Google Cloud’s BigQuery, powering real-time analysis while reducing total cost of ownership and time to value.
In this webinar, see how Confluent’s data warehouse modernization solution leverages the Azure Synapse connector to help enterprises create a bridge across your Azure cloud and on-prem environments. We’ll explain how the solution works, and show you a demo!
The world is changing! Organisations are now more globally integrated than ever before and new problems need to be solved. As systems scale and migrate into the cloud, those seeking to infiltrate enterprise systems are presented with new and more frequent opportunities to succeed.
Watch this webinar to hear more about how Generali, Skechers and Conrad Electronics are using Qlik and Confluent to increase Kafka’s value.
This webinar presents a solution using Confluent Cloud on Azure, Azure Cosmos DB and Azure Synapse Analytics which can be connected in a secure way within Azure VNET using Azure Private link configured on Kafka clusters.
Join this demo to see Stream Governance in action and learn how you can shift to an event-centric business while remaining compliant within an ever-evolving landscape of data regulations.
Great News! You are registered to attend Kafka Summit Americas 2021 organized by Confluent. Kafka Summit Americas 2021 will be hosted virtually - but let's bring the FUN to you!
From data collection at scale to data processing in the Cloud or at the Edge—IoT architectures and data can provide enormous advantages through useful business and operational insights.
Hear how Fortune 500 companies and leading technology providers are driving real-time innovation through the power of data in motion to deliver richer customer experiences and automate backend operations.
Learn the challenges of traditional messaging middleware, hindering innovation, low fault tolerance at scale, ephemeral persistence liming data usage for analytics, and soaring technical debt and operational costs.
Explore new ways that your organization can thrive with a data-in-motion approach by downloading the new e-book, Harness Data in Motion Within a Hybrid and Multicloud Architecture.
リアルタイムのカスタマーデータの力を引き出す
Confluent is pioneering a new category of data infrastructure focused on data in motion, designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly and securely stream across any organization.
Learn how teams around the world continue building innovative, mission-critical applications fueled by data in motion. This 4-part webinar series will provide you with bite-sized tutorials for how to get started with all the latest capabilities available on the platform.
This webinar will cover how you can protect your Kafka use cases with enterprise-grade security, reduce your Kafka operational burden and instead focus on building real-time apps that drive your business forward, and pursue hybrid and multi-cloud architectures with a data platform.
In this short, 20-minute session you’ll gain everything you need to get started with development of your first app based upon event-driven microservices.
Discover how Homepoint uses Confluent and Azure to Speed up Loan Processes
Watch this session to learn how to streamline infrastructure, increase development velocity, unveil new use cases, and analyze data in real-time.
Establish event streaming as the central nervous system of your entire business, perhaps starting with a single use case and eventually architecting a system around event-driven microservices or delivering net-new capabilities like streaming ETL or a comprehensive customer 360.
Discover how to fuel Kafka-enabled analytics use cases—including real-time customer predictions, supply chain optimization, and operational reporting—with a real-time flow of data.
Confluent’s platform for data in motion unifies silos and sets data in motion across an organization. Learn how this empowers developers to build the kinds of real-time applications that make their organizations more competitive and more efficient.
Join Confluent and Imply at this joint webinar to explore and learn the use cases about how Apache Kafka® integrates with Imply to bring in data-in-motion and real-time analytics to life.
By shifting to a fully managed, cloud-native service for Kafka, you can unlock your teams to work on the projects that make the best use of your data in motion.
In the world that real time analytics, cloud, event streaming and Kafka are hot topics, how does “Data In Motion” come into play? What are the core ideas behind and why is it a big deal to companies that are going through digital transformation?
今日の顧客の高い期待に応え続けられる企業は、一貫して供給されるリアルタイムのイベントストリームと、継続的なリアルタイム処理を基盤に運営しています。このような企業のように躍動するデータを活用してさらなる成功へとつなげていきたい場合には、まずはここから始めましょう。
Confluent Platform completes Kafka with a set of enterprise-grade features and services. Confluent Platform can reduce your Kafka TCO by up to 40% and accelerate your time to value for new data in motion use cases by 6+ months. Learn how Confluent Platform drives these outcomes for our customers.
Apache Kafka is the foundation of modern data architectures, but the open-source technology alone doesn’t offer everything enterprises need. Confluent offers a complete and secure enterprise-grade distribution of Kafka and makes it available everywhere your apps and data reside.
This paper presents Apache Kafka’s core design for stream processing, which relies on its persistent log architecture as the storage and inter-processor communication layers to achieve correctness guarantees.
We live in a world of exponential data growth, and businesses are increasingly built around events - the real-time data in a company.
This white paper explores the potential benefits and relevance of deploying Confluent with the Istio service mesh.
During this session you’ll see a pipeline built with data extraction from MongoDB Atlas, real-time transformation with ksqlDB, and simple loading into Snowflake.
Leveraging Confluent’s fully managed, cloud-native service for Apache Kafka®, DriveCentric has been able to successfully transform and grow their business within a rapidly changing market.
The ASAPIO Connector for Confluent allows true application-based change data capture, along with full database access. This webinar will showcase a SAP- and Confluent-certified solution to enable real-time event streaming for on-prem SAP data.
In this Online Talk we will discuss some of the key distinctions between Confluent and traditional message oriented middleware. We will go into detail about the architecture of Confluent and how it enables a new level of scalability and throughput.
Listen back and view the presentations from the Confluent Streaming Event Series in Europe 2020
In this white paper, you’ll learn about five Kafka elements that deserve closer attention, either because they significantly improve upon the behavior of their predecessors, because they are easy to overlook or to make assumptions about, or simply because they are extremely useful.
With Confluent, you can start streaming data into MongoDB Atlas in just a few easy clicks. Learn how to bring real-time capabilities to your business and applications by setting data in motion.
In this Online Talk you will learn:
Real-time ETL with Apache Kafka® doesn’t have to be a challenge. Join this demo and see how with Confluent Cloud. With out-of-the-box source & sink connectors and SQL-based stream processing, all fully managed on a complete platform for data in motion.
In this webinar, Dan Rosanova, Group Product Manager at Confluent, will cover:
Learn about the benefits of leveraging a cloud-native service for Kafka, and how you can lower your total cost of ownership (TCO) by 60% with Confluent Cloud while streamlining your DevOps efforts. Priya Shivakumar, Head of Product, Confluent Cloud, will share two short demos.
Microservices have become a dominant architectural paradigm for building systems in the enterprise, but they are not without their tradeoffs.
View this webinar with Confluent and Microsoft experts to:
If you want more details about how Confluent Cloud speeds up app dev, unblocks your people, and frees up your budget —and how it compares to other managed Kafka offerings—read the free technical brief Running Kafka in 2021: A Cloud-Native Service or fill out the form to download the full technical ebook.
Responsive, relevant, timely, insightful. Agencies are asking a lot of their data these days and treating it as a strategic asset. It’s a big job and a big change for agencies, which have been dealing with disconnected data silos, legacy applications and practices, and under-resourced data operations for decades. Making that shift from data as a passive to an active asset takes some work, but it pays off. In this report, you’ll learn how to use event streaming to process, store, analyze and act on both historical and real-time data in one place. You'll also explore: Data access and management challenges agencies are facing and how to address them. How the CDC tracked COVID test events to maximize value from COVID testing. Best practices on data analysis and productivity.
The Fourth Industrial Revolution (also known as Industry 4.0) is the ongoing automation of traditional manufacturing and industrial practices, using modern smart technology. Event Streaming with Apache Kafka plays a massive role in processing massive volumes of data in real-time in a reliable, scalable, and flexible way using integrating with various legacy and modern data sources and sinks.
In this talk, we are going to observe the natural journey companies undertake to become real-time, the possibilities it opens for them, and the challenges they will face
Government agencies understand the need to augment traditional SIEM systems. And, with this knowledge comes the pressure to do so in a way that is better, faster, and cheaper than before.
This 60-minute online talk is packed with practical insights where you will learn how Kafka fits into a data ecosystem that spans a global enterprise and supports use cases for both data ingestion and integration
To succeed, insurance companies must unify data from all their channels that may be scattered across multiple legacy systems as well as new digital applications. Without the ability to access and combine all this data in real time, delivering a truly modern insurance experience while assessing fast-changing risks can be an uphill battle. Our eBook explains how event streaming, an emerging technology for analyzing event data in real time, can help insurers compete with their insuretech peers. You will learn how combining event streaming from Apache Kafka® and Confluent with Google Cloud can help you.
To succeed, retailers must unify data scattered across point-of-sale, e-commerce, ERP, and other systems. Without integrating all of this data in motion—and making it available to applications in real time—it’s almost impossible to deliver a fully connected omnichannel customer experience.
Banking customers today demand personalized service and expect real-time insight into their accounts from any device—and not just during “business hours.” Financial institutions trying to meet those expectations have intense competition from each other as well as fintech startups...
Most insurance companies today are somewhere along the spectrum of digital transformation, finding new ways to use data while staying within the confines of strict regulatory complexity and capital requirements. But only a few insurtech leaders and innovative startups have really tapped into real-time streaming data as the architecture behind these efforts. In this free ebook, learn about three pivotal insurance business uses for event streaming: reducing operating costs with automated digital experiences, personalizing the customer experience, and mitigating risks with real-time fraud and security analytics.
Every one of your customer touch points, from an actual purchase to a marketing engagement, creates data streams and opportunities to trigger automations in real time.
In this ebook, you’ll learn about the adoption curve of event streaming and how to gain momentum and effect change within your organization. Learn how to wield event streaming to convert your enterprise to a real-time digital business, responsive to customers and able to create business outcomes in ways never before possible.
In this ebook, we cover five of the more common use cases Confluent has supported, with real-world customer examples and insights into how your organization can make the leap. You’ll get insight into how event streaming can help with use cases such as customer 360° and website clickstream analysis, legacy IT modernization, a single view of the business, next-gen apps, and real-time analytics. These are just a handful of the ways we’ve witnessed forward-thinking companies integrate event streaming into the core of their business models.
In this ebook, you’ll learn about the profound strategic potential in an event streaming platform for enterprise businesses of many kinds. The types of business challenges event streaming is capable of addressing include driving better customer experience, reducing costs, mitigating risk, and providing a single source of truth across the business. It can be a game changer.
We used to talk about the world’s collective data in terms of terabytes. Now, according to IDC’s latest Global Datasphere, we talk in terms of zettabtytes: 138Z of new data will be created in 2024—and 24% of it will be real-time data. How important is real-time streaming data to enterprise organizations? If they want to respond at the speed of business, it’s crucial. In this digital economy, having a competitive advantage requires using data to support quicker decision-making, streamlined operations, and optimized customer experiences. Those things all come from data.
Banks and financial institutions are looking toward a future in which most business is transacted digitally. They’re adding new, always-on digital services, using artificial intelligence (AI) to power a new class of real-time applications, and automating back-office processes.
Learn how companies will leverage event streaming, Apache Kafka, and Confluent to meet the demand of a real-time market, rising regulations, and customer expectations, and much more in 2021
In this 30-minute session, hear from top Kafka experts who will show you how to easily create your own Kafka cluster and use out-of-the-box components like ksqlDB to rapidly develop event streaming applications.
Hands-on workshop: Using Kubernetes, Spring Boot, Kafka Streams, and Confluent Cloud to rate Christmas movies.
Learn how Apache Kafka, Confluent, and event-driven microservices ensure real-time communication and event streaming for modernized deployment, testing, and continuous delivery.
If you’re a leader in a business that could or does benefit from automation, IoT, and real-time data, don’t miss this white paper. The lifeblood of Industry 4.0 is streaming data, which is where event streaming comes in: the real-time capture, processing, and management of all your data in order to drive transformative technology initiatives.
In this two-hour spooktacular workshop with Bruce Springstreams, learn about event-driven microservices with Spring BOOOOt and Confluent Cloud.
For financial services companies, digital technologies can solve business problems, drastically improve traditional processes, modernize middleware and front-end infrastructure, improve operational efficiency, and most importantly, better serve customers.
Hear from Intrado’s Thomas Squeo, CTO, and Confluent’s Chief Customer Officer, Roger Scott, to learn how Intrado future-proofed their architecture to support current and future real-time business initiatives.
Technologies open up a range of use cases for Financial Services organisations, many of which will be explored in this talk. .
Confluent Cloud enabled the company to get started quickly, minimize operational overhead, and reduce engineering effort.
In this Online Talk Henrik Janzon, Solutions Engineer at Confluent, explains Apache Kafka’s internal design and architecture.
The IDC Perspective on Confluent Platform 6.0 is here, and in it, you can read IDC’s lens on the importance of event streaming to enterprise companies today.
In this talk, we are going to show some example use cases that Data Reply developed for some of its customers and how Real-Time Decision Engines had an impact on their businesses.
Confluent is happy to announce that we will be providing new early release chapters of Kafka: The Definitive Guide v2 every month until the completion of the new e-book in Summer 2021.
In this webinar, we take a hands-on approach to these questions and walk through setting up a simple application written in .NET to a Confluent Cloud based Kafka cluster. Along the way, we point out best practices for developing and deploying applications that scale easily.
Confluent implements layered security controls designed to protect and secure Confluent Cloud customer data, incorporating multiple logical and physical security controls that include access management, least privilege, strong authentication, logging and monitoring, vulnerability management, and bug bounty programs.
Replace the mainframe with new applications using modern and less costly technologies. Stand up to the dinosaur, but keep in mind that legacy migration is a journey. This session will guide you to the next step of your company’s evolution!
This ENTERPRISE MANAGEMENT ASSOCIATES® (EMA™) eBook will show how, with fully managed cloud-based event streaming, executives, managers, and individual contributors gain access to real-time intelligence and the enterprise will achieve unprecedented momentum and material gain.
Databases represent some of the most successful software that has ever been written and their importance over the last fifty years is hard to overemphasize. Over this time, they have evolved to form a vast landscape of products that cater to different data types, volumes, velocities, and query characteristics. But the broad definition of what a database is has changed relatively little.
Event streaming: from technology to a completely new business paradigm.
Event Streaming Paradigm: rethink data as not stored records or transient messages, but instead as a continually updating stream of events.
You know the fundamentals of Apache Kafka. You are a Spring Boot developer and working with Apache Kafka. You have chosen Spring Kafka to integrate with Apache Kafka. You implemented your first producer, consumer, and maybe some Kafka streams, it's working... Hurray! You are ready to deploy to production what can possibly go wrong?
Learn how NAV (Norwegian Work and Welfare Department) are using Apache Kafka to distribute and act upon events. NAV currently distributes more than one-third of the national budget to citizens in Norway or abroad. They are there to assist people through all phases of life within the domains of work, family, health, retirement, and social security. Events happening throughout a person’s life determines which services NAV provides to them, how they provide them, and when they offer them.
In the world of online streaming providers, real-time events are becoming the new standard, driving innovation and a new set of use cases to react to a quickly changing market. We explain how, from simple media player heartbeats, Data Reply fueled a diverse set of near-real-time use cases and services for his customer, from blocking concurrent media streams, to recognizing ended sessions and trending content.
Large enterprises, government agencies, and many other organisations rely on mainframe computers to deliver the core systems managing some of their most valuable and sensitive data. However, the processes and cultures around a mainframe often prevent the adoption of the agile, born-on-the web practices that have become essential to developing cutting edge internal and customer-facing applications.
A company's journey to the cloud often starts with the discovery of a new use case or need for a new application. Deploying Confluent Cloud, a fully managed cloud-native streaming service based on Apache Kafka, enables organisations to revolutionise the way they build streaming applications and real-time data pipelines.
Learn how Apache Kafka and Confluent help the gaming industry leverage real-time integration, event streaming, and data analytics for seamless gaming experiences at scale.
Apache Kafka is an open source event streaming platform. It is often used to complement or even replace existing middleware to integrate applications and build microservice architectures. Apache Kafka is already used in various projects in almost every bigger company today. Understood, battled-tested, highly scalable, reliable, real-time. Blockchain is a different story. This technology is a lot in the news, especially related to cryptocurrencies like Bitcoin. But what is the added value for software architectures? Is blockchain just hype and adds complexity? Or will it be used by everybody in the future, like a web browser or mobile app today? And how is it related to an integration architecture and event streaming platform? This session explores use cases for blockchains and discusses different alternatives such as Hyperledger, Ethereum and a Kafka-native tamper-proof blockchain implementation. Different architectures are discussed to understand when blockchain really adds value and how it can be combined with the Apache Kafka ecosystem to integrate blockchain with the rest of the enterprise architecture to build a highly scalable and reliable event streaming infrastructure. Speakers: Kai Waehner, Technology Evangelist, Confluent Stephen Reed, CTO, Co-Founder, AiB
In this presentation, Lyndon Hedderly, Team Lead of Business Value Consulting at Confluent, will cover how Confluent works with customers to measure the business value of data streaming.
Developing a streaming solution working against a self-managed Kafka cluster, can be awkward and time consuming, largely due to security requirements and configuration red-tape. It's beneficial to use Confluent Cloud in the early stages to get quick progress. Creating the cluster in Confluent Cloud is super easy and allows you to concentrate on defining your Connect sources and sinks as well as fleshing out the streaming topology on your laptop. It also shows the client how easy it is to swap out the self-managed Kafka cluster with Confluent Cloud.
Without any coding or scripting, end-users leverage their existing spreadsheet skills to build customized streaming apps for analysis, dashboarding, condition monitoring or any kind of real-time pre-and post-processing of Kafka or KsqlDB streams and tables.
Join Kai Waehner, Technology Evangelist at Confluent, for this session which explores various telecommunications use cases, including data integration, infrastructure monitoring, data distribution, data processing and business applications. Different architectures and components from the Kafka ecosystem are also discussed.
In this webinar we want to share our experience on how the Swiss Mobiliar, the biggest Swiss household insurance enterprise, introduced Kafka and led it to enterprise-wide adoption with the help of AGOORA.com.
Join this Online Talk, to understand how and why Apache Kafka has become the de-facto standard for reliable and scalable streaming infrastructures in the finance industry.
This document provides an overview of Confluent and Snowflake’s integration, a detailed tutorial for getting started with the integration, and unique considerations to keep in mind when working with these two technologies.
TCOとは、購入価格に運用コストを加えた総所有コストを指します。包括的なTCO評価には時間、マンパワーを始め、組織全体の長期的なコストを織り込む必要があります。オープンソースとSaaSはよく比較されますが、その際、オープンソースが「無料」だという主張、自社ソフトウェアが TCO 削減や ROI 改善に寄与するというベンダーの主張が挙げられます。ただ、このような主張はどんな前提でなされているのでしょう。また、推定の確度はどうでしょうか。本ホワイトペーパーでは、使用モデル、アプローチや顧客事例を概説し、知見を共有しつつ、Confluent Cloud に対するこのようなご質問にお答えします。
Adjusting to the real-time needs of your mission-critical apps is only possible with an architecture that scales elastically. Confluent re-engineered Apache Kafka into an elastically scalable, next-gen event streaming platform that processes real-time data wherever it lives - making it accessible for any budget or use case.
Join Unity, Confluent and GCP to learn how to reduce risk and increase business options with a hybrid cloud strategy.
Mainframe offloading with Apache Kafka and its ecosystem can be used to keep a more modern data store in real-time sync with the mainframe. At the same time, it is persisting the event data on the bus to enable microservices, and deliver the data to other systems such as data warehouses and search indexes.
This white paper reports the results of benchmarks we ran on a 2-CKU multi-zone dedicated cluster and shows the ability of a CKU to deliver the stated client bandwidth on AWS, GCP, and Azure clouds.
Explore the use cases and architecture for Apache Kafka®, and how it integrates with MongoDB to build sophisticated data-driven applications that exploit new sources of data.
Experts from Confluent and Attunity share how you can: realize the value of streaming data ingest with Apache Kafka®, turn databases into live feeds for streaming ingest and processing, accelerate data delivery to enable real-time analytics and reduce skill and training requirements for data ingest.
Get answers to: How you would use Apache Kafka® in a micro-service application? How do you build services over a distributed log and leverage the fault tolerance and scalability that comes with it?
Get an introduction to Apache Kafka® and how it serves as a foundation for streaming data pipelines and applications that consume/process real-time data streams. Part 1 in the Apache Kafka: Online Talk Series.
In this talk by Jun Rao, co-creator of Apache Kafka®, get a deep dive on some of the key internals that makes Apache Kafka popular, including how it delivers reliability and compaction. Part 2 in the Apache Kafka: Online Talk Series.
Learn different options for integrating systems and applications with Apache Kafka® and best practices for building large-scale data pipelines using Apache Kafka. Part 3 in the Apache Kafka: Online Talk Series.
Learn typical use cases for Apache Kafka®, how you can get real-time data streaming from Oracle databases to move transactional data to Kafka and enable continuous movement of your data to provide access to real-time analytics.
Learn how to map practical data problems to stream processing and write applications that process streams of data at scale using Kafka Streams. Part 4 in the Apache Kafka: Online Talk Series.
In this talk, we survey the stream processing landscape, the dimensions along which to evaluate stream processing technologies, and how they integrate with Apache Kafka®. Part 5 in the Apache Kafka: Online Talk Series.
This talk focuses on how to integrate all the components of the Apache Kafka® ecosystem into an enterprise environment and what you need to consider as you move into production. Part 6 of the Apache Kafka: Online Talk Series.
This talk will examine the underlying dichotomy we all face as we piece such systems together--one that is not well served today. The solution lies in blending the old with the new and Apache Kafka® plays a central role. Part 1 in the Apache Kafka for Microservices: A Confluent Online Talk Series.
This practical talk will dig into how we piece services together in event driven systems, how we use a distributed log to create a central, persistent narrative and what benefits we reap from doing so. Part 2 in the Apache Kafka® for Microservices: A Confluent Online Talk Series.
This talk will look at how Stateful Stream Processing is used to build truly autonomous services. With the distributed guarantees of Exactly Once Processing, Event-Driven Services supported by Apache Kafka®. Part 3 in the Apache Kafka for Microservices: A Confluent Online Talk Series.
Join us as we walk through an overview of this exciting new service from the experts in Kafka. Learn how to build robust, portable and lock-in free streaming applications using Confluent Cloud.
Neha Narkhede talks about the experience at LinkedIn moving from batch-oriented ETL to real-time streams using Apache Kafka and how the design and implementation of Kafka was driven by this goal of acting as a real-time platform for event data.
Learn about the recent additions to Apache Kafka® to achieve exactly-once semantics (EoS) including support for idempotence and transactions in the Kafka clients.
Microservices guru Sam Newman, Buoyant CTO Oliver Gould and Apache Kafka® engineer Ben Stopford are joined by Jay Kreps, co-founder and CEO, Confluent for a Q&A session where they discuss and debate all things Microservices.
Join the discussion on the relationship between microservices and stream processing with Data-Intensive Apps author Martin Kleppmann, Confluent engineers Damian Guy and Ben Stopford, chaired by Jay Kreps, co-founder and CEO, Confluent.
Learn about the KSQL architecture and how to design and deploy interactive, continuous queries for streaming ETL and real-time analytics.
In this talk, Gwen Shapira describes the reference architecture of Confluent Enterprise, which is the most complete platform to build enterprise-scale streaming pipelines using Apache Kafka®. Part 1 in the Best Practices for Apache Kafka in Production Series.
In this session, we go over everything that happens to a message – from producer to consumer, and pinpoint all the places where data can be lost. Build a bulletproof data pipeline with Apache Kafka. Part 2 in the Best Practices for Apache Kafka in Production Series.
In this session, we discuss the basic patterns of multi-datacenter Apache Kafka® architectures, explore some of the use cases enabled by each architecture and show how Confluent Enterprise products make these patterns easy to implement. Part 3 in the Best Practices for Apache Kafka in Production Series.
In this session, we discuss disaster scenarios that can take down entire Apache Kafka® clusters and share advice on how to plan, prepare and handle these events. Part 4 in the Best Practices for Apache Kafka in Production Series.
In this presentation, we discuss best practices of monitoring Apache Kafka®. Part 5 of the Best Practices for Apache Kafka in Production series.
Tim Berglund covers the patterns and techniques of using KSQL. Part 1 of the Empowering Streams through KSQL series.
Join us as we build a complete streaming application with KSQL. There will be plenty of hands-on action, plus a description of our thought process and design choices along the way. Part 2 in the Empowering Streams through KSQL series.
In this session, Nick Dearden covers the planning and operation of your KSQL deployment, including under-the-hood architectural details. Part 3 out of 3 in the Empowering Streams through KSQL series.
In this talk, members of the Pinterest team offer lessons learned from their Confluent Go client migration and discuss their use cases for adopting Kafka Streams.
In this interactive discussion, the KSQL team will answer 10 of the toughest, most frequently asked questions about KSQL.
Join The New York Times' Director of Engineering Boerge Svingen to learn how the innovative news giant of America transformed the way it sources content while still maintaining searchability, accuracy and accessibility—all through the power of a real-time streaming platform.
Gwen Shapira presents core patterns of modern data engineering and explains how you can use microservices, event streams and a streaming platform like Apache Kafka to build scalable and reliable data pipelines. Part 1 of 3 in Streaming ETL - The New Data Integration series.
In this online talk, Joe Beda, CTO of Heptio and co-creator of Kubernetes, and Gwen Shapira, principal data architect at Confluent and Kafka PMC member, will help you navigate through the hype, address frequently asked questions and deliver critical information to help you decide if running Kafka on Kubernetes is the right approach for your organization.
Capital One supports interactions with real-time streaming transactional data using Apache Kafka®. Join us for this online talk on lessons learned, best practices and technical patterns of Capital One’s deployment of Apache Kafka.
Join experts from VoltDB and Confluent to see why and how enterprises are using Apache Kafka as the central nervous system in combination with VoltDB.
In this talk, we'll build a streaming data pipeline using nothing but our bare hands, the Kafka Connect API and KSQL.
We’ll discuss how to leverage some of the more advanced transformation capabilities available in both KSQL and Kafka Connect. Part 3 of 3 in Streaming ETL - The New Data Integration online talk series.
The ‘current state of stream processing’ walks through the origins of stream processing, applicable use cases and then dives into the challenges currently facing the world of stream processing as it drives the next data revolution.
In this talk we will look at what event driven systems are; how they provide a unique contract for services to communicate and share data and how stream processing tools can be used to simplify the interaction between different services.
Watch Lyndon Hedderly's keynote from Big Data Analytics London 2018.
In this online talk, Technology Evangelist Kai Waehner will discuss and demo how you can leverage technologies such as TensorFlow with your Kafka deployments to build a scalable, mission-critical machine learning infrastructure for ingesting, preprocessing, training, deploying and monitoring analytic models.
See how Kinetica enables businesses to leverage the streaming data delivered with Confluent Platform to gain actionable insights.
Confluent Co-founder Jun Rao discusses how Apache Kafka® became the predominant publish/subscribe messaging system that it is today, Kafka's most recent additions to its enterprise-level set of features and how to evolve your Kafka implementation into a complete real-time streaming data platform.
There’s a prevailing enterprise perception that compliance with data protection regulations and standards is a burden: limiting the leverage of data.
Modern streaming data technologies like Apache Kafka® and Confluent KSQL, the streaming SQL engine for Apache Kafka, can help companies catch and detect fraud in real time instead of after the fact.
With the evolution of data-driven strategies, event-based business models are influential in innovative organizations.
What was once a ‘batch’ mindset is quickly being replaced with stream processing as the demands of the business impose real-time requirements on technology leaders.
Learn from field experts as they discuss how to convert the data locked in traditional databases into event streams using HVR and Apache Kafka®.
Rabobank rose to this challenge and defined the Business Event Bus (BEB) as the place where business events from across the organization are shared between applications.
In this online talk, you’ll hear about ingesting your Kafka streams into Imply’s scalable analytic engine and gaining real-time insights via a modern user interface.
In this session, we will share how companies around the world are using Confluent Cloud, a fully managed Apache Kafka® service, to migrate to AWS.
Learn how Generali Switzerland set up an event-driven architecture to support their digital transformation project.
This talk will cover how to integrate real-time analytics and visualizations to drive business processes and how KSQL, streaming SQL for Kafka, can easily transform and filter streams of data in real time.
Detecting fraudulent activity in real time can save a business significant amounts of money, but has traditionally been an area requiring a lot of complex programming and frameworks, particularly at scale.
This online talk includes in depth practical demonstrations of how Confluent and Panopticon together support several key financial services and IoT applications, including transaction cost analysis and risk monitoring.
In this session, we will share how companies around the world are using Confluent Cloud, a fully managed Apache Kafka® service, to migrate to GCP.
This online talk will showcase how Apache Kafka® plays a key role within Express Scripts’ transformation from mainframe to a microservices-based ecosystem, ensuring data integrity between two worlds.
This talk looks at one of the most common integration requirements – connecting databases to Apache Kafka.
In this all too fabulous talk, we will be addressing the wonderful and new wonders of KSQL vs. KStreams and how Ticketmaster uses KSQL and KStreams in production to reduce development friction in machine learning products.
In this online talk, you will learn why, when facing Open Banking regulation and rapidly increasing transaction volumes, Nationwide decided to take load off their back-end systems through real-time streaming of data changes into Apache Kafka®.
In this session, we'll compare the two approaches to data integration and show how Dataflow allows you to join and transform and deliver data streams among on-prem and cloud Apache Kafka clusters, Cloud Pub/Sub topics and a variety of databases.
Confluent KSQL is the streaming SQL engine that enables real-time data processing against Apache Kafka®. It provides an easy-to-use, yet powerful interactive SQL interface for stream processing on Kafka.
In this session, we will cover the easiest ways to start developing event-driven applications with Apache Kafka using Confluent Platform.
This talk explores the benefits around cloud-native platforms and running Apache Kafka on Kubernetes, what kinds of workloads are best suited for this combination, and best practices.
Real-time data has value. But how do you quantify that value. This talk explores why valuing Kafka is important - but covers some of the problems in quantifying the value of a data infrastructure platform.
This online talk explores how Apache Druid and Apache Kafka® can turn a microservices ecosystem into a distributed real-time application with instant analytics.
This online talk is based on real-world experience of Kafka deployments and explores a collection of common mistakes that are made when running Kafka in production and some best practices to avoid them.
This interactive whiteboard presentation discusses use cases leveraging the Apache Kafka® open source ecosystem as an event streaming platform to process IoT data.
This talk discusses the key design concepts within Apache Kafka Connect and the pros and cons of standalone vs distributed deployment modes.
This talk provides a deep dive into the details of the rebalance protocol, starting from its original design in version 0.9 up to the latest improvements and future work.
This session shows how various sub-systems in Apache Kafka can be used to aggregate, integrate and attribute these signals into signatures of interest.
This online talk focuses on the key business drivers behind connecting to Kafka and introduces the new Confluent Verified Integrations Program. Part 1 of 2 in Building Kafka Connectors - The Why and How
This online talk dives into the new Verified Integrations Program and the integration requirements, the Connect API and sources and sinks that use Kafka Connect. Part 2 of 2 in Building Kafka Connectors - The Why and How
This talk showcases different use cases in automation and Industrial IoT (IIoT) where an event streaming platform adds business value.
Learn how Centene improved their ability to interact and engage with healthcare providers in real time with MongoDB and Confluent Platform.
This talk explains how companies are using event-driven architecture to transform their business and how Apache Kafka serves as the foundation for streaming data applications. Part 1 of 4 in our Fundamentals for Apache Kafka series
This session explains Apache Kafka’s internal design and architecture. Companies like LinkedIn are now sending more than 1 trillion messages per day to Apache Kafka. Part 2 of 4 in our Fundamentals for Apache Kafka series.
Pick up best practices for developing applications that use Apache Kafka, beginning with a high level code overview for a basic producer and consumer.
This session will show you how to get streams of data into and out of Kafka with Kafka Connect and REST Proxy, maintain data formats and ensure compatibility with Schema Registry and Avro, and build real-time stream processing applications with Confluent KSQL and Kafka Streams.
In this technical deep dive, we’ll discuss the proposition of Incremental Cooperative Rebalancing as a way to alleviate stop-the-world and optimize rebalancing in Kafka APIs.
In this session, we will identify and demo some best practices for implementing a large scale IoT system that can stream MQTT messages to Apache Kafka.
Learn how AO.com are enabling real-time event-driven applications to improve customer experience using Confluent Platform.
This talk takes an in-depth look at how Apache Kafka® can be used to provide a common platform on which to build data infrastructure driving both real-time analytics as well as event-driven applications.
Join the Confluent Product team as we provide a technical overview of Confluent Platform 5.4, which delivers groundbreaking enhancements in the areas of security, disaster recovery and scalability.
In this online talk, Bosch’s Ralph Debusmann outlines their architectural vision for bringing many data streams into a single platform, surrounded by databases that can power complex real-time analytics.
During this online talk, presenters from Confluent and Qlik will demonstrate how to accelerate data delivery to enable real-time analytics, make data more valuable with real-time data ingestion to Kafka, modernize data centers by streaming data in real-time, and demo a customer use case for advanced analytics.
In this online talk, we introduce Apache Kafka® and the MongoDB connector for Kafka, and demonstrate a real world stock trading use case that joins heterogeneous data sources to find the moving average of securities using Apache Kafka and MongoDB.
Operating a complex distributed system such as Apache Kafka could be a lot of work. In this talk we will review common issues, and mitigation strategies, seen from the trenches helping teams around the globe with their Kafka infrastructure.
We explain how the microservice ecosystem around Apache Kafka was built to ensure the ability to build and deploy new streaming agents on AWS fast and with the least amount of operational effort possible, as well as some of the issues we found and worked around.
Industry 4.0 and smart manufacturing are driving the manufacturing industry to modernize their software infrastructure. This session will look at the unique business drivers for modernizing the manufacturing industry and how MQTT and Kafka can help make it a reality.
In this online talk, we’ll explore how and why companies are leveraging Confluent and MongoDB to modernize their architecture and leverage the scalability of the cloud and the velocity of streaming.
This reference architecture documents the MongoDB and Confluent integration including detailed tutorials for getting started with the integration, guidelines for deployment, and unique considerations to keep in mind when working with these two technologies.
Robin discusses the role of Apache Kafka as the de facto standard streaming data processing platforms.
This session covers architectures best practises and recommendations for organisations aiming for a more cloud-centric approach in the use of Apache Kafka.
Spending time with many OEMs and suppliers as well as technology vendors in the IoT segment, Kai Waehner gives an overview on current challenges in the automotive industry and on a variety of use cases for event-driven architectures.
The Confluent event-streaming platform enables government organizations to unlock and repurpose their existing data for countless modern applications and use cases.
Learn how CDC (Change Data Capture) captures database transactions for ingest into Confluent Platform to enable real-time data pipelines.
This brief describes a solution for real-time data streaming with ScyllaDB's NoSQL database paired with Confluent Platform.
This brief describes a solution with Neo4js graph database and Confluent Platform.
This brief describes a modern data architecture with Kafka and MongoDB
This brief describes streaming data analysis and visualization accelerated by Kinetica's GPU in-memory technology, in partnership with Confluent.
This brief describes an end-to-end streaming analytics solution with Imply, Druid providing the data querying and visualizations and Kafka data streaming.
This brief describes a solution for data integration and replication in real time and continuously into Kafka, in partnership with HVR and Confluent.
This brief describes a modern datacenter to manage the velocity and variety of data with an event driven enterprise architecture with DataStax and Confluentj
This brief describes how to enable operational data flows with NoSQL and Kafka, in partnership with Couchbase and Confluent.
This brief describes a solution to efficiently prepare data streams for Kafka and Confluent with Qlik Data Integration for CDC Streaming.
This brief describes a comprehensive streaming analytics platform for visualizing real-time data with Altiar Panopticon and Confluent Platform.
Dive into full Kafka examples, with connector configurations and Kafka Streams code, that demonstrate different data formats and SerDes combinations for building event streaming pipelines.
Get the presentations from the Kafka Summit San Francisco 2019 event.
Ensure that only authorized clients have appropriate access to system resources by using RBAC with Kafka Connect.
This paper will guide developers who want to build an integration or connector and outlines the criteria used for Confluent to verify the integration.
With its ViZixⓇ item chain management platform, Mojix is helping major retailers store, analyze and act on inventory data collected from IoT sensor streams in real time.
Download this bridge-to-cloud deployment guide for designing, configuring and managing streaming applications in Confluent Cloud.
Learn why organizations are considering Apache Kafka to streamline cloud migrations.
Alight Solutions, recently embarked on an initiative to align the company’s internal organization with its next-generation digital strategy.
Get the presentations from the Kafka Summit San Francisco 2018 event.
Hans Jespersen (VP WW Systems Engineering, Confluent) Opened afternoon presentations: Confluent Cloud: Agility for the modern data-driven enterprise at Confluent’s streaming event in Paris.
In this talk Gwen Shapira will break through the clutter and look at how successful companies are adopting centralized streaming platforms, and the use-cases and methodologies that we see practiced right now.
Use cases for streaming platforms vary from improving the customer experience - we have synthesized some common themes of streaming maturity and have identified five stages of adoption
Get key research stats on why CIOs are turning to streaming data for a competitive advantage.
Download this Forrester study to understand the economic benefits of Confluent Platform. Learn how you can reduce DevOps costs by $2.4M and accelerate business enablement by $3.8M.
In this paper, we introduce the Dual Streaming Model. The model presents the result of an operator as a stream of successive updates, which induces a duality of results and streams.
In this talk, we’ll explain the architectural reasoning for Apache Kafka® and the benefits of real-time integration, and we’ll build a streaming data pipeline using nothing but our bare hands, Kafka Connect and KSQL.
The reference architecture provides a detailed architecture for deploying Confluent Platform on Kubernetes and uses the Helm Charts for Confluent Platform as a reference to illustrate configuration and deployment practices.
Join The New York Times' Director of Engineering Boerge Svingen to learn how the innovative news giant of America transformed the way it sources content—all through the power of a real-time streaming platform.
Joe Beda, CTO of Heptio and co-creator of Kubernetes, and Gwen Shapira, principal data architect at Confluent, will help you decide if running Kafka on Kubernetes is the right approach for your organization.
The survey of the Apache Kafka community shows how and why companies are adopting streaming platforms to build event-driven architectures.
Download this whitepaper to learn about ksqlDB, one of the most critical components of Confluent, that enables you to build complete stream processing applications with just a few simple SQL queries.
In this white paper, we offer recommendations and best practices for designing data architectures that will work well with Confluent Cloud.
Learn Kubernetes terms, concepts and considerations, as well as best practices for deploying Apache Kafka on Kubernetes.
Originally presented by Gwen Shapira at Gluecon 2018, this talk covers the similarities and differences between the communication layer provided by a service mesh and Apache Kafka and their implementations, as well as ways you can combine them together.
Read this white paper to learn about the common use cases Confluent is seeing amongst its financial services customers.
Get an introduction to and demo of KSQL, Streaming SQL for Apache Kafka.
This video offers an introduction to Kafka stream processing, with a focus on KSQL.
Learn about the impact of Confluent and Apache Kafka® on Funding Circle’s lending marketplace, from Kafka Connect to Exactly-Once processing.
HomeAway, the world’s leading online marketplace for the vacation rental industry, uses Apache Kafka® and Confluent to match travelers with 2 million+ unique places to stay in 190 countries.
One of the largest banks in the world—with 16 million clients globally—RBC built a real-time, scalable and event-driven data architecture for their rapidly growing number of cloud, machine learning and AI initiatives.
In this white paper, you will learn how you can monitor your Apache Kafka deployments like a pro, the 7 common questions you'll need to answer, what requirements to look for in a monitoring solution and key advantages of the Confluent Control Center.
Learn about typical Apache Kafka use cases and how organisations can process large quantities of data in real time using the Kafka Streams API and KSQL.
This paper provides 10 principles for streaming services, a list of items to be mindful of when designing and building a microservices system
Kafka has a set of new features supporting idempotence and transactional writes that support building real-time applications with exactly-once semantics. This talk provides an overview of these features.
In this talk, get a short introduction to common approaches and architectures (lambda, kappa) for streaming processing and learn how to use open-source steam processing tools (Flink, Kafka Streams, Hazelcast Jet) for stream processing.
In this talk, we’ll review the breadth of Apache Kafka as a streaming data platform, including, its internal architecture and its approach to pub/sub messaging.
In this talk we'll examine how Stateful Stream Processing can be used to build Event Driven Services, using a distributed log like Apache Kafka. In doing so this Data-Dichotomy is balanced with an architecture that exhibits demonstrably better scaling properties, be it increased complexity, team size, data volume or velocity.
Get the presentations from the Kafka Summit San Francisco 2017 event.
A practical guide to configuring multiple Apache Kafka clusters so that if a disaster scenario strikes, you have a plan for failover, failback, and ultimately successful recovery.
What is microservices? And how does it work in the Apache Kafka ecosystem.
In this video, Tim Berglund explains how you can speed up development with the Confluent Command Line Interface (CLI), which allows you to quickly iterate while implementing your applications and enables you to interact with the Confluent ecosystem.
In this talk, I'll describe some of the design tradeoffs when building microservices, and how Apache Kafka's powerful abstractions can help.
Recording from QCon New York 2017 Gwen Shapira discusses patterns of schema design, schema storage and schema evolution that help development teams build better contracts through better collaboration - and deliver resilient applications faster.
Confluent Cloud is the industry's only cloud-native, fully managed event streaming platform powered by Apache Kafka.
Learn how to take full advantage of Apache Kafka®, the distributed, publish-subscribe queue for handling real-time data feeds.
Businesses are discovering that they can create new business opportunities as well as make their existing operations more efficient using real-time data at scale. Learn how real-time data streams is revolutionizing your business.
Get the presentations from the Kafka Summit San Francisco 2016 event.
This whitepaper discusses how to optimize your Apache Kafka deployment for various services goals including throughput, latency, durability and availability. It is intended for Kafka administrators and developers planning to deploy Kafka in production.
This survey focuses on why and how companies are using Apache Kafka and streaming data and the impact it has on their business.
In this three-day hands-on course you will learn how to build an application that can publish data to, and subscribe to data from, an Apache Kafka cluster.
In this three-day hands-on course, you will learn how to build, manage, and monitor clusters using industry best-practices developed by the world’s foremost Apache Kafka experts.
In this talk, Matt Howlett will give a technical overview of Kafka, discuss some typical use cases (from surge pricing to fraud detection to web analytics) and show you how to use Kafka from within your C#/.NET applications.
Presentation from Apache Kafka Meetup at Strata San Jose (3/14/17). Jay Kreps will introduce Kafka and explain why it has become the de facto standard for streaming data.
This white paper provides a brief overview of how microservices can be built in the Apache Kafka ecosystem.
Michael Noll provides an introduction to stream processing, use cases, and Apache Kafka.
Confluent の CEO であり、Apache Kafka を生んだ開発者チームの一員でもある Jay Kreps が、分散型システムにおけるログの働きとこうした概念の実際の用途について説明します。
This white paper outlines the integration of Confluent Enterprise with the Microsoft Azure Cloud Platform.
Best practices for developing a connector using Kafka Connect APIs.
本ホワイトペーパーでは、Confluent Platform の基盤である Apache Kafka の基本コンセプトを探り、従来のメッセージ指向ミドルウェアと比較いたします。
Learn about the components of Confluent Enterprise, key considerations for production deployments, and guidelines for selecting hardware or deployment with different cloud providers.
In this book, O’Reilly author Martin Kleppmann shows you how stream processing can make your data processing systems more flexible and less complex.
Neha Narkhede explains how Apache Kafka was designed to support capturing and processing distributed data streams by building up the basic primitives needed for a stream processing system.