You’ve decided to build a real-time application – great! Now which data streaming communication protocol is right for you – polling, websockets, or server sent events (SSE)? Furthermore, how do these protocols integrate with Kafka? How can you gracefully handle if/when your client disconnects from Kafka?
In this session, we will set the stage by talking about the strengths and weaknesses of each protocol, and then dive into how Kafka can be leveraged with these different protocols. We will demo different approaches you might take, for example using a Kafka connector with SSE vs. just having a client handle these real-time workloads directly – and also perform some chaos testing to test resiliency.
By the end of this session, you should have an understanding of these different streaming protocols at your disposal, and how to select the appropriate one for your application.
Commercial Solutions Engineer at Confluent where our mission is to help our customers set data in motion.
Other recent experience: data scientist (contractor) working remotely for a NY-based startup, Saturn Cloud. I focused on demonstrating value/time saved from leveraging Saturn's distributed computing platform, using technologies like distributed Dask, GPUs, and Prefect. You can reference my Github or Medium below to see the Jupyter Notebooks and articles I produced while at Saturn. I was a technical support on sales calls, and regularly interfaced with engineering in testing new features and creating documentation for product releases. Prior to that, I was did business development at a seed fund in Hong Kong, Product Design at a small company in Portugal, Quality Assurance for a venture studio in Chicago, and a Presales role at the fastest U.S. startup to a $2B valuation.
Amanda Gilbert is a Senior Solutions Engineer for Confluent and a Confluent Cloud subject matter expert. She has been working in the data engineering space since graduating college in 2014. She is passionate about building event driven architectures that utilize existing technologies, limit technical debt and create performant applications. Amanda lives in Charlotte, NC where she enjoys playing poker, hiking, traveling and reading in her free time.