Bench, a Framework for Benchmarking Kafka Using K8s and OpenMessaging Benchmark

In this lightning talk session, we will discuss a messaging benchmark tool developed at Reddit called Bench. Bench quantifies the cost-performance trade-offs of various configurations of messaging systems. Infrastructure engineers can use Bench to determine the number and types of instances needed, estimate the expected throughput and response latency, and test the durability and recoverability of these systems under stress. For most use cases, Bench utilizes load tests included in the OpenMessaging Benchmark Framework. Users can configure these to emulate anticipated scale and message sizes. Additionally, engineers can implement custom tests if an appropriate one does not exist, for example, when an accurate simulation is required for a specific producer/consumer pattern. Finally, Bench uses instance and network pricing of the target cloud environment so that users can determine the cost and performance of the trade-offs of each system configuration.