Closing Panel_Streaming at the Crossroads: Can One Architecture Rule Them All?
David Kjerrumgaard
Adam Richardson
Balu Kunju
Mingmin Chen
Matteo Meril
Alexander Gallego

Streaming at the Crossroads: Can One Architecture Rule Them All?

From Kafka to Pulsar to LinkedIn’s new NorthGuard architecture, the data streaming ecosystem has never been more diverse—or more innovative. AI-driven applications, mission-critical transactional workloads, and massive-scale personalization pipelines are all placing unique demands on streaming systems. At the same time, the industry faces big questions: Will the future be defined by a single dominant architecture, or by a mosaic of specialized systems?

In this panel, leaders from Uber, OpenAI, PayPal, Redpanda, and StreamNative will share their perspectives on the trade-offs between unification and specialization. This panel explores whether one architecture can realistically serve all needs—or whether the future remains multi-technology. We’ll examine a few major topics: (1) latency-optimized vs. cost-optimized design, (2) object-storage-first (S3-backed), leaderless/diskless architectures that unify streaming with the lakehouse, and (3) new requirements raised from AI and agents.

David Kjerrumgaard
Principal Sales Engineer, Author of "Apache Pulsar in Action"

David is a Sales Engineer and former Developer Advocate for StreamNative with a focus on helping developers solve their streaming data challenges using Apache Pulsar. He has over 15 years of experience working with open source projects in the Big Data, Stream Processing, and Distributed Computing spaces. David is the author of the book Pulsar in Action.

Adam Richardson
Member of Technical Staff, OpenAI

Adam Richardson is the tech lead for the Realtime Infrastructure team at OpenAI. OpenAI's Realtime Infrastructure team supports hundreds of Kafka and Flink use cases across the entire organization. Previously, Adam was the tech lead for the Data Movement team at Stripe, building and managing ELT pipelines at petabyte scale.

Balu Kunju
Manager of Software Development, Paypal

Balu Kunju serves as Manager of Software Development at PayPal, where he leads the messaging infrastructure team and drives the company's strategic migration from legacy messaging platforms to the next-generation Apache Pulsar ecosystem.At PayPal, Balu spearheads the end-to-end design, architecture, and operationalization of Apache Pulsar for enterprise-scale messaging and streaming workloads. Under his leadership, the team has successfully containerized and automated the entire Pulsar platform lifecycle using Kubernetes operators, executed seamless production migrations with zero downtime, and established Pulsar as PayPal's unified messaging backbone supporting hundreds of producers and consumers across the global enterprise.With a Master's in Computer Science and over 20+ years of distributed systems experience, Balu is recognized for his customer-centric leadership approach and has received multiple awards for technical excellence and collaborative innovation. He actively contributes to the Apache Pulsar open-source community and participates in industry summits to advance streaming technologies. His work directly enables PayPal's ability to process high-throughput financial transactions while maintaining data integrity and system reliability at global scale.

Mingmin Chen
Director of Engineering and Head of Real-Time Data and Search Platform, Uber

Mingmin is the director of engineering and head of the real-time data and search platform at Uber. He has been leading the team to build and operate Kafka infrastructure to power tens of trillions of messages per day, and a streaming processing platform to power thousands of streaming jobs per day. His team builds highly scalable, highly reliable yet efficient data infrastructure with innovative ideas while leveraging many open-source technologies such as OpenSearch, Kafka, Flink, Pinot etc. He got his PhD in computer science from UC Davis.

Matteo Meril
Co-Founder and CTO, StreamNative

Matteo is the CTO at StreamNative, where he brings rich experience in distributed pub-sub messaging platforms. Matteo was one of the co-creators of Apache Pulsar during his time at Yahoo!. Matteo worked to create a global, distributed messaging system for Yahoo!, which would later become Apache Pulsar. Matteo is the PMC Chair of Apache Pulsar, where he helps to guide the community and ensure the success of the Pulsar project. He is also a PMC member for Apache BookKeeper. Matteo lives in Menlo Park, California.

Alexander Gallego
Founder and CEO, Redpanda

Alex Gallego is the founder and CEO of Redpanda Data. He created Redpanda in 2019 with the vision of making real-time data accessible to all developers. Alex engineered the first version of the Redpanda platform from the ground up for low latency, large scale, and a simpler, better user experience. Prior to Redpanda, Alex was the co-founder and CTO of Concord.io, a high-performance stream-processing engine acquired by Akamai in 2016. Following the acquisition, Alex served as a principal engineer at Akamai, where he led the effort to build a next-gen virtualization platform. Alex began his career as a hacker and builder in his hometown of Manizales, Colombia. He holds a bachelor’s degree in computer science and cryptography from NYU.

Newsletter

Our strategies and tactics delivered right to your inbox

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.