Apache Pulsar 5.0 Early Access is now open. Be among the first to try the future of streaming.
Request Early Access >StreamNative Introduces Lakestream Architecture and Launches Native Kafka Service
Read Announcement > Sign Up Now >
Making Kafka Connectors Dance with Apache Pulsar
Unlock Instant Access
Complete the form to start watching.
Session Overview
In this presentation, we introduce our cutting-edge framework designed to run Kafka connectors natively on Apache Pulsar without relying on the traditional Kafka Connect Herder deployment. Our solution leverages a serverless model and fully integrated with Kubernetes for scheduling, ensuring a fully cloud-native experience. This approach not only broadens the robust ecosystem of Pulsar to include Kafka streaming processes but also enables the seamless reuse of existing Kafka connectors within Pulsar. We'll explore the architecture, technical challenges, and performance optimizations involved in building this integration. Expect practical demonstrations, real-world use cases, and an in-depth look at how our solution can revolutionize your stream processing pipelines. Whether you're a Kafka enthusiast looking to modernize or a Pulsar advocate seeking enhanced functionality, this session offers invaluable insights into orchestrating streamlined, scalable, and efficient streaming pipeline in a cloud-native environment.
About Speaker
Jobin George Jobin George is the Head of Global Data & AI Partner Engineering at Google.
Neng Lu Neng Lu is currently the Director of Platform at StreamNative, where he leads the engineering team in developing the StreamNative ONE Platform and the next-generation Ursa engine. As an Apache Pulsar Committer, he specializes in advancing Pulsar Functions and Pulsar IO Connectors, contributing to the evolution of real-time data streaming technologies. Prior to joining StreamNative, Neng was a Senior Software Engineer at Twitter, where he focused on the Heron project, a cutting-edge real-time computing framework. He holds a Master's degree in Computer Science from the University of California, Los Angeles (UCLA) and a Bachelor's degree from Zhejiang University.
Rui Fu Rui Fu is a software engineer at StreamNative. Before joining StreamNative, he was a platform engineer at the Energy Internet Research Institute of Tsinghua University. He was leading and focused on stream data processing and IoT platform development at Energy Internet Research Institute. Rui received his postgraduate degree from HKUST and an undergraduate degree from The University of Sheffield.
• RESOURCES
