Sep 9, 2024
10 min

Introducing StreamNative Serverless: Instant Start, Seamless Scaling, and Effortless Data Streaming

Sijie Guo
Co-Founder and CEO, StreamNative

Today’s businesses thrive on data, and real-time insights are crucial for staying competitive in an ever-evolving market. However, adopting data streaming has often been challenging due to the complexity and operational overhead required to size and manage the infrastructure properly. To address these challenges and make data streaming more accessible to organizations of all sizes, we are proud to introduce StreamNative Serverless! Our new product delivers a Pulsar & Kafka API as a fully managed data streaming service that is instantly available, allowing organizations to get started on their data streaming journey much faster.

Serverless Data Streaming: Instant, Effortless, and Powerful

With StreamNative Serverless, we're changing how organizations approach data streaming by offering instant provisioning and elastic scaling—all without the need for complex sizing exercises, configuration, or resource management. Built on the robust and reliable Apache Pulsar architecture, our serverless solution is designed to meet the real-time demands of businesses without requiring extensive expertise in data engineering or infrastructure management.

Our goal is simple: empower businesses to focus on driving insights and innovation, rather than wrestling with the complexities of data streaming technology.

There’s no infrastructure to manage. You can get started instantly and stay flexible with:

  • Instant Provisioning: Get started with data streaming in seconds, without the need for complex sizing exercises.
  • Seamless Scaling: Autoscaling capabilities ensure that your streaming workloads dynamically adjust based on demand, whether you're handling surges in traffic or operating at minimal capacity.
  • Throughput-based Usage Pricing: Pay only for the traffic you use with our elastic, throughput-based pricing model, ensuring you’re not overpaying for idle capacity.
  • Simplified User Experience: A revamped user interface that makes getting started and managing data streams intuitive and easy, even for non-experts.

While Serverless removes the complexity of sizing, planning, and managing capacity, it continues to offer the same functionalities as our other product offerings, including Dedicated and BYOC clusters. Specifically, with a Serverless cluster, you can continue to leverage Pulsar’s unique multi-tenancy architecture. This ensures that businesses can run multiple workloads in one serverless environment with enhanced security and flexibility—critical for organizations handling diverse data streams.

Want to learn more about our Serverless offering directly from our team? Sign up for our Q4 Roadmap webinar on September 26th. In the meantime, here’s what you need to know about our exciting new service.

Universal Connectivity and StreamNative Partnership ecosystem

In addition to introducing Serverless clusters to complement StreamNative Cloud’s Dedicated and BYOC cluster options, we are also excited to announce UniConn (aka “Universal Connectivity”), which supports running Kafka Connect connectors natively on StreamNative Cloud. We’re also launching the StreamNative Partnership Program. With Serverless and UniConn, we can help organizations accelerate opportunities to build innovative solutions across the data streaming ecosystem.

For example, you can create a GenAI application in minutes: Use a Serverless cluster to get a Kafka API managed service up and running in seconds, then instantly launch a MongoDB Kafka Connect connector to capture change events from your system of record. You can also write a Pulsar function to redact sensitive information, chunk, and transform the data, and finally, use a Pinecone Sink connector to write embeddings to Pinecone.

With Serverless, UniConn, and the StreamNative Partnership Network, we aim to deliver a first-class data streaming experience that helps organizations of all sizes grow their businesses with real-time data.

Getting Started with StreamNative Serverless: A Quick Tour

It’s never been easier to start your data streaming journey with StreamNative Serverless. We’re offering $200 in free credits to help you explore the platform—no credit card required! Let’s take a quick tour to show you just how simple it is to get started and begin working with streaming data in just a few seconds.

Creating a Serverless cluster takes just three easy steps:

  1. Choose a Cloud Provider
  2. Select a Region
  3. Click "Deploy"

Within moments, your Serverless cluster will be provisioned and ready to use.

There’s no need for complex sizing calculations. StreamNative Serverless automatically scales based on your needs—no need to worry about the number of brokers or configuring CPUs and memory. When you’re ready to grow beyond Serverless, you can easily transition to a Dedicated cluster for more predictable workloads or BYOC clusters to meet specific data sovereignty requirements.

Once inside the StreamNative Console, you’ll find quickstart guides for using Pulsar CLI tools, Kafka CLI tools, and examples for Pulsar and Kafka client libraries to get you up and running quickly.

While most users interact with the service programmatically, the StreamNative Cloud Console also offers an intuitive interface to manage resources like Tenants, Namespaces, and Topics—perfect for rapid prototyping and testing.

In addition to the native Kafka and Pulsar APIs, you can also launch Kafka Connect connectors or Pulsar IO connectors directly within your Serverless clusters for seamless data integration.

For more information on StreamNative Serverless, including pricing, supported features, and detailed instructions, check out our documentation.

Ready to Get Started?

With StreamNative Serverless, we’re democratizing data streaming by making it accessible, affordable, and scalable. Whether you’re new to data streaming or looking to optimize your existing workflows, StreamNative Serverless gives you the power and flexibility you need—without the operational headaches.

Visit our documentation to learn more about how StreamNative Serverless can transform your data streaming journey.

Join us in breaking down the barriers to data streaming and unlocking the full potential of real-time data for your business.

Sijie Guo
Sijie’s journey with Apache Pulsar began at Yahoo! where he was part of the team working to develop a global messaging platform for the company. He then went to Twitter, where he led the messaging infrastructure group and co-created DistributedLog and Twitter EventBus. In 2017, he co-founded Streamlio, which was acquired by Splunk, and in 2019 he founded StreamNative. He is one of the original creators of Apache Pulsar and Apache BookKeeper, and remains VP of Apache BookKeeper and PMC Member of Apache Pulsar. Sijie lives in the San Francisco Bay Area of California.

Related articles

Sep 10, 2024
10 min

Revolutionizing Data Connectivity: Introducing StreamNative's Universal Connectivity (UniConn) for Seamless Real-Time Data Access

Sep 9, 2024
10 min

StreamNative Unveils Partner Program To Expand Data Streaming Ecosystem

Newsletter

Our strategies and tactics delivered right to your inbox

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Kafka
Pulsar