StreamNative’s 2024 Year in Review

As 2024 comes to a close, we’re thrilled to reflect on a year of remarkable achievements and innovations. This year has been pivotal for StreamNative as we continue to advance the field of data streaming and push the boundaries of what’s possible. Here’s a look at some of the most exciting developments that defined 2024.

Introducing Ursa Engine: Augmenting Lakehouse with data streaming capabilities

This year, we unveiled Ursa Engine, a groundbreaking addition to our product portfolio. Ursa Engine delivers a 100% Kafka-compatible API paired with cost-effective storage designed for seamless lakehouse integration. By combining efficiency and compatibility, Ursa Engine empowers businesses to harness the power of a unified streaming and storage platform for their data lakehouse needs.

UniConn: Simplifying Data Pipelines

2024 saw the launch of UniConn (Universal Connectivity), a revolutionary solution aimed at simplifying and enhancing data streaming. UniConn offers a consistent, declarative approach to, connecting, processing, debugging and monitoring. Whether leveraging Kafka Connect or Pulsar IO frameworks, UniConn delivers a streamlined experience that reduces complexity and accelerates pipeline development.

UniLink: Cross-Cluster Interoperability Made Easy

UniLink (Universal Linking) is another highlight of our 2024 journey. Designed for seamless data replication and interoperability, UniLink works across self-managed or fully-managed Kafka and Pulsar clusters. By utilizing object storage (e.g., S3) for networking and storage, UniLink provides a cost-effective and efficient solution while significantly reducing operational complexity.

Apache Pulsar 4.0: The Next Generation of Data Streaming

A major milestone this year was the release of Apache Pulsar 4.0, the second Long-Term Support (LTS) version following the success of Pulsar 3.0. Pulsar 4.0 is a significant leap forward in our mission to make data streaming more accessible, affordable, and scalable. Key enhancements include:

• Modularity: Enabling flexible, composable deployments.
• Observability: Improved tools for monitoring and debugging.
• Scalability: Enhanced for large-scale enterprise applications.
• Security: Strengthened protections for sensitive data.

With advanced Quality of Service (QoS) controls and a focus on simplicity and flexibility, Pulsar 4.0 drives the vision of an Open Data Streaming Architecture closer to reality.

Fully Managed Flink Services

StreamNative introduced Flink as a fully managed service, providing an enterprise-grade stream processing platform built on Apache Flink. This service simplifies real-time data processing, offering a highly scalable, resilient, and efficient solution for developing and running stream processing applications.

StreamNative Cloud Feature Enhancements

This year, StreamNative Cloud introduced new UI and capabilities to further improve flexibility, reliability, and operational simplicity for Pulsar instances:

• Release Channel: Provides users with the ability to choose stable or experimental software releases for their Pulsar environments.
• Custom Maintenance Window: Allows organizations to schedule maintenance periods that align with their operational requirements, reducing disruption to critical workflows.
• Automated Geo-Replication Setup: StreamNative Cloud simplifies setting up geo-replication for Pulsar instances, enabling seamless and reliable data replication across regions to improve resilience and availability.

Expanding Deployment Options

In 2024, we expanded our deployment options to meet diverse customer needs:

• Self-service BYOC (Bring Your Own Cloud): Empowering users with greater control over their infrastructure.
• Serverless Deployments: Reducing operational overhead with fully managed solutions.

Partnerships and Marketplace Expansion

Collaboration has always been at the heart of our mission. This year, we strengthened our ecosystem with exciting new partnerships and marketplace integrations:

• Pulsar-Spark Connector with Databricks: In collaboration with Databricks, StreamNative introduced the Pulsar-Spark Connector, enabling seamless integration of Apache Pulsar and Apache Spark. This connector allows organizations to process real-time streaming data within the Databricks ecosystem, combining the strengths of Pulsar’s flexible messaging platform and Spark’s powerful analytics capabilities.
• Marketplace Presence: StreamNative is now available on AWS, Azure, and Google Cloud marketplaces.
• Partner Program: We welcomed innovative partners such as RisingWave, Zilliz, Calsoft Nexaminds, Timeplus, Pinecone, PuppyGraph, TiDB, Ververica, Snowflake, and Nuaav.
• Google Cloud BigQuery Ready Program: Achieving BigQuery Ready status underscores our commitment to seamless cloud integration and analytics.

Data Streaming Summit 2024

Finally, we wrapped up the year with the highly anticipated Data Streaming Summit 2024. The event brought together thought leaders, industry experts, and developers from around the world to share insights and explore the future of data streaming. It was a celebration of innovation and collaboration, setting the stage for an even brighter 2025. Missed a session? You can watch the on-demand sessions here.

Looking Ahead

As we reflect on these accomplishments, we’re excited about the road ahead. StreamNative remains dedicated to delivering cutting-edge solutions, fostering a vibrant ecosystem, and helping businesses unlock the full potential of data streaming. Experience the power of StreamNative today with a $200 credit to get started. Explore our innovative solutions and see how they can transform your data streaming needs.

Here’s to continued innovation and success in 2025 and beyond!

‍