January 31, 2025
10 min

January Data Streaming Launch: Organization Profile, Ursa Engine on Azure, Enhancements for StreamNative Cloud, and More

Sijie Guo
Co-Founder and CEO, StreamNative

At StreamNative, we are committed to redefining data streaming with cutting-edge solutions that provide flexibility, scalability, and ease of use. Our mission is to democratize data streaming by enabling organizations to build real-time applications with confidence and efficiency. In this month's data streaming launch, we are introducing significant updates to StreamNative Cloud, Ursa Engine, and Snowflake integration, along with enhancements to security and containerization.

New Organization Profile Page

We’ve introduced a new Organization Profile Page in the StreamNative Console, making it easier for users to manage their organization’s details and receive important updates.

What You Can Update:

  • Organization Name – Keep your organization’s name up to date.
  • Billing Contact Email – Ensure you receive billing notifications without disruption.
  • Technical Contact Email – Stay informed about maintenance and technical updates.

Why It Matters:

  • Improved communication – Ensures your organization receives critical notifications regarding billing, maintenance, and system updates.
  • Better account management – Provides a centralized place to manage essential organization details.

To update your Organization Profile, visit the StreamNative Console today.

Enhanced Cluster Naming Flexibility

Improving Usability with Display Name Support

Currently, the StreamNative Cloud console uses the user-provided cluster name as the object name for the cluster Custom Resource Definition (CRD), which imposes a strict 10-character limit. This restriction has posed challenges for users in creating meaningful and descriptive cluster names.

To improve usability, we are introducing a change that allows the user-provided cluster name to serve as the display name rather than the object name for the cluster CRD. This update removes the 10-character limit, giving users greater flexibility in naming their clusters.

Key Benefits:

  • Enhanced readability: Users can now create more descriptive cluster names, improving organization and management.
  • Better user experience: By decoupling the display name from the object name, users are no longer constrained by the character limit.
  • Seamless transition: Existing clusters will retain their functionality while new clusters benefit from this enhancement.

Ursa Engine Available on Azure for Private Preview

Ursa Engine, our next-generation data streaming engine designed to augment lakehouses with real-time capabilities, is now available for private preview on Microsoft Azure. This marks a significant milestone in expanding Ursa’s footprint across cloud providers, enabling Azure users to leverage its powerful features for high-throughput, low-latency data processing.

Organizations interested in participating in the private preview can contact us to gain early access and provide feedback on optimizing Ursa Engine for Azure environments.

Snowpipe Streaming Support in Snowflake Sink Connector

We are excited to announce Snowpipe Streaming support in the StreamNative Snowflake Streaming Sink Connector. This enhancement enables more efficient and real-time data ingestion into Snowflake, reducing latency and improving cost efficiency.

For more details on this integration, check out our blog post.

Key Advantages:

  • Lower latency: Data streams into Snowflake in near real-time without the need for staging files.
  • Reduced costs: Eliminates the need for intermediate storage and reduces data pipeline complexity.
  • Simplified architecture: Direct streaming improves operational efficiency and reliability.

Kafka Schema Registry RBAC Support Available for Private Preview

Role-Based Access Control (RBAC) for the Kafka Schema Registry is now available for private preview. This feature enhances security by providing fine-grained access control over schema definitions, ensuring that only authorized users can manage and modify schema resources.

Benefits of RBAC Support:

  • Improved security: Protect schema definitions from unauthorized access.
  • Granular permissions: Assign user-specific access roles to enforce governance.
  • Enterprise-grade compliance: Aligns with best practices for managing data governance in streaming environments.

Organizations interested in previewing this feature can sign up to get early access and provide feedback.

New Slim Image Using BOM for Dependency Management

We have introduced a new slim image that uses a Bill of Materials (BOM) to manage dependencies, reducing the overall image size to approximately 1GB. This improvement enhances deployment efficiency and security by minimizing the attack surface and optimizing resource usage.

Why It Matters:

  • Smaller footprint: Reduces storage and transfer costs.
  • Faster deployment: Speeds up container startup times.
  • Better dependency management: Ensures consistency across different environments.

Get Started Today

These enhancements are part of our continued effort to improve the StreamNative ecosystem and provide the best experience for our users. If you are interested in joining our private preview programs for Ursa Engine on Azure or Kafka Schema Registry RBAC support, reach out to us today.

Stay tuned for more updates as we continue to innovate and push the boundaries of real-time data streaming!

This is some text inside of a div block.
Button Text
Sijie Guo
Sijie’s journey with Apache Pulsar began at Yahoo! where he was part of the team working to develop a global messaging platform for the company. He then went to Twitter, where he led the messaging infrastructure group and co-created DistributedLog and Twitter EventBus. In 2017, he co-founded Streamlio, which was acquired by Splunk, and in 2019 he founded StreamNative. He is one of the original creators of Apache Pulsar and Apache BookKeeper, and remains VP of Apache BookKeeper and PMC Member of Apache Pulsar. Sijie lives in the San Francisco Bay Area of California.

Newsletter

Our strategies and tactics delivered right to your inbox

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Product Announcements