New to StreamNative Cloud [Feb 2023]: Audit Log, Cluster Metrics, and More

We’re committed to providing enterprise-grade tooling that empowers teams to deliver sophisticated data streaming and event-driven architecture with Apache Pulsar. Whether you’re building new applications or future-proofing existing applications, StreamNative provides a versatile set of tools that are resilient and flexible for engineering teams of all sizes.

We’re rolling out some new capabilities in the next month that will help teams improve security and observability, and enable teams to operate Pulsar at scale.

Rest API

We recently announced the Rest API for Pulsar clusters on StreamNative Cloud. Connect to your Pulsar clusters using a RESTful interface, eliminating the dependency on specific client libraries.

Our Rest API allows you to:

• Effortlessly produce, consume, and acknowledge messages
• Monitor the state of your Pulsar clusters
• Perform a wide range of administrative actions

You can use the Rest API for use cases such as sending data to Pulsar from any application built in any language or ingesting messages into a stream processing framework that may not support Pulsar.

This feature is automatically enabled for Cloud console users. Private Cloud users can enable this feature by editing the PulsarBroker CR configuration. Learn more about the StreamNative Rest API in our documentation page. You can also check out this demo of the StreamNative Rest API in Action:

Pulsar Functions on Cloud in Beta

Leverage the full power of Pulsar Functions with StreamNative Cloud. Pulsar Functions on StreamNative Cloud enable you to build real-time data pipelines for ETL jobs, event-driven applications, and simple data analytics applications.

By using Pulsar’s built-in framework instead of a separate stream processing engine, you can reduce architectural complexity and quickly deploy pipelines within StreamNative Cloud.

Example use cases include:

• Real-time data analytics based on incoming Pulsar data such as fraud detection
• Real-time data integration and transformation for AI feature extraction and machine learning model scoring
• Event-driven pipelines based on Pulsar messages for Processing, verification, and notifications

Learn more about Functions on Cloud in our documentation page.

Watch our demo video on how to get started with Functions on StreamNative Cloud:

Audit Log

Now available: The StreamNative Audit Log lets you track and monitor administrative activity within your Pulsar clusters, tenants, namespaces, and topics. Identify which users or services performed specific actions, which resources were affected, and when the event occurred. You can also view the user's permission status for a comprehensive overview of your system’s activity.

Designed with security and compliance in mind, the Audit Log is particularly useful for customers with strict requirements. The Audit Log gives you the ability to track user and application access, identify abnormal behavior, and monitor for potential security risks.

The Audit Log supports a wide variety of audit event types, including the creation, updating, and deletion of clusters, tenants, namespaces, and topics. Each log entry contains detailed information about the event, event time, and permission status.

You can easily process and analyze the audit events stored in Pulsar topics using Pulsar clients, Pulsar CLI, Rest API, and sink connectors. This allows you to gain valuable insights into your system’s activity and take proactive measures to ensure the security and compliance of your organization.

Cluster Metrics in Beta

We’re excited to introduce our new Prometheus endpoint, which provides you with real-time metrics of your Pulsar clusters. By configuring your preferred observability tool (such as Grafana or NewRelic) to scrape this endpoint, you gain real-time visibility into your clusters and the ability to track performance over time.

Cluster Metrics enable you to collect metrics like the number of producers, consumers, throughput, message delivery, storage, and size of the backlog, among others. By analyzing trends and proactively maintaining your applications, you can ensure optimal performance and address potential issues.

Conclusion

With these new capabilities and enhancements, StreamNative Cloud provides more flexibility and control over your data, empowering you to make informed decisions. These features are a valuable addition to your toolkit, allowing you to streamline your workflows, boost productivity, and ultimately achieve greater business success.

Our team is committed to providing you with the best possible experience on StreamNative Cloud, and we can’t wait to see the innovative solutions you’ll create with these new capabilities!

Connect with us!

Learn more about upcoming StreamNative Cloud features and enhancements on our docs site, which also includes helpful tutorials and resources.

‍

The preceding information serves as a general guide for our product direction and should not be interpreted as a binding commitment to deliver any specific materials, code, or functionality. Please note that the development, release, timing, and pricing of any features or functionality described may be subject to change. We recommend that customers base their purchasing decisions on the services, features, and functions that are currently available.

‍