StreamNative is excited to announce the general availability of the Amazon EventBridge sink connector for Apache Pulsar. This connector synchronizes Pulsar data to Amazon EventBridge in real-time, enabling Google Amazon EventBridge to leverage Pulsar and expand the Apache Pulsar ecosystem.

What is the Amazon EventBridge sink connector?

The Amazon EventBridge sink connector pulls data from Pulsar topics and persists data to AWS EventBridge.

‍

Why we built the Amazon EventBridge sink connector?

AWS EventBridge is a serverless service that uses events to connect application components together, making it easier to build scalable event-driven applications. 

Sending data from Apache Pulsar to AWS EventBridge can provide several benefits:

• AWS EventBridge can act as a central hub for processing and routing events from various sources, including Apache Pulsar. This can enable teams to build a unified event-driven architecture that can handle events from different systems and applications.
• AWS EventBridge provides a wide range of event targets, such as AWS Lambda, Amazon SNS, Amazon SQS, etc., that can be used quickly to access the AWS ecosystem. This can enable teams to build event-driven workflows that can automate business processes and reduce manual intervention.
• AWS EventBridge provides built-in security and compliance features, such as AWS CloudTrail integration, AWS Identity and Access Management (IAM) policies, and encryption at rest and in transit. This can help ensure the confidentiality, integrity, and availability of event data.

Therefore, StreamNative developed this connector to provide an easy way for teams to write data from Pulsar to EventBridge in real time.

Benefits of the Amazon EventBridge sink connector?

The integration between Amazon EventBridge and Apache Pulsar provides four key benefits.

• Simplicity: Quickly move data from Apache Pulsar to Amazon EventBridge without requiring any code
• Efficiency: Reduce the time in configuring the data layer. This means that teams can spend more time building their business use cases instead of configuring their data. 
• Scalability: Run the EventBridge connector in different modes (standalone or distributed). This allows teams to build reactive data pipelines to meet business and operational needs in real-time.

Get started with the Amazon EventBridge sink connector

> For StreamNative Cloud users, do refer to this blog to create a connector on StreamNative Cloud quickly.

Prerequisites

First, you must run an Apache Pulsar cluster and an Amazon EventBridge service.

1. Prepare the Pulsar service. You can quickly run a Pulsar cluster anywhere by running `$PULSAR_HOME/bin/pulsar standalone`. Refer to the documentation for details.
2. Prepare the AWS EventBridge service. See Getting Started with Amazon EventBridge for details. Need to create EventBus and Rule first.
3. Set up the AWS EventBridge connector. Download the connector from the Releases page, and then move the nar package to `$PULSAR_HOME/connectors`.

Apache Pulsar provides a Pulsar IO feature to run the connector. Follow the steps below to get the connector up and running.

Configure the sink connector

1. Create a configuration file named _{aws-eventbridge-sink-config.json}. The configured connector writes the message in the _{public/default/aws-eventbridge-pulsar} topic to the _{pulsar-event-bus-name} event bus of EventBridge.

{
	"name": "eventbridge-sink",
	"archive": "connectors/pulsar-io-aws-eventbridge-2.10.4.3.nar",
	"tenant": "public",
	"namespace": "default",
	"inputs": [
		"aws-eventbridge-pulsar"
	],
	"parallelism": 1,
	"configs": {
		"accessKeyId": "{{Your access access key}}",
		"secretAccessKey": "{{Your secret access key}}",
		"region": "test-region",
		"eventBusName": "pulsar-event-bus-name"
	}
}

2. Run the sink connector.

PULSAR_HOME/bin/pulsar-admin sinks localrun --sink-config-file aws-eventbridge-sink-config.json

3. You can send messages to the `public/default/aws-eventbridge-pulsar` topic, then view it in EventBridge.

For more information, see the [Hub doc](https://docs.streamnative.io/hub/connector-aws-eventbridge-sink-v2.10.4.3).

Get involved

The Amazon EventBridge sink connector is a major step in the journey of integrating Pulsar with other big data systems. To get involved with the Amazon EventBridge sink connector for Apache Pulsar, check out the following featured resources:

• Try out the Amazon EventBridge sink connector. To get started, download the connector and refer to the ReadMe that walks through the whole process.
• Make a contribution. The Amazon EventBridge sink connector is a community-driven service, which hosts its source code on the StreamNative GitHub repository. If you have any feature requests or bug reports, do not hesitate to share your feedback and ideas and submit a pull request.
• Contact us. Feel free to create an issue on GitHub, send an email to the Pulsar mailing list, or message us on Twitter to get answers from Pulsar experts.

About StreamNative

StreamNative was founded by the original creators of Apache Pulsar and offers a fully managed service to help teams accelerate time-to-production and take advantage of Pulsar’s powerful streaming and messaging technology. We work with software companies worldwide - powering the next generation of real-time/event-streaming applications.