Apr 26, 2021
2 min read

Announcing AMQP 1.0 Connector for Apache Pulsar

Ran Gao
Software Engineer, StreamNative
Yu Liu

Today StreamNative announces the release of the AMQP 1.0 connector for Apache Pulsar. This connector enables seamless integration between the Pulsar ecosystem and AMQP. If you are an organization looking to deploy reactive data pipelines, try it out!

What is the AMQP 1.0 connector?

The AMQP 1.0 connector (AMQP1_0) enables your application to publish and consume data using the AMQP 1.0-compliant broker and move data bi-directionally between Pulsar and AMQP service. The Pulsar IO framework allows you to read data from Pulsar or write data to Pulsar using source and sink.

  • AMQP 1.0 source
  • This source feeds data from AMQP 1.0 and persists data to Pulsar topics.
pulsar and AMQP source illustration
Figure 1 - AMQP1_0 source connector


  • AMQP 1.0 sink
  • This sink feeds data from Pulsar topics and persists data to AMQP.
pulsar and AMQP sink illustration
Figure 2 - AMQP1_0 sink connector


Why did StreamNative develop the AMQP 1.0 connector?

Pulsar and AMQP are at the heart of modern cloud architectures.

As one of the leading open-source distributed messaging systems, Pulsar unifies streaming and queuing capabilities and provides a broad set of features and functionalities all in one system.

AMQP 1.0 is one of the most efficient and reliable messaging protocols, allowing you to construct cross-platform and message-based applications with the vendor-agnostic and implementation-neutral protocol.

Both Pulsar and AMQP have grown rapidly in recent years. Pulsar has received global adoptions from top tech companies such as Yahoo! JAPAN, Verizon Media, Splunk, Iterable, Tencent, just to name a few. AMQP is widely adopted by leading organizations such as Google, Microsoft, IBM, Red Hat, and more. Many users want to leverage both the benefits of Pulsar and AMQP and we have received requests from a number of our customers looking for an integration between Pulsar and AMQP.

Why use the AMQP 1.0 connector?

Built to deploy integrations between Pulsar and AMQP quickly, securely, and reliably, the AMQP 1.0 connector brings various advantages, including but not limited to:

  • Simplicity
  • This connector simplifies integration for organizations who want to bring Pulsar into their existing infrastructure. It empowers organizations to move data in and out of Pulsar without writing a single line of code.
  • Scalability
  • This connector is able to run jobs on a single node (standalone) or deliver reliability at scale for an entire organization (distributed), which allows you to build reactive data pipelines to serve your business and operational needs in real-time.
  • Sustainability
  • Taking advantage of the full power of this connector enables you to spend less time worrying about the data layer and have more time to maximize business value from living data in an efficient manner.

Get involved

The AMQP 1.0 connector is a major step in the journey of integrating other message systems into the Pulsar ecosystem. To get involved with the AMQP 1.0 connector, check out the following featured resources:

  • Try the AMQP 1.0 connector
  • To get started, download the connector and head over to the user guides that will walk you through the setup process.
  • Ask a question
  • Have questions? As always, feel free to create issues on GitHub, send emails to the Pulsar mailing list, message us on Twitter, or join the #connector-AMQP1_0 channel on Pulsar Slack to get answers from Pulsar experts.
  • Make a contribution
  • The AMQP 1.0 connector is a community-driven service, which hosts its source code on the StreamNative GitHub repo. We would love you to explore this new connector and contribute to its evolution. Have feature requests or bug reports? Do not hesitate to share your ideas and welcome to submit your pull request.

The AMQP 1.0 connector is available on the StreamNative Hub, a centralized hub for the Pulsar ecosystem. Whether you are a longtime Pulsar user or new to Pulsar, StreamNative Hub and its rich integrations are a great way to take your organization to the next level. At StreamNative, we’re committed to the Pulsar community and will continue to invest in the Pulsar ecosystem. Today’s announcement is just another step towards realizing our vision of delivering enhanced integrations to enable enterprises to easily access their data. Stay tuned for more announcements from StreamNative!

Happy Connecting!

Ran Gao
Ran Gao is a software engineer at StreamNative. Before that, he was responsible for the development of search service at Zhaopin.com. Prior to that, he worked on the development of the logistics system at JD Logistics. Being interested in open source and messaging systems, Ran is an Apache Pulsar committer.
Yu Liu
Yu Liu is an Apache Pulsar PMC member and a content strategist from StreamNative.

Newsletter

Our strategies and tactics delivered right to your inbox

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Pulsar Connectors
Apache Pulsar Announcements