Unlock the full potential of upstream Apache Pulsar
Ingest data from anywhere, any platform, and use your favoriate messaging protocols
Unlock many new use cases stemming from infinite data retention
Enable modern stream processing capabilities to power real-time applications or streaming transformations
Apache Pulsar is a cloud-native, distributed messaging and streaming platform that manages hundreds of billions of events per day. Pulsar was originally developed and deployed inside Yahoo as the consolidated messaging platform connecting critical Yahoo applications such as Yahoo Finance, Yahoo Mail, and Flickr, to data. Pulsar was contributed to open source by Yahoo in 2016 and became a top-level Apache Software Foundation project in 2018.
Apache BookKeeper is a large scale distributed log storage system that is able to store trillions of events per day. It was developed for addressing the high availability challenges for HDFS NameNode. BookKeeper became a top-level Apache Software Foundation project in 2014, and has been adopted by Twitter, Yahoo, Salesforce, Bytedance (Tiktok) and other major technology companies. BookKeeper is the default message storage for Apache Pulsar, which provides a durable, strong consistent log storage for storing all the messages for Pulsar.
"Pulsar provides us with a highly consistent and highly reliable distributed message queue that fits well in our financial use cases. Multi-tenant and storage separation architecture design greatly reduce our operational and maintenance overhead. We have used Pulsar on a very large scale in our organization and we are impressed that Pulsar is able to provide high consistency while supporting high concurrent client connections."Read More
"We offer financial services, so stability is a requirement. When we were running promotions we were getting so much traffic and were having issues with the infrastructure. Then we discovered Pulsar, which offered decoupled computation and storage. It had all the features we needed."Read More