- Apache Pulsar
- Company
- Developers
Cloud-Native Event Streaming powered by Apache Pulsar
Unlock the full potential of upstream Apache Pulsar
ConnectIngest data from anywhere, any platform, and use your favoriate messaging protocols
StoreUnlock many new use cases stemming from infinite data retention
ProcessEnable modern stream processing capabilities to power real-time applications or streaming transformations
Publish and subscribe to event streams at scale
Pub & Sub
Unified streaming & queueingPulsar IO
Ingest data without writing codeKafka-on-Pulsar
Seamlessly integrate with Apache KafkaStore infinite event streams reliably at scale
Apache BookKeeper
Amazon S3
Google Cloud Services
Process event streams in real-time at scale
Pulsar Functions
Serverless computingPulsar-Spark & Pulsar-Flink
Unified data processingPulsar SQL (Presto)
SQL queries at scale
About Apache Pulsar
Apache Pulsar is a cloud-native, distributed messaging and streaming platform that manages hundreds of billions of events per day. Pulsar was originally developed and deployed inside Yahoo as the consolidated messaging platform connecting critical Yahoo applications such as Yahoo Finance, Yahoo Mail, and Flickr, to data. Pulsar was contributed to open source by Yahoo in 2016 and became a top-level Apache Software Foundation project in 2018.
Built on BookKeeper
Apache BookKeeper is a large scale distributed log storage system that is able to store trillions of events per day. It was developed for addressing the high availability challenges for HDFS NameNode. BookKeeper became a top-level Apache Software Foundation project in 2014, and has been adopted by Twitter, Yahoo, Salesforce, Bytedance (Tiktok) and other major technology companies. BookKeeper is the default message storage for Apache Pulsar, which provides a durable, strong consistent log storage for storing all the messages for Pulsar.
Why Apache Pulsar?
Multi-tenancy
Streamline operations and avoid data silos.
Hierarchical topic management
Scale out to support millions of topicsEncryption, Authorization, and Authorization
Protect and share your event streams in a highly secured wayIsolation and Quotas
Comprehensive polices to ensure service isolation and resource quotas
Scalability
Instant scalability without partition rebalancing.
Multi-layer architecture
Scale computation and storage independentlySegment-centric storage
Expand cluster without recopying partitions to rebalanceAutomatical storage tiering
Store all time-range of event data in different storage tiers
Multi-cluster Replication
Keep your data safe with integrated, multi-datacenter replication.
Built-in replication
Configurable replication between clusters across multiple geographic regionsFlexible replication setup
Support active-active, active-standy, aggregate, and full-mesh replicationGlobal consistency
Support replicated subscription, sync and async replication
Tencent 腾讯
"Pulsar provides us with a highly consistent and highly reliable distributed message queue that fits well in our financial use cases. Multi-tenant and storage separation architecture design greatly reduce our operational and maintenance overhead. We have used Pulsar on a very large scale in our organization and we are impressed that Pulsar is able to provide high consistency while supporting high concurrent client connections."
Read More
Bestpay
"We offer financial services, so stability is a requirement. When we were running promotions we were getting so much traffic and were having issues with the infrastructure. Then we discovered Pulsar, which offered decoupled computation and storage. It had all the features we needed."
Read MoreTry StreamNative
Run Anyway
An enterprise-ready event streaming platform built by the original developers of Apache Pulsar and Apache BookKeeper
Fully Managed Service
A fully-supported, turnkey enterprise offering managed and operated by the Pulsar core team, who has deep experience operating Pulsar and BookKeeper at internet scale.
Upcoming Events & Conferences
Conference ⋯ San Francisco
April 2020
Pulsar Summit
Conference ⋯ San Jose
March 2020
Strata Data Conference
Conference ⋯ San Francisco
