Replicated Subscriptions: Taking Geo-Replication to the Next Level

Pulsar Summit North America 2021

Replicated Subscriptions: Taking Geo-Replication to the Next Level

Replicated subscriptions is a powerful feature that was recently added to Pulsar. It allows for applications to implement very sophisticated cluster-level failover strategies, by keeping the subscription status in-sync across different clusters. With replicated subscriptions, a consumer can switch to a different cluster and resume the consumption from a position very close to where it left off before.
‍

In this video we explore various patterns of cluster failover, when it is appropriate to use them and the different tradeoffs of each approach.
After that, we dive into the implementation of the replicated subscriptions mechanism, to show how using a distributed protocol, Pulsar is able to establish associations for a given message across multiple different data-centers, while exchanging control messages through the replication data path.

‍
Download slides.