Partition-tolerant Distributed Publish/Subscribe Systems

Reza Sherafat Kazemzadeh and Hans-Arno Jacobsen.

In 30th IEEE Symposium on Reliable Distributed Systems (SRDS 2011), pages 101-110, Madrid, Spain, October 2011. IEEE.
Acceptance rate: 34%.


In this paper, we develop reliable distributed pub- lish/subscribe algorithms that can tolerate concurrent failure of up to δ broker machines or communication links. In our approach, δ is a configuration parameter which determines the level of fault-tolerance of the system and reliability refers to exactly-once and per-source, in-order delivery of publications to clients with matching subscriptions. We propose protocols to address three problems in presence of broker or link failures: (i) subscription propagation; (ii) publication forwarding; and (iii) broker recovery. Finally, we study the effectiveness of our approach when the number of concurrent failures exceeds δ. Through large-scale experimental evaluations with up to 500 brokers, we demonstrate that a system configured with a modest value of δ = 3 is able to reliably deliver 97% of publications in presence of failure of up to 17% of its brokers.


Related Projects

Tags: publish/subscribe, reliability, fault-tolerance, partition-tolerance

Readers who enjoyed the above work, may also like the following: