In Proceedings of the 10th ACM International Conference on Distributed and Event-Based Systems (DEBS 2016), June 2016.
Best Paper Award.
We propose, OMen, a distributed system for dynamically maintaining
overlays for topic-based publish/subscribe (pub/sub) systems.
In particular, OMen supports churn-resistant construction of
topic-connected overlays (TCO), which organizes all nodes interested in
the same topic in a directly connected dissemination sub-overlay.
While aiming at pub/sub deployments in data centers, OMen internally
leverages selected peer-to-peer technologies, such as T-Man
as the underlying topology maintenance protocol.
Existing approaches for constructing pub/sub TCOs are (i) centralized algorithms that guarantee low node degrees at the cost of prohibitive running time and (ii) decentralized protocols that are time efficient while lacking bounds on node degrees.
We show both analytically and experimentally that OMen combines the best from both worlds. Namely, OMen achieves (i) low node degrees, close to centralized algorithms, and (ii) high efficiency, scalability, and load balance, comparable to decentralized protocols. Our evaluation uses both synthetic pub/sub workloads and real-world ones extracted from Facebook and Twitter. We generate churn traces with Google cluster data.
Readers who enjoyed the above work, may also like the following: