Towards Scalable Publish/Subscribe Systems

Shuping Ji, Chunyang Ye, Wei Jun, and Hans-Arno Jacobsen.

In IEEE 35th International Conference on Distributed Computing Systems (ICDCS), June 2015.
(Short paper).

Abstract

Despite suffering from inefficiency and flexibility limitations, the filter-based routing (FBR) algorithm is widely used in content-based publish/subscribe\ (pub/sub) systems. To address its limitations, we propose a dynamic destination-based routing algorithm called DDBR, which decomposes pub\sub into two independent parts: Content-based matching and destination-based multicasting. DDBR exhibits low event matching cost and high efficiency, flexibility, and robustness for event routing in small-scale overlays. To improve its scalability to large-scale overlays, we further extend DDBR to a new routing algorithm called MERC. MERC divides the overlay into interconnected clusters and applies content-based and destination-based mechanisms to route events inter- and intra-cluster, respectively. We implemented all algorithms in the PADRES pub/sub system. Experimental results show that our algorithms outperform the FBR algorithm.

Download




Tags: icdcs15


Readers who enjoyed the above work, may also like the following:


  • Congestion Avoidance with Incremental Filter Aggregation in Content-Based Routing Networks.
    Mingwen Chen, Songlin Hu, Vinod Muthusamy, and Hans-Arno Jacobsen.
    In IEEE 35th International Conference on Distributed Computing Systems (ICDCS), June 2015.
    Acceptance rate: 13%. Number of submissions: 543..
    Tags: icdcs15
  • Weighted Overlay Design for Topic-based Publish/Subscribe on Geo-Distributed Data Centers.
    Chen Chen, Yoav Tock, Hans-Arno Jacobsen, and Roman Vitenberg.
    In 35th IEEE International Conference on Distributed Computing Systems (ICDCS), pages 474-485, July 2015.
    Acceptance rate: 13%. 70 papers accepted out of 543 submissions..
    Tags: icdcs15, overlay, pub/sub
  • Towards Planning the Transformation of Distributed Messaging Middlewares.
    Young Yoon, Nathan Robinson, Vinod Muthusamy, Sheila McIlraith, and Hans-Arno Jacobsen.
    In IEEE 35th International Conference on Distributed Computing Systems (ICDCS), June 2015.
    (Short paper).
    Tags: content-based publish/subscribe, overlay construction, overlay design, overlay networks, overlays, icdcs15