Decentralized Execution of Event-driven Scientific Workflows

Guoli Li, Vinod Muthusamy, Hans-Arno Jacobsen, and S. Mankovski.

In International Workshop on Event-driven Architecture, Processing and Systems (EDA-PS), pages 73-82, September 2006.


Scientific workflows (SWF) are traditionally coordinated and executed in a centralized fashion. This creates a single point of failure, forms a scalability bottleneck, and often leads to too much message traffic routed back to the coordinator. We have developed PADRES, a content-based publish/subscribe platform that serves as a runtime environment for the decentralized execution, control, and monitoring of SWF. Publish/subscribe is a natural paradigm for event-driven applications such as SWF management, as the loosely-coupled nature of publishers and subscribers relieves the coordinator from maintaining client connection and capability information. PADRES has been developed with features inspired by the requirements of SWF management. Its unique features include an expressive subscription language, composite subscription processing support, a rule-based matching and routing mechanism, a querybased historic data access mechanism, and support for the decentralized execution of SWFs specified in XML.


Tags: content-based publish/subscribe, publish/subscribe, scientifc worklow

Readers who enjoyed the above work, may also like the following: