Dataflow computations on enterprise Grids

Abstract

This chapter presents the design, implementation and evaluation of a dataflow system, including a macro-dataflow programming model, runtime system and an online scheduling algorithm, to simplify the development and deployment of distributed applications. The model provides users with a simple interface for programming applications with complex parallel patterns. The associated runtime system dispatches tasks onto distributed resources through a proposed online algorithm, called localized heterogeneous earliest-finish-time (L-HEFT), and manages failures and load balancing in a transparent manner. The system has been implemented in a.NET-based enterprise grid software platform, called Aneka. E..