Executing multiple pipelined data analysis operations in the grid

Matthew Spencer; Renato Ferreira; Michael Beynon; Tahsin Kurc; Umit Catalyurek; Alan Sussman; Joel Saltz

doi:10.1109/SC.2002.10015

Executing multiple pipelined data analysis operations in the grid

Matthew Spencer
, Renato Ferreira
, Michael Beynon
, Tahsin Kurc
, Umit Catalyurek
, Alan Sussman
, Joel Saltz

Biomedical Informatics

Stony Brook University

Ohio State University
University of Maryland, College Park

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

32 Scopus citations

Abstract

Processing of data in many data analysis applications can be represented as an acyclic, coarse grain data flow, from data sources to the client. This paper is concerned with scheduling of multiple data analysis operations, each of which is represented as a pipelined chain of processing on data. We define the scheduling problem for effectively placing components onto Grid resources, and propose two scheduling algorithms. Experimental results are presented using a visualization application.

Original language	English
Title of host publication	Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002
Publisher	Association for Computing Machinery
ISBN (Electronic)	076951524X
DOIs	https://doi.org/10.1109/SC.2002.10015
State	Published - 2002
Event	2002 IEEE/ACM Conference on Supercomputing, SC 2002 - Baltimore, United States Duration: Nov 16 2002 → Nov 22 2002

Publication series

Name	Proceedings of the International Conference on Supercomputing
Volume	2002-November

Conference

Conference	2002 IEEE/ACM Conference on Supercomputing, SC 2002
Country/Territory	United States
City	Baltimore
Period	11/16/02 → 11/22/02

Access to Document

10.1109/SC.2002.10015

Cite this

Spencer, M., Ferreira, R., Beynon, M., Kurc, T., Catalyurek, U., Sussman, A., & Saltz, J. (2002). Executing multiple pipelined data analysis operations in the grid. In Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002 (Proceedings of the International Conference on Supercomputing; Vol. 2002-November). Association for Computing Machinery. https://doi.org/10.1109/SC.2002.10015

@inproceedings{36a65c5c99874d659a8a1fd92e8e5fa1,

title = "Executing multiple pipelined data analysis operations in the grid",

abstract = "Processing of data in many data analysis applications can be represented as an acyclic, coarse grain data flow, from data sources to the client. This paper is concerned with scheduling of multiple data analysis operations, each of which is represented as a pipelined chain of processing on data. We define the scheduling problem for effectively placing components onto Grid resources, and propose two scheduling algorithms. Experimental results are presented using a visualization application.",

author = "Matthew Spencer and Renato Ferreira and Michael Beynon and Tahsin Kurc and Umit Catalyurek and Alan Sussman and Joel Saltz",

note = "Publisher Copyright: {\textcopyright} 2002 IEEE.; 2002 IEEE/ACM Conference on Supercomputing, SC 2002 ; Conference date: 16-11-2002 Through 22-11-2002",

year = "2002",

doi = "10.1109/SC.2002.10015",

language = "English",

series = "Proceedings of the International Conference on Supercomputing",

publisher = "Association for Computing Machinery",

booktitle = "Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002",

}

Spencer, M, Ferreira, R, Beynon, M, Kurc, T, Catalyurek, U, Sussman, A & Saltz, J 2002, Executing multiple pipelined data analysis operations in the grid. in Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002. Proceedings of the International Conference on Supercomputing, vol. 2002-November, Association for Computing Machinery, 2002 IEEE/ACM Conference on Supercomputing, SC 2002, Baltimore, United States, 11/16/02. https://doi.org/10.1109/SC.2002.10015

Executing multiple pipelined data analysis operations in the grid. / Spencer, Matthew; Ferreira, Renato; Beynon, Michael et al.
Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002. Association for Computing Machinery, 2002. (Proceedings of the International Conference on Supercomputing; Vol. 2002-November).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Executing multiple pipelined data analysis operations in the grid

AU - Spencer, Matthew

AU - Ferreira, Renato

AU - Beynon, Michael

AU - Kurc, Tahsin

AU - Catalyurek, Umit

AU - Sussman, Alan

AU - Saltz, Joel

PY - 2002

Y1 - 2002

N2 - Processing of data in many data analysis applications can be represented as an acyclic, coarse grain data flow, from data sources to the client. This paper is concerned with scheduling of multiple data analysis operations, each of which is represented as a pipelined chain of processing on data. We define the scheduling problem for effectively placing components onto Grid resources, and propose two scheduling algorithms. Experimental results are presented using a visualization application.

AB - Processing of data in many data analysis applications can be represented as an acyclic, coarse grain data flow, from data sources to the client. This paper is concerned with scheduling of multiple data analysis operations, each of which is represented as a pipelined chain of processing on data. We define the scheduling problem for effectively placing components onto Grid resources, and propose two scheduling algorithms. Experimental results are presented using a visualization application.

UR - https://www.scopus.com/pages/publications/31144436184

U2 - 10.1109/SC.2002.10015

DO - 10.1109/SC.2002.10015

M3 - Conference contribution

T3 - Proceedings of the International Conference on Supercomputing

BT - Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002

PB - Association for Computing Machinery

T2 - 2002 IEEE/ACM Conference on Supercomputing, SC 2002

Y2 - 16 November 2002 through 22 November 2002

ER -

Executing multiple pipelined data analysis operations in the grid

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this