Addressing the petascale data challenge using in-situ analytics

Manish Parashar

doi:10.1145/2110205.2110212

Addressing the petascale data challenge using in-situ analytics

Manish Parashar

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

10 Scopus citations

Abstract

Data management, processing and analysis costs are quickly dominating computational and data-enabled sciences, and are limiting the potential impacts of advanced simulations running at extreme scales on the high-end computing systems. This presentation explores how in-situ data analytics and in-transit data transformation and data manipulation can be used to address these data challenges at petascale and beyond. Specifically, this presentations describes solutions developed as part of the Rutgers Spaces Project ¹ and deployed within the ADIOS framework.

Original language	English (US)
Title of host publication	PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics
Subtitle of host publication	Challenges and Opportunities, Co-located with SC'11
Pages	35-36
Number of pages	2
DOIs	https://doi.org/10.1145/2110205.2110212
State	Published - 2011
Event	2011 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, Held in Cooperation with the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis, SC'11 - Seattle, WA, United States Duration: Nov 14 2011 → Nov 14 2011

Publication series

Name	PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11

Other

Other	2011 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, Held in Cooperation with the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis, SC'11
Country/Territory	United States
City	Seattle, WA
Period	11/14/11 → 11/14/11

All Science Journal Classification (ASJC) codes

Computer Science Applications
Information Systems

Keywords

ADIOS
ActiveSpaces
DataSpaces
Dynamic code deployment
In-situ data analytics
In-transit data processing

Access to Document

10.1145/2110205.2110212

Cite this

Parashar, M. (2011). Addressing the petascale data challenge using in-situ analytics. In PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11 (pp. 35-36). (PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11). https://doi.org/10.1145/2110205.2110212

Parashar, Manish. / Addressing the petascale data challenge using in-situ analytics. PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11. 2011. pp. 35-36 (PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11).

@inproceedings{9c442b40d7ee47359fec70f37ce84d2b,

title = "Addressing the petascale data challenge using in-situ analytics",

abstract = "Data management, processing and analysis costs are quickly dominating computational and data-enabled sciences, and are limiting the potential impacts of advanced simulations running at extreme scales on the high-end computing systems. This presentation explores how in-situ data analytics and in-transit data transformation and data manipulation can be used to address these data challenges at petascale and beyond. Specifically, this presentations describes solutions developed as part of the Rutgers Spaces Project 1 and deployed within the ADIOS framework.",

keywords = "ADIOS, ActiveSpaces, DataSpaces, Dynamic code deployment, In-situ data analytics, In-transit data processing",

author = "Manish Parashar",

year = "2011",

doi = "10.1145/2110205.2110212",

language = "English (US)",

isbn = "9781450311304",

series = "PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11",

pages = "35--36",

booktitle = "PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics",

note = "2011 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, Held in Cooperation with the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis, SC'11 ; Conference date: 14-11-2011 Through 14-11-2011",

}

Parashar, M 2011, Addressing the petascale data challenge using in-situ analytics. in PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11. PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11, pp. 35-36, 2011 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, Held in Cooperation with the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis, SC'11, Seattle, WA, United States, 11/14/11. https://doi.org/10.1145/2110205.2110212

Addressing the petascale data challenge using in-situ analytics. / Parashar, Manish.
PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11. 2011. p. 35-36 (PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Addressing the petascale data challenge using in-situ analytics

AU - Parashar, Manish

PY - 2011

Y1 - 2011

N2 - Data management, processing and analysis costs are quickly dominating computational and data-enabled sciences, and are limiting the potential impacts of advanced simulations running at extreme scales on the high-end computing systems. This presentation explores how in-situ data analytics and in-transit data transformation and data manipulation can be used to address these data challenges at petascale and beyond. Specifically, this presentations describes solutions developed as part of the Rutgers Spaces Project 1 and deployed within the ADIOS framework.

AB - Data management, processing and analysis costs are quickly dominating computational and data-enabled sciences, and are limiting the potential impacts of advanced simulations running at extreme scales on the high-end computing systems. This presentation explores how in-situ data analytics and in-transit data transformation and data manipulation can be used to address these data challenges at petascale and beyond. Specifically, this presentations describes solutions developed as part of the Rutgers Spaces Project 1 and deployed within the ADIOS framework.

KW - ADIOS

KW - ActiveSpaces

KW - DataSpaces

KW - Dynamic code deployment

KW - In-situ data analytics

KW - In-transit data processing

UR - http://www.scopus.com/inward/record.url?scp=84857975823&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84857975823&partnerID=8YFLogxK

U2 - 10.1145/2110205.2110212

DO - 10.1145/2110205.2110212

M3 - Conference contribution

AN - SCOPUS:84857975823

SN - 9781450311304

T3 - PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11

SP - 35

EP - 36

BT - PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics

T2 - 2011 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, Held in Cooperation with the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis, SC'11

Y2 - 14 November 2011 through 14 November 2011

ER -

Parashar M. Addressing the petascale data challenge using in-situ analytics. In PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11. 2011. p. 35-36. (PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11). doi: 10.1145/2110205.2110212

Addressing the petascale data challenge using in-situ analytics

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Keywords

Access to Document

Other files and links

Fingerprint

Cite this