Management, analysis, and visualization of experimental and observational data - The convergence of data and computing

E. Wes Bethel, Martin Greenwald, Kerstin Kleese Van Dam, Manish Parashar, Stefan M. Wild, H. Steven Wiley

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Scientific user facilities - particle accelerators, telescopes, colliders, supercomputers, light sources, sequencing facilities, and more - operated by the U.S. Department of Energy (DOE) Office of Science (SC) generate ever increasing volumes of data at unprecedented rates from experiments, observations, and simulations. At the same time there is a growing community of experimentalists that require real-time data analysis feedback, to enable them to steer their complex experimental instruments to optimized scientific outcomes and new discoveries. Recent efforts in DOE-SC have focused on articulating the data-centric challenges and opportunities facing these science communities. Key challenges include difficulties coping with data size, rate, and complexity in the context of both real-time and post-experiment data analysis and interpretation. Solutions will require algorithmic and mathematical advances, as well as hardware and software infrastructures that adequately support data-intensive scientific workloads. This paper presents the summary findings of a workshop held by DOE-SC in September 2015, convened to identify the major challenges and the research that is needed to meet those challenges.

Original languageEnglish (US)
Title of host publicationProceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages213-222
Number of pages10
ISBN (Electronic)9781509042722
DOIs
StatePublished - Mar 3 2017
Event12th IEEE International Conference on e-Science, e-Science 2016 - Baltimore, United States
Duration: Oct 23 2016Oct 27 2016

Publication series

NameProceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016

Other

Other12th IEEE International Conference on e-Science, e-Science 2016
CountryUnited States
CityBaltimore
Period10/23/1610/27/16

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems
  • Environmental Science (miscellaneous)
  • Medicine (miscellaneous)
  • Social Sciences (miscellaneous)
  • Agricultural and Biological Sciences (miscellaneous)
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Management, analysis, and visualization of experimental and observational data - The convergence of data and computing'. Together they form a unique fingerprint.

Cite this