TY - GEN
T1 - Leveraging energy-efficient non-lossy compression for data-intensive applications
AU - Rais, Issam
AU - Balouek-Thomert, Daniel
AU - Orgerie, Anne Cecile
AU - Lefevre, Laurent
AU - Parashar, Manish
N1 - Funding Information:
ACKNOWLEDGMENTS This research is partially supported by the French FSN ELCI project and the Inria-Rutgers SUSTAM (Sustainable Ultra Scale compuTing, dAta and energy Management) associate team, by NSF via grants numbers ACI 1339036, ACI 1441376 and by the Research Council of Norway (RCN) IKTPluss program, project number 270672. Experiments were carried out using the Grid’5000 testbed, supported by a scientific interest group hosted by Inria and including CNRS, RE-NATER and several Universities as well as other organisations (https://www.grid5000.fr).
Publisher Copyright:
© 2019 IEEE.
PY - 2019/7
Y1 - 2019/7
N2 - The continuous increase of data volumes poses several challenges to established infrastructures in terms of resource management and expenses. One of the most important challenges is the energy-efficient enactment of data operations in the context of data-intensive applications. Computing, generating and exchanging growing volumes of data are costly operations, both in terms of time and energy. In the late literature, different types of compression mechanisms emerge as a new way to reduce time spent on data-related operations, but the overall energy cost has not been studied. Based on current advances and benefits of compression techniques, we propose a model that leverages non-lossy compression and identifies situations where compression presents an interest from an energy reduction perspective. The proposed model considers sender, receiver, communications costs over various types of files and available bandwidth. This strategy allows us to improve both time and energy required for communications by taking advantage of idle times and power states. Evaluation is performed over HPC, Big Data and datacenter scenarios. Results show significant energy savings for all types of file while avoiding counter performances, resulting in a strong incentive to actively leverage non-lossy compression using our model.
AB - The continuous increase of data volumes poses several challenges to established infrastructures in terms of resource management and expenses. One of the most important challenges is the energy-efficient enactment of data operations in the context of data-intensive applications. Computing, generating and exchanging growing volumes of data are costly operations, both in terms of time and energy. In the late literature, different types of compression mechanisms emerge as a new way to reduce time spent on data-related operations, but the overall energy cost has not been studied. Based on current advances and benefits of compression techniques, we propose a model that leverages non-lossy compression and identifies situations where compression presents an interest from an energy reduction perspective. The proposed model considers sender, receiver, communications costs over various types of files and available bandwidth. This strategy allows us to improve both time and energy required for communications by taking advantage of idle times and power states. Evaluation is performed over HPC, Big Data and datacenter scenarios. Results show significant energy savings for all types of file while avoiding counter performances, resulting in a strong incentive to actively leverage non-lossy compression using our model.
KW - Big Data
KW - Compression
KW - Datacenter
KW - Energy efficiency
KW - HPC
UR - http://www.scopus.com/inward/record.url?scp=85089102790&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089102790&partnerID=8YFLogxK
U2 - 10.1109/HPCS48598.2019.9188058
DO - 10.1109/HPCS48598.2019.9188058
M3 - Conference contribution
AN - SCOPUS:85089102790
T3 - 2019 International Conference on High Performance Computing and Simulation, HPCS 2019
SP - 463
EP - 469
BT - 2019 International Conference on High Performance Computing and Simulation, HPCS 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 International Conference on High Performance Computing and Simulation, HPCS 2019
Y2 - 15 July 2019 through 19 July 2019
ER -