HPC, Big Data, and AI Convergence Towards Exascale

9Data Convergence for High-Performance Cloud

Christian Pinto, Antony Chazapis, Christos Kozanitis, Yiannis Gkoufas, Panos Koutsovasilis, Srikumar Venugopal, Jean-Thomas Acquaviva, and Angelos Bilas

DOI: 10.1201/9781003176664-9

Contents

1. 9.1Introduction
2. 9.2Motivations
3. 9.3Design and Implementation
4. 9.4Karvdash
5. 9.5DataShim
6. 9.5.1Overview
7. 9.5.2Dataset Custom Resource Definition
8. 9.5.3DatasetInternal Custom Resource Definition
9. 9.5.4DataShim Operator and Admission Controller
10. 9.5.5Caching Plugin
11. 9.5.6Objects Caching on CEPH
12. 9.5.7Ceph-Based Caching Plugin Implementation
13. 9.5.8Evaluation of the Ceph-Based Caching Plugin
14. 9.6H3
15. 9.6.1Overview
16. 9.6.2Data and Metadata Organization
17. 9.6.3The H3 Ecosystem
18. 9.7Integration
19. 9.8Related Work
20. 9.9Conclusions
21. References ...