High-Performance Computing is similar to Big Data in many ways, but is much more sensitive to access latency in messaging between nodes. This impacts networks, including switching and NICs, and is the primary reason for InfiniBand use. The migration to Remote Direct Memory Access over Ethernet is a major change with unresolved issues.
Compression; High-performance computing; HPC; Latency; RDMA; Sparse data
High-Performance Computing (HPC) is a group term for high-powered computing that addresses scientific, oil and gas, and other very large-scale tasks. Clearly, there are enough similarities with the Big Data environment that many concepts are shared, but, at the same time, HPC has unique characteristics. ...
Get Network Storage now with O’Reilly online learning.
O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.