The CAU is a unit that accelerates the processing of collectives within a system that is made
up of multiple nodes that are interconnected via a cluster network.
Collectives are distributed operations that operate across a tree. The following primary
collective operations are used:
Reduce: Gathers packets from all nodes expect the root node in a tree and reduces the
nodes to a single packet that is delivered to the root node. The root node is any node in
the tree (not necessarily the node at the top of the tree).
MP_INSTANC ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.