Matrix-Multiply Assist Architecture
The Matrix-Multiply Assist (MMA) architecture is introduced in Power ISA v3.1. Several new concepts are described in this chapter, such as:
•An introduction of accumulator registers
•New compute instructions for the matrix multiplication operation
•Support for lower precision arithmetic beyond single- and double-precision
2.1 Data types
MMA architecture supports both floating-point and integer data types. This support was introduced because of the growing requirements of future AI-inferencing models.
The following ...
Get Matrix-Multiply Assist Best Practices Guide now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
