Chapter 4: Software architecture

Abstract

This chapter explains the software architecture of the Huawei Ascend AI processor. Firstly, the Ascend AI software stack is introduced, including the process orchestration (Matrix), the framework manager (Framework), the execution manager (Runtime), the Digital Vision Preprocessing (DVPP) module, the Tensor Boost Engine (TBE), and the Task Scheduler (TS). The neural network software flow is used to complete the generation, loading, and execution of the neural network model. Then, the development tool chain, Mind Studio, is introduced. It provides the auxiliary convenience for the realization process of the neural network.

Keywords

Software architecture; Process orchestration; Framework manager; ...

Get Ascend AI Processor Architecture and Programming now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.