Hands-On Deep Learning with Go

Basic Linear Algebra Subprograms

As we've seen in the networks we've built so far, tensor operations are fundamental to machine learning. GPUs are designed for these types of vector or matrix operations, but our software also needs to be designed to take advantage of these optimizations. Enter BLAS!

BLAS provide the building blocks for linear algebra operations, commonly used in graphics programming as well as machine learning. BLAS libraries are low level, originally written in Fortran, and group the functionality they offer into three levels, defined by the types of operations covered, as follows:

• Level 1: Vector operations on strided arrays, dot products, vector norms, and generalized vector addition
• Level 2: Generalized matrix-vector ...