What is hipBLASLt?

What is hipBLASLt?#

hipBLASLt is a library that provides GEMM operations with flexible APIs and extends functionalities beyond the traditional BLAS library. hipBLASLt exposes APIs in the HIP programming language with an underlying optimized generator as a backend kernel provider.

This library adds flexibility in matrix data layouts, input types, compute types, and also in choosing the algorithmic implementations and heuristics through parameter programmability. After you identify a set of options for the intended GEMM operations, you can use these options repeatedly for different inputs.

The GEMM operation of hipBLASLt is performed by hipblasLtMatmul(). Here is the equation:

D = A c t i v a t i o n (a l p h a \cdot o p (A) \cdot o p (B) + b e t a \cdot o p (C) + b i a s)

where, $o p (A) / o p (B)$ refers to in-place operations such as transpose/non-transpose and $a l p h a$ , $b e t a$ are the scalars. $A c t i v a t i o n$ function supports Gelu and Relu. $B i a s$ vector matches matrix $D$ rows and broadcasts to all $D$ columns.