hipBLASLt Datatypes Reference

hipblasLtEpilogue_t

enum hipblasLtEpilogue_t

Specify the enum type to set the postprocessing options for the epilogue.

Values:

enumerator HIPBLASLT_EPILOGUE_DEFAULT

No special postprocessing, just scale and quantize the results if necessary.

enumerator HIPBLASLT_EPILOGUE_RELU

Apply ReLU point-wise transform to the results:(x:=max(x, 0))

enumerator HIPBLASLT_EPILOGUE_BIAS

Apply (broadcast) bias from the bias vector. Bias vector length must match matrix D rows, and it must be packed (such as stride between vector elements is 1). Bias vector is broadcast to all columns and added before applying the final postprocessing.

enumerator HIPBLASLT_EPILOGUE_RELU_BIAS

Apply bias and then ReLU transform.

enumerator HIPBLASLT_EPILOGUE_GELU

Apply GELU point-wise transform to the results (x:=GELU(x)).

enumerator HIPBLASLT_EPILOGUE_GELU_BIAS

Apply Bias and then GELU transform.

hipblasLtHandle_t

typedef void *hipblasLtHandle_t

Handle to the hipBLASLt library context queue.

The hipblasLtHandle_t type is a pointer type to an opaque structure holding the hipBLASLt library context. Use the following functions to manipulate this library context:

hipblasLtCreate(): To initialize the hipBLASLt library context and return a handle to an opaque structure holding the hipBLASLt library context. hipblasLtDestroy(): To destroy a previously created hipBLASLt library context descriptor and release the resources.

hipblasLtMatmulAlgo_t

struct hipblasLtMatmulAlgo_t

Description of the matrix multiplication algorithm.

This is an opaque structure holding the description of the matrix multiplication algorithm. This structure can be trivially serialized and later restored for use with the same version of hipBLASLt library to save on selecting the right configuration again.

hipblasLtMatmulDesc_t

typedef hipblasLtMatmulDescOpaque_t *hipblasLtMatmulDesc_t

Descriptor of the matrix multiplication operation.

This is a pointer to an opaque structure holding the description of the matrix multiplication operation hipblasLtMatmul(). Use the following functions to manipulate this descriptor: hipblasLtMatmulDescCreate(): To create one instance of the descriptor. hipblasLtMatmulDescDestroy(): To destroy a previously created descriptor and release the resources.

hipblasLtMatmulDescAttributes_t

enum hipblasLtMatmulDescAttributes_t

Specify the attributes that define the specifics of the matrix multiply operation.

Values:

enumerator HIPBLASLT_MATMUL_DESC_TRANSA

Specifies the type of transformation operation that should be performed on matrix A. Default value is HIPBLAS_OP_N (for example, non-transpose operation). See hipblasOperation_t. Data Type:int32_t

enumerator HIPBLASLT_MATMUL_DESC_TRANSB

Specifies the type of transformation operation that should be performed on matrix B. Default value is HIPBLAS_OP_N (for example, non-transpose operation). See hipblasOperation_t. Data Type:int32_t

enumerator HIPBLASLT_MATMUL_DESC_EPILOGUE

Epilogue function. See hipblasLtEpilogue_t. Default value is: HIPBLASLT_EPILOGUE_DEFAULT. Data Type: uint32_t

enumerator HIPBLASLT_MATMUL_DESC_BIAS_POINTER

Bias or Bias gradient vector pointer in the device memory. Data Type:void* /const void*

enumerator HIPBLASLT_MATMUL_DESC_BIAS_DATA_TYPE

Type of the bias vector in the device memory. Can be set same as D matrix type or Scale type. Bias case: see HIPBLASLT_EPILOGUE_BIAS. Data Type:int32_t based on hipblasDatatype_t

enumerator HIPBLASLT_MATMUL_DESC_D_SCALE_POINTER

D scale vector length must match matrix D rows. It must match Scale data type. D scale vector is broadcast to all columns and multipied after final postprocssion. Data Type: void* /const void*

enumerator HIPBLASLT_MATMUL_DESC_MAX

hipblasLtMatmulHeuristicResult_t

struct hipblasLtMatmulHeuristicResult_t

Description of the matrix multiplication algorithm.

This is a descriptor that holds the configured matrix multiplication algorithm descriptor and its runtime properties. This structure can be trivially serialized and later restored for use with the same version of hipBLASLt library to save on selecting the right configuration again.

hipblasLtMatmulPreference_t

typedef hipblasLtMatmulPreferenceOpaque_t *hipblasLtMatmulPreference_t

Descriptor of the matrix multiplication preference.

This is a pointer to an opaque structure holding the description of the preferences for hipblasLtMatmulAlgoGetHeuristic() configuration. Use the following functions to manipulate this descriptor: hipblasLtMatmulPreferenceCreate(): To create one instance of the descriptor. hipblasLtMatmulPreferenceDestroy(): To destroy a previously created descriptor and release the resources.

hipblasLtMatmulPreferenceAttributes_t

enum hipblasLtMatmulPreferenceAttributes_t

It is an enumerated type used to apply algorithm search preferences while fine-tuning the heuristic function.

Values:

enumerator HIPBLASLT_MATMUL_PREF_SEARCH_MODE

Search mode. Data Type: uint32_t

enumerator HIPBLASLT_MATMUL_PREF_MAX_WORKSPACE_BYTES

Maximum allowed workspace memory. Default is 0 (no workspace memory allowed). Data Type: uint64_t

enumerator HIPBLASLT_MATMUL_PREF_MAX

hipblasLtMatrixLayout_t

typedef hipblasLtMatrixLayoutOpaque_t *hipblasLtMatrixLayout_t

Descriptor of the matrix layout.

This is a pointer to an opaque structure holding the description of a matrix layout. Use the following functions to manipulate this descriptor: hipblasLtMatrixLayoutCreate(): To create one instance of the descriptor. hipblasLtMatrixLayoutDestroy(): To destroy a previously created descriptor and release the resources.

hipblasLtMatrixLayoutAttribute_t

enum hipblasLtMatrixLayoutAttribute_t

Specify the attributes that define the details of the matrix.

Values:

enumerator HIPBLASLT_MATRIX_LAYOUT_BATCH_COUNT

Number of batch of this matrix. Default value is 1. Data Type: int32_t

enumerator HIPBLASLT_MATRIX_LAYOUT_STRIDED_BATCH_OFFSET

Stride (in elements) to the next matrix for the strided batch operation. Default value is 0. Data Type: int64_t

hipBLASLt API Reference

hipblasLtCreate()

hipblasStatus_t hipblasLtCreate(hipblasLtHandle_t *handle)

Create a hipblaslt handle.

This function initializes the hipBLASLt library and creates a handle to an opaque structure holding the hipBLASLt library context. It allocates light hardware resources on the host and device, and must be called prior to making any other hipBLASLt library calls. The hipBLASLt library context is tied to the current CUDA device. To use the library on multiple devices, one hipBLASLt handle should be created for each device.

Parameters:

handle – [out] Pointer to the allocated hipBLASLt handle for the created hipBLASLt context.

Return values:

• HIPBLAS_STATUS_SUCCESS – The allocation completed successfully.

• HIPBLAS_STATUS_INVALID_VALUE – handle == NULL.

hipblasLtDestroy()

hipblasStatus_t hipblasLtDestroy(const hipblasLtHandle_t handle)

Destory a hipblaslt handle.

This function releases hardware resources used by the hipBLASLt library. This function is usually the last call with a particular handle to the hipBLASLt library. Because hipblasLtCreate() allocates some internal resources and the release of those resources by calling hipblasLtDestroy() will implicitly call hipDeviceSynchronize(), it is recommended to minimize the number of hipblasLtCreate()/hipblasLtDestroy() occurrences.

Parameters:

handle – [in] Pointer to the hipBLASLt handle to be destroyed.

Return values:

• HIPBLAS_STATUS_SUCCESS – The hipBLASLt context was successfully destroyed.

• HIPBLAS_STATUS_NOT_INITIALIZED – The hipBLASLt library was not initialized.

• HIPBLAS_STATUS_INVALID_VALUE – handle == NULL.

hipblasLtMatrixLayoutCreate()

hipblasStatus_t hipblasLtMatrixLayoutCreate(hipblasLtMatrixLayout_t *matLayout, hipblasDatatype_t type, uint64_t rows, uint64_t cols, int64_t ld)

Create a matrix layout descriptor.

This function creates a matrix layout descriptor by allocating the memory needed to hold its opaque structure.

Parameters:

• matLayout – [out] Pointer to the structure holding the matrix layout descriptor created by this function. see hipblasLtMatrixLayout_t .

• type – [in] Enumerant that specifies the data precision for the matrix layout descriptor this function creates. See hipblasDataType_t.

• rows – [in] Number of rows of the matrix.

• cols – [in] Number of columns of the matrix.

• ld – [in] The leading dimension of the matrix. In column major layout, this is the number of elements to jump to reach the next column. Thus ld >= m (number of rows).

Return values:

• HIPBLAS_STATUS_SUCCESS – If the descriptor was created successfully.

• HIPBLAS_STATUS_ALLOC_FAILED – If the memory could not be allocated.

hipblasLtMatrixLayoutDestroy()

hipblasStatus_t hipblasLtMatrixLayoutDestroy(const hipblasLtMatrixLayout_t matLayout)

Destory a matrix layout descriptor.

This function destroys a previously created matrix layout descriptor object.

Parameters:

matLayout – [in] Pointer to the structure holding the matrix layout descriptor that should be destroyed by this function. see hipblasLtMatrixLayout_t .

Return values:

HIPBLAS_STATUS_SUCCESS – If the operation was successful.

hipblasLtMatrixLayoutSetAttribute()

hipblasStatus_t hipblasLtMatrixLayoutSetAttribute(hipblasLtMatrixLayout_t matLayout, hipblasLtMatrixLayoutAttribute_t attr, const void *buf, size_t sizeInBytes)

Set attribute to a matrix descriptor.

This function sets the value of the specified attribute belonging to a previously created matrix descriptor.

Parameters:

• matLayout – [in] Pointer to the previously created structure holding the matrix mdescriptor queried by this function. See hipblasLtMatrixLayout_t

• attr – [in] The attribute that will be set by this function. See hipblasLtMatrixLayoutAttribute_t.

• buf – [in] The value to which the specified attribute should be set.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

Return values:

• HIPBLAS_STATUS_SUCCESS – If the attribute was set successfully..

• HIPBLAS_STATUS_INVALID_VALUE – If buf is NULL or sizeInBytes doesn’t match the size of the internal storage for the selected attribute.

hipblasLtMatrixLayoutGetAttribute()

hipblasStatus_t hipblasLtMatrixLayoutGetAttribute(hipblasLtMatrixLayout_t matLayout, hipblasLtMatrixLayoutAttribute_t attr, void *buf, size_t sizeInBytes, size_t *sizeWritten)

Query attribute from a matrix descriptor.

This function returns the value of the queried attribute belonging to a previously created matrix descriptor.

Parameters:

• matLayout – [in] Pointer to the previously created structure holding the matrix descriptor queried by this function. See hipblasLtMatrixLayout_t

• attr – [in] The attribute that will be retrieved by this function. See hipblasLtMatrixLayoutAttribute_t.

• buf – [out] Memory address containing the attribute value retrieved by this function.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

• sizeWritten – [out] Valid only when the return value is HIPBLAS_STATUS_SUCCESS. If sizeInBytes is non-zero: then sizeWritten is the number of bytes actually written; if sizeInBytes is 0: then sizeWritten is the number of bytes needed to write full contents.

Return values:

• HIPBLAS_STATUS_SUCCESS – If attribute’s value was successfully written to user memory.

• HIPBLAS_STATUS_INVALID_VALUE – If sizeInBytes is 0 and sizeWritten is NULL, or if sizeInBytes is non-zero and buf is NULL, or sizeInBytes doesn’t match size of internal storage for the selected attribute.

hipblasLtMatmulDescCreate()

hipblasStatus_t hipblasLtMatmulDescCreate(hipblasLtMatmulDesc_t *matmulDesc, hipblasLtComputeType_t computeType, hipblasDatatype_t scaleType)

Create a matrix multiply descriptor.

This function creates a matrix multiply descriptor by allocating the memory needed to hold its opaque structure.

Parameters:

• matmulDesc – [out] Pointer to the structure holding the matrix multiply descriptor created by this function. See hipblasLtMatmulDesc_t .

• computeType – [in] Enumerant that specifies the data precision for the matrix multiply descriptor this function creates. See hipblasLtComputeType_t .

• scaleType – [in] Enumerant that specifies the data precision for the matrix transform descriptor this function creates. See hipblasDataType_t.

Return values:

• HIPBLAS_STATUS_SUCCESS – If the descriptor was created successfully.

• HIPBLAS_STATUS_ALLOC_FAILED – If the memory could not be allocated.

hipblasLtMatmulDescDestroy()

hipblasStatus_t hipblasLtMatmulDescDestroy(const hipblasLtMatmulDesc_t matmulDesc)

Destory a matrix multiply descriptor.

This function destroys a previously created matrix multiply descriptor object.

Parameters:

matmulDesc – [in] Pointer to the structure holding the matrix multiply descriptor that should be destroyed by this function. See hipblasLtMatmulDesc_t .

Return values:

HIPBLAS_STATUS_SUCCESS – If operation was successful.

hipblasLtMatmulDescSetAttribute()

hipblasStatus_t hipblasLtMatmulDescSetAttribute(hipblasLtMatmulDesc_t matmulDesc, hipblasLtMatmulDescAttributes_t attr, const void *buf, size_t sizeInBytes)

Set attribute to a matrix multiply descriptor.

This function sets the value of the specified attribute belonging to a previously created matrix multiply descriptor.

Parameters:

• matmulDesc – [in] Pointer to the previously created structure holding the matrix multiply descriptor queried by this function. See hipblasLtMatmulDesc_t

• attr – [in] The attribute that will be set by this function. See hipblasLtMatmulDescAttributes_t.

• buf – [in] The value to which the specified attribute should be set.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

Return values:

• HIPBLAS_STATUS_SUCCESS – If the attribute was set successfully..

• HIPBLAS_STATUS_INVALID_VALUE – If buf is NULL or sizeInBytes doesn’t match the size of the internal storage for the selected attribute.

hipblasLtMatmulDescGetAttribute()

hipblasStatus_t hipblasLtMatmulDescGetAttribute(hipblasLtMatmulDesc_t matmulDesc, hipblasLtMatmulDescAttributes_t attr, void *buf, size_t sizeInBytes, size_t *sizeWritten)

Query attribute from a matrix multiply descriptor.

This function returns the value of the queried attribute belonging to a previously created matrix multiply descriptor.

Parameters:

• matmulDesc – [in] Pointer to the previously created structure holding the matrix multiply descriptor queried by this function. See hipblasLtMatmulDesc_t

• attr – [in] The attribute that will be retrieved by this function. See hipblasLtMatmulDescAttributes_t.

• buf – [out] Memory address containing the attribute value retrieved by this function.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

• sizeWritten – [out] Valid only when the return value is HIPBLAS_STATUS_SUCCESS. If sizeInBytes is non-zero: then sizeWritten is the number of bytes actually written; if sizeInBytes is 0: then sizeWritten is the number of bytes needed to write full contents.

Return values:

• HIPBLAS_STATUS_SUCCESS – If attribute’s value was successfully written to user memory.

• HIPBLAS_STATUS_INVALID_VALUE – If sizeInBytes is 0 and sizeWritten is NULL, or if sizeInBytes is non-zero and buf is NULL, or sizeInBytes doesn’t match size of internal storage for the selected attribute.

hipblasLtMatmulPreferenceCreate()

hipblasStatus_t hipblasLtMatmulPreferenceCreate(hipblasLtMatmulPreference_t *pref)

Create a preference descriptor.

This function creates a matrix multiply heuristic search preferences descriptor by allocating the memory needed to hold its opaque structure.

Parameters:

pref – [out] Pointer to the structure holding the matrix multiply preferences descriptor created by this function. see hipblasLtMatmulPreference_t .

Return values:

• HIPBLAS_STATUS_SUCCESS – If the descriptor was created successfully.

• HIPBLAS_STATUS_ALLOC_FAILED – If memory could not be allocated.

hipblasLtMatmulPreferenceDestroy()

hipblasStatus_t hipblasLtMatmulPreferenceDestroy(const hipblasLtMatmulPreference_t pref)

Destory a preferences descriptor.

This function destroys a previously created matrix multiply preferences descriptor object.

Parameters:

pref – [in] Pointer to the structure holding the matrix multiply preferences descriptor that should be destroyed by this function. See hipblasLtMatmulPreference_t .

Return values:

HIPBLAS_STATUS_SUCCESS – If operation was successful.

hipblasLtMatmulPreferenceSetAttribute()

hipblasStatus_t hipblasLtMatmulPreferenceSetAttribute(hipblasLtMatmulPreference_t pref, hipblasLtMatmulPreferenceAttributes_t attr, const void *buf, size_t sizeInBytes)

Set attribute to a preference descriptor.

This function sets the value of the specified attribute belonging to a previously created matrix multiply preferences descriptor.

Parameters:

• pref – [in] Pointer to the previously created structure holding the matrix multiply preferences descriptor queried by this function. See hipblasLtMatmulPreference_t

• attr – [in] The attribute that will be set by this function. See hipblasLtMatmulPreferenceAttributes_t.

• buf – [in] The value to which the specified attribute should be set.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

Return values:

• HIPBLAS_STATUS_SUCCESS – If the attribute was set successfully..

• HIPBLAS_STATUS_INVALID_VALUE – If buf is NULL or sizeInBytes doesn’t match the size of the internal storage for the selected attribute.

hipblasLtMatmulPreferenceGetAttribute()

hipblasStatus_t hipblasLtMatmulPreferenceGetAttribute(hipblasLtMatmulPreference_t pref, hipblasLtMatmulPreferenceAttributes_t attr, void *buf, size_t sizeInBytes, size_t *sizeWritten)

Query attribute from a preference descriptor.

This function returns the value of the queried attribute belonging to a previously created matrix multiply heuristic search preferences descriptor.

Parameters:

• pref – [in] Pointer to the previously created structure holding the matrix multiply heuristic search preferences descriptor queried by this function. See hipblasLtMatmulPreference_t.

• attr – [in] The attribute that will be retrieved by this function. See hipblasLtMatmulPreferenceAttributes_t.

• buf – [out] Memory address containing the attribute value retrieved by this function.

• sizeInBytes – [in] Size of buf buffer (in bytes) for verification.

• sizeWritten – [out] Valid only when the return value is HIPBLAS_STATUS_SUCCESS. If sizeInBytes is non-zero: then sizeWritten is the number of bytes actually written; if sizeInBytes is 0: then sizeWritten is the number of bytes needed to write full contents.

Return values:

• HIPBLAS_STATUS_SUCCESS – If attribute’s value was successfully written to user memory.

• HIPBLAS_STATUS_INVALID_VALUE – If sizeInBytes is 0 and sizeWritten is NULL, or if sizeInBytes is non-zero and buf is NULL, or sizeInBytes doesn’t match size of internal storage for the selected attribute.

hipblasLtMatmulAlgoGetHeuristic()

hipblasStatus_t hipblasLtMatmulAlgoGetHeuristic(hipblasLtHandle_t handle, hipblasLtMatmulDesc_t matmulDesc, hipblasLtMatrixLayout_t Adesc, hipblasLtMatrixLayout_t Bdesc, hipblasLtMatrixLayout_t Cdesc, hipblasLtMatrixLayout_t Ddesc, hipblasLtMatmulPreference_t pref, int requestedAlgoCount, hipblasLtMatmulHeuristicResult_t heuristicResultsArray[], int *returnAlgoCount)

Retrieve the possible algorithms.

This function retrieves the possible algorithms for the matrix multiply operation hipblasLtMatmul() function with the given input matrices A, B and C, and the output matrix D. The output is placed in heuristicResultsArray[] in the order of increasing estimated compute time.

Parameters:

• handle – [in] Pointer to the allocated hipBLASLt handle for the hipBLASLt context. See hipblasLtHandle_t .

• matmulDesc – [in] Handle to a previously created matrix multiplication descriptor of type hipblasLtMatmulDesc_t .

• Adesc, Bdesc, Cdesc, Ddesc – [in] Handles to the previously created matrix layout descriptors of the type hipblasLtMatrixLayout_t .

• pref – [in] Pointer to the structure holding the heuristic search preferences descriptor. See hipblasLtMatmulPreference_t .

• requestedAlgoCount – [in] Size of the heuristicResultsArray (in elements). This is the requested maximum number of algorithms to return.

• heuristicResultsArray[] – [out] Array containing the algorithm heuristics and associated runtime characteristics, returned by this function, in the order of increasing estimated compute time.

• returnAlgoCount – [out] Number of algorithms returned by this function. This is the number of heuristicResultsArray elements written.

Return values:

• HIPBLAS_STATUS_SUCCESS – If query was successful. Inspect heuristicResultsArray[0 to (returnAlgoCount -1)].state for the status of the results.

• HIPBLAS_STATUS_NOT_SUPPORTED – If no heuristic function available for current configuration.

• HIPBLAS_STATUS_INVALID_VALUE – If requestedAlgoCount is less or equal to zero.

hipblasLtMatmul()

hipblasStatus_t hipblasLtMatmul(hipblasLtHandle_t handle, hipblasLtMatmulDesc_t matmulDesc, const void *alpha, const void *A, hipblasLtMatrixLayout_t Adesc, const void *B, hipblasLtMatrixLayout_t Bdesc, const void *beta, const void *C, hipblasLtMatrixLayout_t Cdesc, void *D, hipblasLtMatrixLayout_t Ddesc, const hipblasLtMatmulAlgo_t *algo, void *workspace, size_t workspaceSizeInBytes, hipStream_t stream)

Retrieve the possible algorithms.

This function computes the matrix multiplication of matrices A and B to produce the output matrix D, according to the following operation: D = alpha*( A *B) + beta*( C ), where A, B, and C are input matrices, and alpha and beta are input scalars. Note: This function supports both in-place matrix multiplication (C == D and Cdesc == Ddesc) and out-of-place matrix multiplication (C != D, both matrices must have the same data type, number of rows, number of columns, batch size, and memory order). In the out-of-place case, the leading dimension of C can be different from the leading dimension of D. Specifically the leading dimension of C can be 0 to achieve row or column broadcast. If Cdesc is omitted, this function assumes it to be equal to Ddesc.

Parameters:

• handle – [in] Pointer to the allocated hipBLASLt handle for the hipBLASLt context. See hipblasLtHandle_t .

• matmulDesc – [in] Handle to a previously created matrix multiplication descriptor of type hipblasLtMatmulDesc_t .

• alpha, beta – [in] Pointers to the scalars used in the multiplication.

• Adesc, Bdesc, Cdesc, Ddesc – [in] Handles to the previously created matrix layout descriptors of the type hipblasLtMatrixLayout_t .

• A, B, C – [in] Pointers to the GPU memory associated with the corresponding descriptors Adesc, Bdesc and Cdesc .

• D – [out] Pointer to the GPU memory associated with the descriptor Ddesc .

• algo – [in] Handle for matrix multiplication algorithm to be used. See hipblasLtMatmulAlgo_t. When NULL, an implicit heuritics query with default search preferences will be performed to determine actual algorithm to use.

• workspace – [in] Pointer to the workspace buffer allocated in the GPU memory. Pointer must be 16B aligned (that is, lowest 4 bits of address must be 0).

• workspaceSizeInBytes – [in] Size of the workspace.

• stream – [in] The HIP stream where all the GPU work will be submitted.

Return values:

• HIPBLAS_STATUS_SUCCESS – If the operation completed successfully.

• HIPBLAS_STATUS_EXECUTION_FAILED – If HIP reported an execution error from the device.

• HIPBLAS_STATUS_ARCH_MISMATCH – If the configured operation cannot be run using the selected device.

• HIPBLAS_STATUS_NOT_SUPPORTED – If the current implementation on the selected device doesn’t support the configured operation.

• HIPBLAS_STATUS_INVALID_VALUE – If the parameters are unexpectedly NULL, in conflict or in an impossible configuration. For example, when workspaceSizeInBytes is less than workspace required by the configured algo.

• HIBLAS_STATUS_NOT_INITIALIZED – If hipBLASLt handle has not been initialized.

Datatypes Supported:

hipblasLtMatmul supports the following computeType, scaleType, Atype/Btype, Ctype/Dtype and Bias Type:

computeType	scaleType/Bias Type	Atype/Btype	Ctype/Dtype
HIPBLASLT_COMPUTE_F32	HIPBLAS_R_32F	HIPBLAS_R_32F	HIPBLAS_R_32F
HIPBLASLT_COMPUTE_F32	HIPBLAS_R_32F	HIPBLAS_R_16F	HIPBLAS_R_16F
HIPBLASLT_COMPUTE_F32	HIPBLAS_R_32F	HIPBLAS_R_16B	HIPBLAS_R_16B