hipBLASLt API reference

hipBLASLt API reference#

hipblasLtCreate()#

Warning

doxygenfunction: Cannot find function “hipblasLtCreate” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtDestroy()#

Warning

doxygenfunction: Cannot find function “hipblasLtDestroy” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixLayoutCreate()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixLayoutCreate” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixLayoutDestroy()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixLayoutDestroy” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixLayoutSetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixLayoutSetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixLayoutGetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixLayoutGetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulDescCreate()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulDescCreate” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulDescDestroy()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulDescDestroy” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulDescSetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulDescSetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulDescGetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulDescGetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulPreferenceCreate()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulPreferenceCreate” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulPreferenceDestroy()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulPreferenceDestroy” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulPreferenceSetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulPreferenceSetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulPreferenceGetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulPreferenceGetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmulAlgoGetHeuristic()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmulAlgoGetHeuristic” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatmul()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatmul” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

Supported data types#

hipblasLtMatmul supports the following computeType, scaleType, Bias type, Atype/Btype, and Ctype/Dtype:

computeType	scaleType/Bias type	Atype/Btype	Ctype/Dtype
HIPBLAS_COMPUTE_32F	HIP_R_32F	HIP_R_32F	HIP_R_32F
HIPBLAS_COMPUTE_32F_FAST_TF32	HIP_R_32F	HIP_R_32F	HIP_R_32F
HIPBLAS_COMPUTE_32F	HIP_R_32F	HIP_R_16F	HIP_R_16F
HIPBLAS_COMPUTE_32F	HIP_R_32F	HIP_R_16F	HIP_R_32F
HIPBLAS_COMPUTE_32F	HIP_R_32F	HIP_R_16BF	HIP_R_16BF

For FP8 type Matmul, hipBLASLt supports the type combinations shown in the following table:

This table uses simpler abbrieviations:
- FP16 means HIP_R_16F
- BF16 means HIP_R_16BF
- FP32 means HIP_R_32F
- FP8 means HIP_R_8F_E4M3
- BF8 means HIP_R_8F_E5M2
- FP8_FNUZ means HIP_R_8F_E4M3_FNUZ and
- BF8_FNUZ means HIP_R_8F_E5M2_FNUZ
The table applies to all transpose types (NN/NT/TT/TN).
Default bias type indicates the type when the bias type is not explicitly specified.

Atype	Btype	Ctype	Dtype	computeType	scaleA,B	scaleC,D	Bias type	Default bias type
FP8	FP8	FP16	FP16	FP32	Yes	No	FP32, FP16	FP16
		BF16	BF16				FP32, BF16	BF16
		FP32	FP32				FP32, BF16	BF16
		FP8	FP8			Yes	FP32, FP16	FP16
		BF8	BF8			Yes	FP32, FP16	FP16
	BF8	FP16	FP16			No	FP32, FP16	FP16
		BF16	BF16				FP32, BF16	BF16
		FP32	FP32				FP32, BF16	BF16
		FP8	FP8			Yes	FP32, FP16	FP16
		BF8	BF8			Yes	FP32, FP16	FP16
BF8	FP8	FP16	FP16			No	FP32, FP16	FP16
		BF16	BF16				FP32, BF16	BF16
		FP32	FP32				FP32, BF16	BF16
		FP8	FP8			Yes	FP32, FP16	FP16
		BF8	BF8			Yes	FP32, FP16	FP16
	BF8	FP16	FP16			No	FP32, FP16	FP16
		BF16	BF16				FP32, BF16	BF16
		FP32	FP32				FP32, BF16	BF16
		FP8	FP8			Yes	FP32, FP16	FP16
		BF8	BF8			Yes	FP32, FP16	FP16

To use special data ordering for HIPBLASLT_ORDER_COL16_4R8 and HIPBLASLT_ORDER_COL16_4R16 in hipblasLtMatmul for the gfx94x architecture, choose one of these valid combinations of transposes and orders of input and output matrices:

Atype	Btype	CType	DType	opA	opB	orderA	orderB	orderC	orderD
FP8	FP8	FP16	FP16	T	N	HIPBLASLT_ORDER_COL16_4R16	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL
FP8	FP8	BF16	BF16	T	N	HIPBLASLT_ORDER_COL16_4R16	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL
FP16	FP16	FP16	FP16	T	N	HIPBLASLT_ORDER_COL16_4R8	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL
BF16	BF16	BF16	BF16	T	N	HIPBLASLT_ORDER_COL16_4R8	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL	HIPBLASLT_ORDER_COL

hipblasLtMatrixTransformDescCreate()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixTransformDescCreate” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixTransformDescDestroy()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixTransformDescDestroy” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixTransformDescSetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixTransformDescSetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixTransformDescGetAttribute()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixTransformDescGetAttribute” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixTransform()#

Warning

doxygenfunction: Cannot find function “hipblasLtMatrixTransform” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasLtMatrixTransform supports the following Atype/Btype/Ctype and scaleType:

Atype/Btype/Ctype	scaleType
HIP_R_32F	HIP_R_32F
HIP_R_16F	HIP_R_32F/HIP_R_16F
HIP_R_16BF	HIP_R_32F
HIP_R_8I	HIP_R_32F
HIP_R_32I	HIP_R_32F

hipBLASLt API reference

Contents

hipBLASLt API reference#

hipblasLtCreate()#

hipblasLtDestroy()#

hipblasLtMatrixLayoutCreate()#

hipblasLtMatrixLayoutDestroy()#

hipblasLtMatrixLayoutSetAttribute()#

hipblasLtMatrixLayoutGetAttribute()#

hipblasLtMatmulDescCreate()#

hipblasLtMatmulDescDestroy()#

hipblasLtMatmulDescSetAttribute()#

hipblasLtMatmulDescGetAttribute()#

hipblasLtMatmulPreferenceCreate()#

hipblasLtMatmulPreferenceDestroy()#

hipblasLtMatmulPreferenceSetAttribute()#

hipblasLtMatmulPreferenceGetAttribute()#

hipblasLtMatmulAlgoGetHeuristic()#

hipblasLtMatmul()#

Supported data types#

hipblasLtMatrixTransformDescCreate()#

hipblasLtMatrixTransformDescDestroy()#

hipblasLtMatrixTransformDescSetAttribute()#

hipblasLtMatrixTransformDescGetAttribute()#

hipblasLtMatrixTransform()#