This page contains proposed changes for a future release of ROCm. Read the latest Linux release of ROCm documentation for your production environments.

hipBLASLtExt operation API reference#

hipBLASLt has the following extension operation APIs that are independent of GEMM operations. These extensions support the following:

  • hipblasltExtSoftmax

    Softmax for 2D tensor. It performs softmax on the second dimension of input tensor and assumes the input is contiguous on the second dimension. For sample code, see Softmax for a 2D tensor.

  • hipblasltExtLayerNorm

    Converts a 2D tensor using LayerNorm to generate a new 2D normalized tensor. This is an independent function used to call and get the result. For sample code, see Converting a 2D tensor using LayerNorm.

  • hipblasltExtAMax

    Determines the absolute maximum value of a 2D tensor. This is an independent function used to call and get the result. For sample code, see Absolute maximum value of a 2D Tensor.

  • hipblasltExtAMaxWithScale

    Determines the absolute maximum value and scaled output of a 2D tensor. This is an independent function used to call and get the result. For sample code, see Absolute maximum value and scaled output of a 2D tensor.

These APIs are explained in detail below.

hipblasltExtSoftmax()#

Warning

doxygenfunction: Cannot find function “hipblasltExtSoftmax” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasltExtLayerNorm()#

Warning

doxygenfunction: Cannot find function “hipblasltExtLayerNorm” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasltExtAMax()#

Warning

doxygenfunction: Cannot find function “hipblasltExtAMax” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml

hipblasltExtAMaxWithScale()#

Warning

doxygenfunction: Cannot find function “hipblasltExtAMaxWithScale” in doxygen xml output for project “hipBLASLt 0.15.0 Documentation” from directory: /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-hipblaslt/checkouts/develop/docs/doxygen/xml