This page contains proposed changes for a future release of ROCm. Read the latest Linux release of ROCm documentation for your production environments.

RotaryPositionalEmbeddings

RotaryPositionalEmbeddings#

MIOpen: RotaryPositionalEmbeddings
RotaryPositionalEmbeddings

Functions

miopenStatus_t miopenRoPEForward (miopenHandle_t handle, const miopenTensorDescriptor_t xDesc, const void *x, const miopenTensorDescriptor_t cosDesc, const void *cos, const miopenTensorDescriptor_t sinDesc, const void *sin, const miopenTensorDescriptor_t yDesc, void *y)
 Execute a rope forward layer. More...
 
miopenStatus_t miopenRoPEBackward (miopenHandle_t handle, const miopenTensorDescriptor_t dyDesc, const void *dy, const miopenTensorDescriptor_t cosDesc, const void *cos, const miopenTensorDescriptor_t sinDesc, const void *sin, const miopenTensorDescriptor_t dxDesc, void *dx)
 Execute a rope backward layer. More...
 

Detailed Description

Function Documentation

◆ miopenRoPEBackward()

miopenStatus_t miopenRoPEBackward ( miopenHandle_t  handle,
const miopenTensorDescriptor_t  dyDesc,
const void *  dy,
const miopenTensorDescriptor_t  cosDesc,
const void *  cos,
const miopenTensorDescriptor_t  sinDesc,
const void *  sin,
const miopenTensorDescriptor_t  dxDesc,
void *  dx 
)

Execute a rope backward layer.

Parameters
[in]handleMIOpen handle
[in]dyDescTensor descriptor for data input tensor dy
[in]dyData tensor dy
[in]cosDescTensor descriptor for output data tensor cos
[in]cosData tensor cos
[in]sinDescTensor descriptor for data input tensor sin
[in]sinData tensor sin
[in]dxDescTensor descriptor for output data tensor dx
[out]dxData tensor dx
Returns
miopenStatus_t
Examples
/home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-miopen/checkouts/develop/include/miopen/miopen.h.

◆ miopenRoPEForward()

miopenStatus_t miopenRoPEForward ( miopenHandle_t  handle,
const miopenTensorDescriptor_t  xDesc,
const void *  x,
const miopenTensorDescriptor_t  cosDesc,
const void *  cos,
const miopenTensorDescriptor_t  sinDesc,
const void *  sin,
const miopenTensorDescriptor_t  yDesc,
void *  y 
)

Execute a rope forward layer.

Parameters
[in]handleMIOpen handle
[in]xDescTensor descriptor for data input tensor x
[in]xData tensor x
[in]cosDescTensor descriptor for data input tensor cos
[in]cosData tensor cos
[in]sinDescTensor descriptor for data input tensor sin
[in]sinData tensor sin
[in]yDescTensor descriptor for output data tensor y
[out]yData tensor y
Returns
miopenStatus_t
Examples
/home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-miopen/checkouts/develop/include/miopen/miopen.h.