LLM

Refer to the applicable guides to optimize LLM/vLLM usecase performance.

Note

Radeon GPUs do not support vLLM usecases on Windows OS.

LLM

• Install Huggingface transformers