Hardware Backends#

Use these guides when the runtime depends on a specific accelerator stack or SGLang version.

Guide

What you get

AMD ROCm

Run on AMD ROCm accelerators.

Ascend CANN

Run on Ascend CANN accelerators.

SGLang Version Switching

Switch between SGLang versions.