Rollout Engines#
Use these guides to bring up the inference engines RLinf rollouts talk to over HTTP — server-side processes you launch alongside (or independently of) your training run, plus the client used to call them.
Guide |
What you get |
|---|---|
Launch an sglang HTTP server group and an sglang router, with a single
OpenAI-compatible endpoint for |
|
Send sync and async |
|
Switch between SGLang versions for the rollout engine. |