Extending#
Use Extending when you add a model, environment, or advanced integration path to RLinf.
Extending Overview
Where each extension point lives and how the pieces fit together.
New Environment
Add a new RL environment and wire it into the env registry.
New Model with FSDP
Add a HuggingFace model on the FSDP backend.
New Model with Megatron
Add a HuggingFace model on the Megatron+SGLang backend.
New SFT Model
Plug a new model into the SFT training flow.
Advanced Integrations
Add Megatron-Bridge and weight synchronization workflows.
SGLang Embodied Model
Adapt the embodied model to the RLinf rollout worker using the sglang backend, and use various simulators to evaluate the model.