Extending#

Use Extending when you add a model, environment, or advanced integration path to RLinf.

Extending Overview

Where each extension point lives and how the pieces fit together.

Extending the Framework
New Environment

Add a new RL environment and wire it into the env registry.

Adding New Environment
New Model with FSDP

Add a HuggingFace model on the FSDP backend.

Adding New Models with FSDP+HuggingFace
New Model with Megatron

Add a HuggingFace model on the Megatron+SGLang backend.

Adding New Models with Megatron+SGLang
New SFT Model

Plug a new model into the SFT training flow.

Add a New Model for SFT Training with FSDP + HuggingFace
Advanced Integrations

Add Megatron-Bridge, weight synchronization, or reward model workflows.

Advanced Integrations