Advanced Integrations#

Use these guides when the extension changes backend integration, weight transport, or reward-model workflows instead of adding a primary model or environment.

Guide

What you get

Megatron-Bridge

Use the Megatron-Bridge actor backend.

Weight Synchronization

Optimize actor-to-rollout weight sync in embodied training.

Reward Model Workflow

Use image-classification and VLM reward models.