Skip to content

feat(gym): persist stable rollout attempt identity - #4085

Closed
ananthsub wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/gym-rollout-checkpoint-identity
Closed

feat(gym): persist stable rollout attempt identity#4085
ananthsub wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
ananthsub:ananthsub/gym-rollout-checkpoint-identity

Conversation

@ananthsub

@ananthsub ananthsub commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Summary

  • assign one stable logical _ng_rollout_id to each prompt sibling
  • allocate numeric _ng_attempt_index values only when a sibling is dispatched
  • preserve attempt allocation across partial row redispatch, outer retries, and rollout recovery
  • derive Gym capture keys as <logical> for attempt 0 and <logical>-a<N> for later attempts
  • bump rollout recovery state to schema v3 and reject unmigratable UUID-based v2 state with guidance

This is the first PR in the NeMo Gym checkpoint integration stack. It intentionally excludes the NemoGym checkpoint participant and SingleController orchestration. The dependent actor PR will pin the matching Gym stack and add cross-repository checkpoint lifecycle tests.

Related Gym tracking issue: NVIDIA-NeMo/Gym#3024

Validation

  • focused rollout identity, manager, recovery, failure, redispatch, and NemoGym actor tests: 202 passed
  • native redispatch suite: 25 passed
  • capture-key compatibility and receipt lookup tests: passed
  • Ruff and formatting: passed
  • Pyrefly: 0 errors (run with the shared complete checkout because isolated worktree dependency submodules are absent)

Stack

Dependent actor participant: RL#4088.

Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Sep 10, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@ananthsub

Copy link
Copy Markdown
Contributor Author

Superseded by a GitHub Stack whose branches are owned by NVIDIA-NeMo/RL rather than a fork.

@ananthsub ananthsub closed this Sep 10, 2026
@ananthsub
ananthsub deleted the ananthsub/gym-rollout-checkpoint-identity branch September 10, 2026 22:35
@ananthsub

Copy link
Copy Markdown
Contributor Author

Replacement upstream-owned GitHub Stack: #4092#4093.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant