Skip to content

Frontend 2/5 speedup: Persistent RoMa compilation - #13

Merged
Zador-Pataki merged 2 commits into
mainfrom
zador/frontend-speedup-02-compile
Sep 21, 2026
Merged

Zador-Pataki merged 2 commits into
mainfrom
zador/frontend-speedup-02-compile

Conversation

@Zador-Pataki

Copy link
Copy Markdown
Collaborator

Changes

  • Save RoMa model state and compiled programs to skip construction and graph capture in new processes.
  • Make RoMa wrappers serializable with PyTorch while retaining descriptor normalization.
  • Validate cached programs with identities and checksums; lock and publish entries atomically.
  • Isolate internal cache lookup during compilation to prevent PyTorch's seeded cache-key collision.

Older PyTorch versions without program persistence use ordinary compilation.

Impact

Shortened LaMAR HGE sequence: 589 images, 63 keyframes.

Frontend: 136.682 → 103.127 s (33.554 s saved, 24.55%).

Median of three fresh local RTX 4090 runs with warm caches.

@Zador-Pataki
Zador-Pataki changed the base branch from zador/frontend-speedup-01-cpu to main September 21, 2026 22:15
@Zador-Pataki
Zador-Pataki merged commit ecc17fe into main Sep 21, 2026
1 check passed
@Zador-Pataki
Zador-Pataki deleted the zador/frontend-speedup-02-compile branch September 21, 2026 22:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant