Skip to content

Frontend 4/5 speedup: DA3 inference acceleration - #15

Merged
Zador-Pataki merged 2 commits into
mainfrom
zador/frontend-speedup-04-da3
Sep 21, 2026
Merged

Zador-Pataki merged 2 commits into
mainfrom
zador/frontend-speedup-04-da3

Conversation

@Zador-Pataki

Copy link
Copy Markdown
Collaborator

Changes

  • Speed up model construction and weight loading.
  • Compile and save the backbones and depth heads.
  • Batch four independent windows.
  • Skip unused ray predictions while retaining depth, confidence and camera-derived intrinsics.
  • Release finished weights without copying them to the CPU.

Impact

Shortened LaMAR HGE sequence: 589 images, 61 keyframes.

Frontend: 72.940 → 63.988 s (8.952 s saved, 12.27%).

Median of three fresh local RTX 4090 runs with warm caches.

Component measurement (61 keyframes) Before (s) After (s) Saved (s)
Model construction and weight loading ≈9.60 ≈4.41 ≈5.19
Backbone compilation (estimated warm inference) 5.05 3.43 ≈1.62
Skip unused ray predictions (estimated warm inference) 3.41 3.01 ≈0.40
Depth-head compilation (estimated warm inference) 3.01 2.79 ≈0.22
Four-window batching (estimated warm inference) 2.79 2.21 ≈0.58
Release weights without CPU copy 1.974 0.168 1.806

@Zador-Pataki
Zador-Pataki changed the base branch from zador/frontend-speedup-03-roma to main September 21, 2026 22:17
@Zador-Pataki
Zador-Pataki merged commit fd49a55 into main Sep 21, 2026
1 check passed
@Zador-Pataki
Zador-Pataki deleted the zador/frontend-speedup-04-da3 branch September 21, 2026 22:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant