Skip to content

Mocap follow-up: activate SAM 3D Body quality backend for --body #920

Description

@fernandotonon

Follow-up to #869 (shipped in PR #909).

Body capture currently uses the MediaPipe Pose + PoseIKSolver + canonical retarget path (--algo pose-ik, the default and only active backend). The SAM 3D Body "quality" backend is dispatched in code but falls back to Pose-IK because its checkpoints are HF-gated (Meta SAM License access pending). This was the planned degradation (epic #869 risk #3).

To activate:

  • Obtain SAM 3D Body checkpoint access; confirm the SAM License permits rehosting the converted ONNX on the fernandotonon/QtMeshEditor-models HF repo (record the verdict in THIRD_PARTY_AI_MODELS.md).
  • Export to ONNX (a community C++ port exists: AmmarkoV/SAM3DBody-cpp) and host under mocap/body/ (or similar).
  • Flip the dispatch in MocapRecorder/MocapCLI so --algo sam3dbody uses the real backend; the fallback + algorithmUsed/fallbackReason reporting already exists.
  • Add a catalog entry in AIModelCatalog (the mocap face/body entries are the pattern).

No architectural change needed — the plumbing is complete; this is model hosting + dispatch enablement.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions