Skip to content

Add person ReID embedding utilities and source-exact retrieval protocols - #30

Merged
parkjinman98 merged 6 commits into
mainfrom
feat/reid-embedding-c1
Nov 4, 2026
Merged

parkjinman98 merged 6 commits into
mainfrom
feat/reid-embedding-c1

Conversation

@parkjinman98

Copy link
Copy Markdown
Contributor

Summary

Stacked on #28 (281b8683f42342e6fdd57764b76ba1f39ded2356), not independently mergeable before that base. Stage c1 only; published model/HF YAMLs are deferred to stage d2.

  • Add reusable EmbeddingPost and dataset-bound PersonReIDPost, selected by configuration, plus opt-in processing family bases.
  • Add Market-1501, DukeMTMC-reID and Occluded-Duke prepared query/gallery loaders with identity/camera metadata and source-pinned dataset YAMLs.
  • Add retrieval evaluator subclasses and ordered batched embedding extraction. Preserve source float32 squared distance, stable ties, same-ID/same-camera exclusion, unmatched-query omission, Market junk filtering and retained background distractors.
  • Add explicit mean/std normalization without changing historical named-style arithmetic. Public utility exports are available from mblt_vision.person_reid; CLI routing and benchmark support remain unchanged.

Validation (CPU only)

  • Offline suite: 1405 passed, 16 deselected. No hardware, downloaded models or benchmark data.
  • Focused inheritance/ReID suite: 654 passed, including all 595 existing variants, ordered operation mappings and artifact-name identity.
  • Numeric metric parity: pinned verbatim ops reference, 10 synthetic seeds × 4 max-rank values; squared distances, CMC arrays and unrounded mAP match exactly.
  • Preprocessing parity: 3 synthetic RGB image sizes × 2 source statistics profiles, ops adapter vs utility pipeline; byte equality, max absolute error 0, atol=0.
  • Wheel built and checked for new dataset/base YAMLs and utility modules; development assets/tests absent. Ruff new/changed processing modules and git diff --check pass.

Provenance / boundaries

Exact read-only ops source: ec537764e36ca10da963fcb7afab157ea60ca022, datasets/_shared/reid.py, each dataset private loader/evaluator/config and models/person_reid/_shared/preprocess.py. Test references are pinned offline snapshots. Dataset YAML source/evaluation blocks include exact paths and revision.

No inference/accuracy claim, HF mutation, redistribution of sample data, GPU/NPU use or --execute. No OBB/DOTA, CLI routing or version changes. Camera-aware multi-input models are not claimed by this utility-only stage.

🤖 Generated with Claude Code

parkjinman98 and others added 2 commits November 4, 2026 16:22
Preserve existing alias and update semantics across 334 configs and 595 variants. Add ordered resolution and CPU preprocessing regression tests without changing shipped model definitions.

Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
…tocol scoring

Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-04T09:22:08.791267Z 1e70398 Manual request
🔒 Security Review ✅ Completed 2026-11-04T09:24:52.032248Z 1e70398 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c1289eb095

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread mblt_vision/person_reid/__init__.py Resolved
Comment thread mblt_vision/_tasks.py Resolved
Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
@parkjinman98

Copy link
Copy Markdown
Contributor Author

@codex review

Review exact head 81a3727893009bbb65a667e6d10ba5e6f30bd148 (stacked on #28).

Fixed all three first-round threads: engine postprocess now retains validated matrices in Results.embeddings/output; generic EmbeddingPost is exported from mblt_vision.person_reid; dataset_ready supports Market-1501/DukeMTMC-reID/Occluded-Duke with source counts, names/cameras and full image decoding. Threads 4464940725, 4464940730, 4464940742 have replies and are resolved.

Please check the engine Results contract and invalid result inputs, the public import, and valid/incomplete/corrupt readiness fixtures. Offline CPU: 1409 passed, 16 deselected; existing protocol/preprocessing parity and 595 variant identity tests remain green. No OBB/DOTA, CLI routing or version changes.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🎉

Reviewed commit: 81a3727893

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 81a3727893

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@parkjinman98
parkjinman98 changed the base branch from feat/config-inheritance-coverage to main November 4, 2026 08:10
Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
@parkjinman98

Copy link
Copy Markdown
Contributor Author

@codex review

Exact head 6271d5a4212db0143d4794a324614bd99d86ee21. main merge only, own diff unchanged. Integrated squash-merged #28/main 9a81fb52 using a merge commit, no force push. The complete binary diff against current main is byte-for-byte identical to the previous own diff against original #28 head 281b8683; no feature behavior changes. Integration was conflict-free; both guide and README additions are preserved.

Full offline CPU after integration: 1413 passed, 16 deselected. Existing all-595 variant identity proof remains green. Please review this exact integration head; dependent PRs #31/#32 have been retargeted to main before any parent branch deletion. Squash merge will occur only after exact-head agent approval.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Bravo.

Reviewed commit: 6271d5a421

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 6271d5a421

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
@parkjinman98

Copy link
Copy Markdown
Contributor Author

@codex review

Exact head 3414b781f5aca4fa2e91c79b651343953fceee49 after merging main 89a44a83 (squash #29), no force push. main merge only, own diff unchanged. Proved by applying the original own patch to current main in an isolated Git index and comparing the entire resulting tree: exact match.

Full offline CPU 1425 passed,19 deselected. Includes all595 legacy variant identities. No version bump, release, tag or publish. Review exact head before squash merge.

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 3414b781f5

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 3414b781f5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread mblt_vision/utils/datasets/reid.py Resolved
Comment thread mblt_vision/utils/datasets/readiness.py Resolved
Omit uncomputed rank metrics for truncated CMC, reject negative IDs below junk marker and reject symlinked roots or split ancestors.

Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
@parkjinman98

Copy link
Copy Markdown
Contributor Author

@codex review

Exact head 1e70398bc39a0b2e0175fd1bff060242edde19b2. Fixed/resolved all three latest findings: truncated rank reporting, unsupported negative identities, and symlinked cache roots/split ancestors. New focused regressions plus source-parity tests 53 passed; full offline CPU 1430 passed,19 deselected, all595 legacy identities included. Please check gallery-count-aware rank reporting and readiness boundary handling. No version/publish changes. This is a real fix follow-up to main integration, so own diff changed only by these reviewed fixes.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 👍

Reviewed commit: 1e70398bc3

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: 1e70398bc3

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@parkjinman98
parkjinman98 merged commit c7cf545 into main Nov 4, 2026
21 checks passed
@parkjinman98
parkjinman98 deleted the feat/reid-embedding-c1 branch November 4, 2026 09:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant