Repository navigation
fix: install versioned marketplace package directories - #3156
Daniel Meppiel (danielmeppiel) merged 18 commits into
Conversation
There was a problem hiding this comment.
Copilot review overview
🟡 Changes recommended
The Contents API path can still accept non-directory entries before the stricter Git tree check runs.
Review effort: Balanced
Findings: 1
Open (2)
What changed in this PR
Fixes installation of versioned marketplace package directories while preserving structured Git/path references.
Changes:
- Resolves dotted marketplace directories as explicit Git/path dependencies.
- Preserves structured identities during selective installs and dry runs.
- Adds Git tree validation and regression coverage.
| File | Description |
|---|---|
.apm/architecture/owners/install-deployment.json |
Registers package-selection ownership. |
scripts/architecture_linter/checks/install_dry_run_plan.py |
Guards structured selector usage. |
src/apm_cli/deps/github_downloader_validation.py |
Tightens Git tree probing. |
src/apm_cli/install/dry_run_plan.py |
Preserves interpreted dependency identities. |
src/apm_cli/install/package_selection.py |
Centralizes selector identity resolution. |
src/apm_cli/install/phases/resolve.py |
Uses structured references during filtering. |
src/apm_cli/marketplace/resolver.py |
Handles dotted marketplace directory paths. |
tests/integration/test_architecture_owner_rule_mutations.py |
Tests architecture guard enforcement. |
tests/integration/test_marketplace_versioned_directory_lifecycle.py |
Covers the complete install lifecycle. |
tests/unit/deps/test_github_downloader_validation.py |
Updates expected Git tree output. |
tests/unit/deps/test_versioned_directory_probe.py |
Tests tree, blob, symlink, and gitlink probes. |
tests/unit/install/phases/test_resolve_selective_update_plan.py |
Tests selective filtering and descendants. |
tests/unit/install/test_dry_run_render.py |
Tests dry-run identity preservation. |
tests/unit/marketplace/test_versioned_directory_resolution.py |
Tests classification and traversal rejection. |
💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Preserve the approved issue microsoft#3078 repair while incorporating current main before exact-head verification. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Fold the PR microsoft#3156 panel follow-ups without changing the approved issue microsoft#3078 boundary: retain reusable dependency sequences, distinguish explicit Git paths from shorthand, and keep one Unreleased Fixed section. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Keep recent MCP, specification and documentation changes intact before final exact-head verification. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve trusted current workflow updates without broadening the marketplace directory repair. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve main policy and audit ownership changes while retaining the bounded marketplace directory repair. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve the strict default relocation behavior and bounded prune opt-in from main while adding existing-requirement conformance evidence for issue microsoft#3078. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Exercise req-mf-008 through real pack, marketplace registration, dry-run, install, and lock replay for dotted Git directories. Reuse the existing lifecycle harness and regenerate conformance counts without a waiver or normative expansion. Update legacy conflict tests to patch DependencyReference at its canonical lookup site, preserving all assertions. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve upstream validation, transport fallback and architecture coverage before exact-head CI recovery validation. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Versioned marketplace directory recovery: ready for parent validationCurrent-head recommendation: Faithful integration and reviewThe approved scope is unchanged: consume versioned directories produced by After the first validated integration, main advanced with the separately delivered nested-hook metadata work. The second text-only preview again identified only CHANGELOG; the repository's union driver masks that conflict. Both pending entries remain under Unreleased, and the dated 0.34.0 section is byte-identical to current main. Apart from CHANGELOG, all PR-specific files are unchanged by the final integration, including the full mutation matrix. Original sama Pyb (@Pybsama) commits remain ancestors. The genuine prior full/delta reviews carry forward through this proof; no broad panel was restarted and no fresh panel was invented. Prior Both author-addressed Copilot threads remain resolved: directory-shaped Contents API responses and the test return annotation. Complete paginated discussion was refreshed without new substantive feedback. The Starlight marketplace guide and bundled usage resources remain consistent with the executed lifecycle; README is untouched. Final-head validation
Actual standard technical workflowsAll six completed successfully for the final published head, with actual job results verified:
Both CodeQL analyses match current synthetic merge Publication and landing boundaryThe previous published head was git push --force-with-lease=refs/heads/codex/fix-versioned-marketplace-dirs:6c441f848f7cb2838143b449a58721c86460db5d https://github.com/Pybsama/apm.git HEAD:refs/heads/codex/fix-versioned-marketplace-dirsGitHub reports MERGEABLE / BLOCKED, with all effective checks passed or correctly skipped. Parent validation and the explicitly authorized admin-bypass decision remain separate. This worker has not merged, queued, enabled auto-merge, requested reviewers, assigned anyone, changed policy or changed either item's open state. Counters are 4/4 outer iterations, 2/2 Copilot rounds, 1/3 CI recoveries, without reset. No unresolved in-scope findings or deferred items remain. Generated by autopilot-pr-merge-worker. This comment is AI-generated and may contain errors. |
Faithfully integrate current main for PR microsoft#3156. Preserve every release entry from both parents and carry forward the reviewed versioned-directory implementation and regression guards unchanged. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve the intervening Claude cleanup and dependency updates while retaining the reviewed marketplace repair. This is faithful integration, with no new product behavior or policy change. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Integrate main microsoft#3190 faithfully, preserving conservative historical output handling. Keep the unchanged microsoft#3156 entry within Unreleased Fixed but after existing entries to avoid repeated adjacent insert conflicts. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Faithfully retain both adjacent architecture-test additions without changing either decorated function or reviewed marketplace behavior. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Integrate main 65b3b9f without rewriting contributor history. Keep the published 0.34.0 notes unchanged, retain the pending microsoft#3156 note under Unreleased, and preserve the microsoft#3251 matrix coverage alongside both owner regressions. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
Preserve contributor ancestry and both Unreleased notes while incorporating the independently delivered nested-hook metadata work. All marketplace repair code and its regression matrix remain unchanged. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: f79e464c-180e-4be3-9056-0773aa679a1a
12caf1c
into
microsoft:main


Description
Installing
my-plugin@marketplacefails when the catalog points at a versioned directory produced byapm pack, such asplugins/my-plugin-1.2.3. Shorthand parsing mistakes the dotted suffix for an unsupported file extension.Use the existing explicit Git/path reference when the marketplace already identifies the repository and path. Keep that interpreted identity through selective installation and dry-run planning using the existing package-selection module instead of reparsing an ambiguous display string. GitHub/GHE Contents API success requires a directory listing, not merely HTTP 200. The Git fallback requires an actual tree entry, so file, symbolic-link, and submodule responses cannot bypass directory validation.
Supported individual files, package-content validation, containment checks, bundle naming, and local marketplace behavior retain their existing contracts.
Issue and approved scope
Fixes #3078.
Human scope approval: #3078 (comment)
This completes the bounded versioned-directory installation repair; it does not change the bundle layout from #2432.
Type of change
Testing
The hermetic lifecycle test runs
apm pack, commits the generated bundle to a local Git repository, previews installation without changing the consumer, verifies the first install deploys the expected skill, and replays the lockfile. Semver, calendar versions, and the local-marketplace control are covered. Negative cases reject unknown files, version-named blobs, malformed package content, and traversal without writing the consumer manifest or lockfile; real Git tree probes also reject symbolic links.The GitHub catalog fetch is substituted at the transport boundary with the existing Git fetcher against the committed local fixture. Source classification, resolution, download, validation, deployment, and lock replay run normally with external network access denied. This is not a live GitHub API integration test.
Focused validation:
These focused runs overlap; their counts are not a whole-suite total.
The six CI test-quality/architecture-ratchet modules also pass locally: 91 passed. Full-source Ruff lint/format, pylint duplication checks, architecture/auth boundaries, YAML I/O/file-length/portable-path guards, and
git diff --checkpass.A broader earlier run had 4,791 passes and 25 failures: one introduced module-length violation was fixed by the shared selection helper and passes in the final checks; 24 Unix installer fixture failures came from writing the Chinese checkout's Python path as ASCII. The same encoding failure was reproduced using an unchanged HEAD fixture. The full suite is therefore not claimed green, and Windows was not tested locally.
Spec conformance (OpenAPM v0.1)
No normative requirement changes. This repairs consumption of existing explicit Git/path coordinates and preserves path validation, package-content checks, and lockfile identity; it introduces no new manifest syntax or bundle format.