Skip to content

ci: run the core and CLI tests once - #2706

Merged
josephfusco merged 4 commits into
canaryfrom
ci/faster-pr-checks
Oct 27, 2026
Merged

josephfusco merged 4 commits into
canaryfrom
ci/faster-pr-checks

Conversation

@josephfusco

@josephfusco josephfusco commented Oct 27, 2026 •

Copy link
Copy Markdown
Member

Test Packages is the last check to finish on most PRs, and it ran the core and CLI tests twice. Now they run once (with coverage), and an unused coverage report step is gone.

Before After
PR gets its last result (p50) 2.4 min 2.0 min
Test Packages job (Node 22 / 24) ~133s 86–111s
Tests run 403 + 325 again 403, once

Baseline: 23 PR commits since #2700 (Oct 23). After: 3 full runs of this PR.

An npm cache was tried and dropped: restoring it cost as much as it saved. The plugin unit tests (~2 min) are now the slowest check, so trimming Test Packages further won't make PRs finish sooner.

Use of AI Tools

AI assistance: Yes
Tool(s): Claude Code
Model(s): Claude Opus 5.5
Used for: Assisting with analyzing Actions run history and editing the workflows.

The Tests step rebuilt the packages and ran the core and CLI suites,
then the coverage steps ran both suites again. Only the Blocks tests
now run on their own; core and CLI run once, with coverage.
@josephfusco josephfusco added [Area] Infrastructure Issues for the repository infrastructure [Type] Enhancement A suggestion for improvement of an existing feature labels Oct 27, 2026
Restoring the 356 MB cache added 4-6s to setup and saved 4-8s on
npm ci, so it bought nothing and used repo cache space.
The report action built a markdown summary that no step read and
posted nothing, costing about 5s per package. Its checks and
pull-requests write permissions go with it.
The core and CLI tests now only run in these steps, so a failing test
should point at "Test Core Package" rather than "Code Coverage".
@josephfusco josephfusco changed the title ci: run the core and CLI tests once and cache npm downloads ci: run the core and CLI tests once Oct 27, 2026
@josephfusco
josephfusco marked this pull request as ready for review October 27, 2026 15:53
@josephfusco
josephfusco requested review from a team and colinmurphy as code owners October 27, 2026 15:53
@josephfusco
josephfusco merged commit 38c6876 into canary Oct 27, 2026
36 checks passed
@josephfusco
josephfusco deleted the ci/faster-pr-checks branch October 27, 2026 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

[Area] Infrastructure Issues for the repository infrastructure [Type] Enhancement A suggestion for improvement of an existing feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant