Skip to content

ci: run full UI suite on PR when AuthFlowTester changes#2941

Merged
wmathurin merged 2 commits into
forcedotcom:devfrom
wmathurin:run-all-ui-tests-on-authflowtester-changes
Jun 26, 2026
Merged

ci: run full UI suite on PR when AuthFlowTester changes#2941
wmathurin merged 2 commits into
forcedotcom:devfrom
wmathurin:run-all-ui-tests-on-authflowtester-changes

Conversation

@wmathurin

@wmathurin wmathurin commented Jun 26, 2026

Copy link
Copy Markdown
Contributor

Summary

  • When a PR modifies any file under `native/NativeSampleApps/AuthFlowTester/`, the CI now runs the full UI suite (all test classes, including `MultiUserLoginTests`) instead of the fixed 7-test smoke subset.
  • Unrelated PRs continue to use the fast 7-test subset with a 10-minute timeout.
  • Full-suite run uses a 30-minute timeout on API 36 / MediumPhone.arm.

How it works

  • `TestOrchestrator.rb` detects whether any changed file starts with `native/NativeSampleApps/AuthFlowTester/` and emits a `run_all_ui_tests` boolean output.
  • `pr.yaml` propagates that output to `reusable-ui-workflow.yaml` as a new `run_all_ui_tests` input.
  • In `reusable-ui-workflow.yaml`, the existing "Run PR Tests" step is gated on `!run_all_ui_tests`; a new "Run All UI Tests" step runs when `run_all_ui_tests` is true, with no `--test-targets` filter so all classes (including `MultiUserLoginTests`) execute.
  • The `results-dir` name is unchanged (`authflowtester-pr-build-${RUN_NUMBER}`) so the downstream "Copy Test Results" and "Test Report" steps require no changes.

Test plan

  • Verify a PR touching only `libs/` still runs the 7-test subset
  • Verify a PR touching `native/NativeSampleApps/AuthFlowTester/` triggers the full suite including `MultiUserLoginTests`

When a PR touches native/NativeSampleApps/AuthFlowTester/, the fixed
7-test PR subset is replaced with the full single-user suite (excl.
MultiUserLoginTests) on API 36, using a 20m timeout. Unrelated PRs
continue to run only the smoke subset with a 10m timeout.

- TestOrchestrator.rb: detect AuthFlowTester path changes, emit
  run_all_ui_tests output
- pr.yaml: propagate run_all_ui_tests output to reusable-ui-workflow
- reusable-ui-workflow.yaml: add run_all_ui_tests input; gate existing
  "Run PR Tests" on !run_all_ui_tests; add new "Run All UI Tests" step
@wmathurin wmathurin merged commit 9e668a1 into forcedotcom:dev Jun 26, 2026
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants