Skip to content

Bug 2073095 - set up ci config to run ui tests on nightly build. - #382

Closed
pollym wants to merge 1 commit into
mozilla-firefox:autolandfrom
pollym:run-ui-tests-on-nightly
Closed

pollym wants to merge 1 commit into
mozilla-firefox:autolandfrom
pollym:run-ui-tests-on-nightly

Conversation

@pollym

@pollym pollym commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

this allows you to run ./mach try fuzzy --full -q "'ui-test-apk-fenix-arm-nightly" to exercise the ui tests on nightly

some changes required:

  • StartupExcessiveResourceUseTest needs excluding for nightly because it looks at StrictMode violations, which are only flagged on debug.

  • fix java.lang.RuntimeException: Unable to resolve activity for: Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] cmp=org.mozilla.fenix.test/androidx.activity.ComponentActivity }. This was causing all tests to take 45s to run as they were hitting a timeout on nightly (:

  • run on merge to mozilla-central only. this saves a bit of cash as it only happens twice a day.

./mach try --preset android-fenix is running here
./mach try fuzzy --full -q "'ui-test-apk-fenix-arm-nightly" is running here


Lando: link
Bugzilla: bug 2073095

⚠️ This pull request has 1 warning.
🚫 This pull request has 1 blocker.

@lando-web
lando-web Bot requested a review from a team October 8, 2026 10:27
@mozilla-code-review

Copy link
Copy Markdown

No new issues detected. This pull request is 🆗

this allows you to run ./mach try fuzzy --full -q "'ui-test-apk-fenix-arm-nightly"

some changes required:
- StartupExcessiveResourceUseTest needs excluding for nightly because it looks at StrictMode violations, which are only flagged on debug.

- fix java.lang.RuntimeException: Unable to resolve activity for: Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] cmp=org.mozilla.fenix.test/androidx.activity.ComponentActivity }. This was causing all tests to take 45s to run as they were hitting a timeout on nightly (:

- run on merge to mozilla-central only. this saves a bit of cash as it only happens twice a day.
@pollym
pollym force-pushed the run-ui-tests-on-nightly branch from cf142f8 to 5155cbb Compare October 8, 2026 15:04
@mozilla-code-review

Copy link
Copy Markdown

No new issues detected. This pull request is 🆗

@segunfamisa segunfamisa left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Polly for this lovely work!

skip-unless-backstop: null
run-on-projects: [autoland-only]
flank-config: fenix/arm-start-test.yml
run-on-projects: [mozilla-central-only]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice touch!

i take it that our test eng friends have +1'ed this approach?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes. i should have asked for their review probably. but this change was requested by test eng friends :)

lando-worker Bot pushed a commit that referenced this pull request Oct 13, 2026
…amisa

this allows you to run `./mach try fuzzy --full -q "'ui-test-apk-fenix-arm-nightly"` to exercise the ui tests on nightly

some changes required:
- `StartupExcessiveResourceUseTest` needs excluding for nightly because it looks at StrictMode violations, which are only flagged on debug.

- fix java.lang.RuntimeException: Unable to resolve activity for: Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] cmp=org.mozilla.fenix.test/androidx.activity.ComponentActivity }. This was causing all tests to take 45s to run as they were hitting a timeout on nightly (:

- run on merge to mozilla-central only. this saves a bit of cash as it only happens twice a day.

[`./mach try --preset android-fenix` is running here](https://treeherder.mozilla.org/jobs?repo=try&revision=11f55b5b96434545cfe75568d4dde7ee1a85e56f)
[`./mach try fuzzy --full -q "'ui-test-apk-fenix-arm-nightly"` is running here](https://treeherder.mozilla.org/jobs?repo=try&landoInstance=lando-prod-2025&landoCommitID=101947)

Pull request: #382
@lando-worker

lando-worker Bot commented Oct 13, 2026

Copy link
Copy Markdown

Pull request closed by commit 9db5e78

@lando-worker lando-worker Bot closed this Oct 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants