OCPBUGS-85579: Add consoleless e2e CI job for cert-manager-operator

[sebrandon1]

Summary

• Adds an optional e2e-operator-consoleless pre-submit job for openshift/cert-manager-operator on master, cert-manager-1.19, and cert-manager-1.20 branches
• Provisions an AWS cluster with BASELINE_CAPABILITY_SET=None (Console capability disabled) to verify the operator works correctly on consoleless RAN/RDS clusters
• Uses the openshift-e2e-aws-ovn workflow with optional-operators-operator-sdk for bundle install
• Companion to cert-manager-operator PR 455 which moves Console resources from OLM bundle to runtime with capability detection

Test plan

• CI rehearsal job passes on this PR
• Trigger e2e-operator-consoleless rehearsal to validate the consoleless cluster provisions correctly and the operator installs without Console CRDs

[openshift-ci-robot]

@sebrandon1: This pull request references Jira Issue OCPBUGS-85579, which is invalid:

• expected the bug to target either version "5.0." or "openshift-5.0.", but it targets "4.22" instead
• expected the bug to be in one of the following states: NEW, ASSIGNED, POST, but it is Release Pending (Done) instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

Summary

• Adds an optional e2e-operator-consoleless pre-submit job for openshift/cert-manager-operator
• Provisions an AWS cluster with BASELINE_CAPABILITY_SET=None (Console capability disabled) to verify the operator works correctly on consoleless RAN/RDS clusters
• Uses the openshift-e2e-aws-ovn workflow with optional-operators-operator-sdk for bundle install
• Companion to cert-manager-operator PR 455 which moves Console resources from OLM bundle to runtime with capability detection

Test plan

• CI rehearsal job passes on this PR
• Trigger e2e-operator-consoleless rehearsal to validate the consoleless cluster provisions correctly and the operator installs without Console CRDs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[coderabbitai]

Walkthrough

Adds an optional e2e-operator-consoleless test to the cert-manager operator OpenShift CI configuration, using AWS infrastructure, restricted all-namespaces installation, consoleless capability settings, filtered E2E execution, and the AWS OVN workflow.

Changes

Cert-manager operator E2E coverage

Layer / File(s)	Summary
Add consoleless E2E test configuration ci-operator/config/openshift/cert-manager-operator/openshift-cert-manager-operator-master.yaml	Adds the optional e2e-operator-consoleless test with AWS cluster wiring, bundle dependency, capability environment variables, filtered make test-e2e execution, CPU resources, and openshift-e2e-aws-ovn workflow assignment.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: bharath-b-rh, tashirj

🚥 Pre-merge checks | ✅ 15

✅ Passed checks (15 passed)

Check name	Status	Explanation
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names	✅ Passed	PR only adds CI job config; no Ginkgo It/Describe/Context/When titles or dynamic test names were introduced.
Test Structure And Quality	✅ Passed	Only CI YAML changed; no Ginkgo test code or assertions were added, so the test-quality checklist is not applicable.
Microshift Test Compatibility	✅ Passed	No new Ginkgo tests were added; the PR only adds CI job/config YAML, with no test bodies or MicroShift-relevant API usage in the changed files.
Single Node Openshift (Sno) Test Compatibility	✅ Passed	No new Ginkgo test definitions were added; this PR only wires an existing e2e suite into a new CI job, so the SNO test check is not applicable.
Topology-Aware Scheduling Compatibility	✅ Passed	The PR only adds CI job/config YAML; no deployment manifests, controllers, affinity, topology spread, node selectors, or replica logic changed.
Ote Binary Stdout Contract	✅ Passed	Only CI YAML changed; no Go/main/suite code was added or modified, so the stdout contract isn’t implicated.
Ipv6 And Disconnected Network Test Compatibility	✅ Passed	PASS: The PR only adds CI job configs; no Ginkgo test definitions or new network-facing test code were introduced.
No-Weak-Crypto	✅ Passed	Only CI job config was added; diff/search of both changed files found no MD5/SHA1/DES/RC4/3DES/Blowfish/ECB or custom crypto code.
Container-Privileges	✅ Passed	New e2e job sets OO_SECURITY_CONTEXT=restricted and adds no privileged/hostNetwork/root settings.
No-Sensitive-Data-In-Logs	✅ Passed	The new e2e job block contains no passwords, tokens, PII, session IDs, hostnames, or customer data; only capability and test settings.
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and concisely describes the addition of a consoleless end-to-end CI job for cert-manager-operator.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: sebrandon1
Once this PR has been reviewed and has the lgtm label, please assign trilokgeer for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• ci-operator/config/openshift/cert-manager-operator/OWNERS
• ci-operator/jobs/openshift/cert-manager-operator/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[sebrandon1]

/jira refresh

[openshift-ci-robot]

@sebrandon1: This pull request references Jira Issue OCPBUGS-85579, which is valid.

3 validation(s) were run on this bug

• bug is open, matching expected state (open)
• bug target version (5.0.0) matches configured target version for branch (5.0.0)
• bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira (amendiol@redhat.com), skipping review request.

Details

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[sebrandon1]

/rebase

[bharath-b-rh]

Could we please add this optional job in 1.19 and 1.20 too, since we will be backporting the changes to those branches as well. Thank you!

[bharath-b-rh]

Suggested change

	- as: e2e-operator-consoleless
	- always_run: false
	as: e2e-operator-consoleless

[openshift-ci-robot]

@sebrandon1: This pull request references Jira Issue OCPBUGS-85579, which is valid.

3 validation(s) were run on this bug

• bug is open, matching expected state (open)
• bug target version (5.0.0) matches configured target version for branch (5.0.0)
• bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira (amendiol@redhat.com), skipping review request.

Details

In response to this:

Summary

• Adds an optional e2e-operator-consoleless pre-submit job for openshift/cert-manager-operator on master, cert-manager-1.19, and cert-manager-1.20 branches
• Provisions an AWS cluster with BASELINE_CAPABILITY_SET=None (Console capability disabled) to verify the operator works correctly on consoleless RAN/RDS clusters
• Uses the openshift-e2e-aws-ovn workflow with optional-operators-operator-sdk for bundle install
• Companion to cert-manager-operator PR 455 which moves Console resources from OLM bundle to runtime with capability detection

Test plan

• CI rehearsal job passes on this PR
• Trigger e2e-operator-consoleless rehearsal to validate the consoleless cluster provisions correctly and the operator installs without Console CRDs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-merge-bot]

[REHEARSALNOTIFIER]
@sebrandon1: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name	Repo	Type	Reason
pull-ci-openshift-cert-manager-operator-cert-manager-1.19-e2e-operator-consoleless	openshift/cert-manager-operator	presubmit	Presubmit changed
pull-ci-openshift-cert-manager-operator-cert-manager-1.20-e2e-operator-consoleless	openshift/cert-manager-operator	presubmit	Presubmit changed
pull-ci-openshift-cert-manager-operator-master-e2e-operator-consoleless	openshift/cert-manager-operator	presubmit	Presubmit changed

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

[openshift-ci]

@sebrandon1: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[sebrandon1]

Addressed both review items:

• Added always_run: false to the consoleless job
• Added the e2e-operator-consoleless job to the 1.19 and 1.20 configs as well

Also rebased on main. All CI checks passing.