CMP-4616: Fix flaky TestScheduledSuiteNoStorage e2e test - #1369
Conversation
TestScheduledSuiteNoStorage validates that no PVCs are created when RawResultStorage is disabled. The test was brittle because it only accepted ResultCompliant, but the no_netrc_files rule can return NON_COMPLIANT or ERROR under cluster pressure from parallel tests. Since the test validates storage behavior and not compliance outcome, accept both COMPLIANT and NON_COMPLIANT results. Also move the PVC assertion after WaitForSuiteScansStatusAnyResult so it runs once the scan has actually completed, matching the pattern used by TestScheduledSuitePlatformNoStorage. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
|
@yuumasato: This pull request references CMP-4616 which is a valid jira issue. Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "5.1.0" version, but no target version was set. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
🤖 To deploy this PR, run the following command: |
|
@guzalv: changing LGTM is restricted to collaborators DetailsIn response to this: Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: guzalv, yuumasato The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
3 participants
Summary
TestScheduledSuiteNoStoragevalidates that no PVCs are created whenRawResultStorageis disabled — it tests storage behavior, not compliance outcomeResultCompliant, but under cluster pressure from ~70 parallel tests the scan can returnNON_COMPLIANTorERROR, causing an immediate hard failureWaitForSuiteScansStatusAnyResultaccepting bothCOMPLIANTandNON_COMPLIANTTestScheduledSuitePlatformNoStorageTest plan
TestScheduledSuiteNoStorageflakingJira: CMP-4616
🤖 Generated with Claude Code