Flake in operator-developer-e2e: unexpected status conditions for the operator

[m1kola]

As of a00a93f I see an uptick in operator-developer-e2e job flakes which look like this:

[FAILED] Timed out after 120.000s.
The function passed to Eventually failed at /home/runner/work/operator-controller/operator-controller/test/operator-framework-e2e/operator_framework_test.go:825 with:
Unexpected error:
    <*errors.errorString | 0xc0004c8af0>: 
    Status conditions for the operator plain-operator for the version 0.2.0 is not as expected:Expected status: True, but got: False
    {
        s: "Status conditions for the operator plain-operator for the version 0.2.0 is not as expected:Expected status: True, but got: False",
    }
occurred
In [It] at: /home/runner/work/operator-controller/operator-controller/test/operator-framework-e2e/operator_framework_test.go:826 @ 10/24/23 11:06:46.447

[FAILED] Timed out after 120.000s.
The function passed to Eventually failed at /home/runner/work/operator-controller/operator-controller/test/operator-framework-e2e/operator_framework_test.go:825 with:
Unexpected error:
    <*errors.errorString | 0xc00043bc60>: 
    Status conditions for the operator registry-operator for the version 0.1.0 is not as expected:Expected status: True, but got: False
    {
        s: "Status conditions for the operator registry-operator for the version 0.1.0 is not as expected:Expected status: True, but got: False",
    }
occurred
In [It] at: /home/runner/work/operator-controller/operator-controller/test/operator-framework-e2e/operator_framework_test.go:826 @ 10/24/23 11:09:20.027

Example:

• https://github.com/operator-framework/operator-controller/actions/runs/6625859094/job/17997641772
• Same commit, second attempt is green: https://github.com/operator-framework/operator-controller/actions/runs/6625859094

[m1kola]

I suspect it might be related to #444 or some other recent changes because I do not see anything similar in job history from two weeks ago.

[joelanford]

It would help to have the test failure error include the condition reason and message.

[m1kola]

Agreed. I created #483 for this

[m1kola]

We somehow end up with two Operators which looks like below.

Note that the message is the same almost as if we are writing condition to the wrong operator CR.

apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T12:46:29Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1635"
  uid: 21ce5372-90ba-449d-9e6f-01fa540e762d
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T12:46:29Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 1
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
  - lastTransitionTime: "2023-10-24T12:46:29Z"
    message: 'constraints not satisfiable: installed package registry-operator is
      mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
      registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
      registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
      package registry-operator is mandatory; required package registry-operator requires
      at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
    observedGeneration: 1
    reason: ResolutionFailed
    status: "False"
    type: Resolved
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T12:44:10Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1270"
  uid: 8f5aab31-18d4-4505-9e2d-f05f4eb0c581
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T12:44:15Z"
    message: 'constraints not satisfiable: installed package registry-operator is
      mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
      registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
      registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
      package registry-operator is mandatory; required package registry-operator requires
      at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
    observedGeneration: 2
    reason: ResolutionFailed
    status: "False"
    type: Resolved
  - lastTransitionTime: "2023-10-24T12:44:15Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 2
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed

[joelanford]

same almost as if we are writing condition to the wrong operator CR.

Resolution is global, so unsat resolutions will propogate to all Operator objects if they are reconciled when the global state is unsat.

[m1kola]

Resolution is global, so unsat resolutions will propogate to all Operator objects if they are reconciled when the global state is unsat.

Didn't know that, but this makes sense!

[m1kola]

I think it is a combination of two things:

• False Negatives: the job is green when it must be red
• Changes in Add initial SemVer upgrade support #444. Most likely related to the zero major version being handled differently in semver. I updated the test data for regular e2e job, but not for operator-developer-e2e.

Here are two green runs. Note that after #444 Operator has unsat errors, but still green.

Before #444 (commit c9d387e)

# Before #444
# kubectl get operators -o yaml -w

apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1200"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1202"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: bundledeployment status is unknown
    observedGeneration: 1
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1270"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:34Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1281"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:34Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1283"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:34Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:29Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1284"
  uid: 27fb53ca-9c3e-42e4-be06-030f072bf1e2
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:29Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:34Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1377"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1379"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: bundledeployment status is unknown
    observedGeneration: 1
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1445"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:52Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1466"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:52Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1468"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:52Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:22:48Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1469"
  uid: ecd7cfaa-c693-4bf7-894a-3957526a657b
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:22:48Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:22:52Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.2.0"
    observedGeneration: 2
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.2.0

After #444 (commit a00a93f)

# After #444
# kubectl get operators -o yaml -w

apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1161"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1163"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:14:34Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:14:34Z"
    message: bundledeployment status is unknown
    observedGeneration: 1
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 1
  name: plain-operator
  resourceVersion: "1232"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:14:34Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:14:39Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1251"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:14:34Z"
    message: resolved to "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:14:39Z"
    message: installed from "localhost:5001/plain-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/plain-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1252"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:14:40Z"
    message: 'constraints not satisfiable: installed package plain-operator is mandatory;
      installed package plain-operator requires at least one of plain-operator-catalog-plain-operator-plain-operator.v0.1.0;
      plain-operator package uniqueness permits at most 1 of plain-operator-catalog-plain-operator-plain-operator.v0.2.0,
      plain-operator-catalog-plain-operator-plain-operator.v0.1.0; required package
      plain-operator is mandatory; required package plain-operator requires at least
      one of plain-operator-catalog-plain-operator-plain-operator.v0.2.0'
    observedGeneration: 2
    reason: ResolutionFailed
    status: "False"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:14:40Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 2
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:14:34Z"
  generation: 2
  name: plain-operator
  resourceVersion: "1253"
  uid: bb10ccfc-3bbd-4f35-9c2d-1ec3581120d4
spec:
  packageName: plain-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:14:40Z"
    message: 'constraints not satisfiable: installed package plain-operator is mandatory;
      installed package plain-operator requires at least one of plain-operator-catalog-plain-operator-plain-operator.v0.1.0;
      plain-operator package uniqueness permits at most 1 of plain-operator-catalog-plain-operator-plain-operator.v0.2.0,
      plain-operator-catalog-plain-operator-plain-operator.v0.1.0; required package
      plain-operator is mandatory; required package plain-operator requires at least
      one of plain-operator-catalog-plain-operator-plain-operator.v0.2.0'
    observedGeneration: 2
    reason: ResolutionFailed
    status: "False"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:14:40Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 2
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1378"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1380"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:15:05Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:15:05Z"
    message: bundledeployment status is unknown
    observedGeneration: 1
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 1
  name: registry-operator
  resourceVersion: "1445"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.1.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:15:05Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1456"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:15:05Z"
    message: resolved to "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: installed from "localhost:5001/registry-operator-bundle:v0.1.0"
    observedGeneration: 1
    reason: Success
    status: "True"
    type: Installed
  installedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
  resolvedBundleResource: localhost:5001/registry-operator-bundle:v0.1.0
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1457"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: 'constraints not satisfiable: installed package registry-operator is
      mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
      registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
      registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
      package registry-operator is mandatory; required package registry-operator requires
      at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
    observedGeneration: 2
    reason: ResolutionFailed
    status: "False"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 2
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed
---
apiVersion: operators.operatorframework.io/v1alpha1
kind: Operator
metadata:
  creationTimestamp: "2023-10-24T13:15:05Z"
  generation: 2
  name: registry-operator
  resourceVersion: "1459"
  uid: 181493f6-d102-4f1b-8e63-03775d595278
spec:
  packageName: registry-operator
  upgradeConstraintPolicy: Enforce
  version: 0.2.0
status:
  conditions:
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: 'constraints not satisfiable: installed package registry-operator is
      mandatory; installed package registry-operator requires at least one of registry-operator-catalog-registry-operator-registry-operator.v0.1.0;
      registry-operator package uniqueness permits at most 1 of registry-operator-catalog-registry-operator-registry-operator.v0.2.0,
      registry-operator-catalog-registry-operator-registry-operator.v0.1.0; required
      package registry-operator is mandatory; required package registry-operator requires
      at least one of registry-operator-catalog-registry-operator-registry-operator.v0.2.0'
    observedGeneration: 2
    reason: ResolutionFailed
    status: "False"
    type: Resolved
  - lastTransitionTime: "2023-10-24T13:15:10Z"
    message: installation has not been attempted as resolution is unsatisfiable
    observedGeneration: 2
    reason: InstallationStatusUnknown
    status: Unknown
    type: Installed

[m1kola]

I created #485 for false negatives. Will submit the PR which updates test data shortly.

[m1kola]

#488 should address this issue