Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NO-ISSUE: Automated - Update synthetic test data #29418

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

openshift-bot
Copy link
Contributor

@openshift-bot openshift-bot commented Jan 10, 2025

disruptions Information

There were (234) added jobs and (32) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 363 jobs increased and 1031 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
openshift-api-new-connections 4.19 amd64 ovn vsphere ha 147 7.7s 285.00% 27.8s 131.67%
openshift-api-reused-connections 4.19 amd64 ovn vsphere ha 147 6.7s 235.00% 23.48s 173.66%
oauth-api-reused-connections 4.19 amd64 ovn vsphere ha 147 5.7s 185.00% 29.34s 236.47%
openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 3s 5900.00% 6s 200.00%
kube-api-reused-connections 4.19 amd64 ovn vsphere ha 147 3.7s 270.00% 22.8s 232.36%
service-load-balancer-with-pdb-new-connections 4.18 4.18 amd64 ovn gcp ha 919 2s 100.00% 12.82s 220.50%
oauth-api-new-connections 4.18 4.17 amd64 ovn azure ha 871 3s 50.00% 7.3s 35.44%
oauth-api-new-connections 4.19 amd64 ovn vsphere ha 471 3s 50.00% 16.3s 81.11%
oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 2s 100.00% 6s 200.00%
kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 2s 100.00% 6s 200.00%
openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 2s 100.00% 6.81s 240.50%
oauth-api-new-connections 4.19 amd64 ovn azure ha 275 2s 100.00% 3s 50.00%
kube-api-new-connections 4.19 amd64 ovn vsphere ha 471 3s 50.00% 13.9s 73.75%
service-load-balancer-with-pdb-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 3s 50.00% 7.81s 56.20%
oauth-api-new-connections 4.19 4.19 amd64 ovn azure ha 440 2s 100.00% 3s 40.85%
kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 2s 100.00% 4.83s 141.50%
service-load-balancer-with-pdb-new-connections 4.19 4.18 amd64 ovn gcp ha 718 2s 100.00% 5s 66.67%
kube-api-new-connections 4.19 amd64 ovn gcp ha 136 1s 122.22% 4.95s 147.50%
image-registry-new-connections 4.18 heterogeneous ovn aws ha 166 0s 0.00% 1.35s 35.00%
metrics-api-new-connections 4.18 s390x ovn libvirt ha 148 1m5s 0.00% 7m16.89s 50.65%
ingress-to-oauth-server-reused-connections 4.18 s390x ovn libvirt ha 148 0s 0.00% 6m0.08s 34.64%
oauth-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 3s 50.00%
pod-to-service-reused-connections 4.18 4.18 amd64 ovn aws single 280 5s 0.00% 12.42s 125.00%
ci-cluster-network-liveness-new-connections 4.18 heterogeneous ovn aws ha 166 0s 0.00% 4.5s 262.90%
cache-openshift-api-new-connections 4.18 s390x ovn libvirt ha 148 1m6.3s 0.00% 7m18.48s 50.16%
oauth-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 4.2s 110.00%
host-to-host-new-connections 4.18 amd64 ovn metal external 101 0s 0.00% 1m41s 197.06%
cache-kube-api-reused-connections 4.18 s390x ovn libvirt ha 148 2.95s 0.00% 5m59.55s 33.66%
image-registry-new-connections 4.18 amd64 ovn azure ha 120 0s 0.00% 1.81s 206.78%
kube-api-reused-connections 4.18 s390x ovn libvirt ha 148 4s 0.00% 6m1.9s 35.45%
ingress-to-console-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 10.46s 423.00%
image-registry-new-connections 4.18 4.18 amd64 ovn aws ha 306 1s 0.00% 4s 100.00%
openshift-api-new-connections 4.18 amd64 ovn gcp ha 129 0s 0.00% 3.88s 288.00%
ingress-to-console-reused-connections 4.18 amd64 ovn metal ha 217 1s 0.00% 16.12s 722.45%
cache-oauth-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 7.2s 260.00%
kube-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 4s 100.00%
cache-oauth-api-new-connections 4.18 amd64 ovn metal ha 217 0s 0.00% 32.92s 3192.00%
ingress-to-console-new-connections 4.18 4.18 amd64 ovn aws ha 306 1s 0.00% 3s 50.00%
metrics-api-new-connections 4.18 amd64 ovn gcp ha 312 0s 0.00% 11.34s 150.88%
pod-to-host-new-connections 4.18 ppc64le ovn libvirt ha 202 0s 0.00% 22.77s 234.85%
ci-cluster-network-liveness-new-connections 4.18 4.18 amd64 ovn gcp ha 919 0s 0.00% 27s 2600.00%
openshift-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 4s 33.33%
oauth-api-reused-connections 4.18 4.17 amd64 ovn azure ha 871 3s 0.00% 6s 50.00%
cache-oauth-api-new-connections 4.18 amd64 ovn gcp ha 312 0s 0.00% 1s 733.33%
ingress-to-console-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 2s 100.00%
ingress-to-oauth-server-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 12.64s 532.00%
ingress-to-oauth-server-reused-connections 4.18 amd64 ovn metal ha 217 1s 0.00% 17.8s 1102.70%
oauth-api-new-connections 4.18 amd64 ovn gcp ha 129 0s 0.00% 1.72s 72.00%
oauth-api-reused-connections 4.18 s390x ovn libvirt ha 148 3.3s 0.00% 6m1.9s 35.42%
host-to-service-reused-connections 4.18 4.18 amd64 ovn aws single 280 0s 0.00% 5.21s 73.67%
cache-kube-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 3s 50.00%
service-load-balancer-with-pdb-reused-connections 4.18 4.18 amd64 ovn gcp ha 919 3s 0.00% 4s 33.33%
pod-to-service-new-connections 4.18 4.18 amd64 ovn aws single 280 5s 0.00% 23.03s 317.21%
ingress-to-console-reused-connections 4.18 s390x ovn libvirt ha 148 1s 0.00% 6m0.08s 34.45%
ci-cluster-network-liveness-new-connections 4.18 4.17 amd64 ovn azure ha 871 0s 0.00% 6s 331.65%
metrics-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 4s 100.00%
openshift-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 5.2s 184.15%
cache-kube-api-new-connections 4.18 s390x ovn libvirt ha 148 1m6.6s 0.00% 7m16.89s 50.03%
metrics-api-reused-connections 4.18 s390x ovn libvirt ha 148 2.65s 0.00% 6m0.02s 35.03%
kube-api-new-connections 4.18 amd64 ovn gcp ha 129 0s 0.00% 3.88s 288.00%
ingress-to-console-new-connections 4.18 amd64 ovn metal ha 217 0s 0.00% 32.08s 3108.00%
image-registry-new-connections 4.18 4.18 amd64 ovn gcp ha 919 2s 0.00% 11s 266.67%
oauth-api-new-connections 4.18 s390x ovn libvirt ha 148 1m8.25s 0.00% 7m31.2s 54.31%
cache-oauth-api-reused-connections 4.18 s390x ovn libvirt ha 148 2.65s 0.00% 6m0.55s 34.22%
cache-openshift-api-reused-connections 4.18 s390x ovn libvirt ha 148 2s 0.00% 6m0.08s 34.74%
cache-kube-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 1s 0.00% 5s 400.00%
ingress-to-console-new-connections 4.18 amd64 ovn aws external 713 4.4s 0.00% 37m32.44s 6156.78%
openshift-api-reused-connections 4.18 s390x ovn libvirt ha 148 5.25s 0.00% 6m2.43s 36.32%
ingress-to-console-reused-connections 4.18 amd64 ovn aws external 713 2.2s 0.00% 33m3.4s 11567.06%
cache-oauth-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 4s 100.00%
cache-oauth-api-new-connections 4.18 s390x ovn libvirt ha 148 1m5.95s 0.00% 7m16.89s 49.81%
cache-openshift-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 4.64s 132.00%
ci-cluster-network-liveness-new-connections 4.18 s390x ovn libvirt ha 148 0s 0.00% 2m42s 1961.07%
ingress-to-oauth-server-new-connections 4.18 4.18 amd64 ovn aws ha 306 1s 0.00% 3s 50.00%
openshift-api-new-connections 4.18 s390x ovn libvirt ha 148 1m7.6s 0.00% 7m31.2s 55.05%
metrics-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 0s 0.00% 6s 200.00%
host-to-service-new-connections 4.18 4.18 amd64 ovn aws single 280 0s 0.00% 13.61s 353.67%
ingress-to-console-new-connections 4.18 amd64 ovn gcp ha 129 0s 0.00% 1.44s 44.00%
kube-api-new-connections 4.18 s390x ovn libvirt ha 148 1m6.95s 0.00% 7m31.2s 54.72%
kube-api-new-connections 4.18 4.18 amd64 ovn gcp ha 919 1s 0.00% 3.82s 91.00%
cache-openshift-api-new-connections 4.18 4.17 amd64 ovn gcp ha 581 0s 0.00% 5s 400.00%
service-load-balancer-with-pdb-new-connections 4.18 4.17 amd64 ovn azure ha 871 0s 0.00% 2.3s 130.00%
oauth-api-new-connections 4.19 s390x ovn libvirt ha 150 27.95s 0.00% 2m31.35s 48.56%
openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 456 1s 0.00% 6s 500.00%
oauth-api-new-connections 4.19 amd64 ovn aws single 291 56s 0.00% 2m7.1s 44.43%
host-to-service-reused-connections 4.19 4.19 amd64 ovn aws single 409 2s 0.00% 4.92s 64.00%
openshift-api-reused-connections 4.19 4.19 amd64 ovn aws ha 456 1s 0.00% 5s 461.80%
cache-oauth-api-new-connections 4.19 s390x ovn libvirt ha 150 26.3s 0.00% 2m30.37s 49.83%
openshift-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m10.77s 335.32%
ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws ha 192 0s 0.00% 6.27s 318.00%
cache-kube-api-new-connections 4.19 s390x ovn libvirt ha 150 26.3s 0.00% 2m29.88s 49.34%
ingress-to-console-new-connections 4.19 amd64 ovn aws external 773 9.4s 0.00% 39m2.12s 7279.08%
ingress-to-console-new-connections 4.19 s390x ovn libvirt ha 150 25.2s 0.00% 2m29.9s 49.30%
kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 456 1s 0.00% 4s 111.64%
ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 0s 0.00% 31.05s 417.50%
kube-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 2s 100.00%
kube-api-reused-connections 4.19 4.18 amd64 ovn azure ha 998 2s 0.00% 5s 66.67%
metrics-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m8.81s 269.72%
kube-api-new-connections 4.19 4.19 amd64 ovn azure ha 440 1s 0.00% 3s 50.00%
cache-kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 0s 0.00% 4s 296.04%
ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws microshift 203 0s 0.00% 980ms 53.12%
ci-cluster-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 998 0s 0.00% 8s 33.33%
ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 440 0s 0.00% 8s 100.00%
ingress-to-console-new-connections 4.19 4.18 amd64 ovn gcp ha 718 1s 0.00% 2.83s 41.50%
openshift-api-reused-connections 4.19 4.18 amd64 ovn aws ha 1115 0s 0.00% 2s 100.00%
ingress-to-console-reused-connections 4.19 s390x ovn libvirt ha 150 3.55s 0.00% 2m9.79s 255.01%
cache-kube-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m8.81s 269.72%
metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 0s 0.00% 4.81s 140.50%
ingress-to-console-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 4s 100.00%
kube-api-new-connections 4.19 amd64 ovn aws single 126 55.75s 0.00% 1m21.25s 42.54%
oauth-api-reused-connections 4.19 4.18 amd64 ovn aws ha 1115 0s 0.00% 2s 100.00%
oauth-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 718 2s 0.00% 4s 300.00%
cache-openshift-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m8.32s 270.87%
metrics-api-new-connections 4.19 amd64 ovn vsphere ha 471 0s 0.00% 4.4s 136.56%
ci-cluster-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 718 0s 0.00% 5.83s 190.05%
cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 4.81s 140.50%
metrics-api-reused-connections 4.19 amd64 ovn vsphere ha 147 0s 0.00% 2.08s 108.00%
oauth-api-new-connections 4.19 amd64 ovn gcp ha 326 1s 0.00% 3s 175.23%
kube-api-new-connections 4.19 s390x ovn libvirt ha 150 27.95s 0.00% 2m31.35s 50.81%
ingress-to-console-new-connections 4.19 amd64 ovn metal ha 191 0s 0.00% 2.3s 130.00%
openshift-api-reused-connections 4.19 amd64 ovn gcp ha 136 250ms 0.00% 2.65s 2844.44%
kube-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m9.79s 385.01%
image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 2s 0.00% 4s 33.33%
ingress-to-console-reused-connections 4.19 amd64 ovn aws external 773 6s 0.00% 33m19.24s 7450.00%
image-registry-new-connections 4.19 4.19 amd64 ovn azure ha 440 0s 0.00% 1s 669.23%
cache-kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 0s 0.00% 6s 200.00%
ingress-to-oauth-server-reused-connections 4.19 s390x ovn libvirt ha 150 0s 0.00% 2m8.81s 272.28%
openshift-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 4s 300.00%
ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 456 250ms 0.00% 11.45s 281.67%
metrics-api-reused-connections 4.19 amd64 ovn gcp ha 326 0s 0.00% 1.75s 75.00%
metrics-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 0s 0.00% 2.83s 40.80%
host-to-pod-reused-connections 4.19 4.19 amd64 ovn aws single 409 0s 0.00% 3.92s 86.67%
oauth-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m10.28s 386.85%
kube-api-reused-connections 4.19 4.19 amd64 ovn azure ha 440 1s 0.00% 3s 40.85%
ingress-to-oauth-server-new-connections 4.19 s390x ovn libvirt ha 150 25.2s 0.00% 2m31.39s 48.95%
kube-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 718 2s 0.00% 3s 200.00%
ingress-to-oauth-server-new-connections 4.19 amd64 ovn aws ha 192 1s 0.00% 2s 100.00%
cache-oauth-api-reused-connections 4.19 s390x ovn libvirt ha 150 1s 0.00% 2m10.28s 273.94%
cache-kube-api-new-connections 4.19 amd64 ovn gcp ha 326 0s 0.00% 5.75s 187.50%
kube-api-reused-connections 4.19 amd64 ovn aws single 126 56s 0.00% 1m20.5s 46.36%
oauth-api-reused-connections 4.19 amd64 ovn aws single 291 56s 0.00% 2m7s 42.70%
oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 3s 0.00% 5s 150.00%
openshift-api-new-connections 4.19 s390x ovn libvirt ha 150 28.5s 0.00% 2m31.84s 49.39%
image-registry-new-connections 4.19 heterogeneous ovn aws ha 163 0s 0.00% 1.38s 38.00%
cache-openshift-api-new-connections 4.19 s390x ovn libvirt ha 150 26.3s 0.00% 2m30.37s 49.83%
ingress-to-oauth-server-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 3s 50.00%
ci-cluster-network-liveness-new-connections 4.19 4.19 amd64 ovn aws single 409 0s 0.00% 8s 158.06%
cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1020 0s 0.00% 5.81s 190.50%
oauth-api-reused-connections 4.19 amd64 ovn gcp ha 136 1s 0.00% 2.65s 165.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 456 2s 0.00% 5s 400.00%
metrics-api-new-connections 4.19 s390x ovn libvirt ha 150 26.3s 0.00% 2m30.86s 55.01%
openshift-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 718 2s 0.00% 5s 400.00%
image-registry-reused-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 2s 100.00%
oauth-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 1020 1s 0.00% 3s 200.00%
host-to-pod-new-connections 4.19 4.19 amd64 ovn aws single 409 0s 0.00% 3s 42.86%
cache-openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 0s 0.00% 3.66s 83.00%
cache-oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 718 1s 0.00% 3.83s 283.00%
cache-openshift-api-new-connections 4.19 amd64 ovn gcp ha 136 1s 0.00% 3.3s 65.00%
openshift-api-new-connections 4.19 amd64 ovn gcp ha 326 1s 0.00% 4s 300.00%
kube-api-reused-connections 4.19 4.19 amd64 ovn aws ha 456 1s 0.00% 5.45s 445.00%

alerts Information

There were (4554) added jobs and (2994) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 57 jobs increased and 173 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn gcp ha 105 1h30m53.2s 77.22% 3h12m7.52s 83.78%
NodeSystemSaturation openshift-monitoring Warning 4.18 amd64 ovn aws single 119 8m56s 122.59% 12m34.6s 134.38%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 105 5m20.4s 182.29% 7m26s 117.45%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.18 amd64 ovn gcp ha 149 4m44s 66.67% 8m56s 59.71%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn gcp ha 105 1m50.4s 106.36% 3m20.88s 37.40%
KubeletPlegDurationHigh kube-system Warning 4.18 amd64 ovn gcp ha 149 0s 0.00% 2m44.8s 77.59%
KubeletPlegDurationHigh kube-system Warning 4.18 amd64 ovn azure ha 127 0s 0.00% 42.92s 53.29%
KubeJobFailed openshift-insights Warning 4.18 amd64 ovn vsphere ha 209 52m0s 0.00% 2h17m55.44s 32.23%
NodeSystemSaturation openshift-monitoring Warning 4.18 amd64 ovn azure ha 127 0s 0.00% 1m10.92s 37.98%
KubeAPIErrorBudgetBurn openshift-kube-apiserver Critical 4.18 amd64 ovn aws single 119 1m33.8s 0.00% 4m22.6s 105.09%
CannotRetrieveUpdates openshift-cluster-version Warning 4.18 amd64 ovn metal ha 308 29m54.9s 0.00% 43m25.04s 34.24%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.18 4.17 amd64 ovn aws ha 282 0s 0.00% 1m33.7s 234.64%
etcdGRPCRequestsSlow openshift-etcd Critical 4.18 4.17 amd64 ovn azure ha 250 0s 0.00% 4m44.5s 154.70%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.18 4.18 amd64 ovn aws ha 228 0s 0.00% 2m17.9s 1598.28%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn vsphere ha 149 0s 0.00% 1h16m48s 860.48%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn metal ha 205 0s 0.00% 1m57.84s 42.08%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 194 1m8.5s 0.00% 1m32.06s 130.15%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn aws ha 151 0s 0.00% 1m58s 118.76%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.19 4.18 amd64 ovn gcp ha 141 0s 0.00% 1m46.8s 3582.76%
etcdHighCommitDurations openshift-etcd Warning 4.19 4.19 amd64 ovn azure ha 155 8.4s 0.00% 21m55.84s 370.41%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 194 0s 0.00% 3m4.16s 158.65%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws ha 194 1h7m24.7s 0.00% 3h28m31.92s 34.72%
KubeletPlegDurationHigh kube-system Warning 4.19 4.19 amd64 ovn gcp ha 292 0s 0.00% 2m58s 1769.75%
etcdGRPCRequestsSlow openshift-etcd Critical 4.19 4.18 amd64 ovn azure ha 264 0s 0.00% 10m41.18s 71.92%
/cc @dgoodwin, @neisw, @DennisPeriquet

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Jan 10, 2025
@openshift-ci-robot
Copy link

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (48) added jobs and (0) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 173 jobs increased and 821 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
ci-cluster-network-liveness-new-connections 4.18 amd64 ovn metal ha 234 0s 0.00% 2.67s 33.50%
cache-oauth-api-new-connections 4.18 s390x ovn libvirt ha 125 1m6.4s 0.00% 10m6.08s 107.82%
pod-to-service-new-connections 4.18 amd64 ovn metal ha 234 0s 0.00% 670ms 318.75%
metrics-api-reused-connections 4.18 s390x ovn libvirt ha 125 2s 0.00% 10m2.16s 125.85%
image-registry-reused-connections 4.18 4.17 amd64 ovn aws ha 906 0s 0.00% 1s 58.73%
kube-api-reused-connections 4.18 s390x ovn libvirt ha 125 4s 0.00% 10m1.4s 125.08%
cache-openshift-api-reused-connections 4.18 s390x ovn libvirt ha 125 3.8s 0.00% 10m1.64s 125.13%
ingress-to-oauth-server-new-connections 4.18 amd64 ovn gcp ha 283 0s 0.00% 1s 733.33%
host-to-pod-new-connections 4.18 amd64 ovn metal external 105 0s 0.00% 45.48s 37.82%
cache-kube-api-reused-connections 4.18 s390x ovn libvirt ha 125 3.8s 0.00% 10m1.88s 123.75%
metrics-api-new-connections 4.18 4.18 amd64 ovn gcp ha 874 0s 0.00% 3s 50.00%
ci-cluster-network-liveness-new-connections 4.18 4.18 amd64 ovn aws ha 234 0s 0.00% 670ms 103.03%
openshift-api-reused-connections 4.18 s390x ovn libvirt ha 125 3.8s 0.00% 10m2.16s 126.50%
host-to-service-new-connections 4.18 amd64 ovn metal ha 190 0s 0.00% 47.84s 4684.00%
ci-cluster-network-liveness-new-connections 4.18 4.17 amd64 ovn aws ha 906 0s 0.00% 4s 33.33%
oauth-api-reused-connections 4.18 s390x ovn libvirt ha 125 3.8s 0.00% 10m2.4s 125.42%
ci-cluster-network-liveness-new-connections 4.18 4.17 amd64 ovn azure ha 847 0s 0.00% 2.54s 82.73%
pod-to-pod-new-connections 4.18 amd64 ovn metal external 105 0s 0.00% 45.48s 37.82%
cache-kube-api-new-connections 4.18 s390x ovn libvirt ha 125 1m7.2s 0.00% 10m5.84s 108.05%
kube-api-new-connections 4.18 amd64 ovn metal ha 190 0s 0.00% 2.98s 198.00%
cache-openshift-api-reused-connections 4.18 4.18 amd64 ovn azure ha 220 1s 0.00% 2s 41.84%
ingress-to-oauth-server-reused-connections 4.18 s390x ovn libvirt ha 125 2s 0.00% 10m2.4s 125.26%
image-registry-new-connections 4.18 amd64 ovn aws ha 155 0s 0.00% 1.46s 46.00%
cache-openshift-api-new-connections 4.18 s390x ovn libvirt ha 125 1m6.6s 0.00% 10m6.08s 107.55%
service-load-balancer-with-pdb-new-connections 4.18 arm64 ovn aws ha 175 0s 0.00% 2.04s 104.00%
metrics-api-new-connections 4.18 s390x ovn libvirt ha 125 1m5s 0.00% 10m5.6s 108.82%
ingress-to-console-new-connections 4.18 4.18 amd64 ovn aws ha 234 1s 0.00% 3s 50.00%
ingress-to-console-reused-connections 4.18 s390x ovn libvirt ha 125 4.4s 0.00% 10m2.4s 124.94%
image-registry-new-connections 4.18 4.18 amd64 ovn aws ha 234 1s 0.00% 2.67s 33.50%
image-registry-new-connections 4.18 amd64 ovn gcp ha 283 0s 0.00% 1.54s 54.00%
openshift-api-new-connections 4.18 s390x ovn libvirt ha 125 1m5s 0.00% 10m5.84s 108.19%
ingress-to-oauth-server-new-connections 4.18 s390x ovn libvirt ha 125 1m7.8s 0.00% 10m7.32s 107.10%
oauth-api-new-connections 4.18 s390x ovn libvirt ha 125 1m7.4s 0.00% 10m6.08s 107.28%
metrics-api-new-connections 4.18 amd64 ovn vsphere ha 350 0s 0.00% 6.51s 56.49%
cache-kube-api-reused-connections 4.18 amd64 ovn vsphere ha 350 0s 0.00% 1s 1150.00%
host-to-pod-reused-connections 4.18 amd64 ovn metal external 105 0s 0.00% 45.48s 37.82%
service-load-balancer-with-pdb-new-connections 4.18 4.17 amd64 ovn azure ha 847 0s 0.00% 3s 200.00%
ingress-to-console-new-connections 4.18 amd64 ovn gcp ha 283 0s 0.00% 1.36s 36.00%
cache-oauth-api-reused-connections 4.18 s390x ovn libvirt ha 125 3.8s 0.00% 10m2.64s 124.35%
kube-api-new-connections 4.18 s390x ovn libvirt ha 125 1m6.6s 0.00% 10m6.84s 108.09%
ingress-to-console-new-connections 4.18 4.17 amd64 ovn azure ha 847 0s 0.00% 2.54s 154.00%
cache-oauth-api-new-connections 4.18 amd64 ovn vsphere ha 350 0s 0.00% 6.51s 56.49%
ci-cluster-network-liveness-new-connections 4.18 amd64 ovn aws ha 155 0s 0.00% 1s 72.41%
image-registry-new-connections 4.18 4.17 amd64 ovn azure ha 847 0s 0.00% 2s 100.00%
kube-api-new-connections 4.18 4.18 amd64 ovn aws ha 234 0s 0.00% 1s 203.03%
ingress-to-console-new-connections 4.18 s390x ovn libvirt ha 125 1m6.8s 0.00% 10m7.32s 107.10%
cache-openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 155.00%
image-registry-new-connections 4.19 heterogeneous ovn aws ha 152 450ms 0.00% 2s 100.00%
cache-oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 186.52%
oauth-api-new-connections 4.19 heterogeneous ovn aws ha 152 0s 0.00% 1s 88.68%
aws-network-liveness-new-connections 4.19 4.19 amd64 ovn azure ha 249 0s 0.00% 520ms 300.00%
host-to-pod-reused-connections 4.19 4.19 amd64 ovn aws single 243 0s 0.00% 3s 42.86%
openshift-api-reused-connections 4.19 arm64 ovn aws ha 254 0s 0.00% 29.93s 78.69%
kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 3.24s 71.43%
image-registry-reused-connections 4.19 4.19 amd64 ovn gcp ha 939 1s 0.00% 2s 100.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn azure ha 249 1s 0.00% 3s 40.85%
openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 155.00%
openshift-api-new-connections 4.19 amd64 ovn azure ha 119 1s 0.00% 3.64s 82.00%
openshift-api-reused-connections 4.19 amd64 ovn vsphere ha 335 2s 0.00% 11.66s 35.90%
ingress-to-console-new-connections 4.19 arm64 ovn aws ha 254 0s 0.00% 22.98s 240.44%
oauth-api-reused-connections 4.19 amd64 ovn vsphere ha 335 2.3s 0.00% 12.32s 41.28%
image-registry-new-connections 4.19 amd64 ovn gcp ha 352 0s 0.00% 2.98s 49.00%
host-to-service-new-connections 4.19 arm64 ovn aws ha 253 0s 0.00% 7.68s 668.00%
openshift-api-reused-connections 4.19 amd64 ovn gcp ha 352 0s 0.00% 490ms 444.44%
metrics-api-reused-connections 4.19 amd64 ovn azure ha 234 1s 0.00% 2s 100.00%
oauth-api-new-connections 4.19 amd64 ovn gcp ha 352 0s 0.00% 2s 83.49%
oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 155.00%
ingress-to-oauth-server-new-connections 4.19 amd64 ovn metal ha 195 0s 0.00% 1m38.5s 9750.00%
cache-kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 186.52%
metrics-api-new-connections 4.19 4.19 amd64 ovn aws ha 270 0s 0.00% 2.55s 186.52%
oauth-api-reused-connections 4.19 arm64 ovn aws ha 254 0s 0.00% 28.05s 67.46%

alerts Information

There were (1271) added jobs and (1540) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 52 jobs increased and 159 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn gcp ha 147 1h30m57.8s 77.37% 2h32m47.96s 46.16%
OperatorHubSourceError openshift-operator-lifecycle-manager Warning 4.19 4.18 amd64 ovn gcp ha 169 28s 93.10% 5m37.52s 42.29%
etcdGRPCRequestsSlow openshift-etcd Critical 4.18 4.17 amd64 ovn azure ha 208 0s 0.00% 7m20.02s 293.93%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.18 4.17 amd64 ovn gcp ha 130 44.5s 0.00% 3m47.3s 57.96%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.18 amd64 ovn gcp ha 112 0s 0.00% 5m16.84s 30.88%
NodeSystemSaturation openshift-monitoring Warning 4.18 amd64 ovn metal ha 217 5.6s 0.00% 28m24.64s 64.10%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.18 4.18 amd64 ovn aws single 125 0s 0.00% 3m43.6s 146.31%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.18 4.18 amd64 ovn aws ha 159 0s 0.00% 24.36s 200.00%
KubeJobFailed openshift-insights Warning 4.18 amd64 ovn aws ha 210 1h25m12s 0.00% 3h32m7.12s 50.99%
KubeletPlegDurationHigh kube-system Warning 4.18 amd64 ovn gcp ha 112 0s 0.00% 3m18.1s 113.47%
KubeletPlegDurationHigh kube-system Warning 4.18 4.18 amd64 ovn gcp ha 228 0s 0.00% 1m41.8s 33.95%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn azure ha 112 0s 0.00% 1m46.32s 299.10%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn azure ha 112 0s 0.00% 1m45.02s 41.54%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.19 amd64 ovn gcp ha 147 5m56s 0.00% 10m30.12s 77.00%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws single 102 1h17m19.8s 0.00% 2h15m14.52s 60.80%
KubeAPIErrorBudgetBurn openshift-kube-apiserver Critical 4.19 amd64 ovn aws single 102 0s 0.00% 5m27.1s 314.26%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws ha 229 53m2.4s 0.00% 3h32m28s 37.26%
AlertmanagerReceiversNotConfigured openshift-monitoring Warning 4.19 amd64 ovn vsphere ha 144 1h48m32s 0.00% 2h51m25.38s 57.67%
OperatorHubSourceError openshift-operator-lifecycle-manager Warning 4.19 4.19 amd64 ovn gcp ha 221 58s 0.00% 4m6.4s 57.75%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn gcp ha 147 49s 0.00% 22m4.88s 806.21%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn vsphere ha 144 0s 0.00% 3h9m18.42s 2267.52%
etcdHighCommitDurations openshift-etcd Warning 4.19 amd64 ovn azure ha 112 0s 0.00% 36m35.5s 60886.11%
KubeAPIErrorBudgetBurn openshift-kube-apiserver Critical 4.19 amd64 ovn aws ha 229 0s 0.00% 1m36.64s 255.29%
KubeletPlegDurationHigh kube-system Warning 4.19 4.19 amd64 ovn gcp ha 221 0s 0.00% 28s 194.12%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 147 0s 0.00% 6m57.48s 41.44%
/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from deads2k and p0lyn0mial January 10, 2025 01:03
@dgoodwin
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added lgtm Indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Jan 10, 2025
@openshift-bot openshift-bot force-pushed the no-issue--automated---update-synthetic-test-data branch from 16a6899 to 11c4215 Compare January 17, 2025 01:02
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Jan 17, 2025
@neisw
Copy link
Contributor

neisw commented Jan 17, 2025

/lgtm
/label acknowledge-critical-fixes-only

@openshift-ci openshift-ci bot added the acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. label Jan 17, 2025
@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jan 17, 2025
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD e356b61 and 2 for PR HEAD 11c4215 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 2d391bf and 1 for PR HEAD 11c4215 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 3709116 and 0 for PR HEAD 11c4215 in total

@openshift-ci-robot
Copy link

/hold

Revision 11c4215 was retested 3 times: holding

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jan 18, 2025
@neisw
Copy link
Contributor

neisw commented Jan 21, 2025

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jan 21, 2025
@neisw
Copy link
Contributor

neisw commented Jan 21, 2025

/override ci/prow/e2e-aws-ovn-serial

known issue outside of pr

Copy link
Contributor

openshift-ci bot commented Jan 21, 2025

@neisw: Overrode contexts on behalf of neisw: ci/prow/e2e-aws-ovn-serial

In response to this:

/override ci/prow/e2e-aws-ovn-serial

known issue outside of pr

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD a87dfc8 and 2 for PR HEAD 11c4215 in total

1 similar comment
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD a87dfc8 and 2 for PR HEAD 11c4215 in total

@neisw
Copy link
Contributor

neisw commented Jan 22, 2025

/override ci/prow/e2e-aws-ovn-serial

Copy link
Contributor

openshift-ci bot commented Jan 22, 2025

@neisw: Overrode contexts on behalf of neisw: ci/prow/e2e-aws-ovn-serial

In response to this:

/override ci/prow/e2e-aws-ovn-serial

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 4b05413 and 1 for PR HEAD 11c4215 in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 4ca8255 and 2 for PR HEAD 11c4215 in total

@neisw
Copy link
Contributor

neisw commented Jan 23, 2025

/override ci/prow/e2e-aws-ovn-serial
/skip

Copy link
Contributor

openshift-ci bot commented Jan 23, 2025

@neisw: Overrode contexts on behalf of neisw: ci/prow/e2e-aws-ovn-serial

In response to this:

/override ci/prow/e2e-aws-ovn-serial
/skip

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Copy link

openshift-trt bot commented Jan 23, 2025

Job Failure Risk Analysis for sha: 11c4215

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-serial Medium
[sig-imageregistry][Serial] Image signature workflow can push a signed image to openshift registry and verify it [apigroup:user.openshift.io][apigroup:image.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/serial]
This test has passed 96.46% of 424 runs on release 4.19 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout Low
[Conformance][Suite:openshift/kube-apiserver/rollout][Jira:"kube-apiserver"][sig-kube-apiserver] kube-apiserver should roll out new revisions without disruption [apigroup:config.openshift.io][apigroup:operator.openshift.io]
This test has passed 28.57% of 7 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD a30e8f6 and 2 for PR HEAD 11c4215 in total

@openshift-bot openshift-bot force-pushed the no-issue--automated---update-synthetic-test-data branch from 11c4215 to f79279c Compare January 24, 2025 01:03
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Jan 24, 2025
@openshift-ci-robot
Copy link

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (162) added jobs and (32) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 297 jobs increased and 1062 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
openshift-api-new-connections 4.18 s390x ovn libvirt ha 119 1m25.2s 30.88% 8m11.8s 69.00%
openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 665 2s 3900.00% 5s 150.00%
kube-api-reused-connections 4.19 amd64 ovn vsphere ha 131 2.5s 150.00% 11.4s 66.18%
service-load-balancer-with-pdb-new-connections 4.18 4.18 amd64 ovn gcp ha 825 2s 100.00% 13.76s 244.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn azure ha 320 2s 100.00% 3s 40.85%
metrics-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 566.67% 6s 200.00%
metrics-api-reused-connections 4.18 s390x ovn libvirt ha 119 3.1s 37.78% 6m9.88s 38.73%
kube-api-new-connections 4.19 amd64 ovn gcp ha 126 1s 122.22% 3s 50.00%
openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 1.4s 40.00% 6s 200.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 1.4s 40.00% 6s 200.00%
ci-cluster-network-liveness-new-connections 4.18 s390x ovn libvirt ha 119 0s 0.00% 4m9s 3067.94%
ci-cluster-network-liveness-new-connections 4.18 amd64 ovn aws ha 145 0s 0.00% 1.56s 168.97%
metrics-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 3.76s 88.00%
oauth-api-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 2.37s 137.00%
cache-oauth-api-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 2.11s 1658.33%
service-load-balancer-with-pdb-new-connections 4.18 4.17 amd64 ovn azure ha 789 0s 0.00% 2.12s 112.00%
cache-oauth-api-new-connections 4.18 s390x ovn libvirt ha 119 1m15.1s 0.00% 7m49.66s 61.05%
kube-api-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 1.37s 37.00%
host-to-pod-new-connections 4.18 amd64 ovn metal external 101 0s 0.00% 1m40s 203.03%
host-to-service-new-connections 4.18 4.18 amd64 ovn aws single 227 0s 0.00% 5.22s 74.00%
oauth-api-new-connections 4.18 s390x ovn libvirt ha 119 1m24.1s 0.00% 8m11.8s 68.20%
openshift-api-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 2.11s 111.00%
image-registry-new-connections 4.18 heterogeneous ovn aws ha 144 0s 0.00% 1.57s 57.00%
kube-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 4s 100.00%
gcp-network-liveness-new-connections 4.18 4.18 amd64 ovn aws single 227 0s 0.00% 1.74s 74.00%
cache-kube-api-new-connections 4.18 s390x ovn libvirt ha 119 1m15.2s 0.00% 7m49.66s 61.28%
cache-oauth-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 8s 300.00%
cache-kube-api-reused-connections 4.18 s390x ovn libvirt ha 119 4.2s 0.00% 6m9.7s 37.43%
ingress-to-oauth-server-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 13.76s 588.00%
openshift-api-reused-connections 4.18 s390x ovn libvirt ha 119 7.3s 0.00% 6m11.42s 39.71%
cache-oauth-api-reused-connections 4.18 s390x ovn libvirt ha 119 4s 0.00% 6m10.7s 38.00%
cache-kube-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 0s 0.00% 3s 50.00%
host-to-service-reused-connections 4.18 4.18 amd64 ovn aws single 227 0s 0.00% 5.22s 74.00%
kube-api-reused-connections 4.18 s390x ovn libvirt ha 119 4.5s 0.00% 6m10.6s 38.70%
oauth-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 4.47s 123.50%
cache-openshift-api-new-connections 4.18 s390x ovn libvirt ha 119 1m15.1s 0.00% 7m52.12s 61.68%
cache-openshift-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 350ms 0.00% 5.47s 447.00%
metrics-api-new-connections 4.18 s390x ovn libvirt ha 119 1m14.2s 0.00% 7m49.66s 61.95%
ci-cluster-network-liveness-new-connections 4.18 4.17 amd64 ovn azure ha 789 0s 0.00% 2s 43.88%
image-registry-new-connections 4.18 amd64 ovn azure ha 104 0s 0.00% 1.97s 233.90%
ingress-to-console-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 2s 100.00%
cache-openshift-api-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 1.74s 74.00%
ci-cluster-network-liveness-new-connections 4.18 heterogeneous ovn aws ha 144 0s 0.00% 6.7s 440.32%
kube-api-new-connections 4.18 s390x ovn libvirt ha 119 1m26.1s 0.00% 8m11.8s 68.64%
oauth-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 3s 50.00%
cache-openshift-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 3s 50.00%
image-registry-new-connections 4.18 4.18 amd64 ovn gcp ha 825 2s 0.00% 13.28s 342.67%
kube-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 3s 50.00%
ingress-to-console-reused-connections 4.18 s390x ovn libvirt ha 119 2.2s 0.00% 6m10.52s 38.35%
ingress-to-console-new-connections 4.18 4.18 amd64 ovn aws ha 248 1s 0.00% 3.53s 76.50%
image-registry-new-connections 4.18 4.18 amd64 ovn aws ha 248 1s 0.00% 4s 100.00%
ingress-to-oauth-server-new-connections 4.18 4.18 amd64 ovn aws ha 248 1s 0.00% 3.53s 76.50%
ingress-to-oauth-server-new-connections 4.18 amd64 ovn gcp ha 264 0s 0.00% 370ms 208.33%
ingress-to-oauth-server-reused-connections 4.18 s390x ovn libvirt ha 119 2s 0.00% 6m10.52s 38.55%
cache-oauth-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 4s 100.00%
cache-openshift-api-reused-connections 4.18 s390x ovn libvirt ha 119 2.1s 0.00% 6m10.52s 38.65%
metrics-api-reused-connections 4.18 amd64 ovn azure ha 236 1s 0.00% 2s 100.00%
openshift-api-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 4s 33.33%
cache-kube-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 5s 400.00%
openshift-api-new-connections 4.18 4.17 amd64 ovn gcp ha 454 1s 0.00% 5.47s 198.91%
ingress-to-console-new-connections 4.18 4.18 amd64 ovn gcp ha 825 1s 0.00% 10.28s 414.00%
oauth-api-reused-connections 4.18 s390x ovn libvirt ha 119 4.5s 0.00% 6m10.6s 38.68%
kube-api-new-connections 4.19 amd64 ovn aws single 270 55.55s 0.00% 1m44.23s 82.86%
openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 341 1s 0.00% 3s 200.00%
oauth-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 3s 200.00%
oauth-api-new-connections 4.19 amd64 ovn gcp ha 126 1s 0.00% 5s 358.72%
kube-api-new-connections 4.19 amd64 ovn vsphere ha 421 2s 0.00% 11.8s 47.50%
cache-oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 665 0s 0.00% 3s 200.00%
kube-api-reused-connections 4.19 arm64 ovn aws ha 256 23.25s 0.00% 1m6.15s 6515.00%
openshift-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 4s 300.00%
cache-kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 0s 0.00% 5s 150.00%
metrics-api-reused-connections 4.19 amd64 ovn azure ha 144 0s 0.00% 1.57s 57.00%
image-registry-new-connections 4.19 amd64 ovn aws ha 175 0s 0.00% 2s 100.00%
kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 5s 150.00%
image-registry-reused-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 2s 100.00%
ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws microshift 183 0s 0.00% 1s 56.25%
kube-api-reused-connections 4.19 4.19 amd64 ovn aws ha 341 1s 0.00% 2s 100.00%
ingress-to-console-reused-connections 4.19 amd64 ovn aws external 728 0s 0.00% 31m5.76s 6945.92%
kube-api-new-connections 4.19 amd64 ovn azure ha 144 0s 0.00% 1.57s 57.00%
oauth-api-reused-connections 4.19 amd64 ovn vsphere ha 421 2s 0.00% 11.8s 35.32%
openshift-api-reused-connections 4.19 4.19 amd64 ovn aws ha 341 0s 0.00% 3.6s 304.49%
kube-api-reused-connections 4.19 4.18 amd64 ovn azure ha 992 2s 0.00% 5s 66.67%
service-load-balancer-with-pdb-new-connections 4.19 4.18 amd64 ovn gcp ha 665 1s 0.00% 4s 33.33%
ingress-to-console-new-connections 4.19 amd64 ovn aws external 728 2.65s 0.00% 38m6.81s 7104.82%
host-to-service-reused-connections 4.19 4.19 amd64 ovn aws single 294 2s 0.00% 4s 33.33%
oauth-api-reused-connections 4.19 arm64 ovn aws ha 256 23.25s 0.00% 1m6.8s 298.81%
openshift-api-reused-connections 4.19 amd64 ovn gcp ha 307 0s 0.00% 1.94s 2055.56%
cache-kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 665 0s 0.00% 3s 197.03%
cache-openshift-api-new-connections 4.19 amd64 ovn gcp ha 307 0s 0.00% 3s 50.00%
kube-api-reused-connections 4.19 amd64 ovn aws single 117 56s 0.00% 1m21.4s 48.00%
kube-api-new-connections 4.19 4.19 amd64 ovn azure ha 320 1s 0.00% 2.81s 40.50%
cache-kube-api-new-connections 4.19 amd64 ovn gcp ha 126 0s 0.00% 2.75s 37.50%
kube-api-new-connections 4.19 4.19 amd64 ovn aws ha 341 0s 0.00% 2.6s 37.57%
cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 4s 100.00%
kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 665 1s 0.00% 3.36s 68.00%
openshift-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 665 2s 0.00% 4s 300.00%
cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 0s 0.00% 4s 100.00%
image-registry-new-connections 4.19 heterogeneous ovn aws ha 154 0s 0.00% 1.47s 47.00%
oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 665 2s 0.00% 5s 150.00%
openshift-api-reused-connections 4.19 amd64 ovn vsphere ha 421 2s 0.00% 12.6s 46.85%
openshift-api-new-connections 4.19 amd64 ovn gcp ha 307 1s 0.00% 3.94s 294.00%
kube-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 665 1s 0.00% 3s 200.00%
image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 993 2s 0.00% 4s 33.33%
image-registry-new-connections 4.19 4.19 amd64 ovn azure ha 320 0s 0.00% 1s 669.23%
metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 993 0s 0.00% 4s 100.00%
openshift-api-new-connections 4.19 arm64 ovn aws ha 256 23.25s 0.00% 1m7.25s 118.70%
openshift-api-reused-connections 4.19 4.18 amd64 ovn aws ha 1106 0s 0.00% 2s 100.00%
oauth-api-new-connections 4.19 amd64 ovn vsphere ha 421 2s 0.00% 13.2s 46.67%
host-to-pod-reused-connections 4.19 4.19 amd64 ovn aws single 294 0s 0.00% 3.07s 46.19%
kube-api-reused-connections 4.19 4.19 amd64 ovn gcp ha 993 1s 0.00% 2s 100.00%
kube-api-new-connections 4.19 amd64 ovn metal ha 103 0s 0.00% 14.72s 1372.00%
host-to-pod-new-connections 4.19 4.19 amd64 ovn aws single 294 0s 0.00% 3s 42.86%
oauth-api-reused-connections 4.19 4.18 amd64 ovn gcp ha 665 2s 0.00% 4s 300.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn aws ha 341 1s 0.00% 2s 100.00%

alerts Information

There were (3832) added jobs and (1216) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 44 jobs increased and 191 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn gcp ha 136 2h21m57s 176.80% 3h45m14.1s 115.45%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn gcp ha 136 1m35.5s 78.50% 4m45.5s 95.28%
NodeSystemSaturation openshift-monitoring Warning 4.19 arm64 ovn aws ha 138 1m32.5s 41.22% 4m52.7s 156.98%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.18 4.18 amd64 ovn aws ha 183 0s 0.00% 32.04s 294.58%
OperatorHubSourceError openshift-operator-lifecycle-manager Warning 4.18 4.17 amd64 ovn gcp ha 147 2m26s 0.00% 7m22.04s 137.02%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.18 arm64 ovn aws ha 117 0s 0.00% 4m51.6s 178.03%
NodeSystemSaturation openshift-monitoring Warning 4.18 4.17 amd64 ovn gcp ha 147 0s 0.00% 5m20.48s 38.14%
etcdGRPCRequestsSlow openshift-etcd Critical 4.18 4.17 amd64 ovn azure ha 194 0s 0.00% 3m6.4s 66.88%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn vsphere ha 233 0s 0.00% 1h18m49.6s 885.83%
etcdHighCommitDurations openshift-etcd Warning 4.19 4.19 amd64 ovn azure ha 254 0s 0.00% 33m58.64s 628.81%
KubeletPlegDurationHigh kube-system Warning 4.19 4.19 amd64 ovn gcp ha 250 0s 0.00% 1m13.3s 669.96%
etcdHighCommitDurations openshift-etcd Warning 4.19 amd64 ovn azure ha 133 0s 0.00% 5m20.8s 8811.11%
CoreDNSErrorsHigh openshift-dns Warning 4.19 ppc64le ovn libvirt ha 101 28s 0.00% 3m28s 40.54%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn azure ha 133 11.2s 0.00% 3m17.04s 639.64%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.19 arm64 ovn aws ha 138 15s 0.00% 8m55.36s 33.37%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn aws single 147 1h16m0.8s 0.00% 2h34m59.84s 84.29%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn gcp ha 136 7s 0.00% 3m7s 30.26%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 arm64 ovn aws ha 138 4.2s 0.00% 1m58s 122.22%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn azure ha 133 0s 0.00% 1m48.4s 46.09%
/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@neisw
Copy link
Contributor

neisw commented Jan 24, 2025

/retest-required

Copy link

openshift-trt bot commented Jan 24, 2025

Job Failure Risk Analysis for sha: f79279c

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-fips Medium
[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension [Suite:openshift/conformance/parallel]
This test has passed 97.76% of 134 runs on jobs [periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-fips] in the last 14 days.

Open Bugs
Component Readiness: [Unknown] [Other] test regressed
Component Readiness: [Unknown] [Other] test regressed
Component Readiness: [Unknown] [Other] test regressed
---
[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed [Suite:openshift/conformance/parallel]
This test has passed 97.06% of 102 runs on jobs [periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-fips] in the last 14 days.

Open Bugs
Component Readiness: [Unknown] [Other] test regressed
pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones Medium
[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension [Suite:openshift/conformance/parallel]
This test has passed 94.23% of 104 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.

Open Bugs
Component Readiness: [Unknown] [Other] test regressed
Component Readiness: [Unknown] [Other] test regressed
Component Readiness: [Unknown] [Other] test regressed
---
[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed [Suite:openshift/conformance/parallel]
This test has passed 94.23% of 104 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.

Open Bugs
Component Readiness: [Unknown] [Other] test regressed

@openshift-bot openshift-bot force-pushed the no-issue--automated---update-synthetic-test-data branch from f79279c to b9b53ff Compare January 31, 2025 01:03
@neisw
Copy link
Contributor

neisw commented Jan 31, 2025

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Jan 31, 2025
Copy link
Contributor

openshift-ci bot commented Jan 31, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, neisw, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 6cc7c99 and 2 for PR HEAD b9b53ff in total

1 similar comment
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 6cc7c99 and 2 for PR HEAD b9b53ff in total

Copy link

openshift-trt bot commented Jan 31, 2025

Job Failure Risk Analysis for sha: b9b53ff

Job Name Failure Risk
pull-ci-openshift-origin-master-okd-scos-e2e-aws-ovn High
[sig-arch] Only known images used by tests
This test has passed 100.00% of 149 runs on jobs [periodic-ci-openshift-release-master-ci-4.19-e2e-aws-ovn] in the last 14 days.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD d8e21e6 and 1 for PR HEAD b9b53ff in total

Copy link
Contributor

openshift-ci bot commented Feb 1, 2025

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-scos-e2e-aws-ovn b9b53ff link false /test okd-scos-e2e-aws-ovn
ci/prow/e2e-aws-ovn-single-node-upgrade b9b53ff link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-single-node-serial b9b53ff link false /test e2e-aws-ovn-single-node-serial
ci/prow/e2e-aws-ovn-single-node b9b53ff link false /test e2e-aws-ovn-single-node

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD d8e21e6 and 2 for PR HEAD b9b53ff in total

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants