[jenkins] ha-functional-testing-weekly Smoke tests only (build 325) completed with 53 failures

53/126 Stages failed: - aliyun rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aliyun rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aliyun rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aliyun rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aliyun rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aliyun rhel8 zstream:no upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 2)

- aws rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aws rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aws rhel10 zstream:no upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel10 zstream:no upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aws rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aws rhel10 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aws rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- aws rhel9 zstream:no upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel9 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel9 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 2)

- azure rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- azure rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- azure rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- azure rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- azure rhel10 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- azure rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- gcp rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- gcp rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- gcp rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- gcp rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in Final delete_cluster

- gcp rhel10 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- gcp rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- gcp rhel8 zstream:no upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in pacemaker,recovery,RecoveryActiveNode

- gcp rhel8 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- ibmvpc rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- ibmvpc rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- ibmvpc rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- ibmvpc rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- ibmvpc rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- libvirt centos10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- libvirt centos10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- libvirt rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- libvirt rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- libvirt rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- libvirt rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- libvirt rhel10 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- libvirt rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- libvirt rhel8 zstream:no upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- ocpv centos10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- ocpv centos10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- ocpv rhel10 zstream:no upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- ocpv rhel10 zstream:no upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... - setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4) - pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot (nodes: 4)

- ocpv rhel10 zstream:yes upstream:main tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- ocpv rhel10 zstream:yes upstream:next-stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- ocpv rhel10 zstream:yes upstream:none tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

- ocpv rhel10 zstream:yes upstream:stable tests:smoke: https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testin... failed in deploy_cluster

Run reason: Started by upstream project "global/all-weekly" build number 67 Total runtime: 12 hr

Full log: https://ci.kronosnet.org/job/global/job/ha-functional-testing-weekly/325/con...