38/120 Stages failed: - osp rhel8 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5747/

- osp rhel8 zstream:yes none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5754/

- osp rhel9 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5774/

- osp rhel8 zstream:no stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5761/

- osp rhel9 zstream:no stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5776/

- osp rhel9 zstream:yes stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5777/

- osp rhel9 zstream:yes next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5779/

- osp rhel9 zstream:no next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5778/

- osp rhel9 zstream:no main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5780/

- osp rhel9 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5781/

- gcp rhel8 zstream:no stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5764/

- pacemaker,recovery,RecoveryActiveNode (nodes: 2)

- gcp rhel8 zstream:yes none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5757/

- pacemaker,recovery,RecoveryActiveNode (nodes: 3)

- aliyun rhel8 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5751/

- setup (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - setup (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 3) - setup (nodes: 4) - pacemaker,resource,IPv4,recovery (nodes: 4) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- gcp rhel8 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5750/

- pacemaker,recovery,RecoveryActiveNode (nodes: 3) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- azure rhel9 zstream:yes stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5800/

- gcp rhel9 zstream:yes none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5802/

- lvm,snapper,display_snap,nostack,singlenode (nodes: 1) - lvm,raid_sanity,display_raid,raid4,singlenode (nodes: 1) - pacemaker,resource,IPv4,recovery (nodes: 4)

- gcp rhel9 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5801/

- pacemaker,recovery,RecoveryActiveNode (nodes: 3)

- gcp rhel9 zstream:no stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5805/

- lvm,snapper,display_snap,nostack,singlenode (nodes: 1) - lvm,raid_sanity,display_raid,raid4,singlenode (nodes: 1) - pacemaker,resource,IPv4,recovery (nodes: 3)

- aws rhel9 zstream:no next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5814/

- pacemaker,resource,IPv4,recovery (nodes: 4)

- aliyun rhel10 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5824/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel9 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5820/

- pacemaker,resource,IPv4,recovery (nodes: 4)

- aliyun rhel10 zstream:yes none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5826/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel9 zstream:yes next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5817/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- libvirt rhel10 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5847/

- aliyun rhel10 zstream:no next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5829/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- gcp rhel8 zstream:yes stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5771/

- cleanup (nodes: 4)

- aliyun rhel10 zstream:yes next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5840/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel10 zstream:no none smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5839/

- pacemaker,resource,IPv4,recovery (nodes: 4)

- aliyun rhel10 zstream:no main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5843/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aliyun rhel10 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5848/

- pacemaker,resource,IPv4,recovery (nodes: 2) - pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- gcp rhel9 zstream:yes next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5838/

- lvm,snapper,display_snap,nostack,singlenode (nodes: 1) - lvm,raid_sanity,display_raid,raid4,singlenode (nodes: 1) - pacemaker,recovery,RecoveryActiveNode (nodes: 4)

- aws rhel10 zstream:no next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5845/

- pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- gcp rhel9 zstream:yes stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5832/

- lvm,snapper,display_snap,nostack,singlenode (nodes: 1) - lvm,raid_sanity,display_raid,raid4,singlenode (nodes: 1) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 3)

- gcp rhel9 zstream:no next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5833/

- lvm,snapper,display_snap,nostack,singlenode (nodes: 1) - lvm,raid_sanity,display_raid,raid4,singlenode (nodes: 1) - pacemaker,recovery,RecoveryActiveNode (nodes: 2) - pacemaker,recovery,RecoveryActiveNode (nodes: 3)

- aws rhel10 zstream:yes next-stable smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5850/

- pacemaker,resource,IPv4,recovery (nodes: 3) - pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel10 zstream:no main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5861/

- pacemaker,resource,IPv4,recovery (nodes: 4)

- aws rhel10 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5862/

- pacemaker,resource,IPv4,recovery (nodes: 4)

- gcp rhel9 zstream:yes main smoke: https://ci.kronosnet.org/job/global/job/ha-functional-testing/5864/

- pacemaker,recovery,RecoveryActiveNode (nodes: 4)

Run reason: Started by upstream project "global/all-weekly/default" build number 577 Total runtime: 11 hr

Full log: https://ci.kronosnet.org/job/global/job/ha-functional-testing-weekly/244/con...