1 2Current cluster status: 3Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ] 4RemoteOFFLINE: [ overcloud-novacompute-0 ] 5Containers: [ galera-bundle-0:galera-bundle-docker-0 galera-bundle-1:galera-bundle-docker-1 galera-bundle-2:galera-bundle-docker-2 rabbitmq-bundle-0:rabbitmq-bundle-docker-0 rabbitmq-bundle-1:rabbitmq-bundle-docker-1 rabbitmq-bundle-2:rabbitmq-bundle-docker-2 redis-bundle-0:redis-bundle-docker-0 redis-bundle-1:redis-bundle-docker-1 redis-bundle-2:redis-bundle-docker-2 ] 6 7 fence1 (stonith:fence_xvm): Stopped 8 overcloud-novacompute-0 (ocf::pacemaker:remote): FAILED overcloud-controller-0 9 Docker container set: rabbitmq-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-rabbitmq:latest] 10 rabbitmq-bundle-0 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-0 11 rabbitmq-bundle-1 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-1 12 rabbitmq-bundle-2 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-2 13 Docker container set: galera-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-mariadb:latest] 14 galera-bundle-0 (ocf::heartbeat:galera): Master overcloud-controller-0 15 galera-bundle-1 (ocf::heartbeat:galera): Master overcloud-controller-1 16 galera-bundle-2 (ocf::heartbeat:galera): Master overcloud-controller-2 17 Docker container set: redis-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-redis:latest] 18 redis-bundle-0 (ocf::heartbeat:redis): Master overcloud-controller-0 19 redis-bundle-1 (ocf::heartbeat:redis): Slave overcloud-controller-1 20 redis-bundle-2 (ocf::heartbeat:redis): Slave overcloud-controller-2 21 ip-192.168.24.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0 22 ip-10.0.0.7 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1 23 ip-172.16.2.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2 24 ip-172.16.2.8 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0 25 ip-172.16.1.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1 26 ip-172.16.3.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2 27 Docker container set: haproxy-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-haproxy:latest] 28 haproxy-bundle-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-0 29 haproxy-bundle-docker-1 (ocf::heartbeat:docker): Started overcloud-controller-1 30 haproxy-bundle-docker-2 (ocf::heartbeat:docker): Started overcloud-controller-2 31 Docker container: openstack-cinder-volume [192.168.24.1:8787/tripleoupstream/centos-binary-cinder-volume:latest] 32 openstack-cinder-volume-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-0 33 Docker container: openstack-cinder-backup [192.168.24.1:8787/tripleoupstream/centos-binary-cinder-backup:latest] 34 openstack-cinder-backup-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-1 35 36Transition Summary: 37 * Fence (reboot) overcloud-novacompute-0 'the connection is unrecoverable' 38 * Start fence1 (overcloud-controller-0) 39 * Stop overcloud-novacompute-0 ( overcloud-controller-0 ) due to node availability 40 41Executing cluster transition: 42 * Resource action: fence1 monitor on overcloud-controller-2 43 * Resource action: fence1 monitor on overcloud-controller-1 44 * Resource action: fence1 monitor on overcloud-controller-0 45 * Resource action: overcloud-novacompute-0 stop on overcloud-controller-0 46 * Resource action: rabbitmq-bundle-0 monitor on overcloud-controller-2 47 * Resource action: rabbitmq-bundle-0 monitor on overcloud-controller-1 48 * Resource action: rabbitmq-bundle-1 monitor on overcloud-controller-2 49 * Resource action: rabbitmq-bundle-1 monitor on overcloud-controller-0 50 * Resource action: rabbitmq-bundle-2 monitor on overcloud-controller-1 51 * Resource action: rabbitmq-bundle-2 monitor on overcloud-controller-0 52 * Resource action: galera-bundle-0 monitor on overcloud-controller-2 53 * Resource action: galera-bundle-0 monitor on overcloud-controller-1 54 * Resource action: galera-bundle-1 monitor on overcloud-controller-2 55 * Resource action: galera-bundle-1 monitor on overcloud-controller-0 56 * Resource action: galera-bundle-2 monitor on overcloud-controller-1 57 * Resource action: galera-bundle-2 monitor on overcloud-controller-0 58 * Resource action: redis-bundle-0 monitor on overcloud-controller-2 59 * Resource action: redis-bundle-0 monitor on overcloud-controller-1 60 * Resource action: redis-bundle-1 monitor on overcloud-controller-2 61 * Resource action: redis-bundle-1 monitor on overcloud-controller-0 62 * Resource action: redis-bundle-2 monitor on overcloud-controller-1 63 * Resource action: redis-bundle-2 monitor on overcloud-controller-0 64 * Fencing overcloud-novacompute-0 (reboot) 65 * Resource action: fence1 start on overcloud-controller-0 66 * Resource action: fence1 monitor=60000 on overcloud-controller-0 67 68Revised cluster status: 69Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ] 70RemoteOFFLINE: [ overcloud-novacompute-0 ] 71Containers: [ galera-bundle-0:galera-bundle-docker-0 galera-bundle-1:galera-bundle-docker-1 galera-bundle-2:galera-bundle-docker-2 rabbitmq-bundle-0:rabbitmq-bundle-docker-0 rabbitmq-bundle-1:rabbitmq-bundle-docker-1 rabbitmq-bundle-2:rabbitmq-bundle-docker-2 redis-bundle-0:redis-bundle-docker-0 redis-bundle-1:redis-bundle-docker-1 redis-bundle-2:redis-bundle-docker-2 ] 72 73 fence1 (stonith:fence_xvm): Started overcloud-controller-0 74 overcloud-novacompute-0 (ocf::pacemaker:remote): Stopped 75 Docker container set: rabbitmq-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-rabbitmq:latest] 76 rabbitmq-bundle-0 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-0 77 rabbitmq-bundle-1 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-1 78 rabbitmq-bundle-2 (ocf::heartbeat:rabbitmq-cluster): Started overcloud-controller-2 79 Docker container set: galera-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-mariadb:latest] 80 galera-bundle-0 (ocf::heartbeat:galera): Master overcloud-controller-0 81 galera-bundle-1 (ocf::heartbeat:galera): Master overcloud-controller-1 82 galera-bundle-2 (ocf::heartbeat:galera): Master overcloud-controller-2 83 Docker container set: redis-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-redis:latest] 84 redis-bundle-0 (ocf::heartbeat:redis): Master overcloud-controller-0 85 redis-bundle-1 (ocf::heartbeat:redis): Slave overcloud-controller-1 86 redis-bundle-2 (ocf::heartbeat:redis): Slave overcloud-controller-2 87 ip-192.168.24.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0 88 ip-10.0.0.7 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1 89 ip-172.16.2.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2 90 ip-172.16.2.8 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0 91 ip-172.16.1.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1 92 ip-172.16.3.9 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2 93 Docker container set: haproxy-bundle [192.168.24.1:8787/tripleoupstream/centos-binary-haproxy:latest] 94 haproxy-bundle-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-0 95 haproxy-bundle-docker-1 (ocf::heartbeat:docker): Started overcloud-controller-1 96 haproxy-bundle-docker-2 (ocf::heartbeat:docker): Started overcloud-controller-2 97 Docker container: openstack-cinder-volume [192.168.24.1:8787/tripleoupstream/centos-binary-cinder-volume:latest] 98 openstack-cinder-volume-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-0 99 Docker container: openstack-cinder-backup [192.168.24.1:8787/tripleoupstream/centos-binary-cinder-backup:latest] 100 openstack-cinder-backup-docker-0 (ocf::heartbeat:docker): Started overcloud-controller-1 101 102