I am increasing the num of units for each controller service from 3 to 4. For some services this has gone well, just add a unit, wait and then amend hacluster size with juju config service-hacluster cluster_count=4, with success on:
- ceilometer
- openstack-dashboard
- nova-cloud-controller
- glance
- designate
- designate-bind
However, some services have point blank refused to work with the new unit, so far:
- placement
- masakari
- gnocchi
In each case, I get shared-db incomplete status and Resource res_xxxx_vip not yet configured
gnocchi/3 waiting idle 3/lxd/10 10.0.0.159 8041/tcp 'shared-db' incomplete
gnocchi-hacluster/3 waiting idle 10.0.0.159 Resource: res_gnocchi_632a38e_vip not yet configured
gnocchi-mysql-router/3 active idle 10.0.0.159 Unit is ready
Also in each the haproxy config has no stanzas deployed on the new unit:
global
log /dev/log local0
log /dev/log local1 notice
chroot /var/lib/haproxy
stats socket /run/haproxy/admin.sock mode 660 level admin expose-fd listeners
stats timeout 30s
user haproxy
group haproxy
daemon
# Default SSL material locations
ca-base /etc/ssl/certs
crt-base /etc/ssl/private
# See: https://ssl-config.mozilla.org/#server=haproxy&server-version=2.0.3&config=intermediate
ssl-default-bind-ciphers ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384
ssl-default-bind-ciphersuites TLS_AES_128_GCM_SHA256:TLS_AES_256_GCM_SHA384:TLS_CHACHA20_POLY1305_SHA256
ssl-default-bind-options ssl-min-ver TLSv1.2 no-tls-tickets
defaults
log global
mode http
option httplog
option dontlognull
timeout connect 5000
timeout client 50000
timeout server 50000
errorfile 400 /etc/haproxy/errors/400.http
errorfile 403 /etc/haproxy/errors/403.http
errorfile 408 /etc/haproxy/errors/408.http
errorfile 500 /etc/haproxy/errors/500.http
errorfile 502 /etc/haproxy/errors/502.http
errorfile 503 /etc/haproxy/errors/503.http
errorfile 504 /etc/haproxy/errors/504.http
cluster status:
Cluster Summary:
* Stack: corosync
* Current DC: juju-e6c4b6-1-lxd-6 (version 2.1.2-ada5c3b36e2) - partition with quorum
* Last updated: Tue Mar 4 09:41:41 2025
* Last change: Tue Mar 4 08:56:34 2025 by hacluster via crmd on juju-e6c4b6-1-lxd-6
* 4 nodes configured
* 5 resource instances configured
Node List:
* Online: [ juju-e6c4b6-0-lxd-6 juju-e6c4b6-1-lxd-6 juju-e6c4b6-2-lxd-6 juju-e6c4b6-3-lxd-10 ]
Full List of Resources:
* Clone Set: cl_res_gnocchi_haproxy [res_gnocchi_haproxy]:
* Started: [ juju-e6c4b6-0-lxd-6 juju-e6c4b6-1-lxd-6 juju-e6c4b6-2-lxd-6 juju-e6c4b6-3-lxd-10 ]
* Resource Group: grp_gnocchi_vips:
* res_gnocchi_4de4811_vip (ocf:heartbeat:IPaddr2): Started juju-e6c4b6-0-lxd-6
2025-03-04 08:55:08 WARNING unit.gnocchi/3.cluster-relation-created logger.go:60 Synchronizing state of haproxy.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:08 WARNING unit.gnocchi/3.cluster-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable haproxy
2025-03-04 08:55:09 WARNING unit.gnocchi/3.cluster-relation-created logger.go:60 Unit /etc/systemd/system/haproxy.service is masked, ignoring.
2025-03-04 08:55:09 INFO unit.gnocchi/3.juju-log server.go:325 cluster:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:117:broken:certificates
2025-03-04 08:55:10 INFO juju.worker.uniter.operation runhook.go:186 ran "cluster-relation-created" hook (via explicit, bespoke hook script)
2025-03-04 08:55:12 INFO unit.gnocchi/3.juju-log server.go:325 coordinator-memcached:101: Reactive main running for hook coordinator-memcached-relation-created
2025-03-04 08:55:12 INFO unit.gnocchi/3.juju-log server.go:325 coordinator-memcached:101: Invoking reactive handler: reactive/gnocchi_handlers.py:177:storage_ceph_disconnected
2025-03-04 08:55:12 INFO unit.gnocchi/3.juju-log server.go:325 coordinator-memcached:101: Invoking reactive handler: reactive/layer_openstack.py:161:default_config_not_rendered
2025-03-04 08:55:12 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Synchronizing state of gnocchi-metricd.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:12 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable gnocchi-metricd
2025-03-04 08:55:12 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Unit /etc/systemd/system/gnocchi-metricd.service is masked, ignoring.
2025-03-04 08:55:13 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Synchronizing state of apache2.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:13 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable apache2
2025-03-04 08:55:13 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Unit /etc/systemd/system/apache2.service is masked, ignoring.
2025-03-04 08:55:13 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Synchronizing state of memcached.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:13 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable memcached
2025-03-04 08:55:14 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Unit /etc/systemd/system/memcached.service is masked, ignoring.
2025-03-04 08:55:14 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Synchronizing state of haproxy.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:14 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable haproxy
2025-03-04 08:55:14 WARNING unit.gnocchi/3.coordinator-memcached-relation-created logger.go:60 Unit /etc/systemd/system/haproxy.service is masked, ignoring.
2025-03-04 08:55:15 INFO unit.gnocchi/3.juju-log server.go:325 coordinator-memcached:101: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:117:broken:certificates
2025-03-04 08:55:16 INFO juju.worker.uniter.operation runhook.go:186 ran "coordinator-memcached-relation-created" hook (via explicit, bespoke hook script)
2025-03-04 08:55:24 INFO unit.gnocchi/3.juju-log server.go:325 metric-service:93: Reactive main running for hook metric-service-relation-created
2025-03-04 08:55:25 INFO unit.gnocchi/3.juju-log server.go:325 metric-service:93: Invoking reactive handler: reactive/gnocchi_handlers.py:177:storage_ceph_disconnected
2025-03-04 08:55:25 INFO unit.gnocchi/3.juju-log server.go:325 metric-service:93: Invoking reactive handler: reactive/layer_openstack.py:161:default_config_not_rendered
2025-03-04 08:55:25 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Synchronizing state of gnocchi-metricd.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:25 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable gnocchi-metricd
2025-03-04 08:55:25 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Unit /etc/systemd/system/gnocchi-metricd.service is masked, ignoring.
2025-03-04 08:55:26 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Synchronizing state of apache2.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:26 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable apache2
2025-03-04 08:55:26 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Unit /etc/systemd/system/apache2.service is masked, ignoring.
2025-03-04 08:55:26 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Synchronizing state of memcached.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:26 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable memcached
2025-03-04 08:55:27 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Unit /etc/systemd/system/memcached.service is masked, ignoring.
2025-03-04 08:55:27 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Synchronizing state of haproxy.service with SysV service script with /lib/systemd/systemd-sysv-install.
2025-03-04 08:55:27 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable haproxy
2025-03-04 08:55:27 WARNING unit.gnocchi/3.metric-service-relation-created logger.go:60 Unit /etc/systemd/system/haproxy.service is masked, ignoring.
2025-03-04 08:55:28 INFO unit.gnocchi/3.juju-log server.go:325 metric-service:93: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:117:broken:certificates
2025-03-04 08:55:28 INFO juju.worker.uniter.operation runhook.go:186 ran "metric-service-relation-created" hook (via explicit, bespoke hook script)
2025-03-04 08:55:31 INFO unit.gnocchi/3.juju-log server.go:325 storage-ceph:100: Reactive main running for hook storage-ceph-relation-created
2025-03-04 08:55:32 INFO unit.gnocchi/3.juju-log server.go:325 storage-ceph:100: Invoking reactive handler: reactive/gnocchi_handlers.py:177:storage_ceph_disconnected
2025-03-04 08:55:32 INFO unit.gnocchi/3.juju-log server.go:325 storage-ceph:100: Invoking reactive handler: reactive/layer_openstack.py:161:default_config_not_rendered
:
2025-03-04 08:48:36 INFO juju unit_agent.go:289 Starting unit workers for "gnocchi-hacluster/3"
2025-03-04 08:48:36 INFO juju.worker.apicaller connect.go:163 [2551fd] "unit-gnocchi-hacluster-3" successfully connected to "10.0.10.10:17070"
2025-03-04 08:48:36 INFO juju.worker.apicaller connect.go:260 [2551fd] password changed for "unit-gnocchi-hacluster-3"
2025-03-04 08:48:36 INFO juju.worker.apicaller connect.go:163 [2551fd] "unit-gnocchi-hacluster-3" successfully connected to "10.0.10.10:17070"
2025-03-04 08:48:36 INFO juju.worker.upgrader upgrader.go:141 no waiter, upgrader is done
2025-03-04 08:48:36 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE
2025-03-04 08:48:36 INFO juju.worker.logger logger.go:120 logger worker started
2025-03-04 08:48:37 INFO juju.worker.uniter uniter.go:363 unit "gnocchi-hacluster/3" started
2025-03-04 08:48:37 INFO juju.worker.uniter uniter.go:689 resuming charm install
2025-03-04 08:48:37 INFO juju.worker.uniter.charm bundles.go:82 downloading ch:amd64/jammy/hacluster-131 from API server
2025-03-04 08:48:38 INFO juju.worker.uniter uniter.go:389 hooks are retried true
2025-03-04 08:48:38 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready
2025-03-04 08:48:38 INFO juju.worker.uniter resolver.go:185 found queued "install" hook
2025-03-04 08:48:43 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing)
2025-03-04 08:48:44 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Installed initial corosync.conf file
2025-03-04 08:48:47 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Installing ['crmsh', 'corosync', 'pacemaker', 'ipmitool', 'libmonitoring-plugin-perl', 'python3-requests-oauthlib', 'python3-libmaas', 'resource-agents-extra'] with options: ['--option=Dpkg::Options::=--force-confold']
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/ceph root:root 555
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/maas root:root 555
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /etc/corosync/uidgid.d root:root 555
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/ceph/rbd /usr/lib/ocf/resource.d/ceph/rbd
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/dns /usr/lib/ocf/resource.d/maas/dns
2025-03-04 08:49:07 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_dns.py /usr/lib/heartbeat/maas_dns.py
2025-03-04 08:49:08 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maasclient/ /usr/lib/heartbeat/maasclient/
2025-03-04 08:49:08 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_stonith_plugin.py /usr/lib/stonith/plugins/external/maas
2025-03-04 08:49:29 INFO juju.worker.uniter.operation runhook.go:186 ran "install" hook (via explicit, bespoke hook script)
2025-03-04 08:54:59 INFO juju.worker.uniter.operation runhook.go:189 skipped "hanode-relation-created" hook (missing)
2025-03-04 08:55:04 INFO juju.worker.uniter.operation runhook.go:189 skipped "ha-relation-created" hook (missing)
2025-03-04 08:55:10 INFO juju.worker.uniter.operation runhook.go:189 skipped "leader-settings-changed" hook (missing)
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/ceph root:root 555
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/maas root:root 555
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /etc/corosync/uidgid.d root:root 555
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/ceph/rbd /usr/lib/ocf/resource.d/ceph/rbd
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/dns /usr/lib/ocf/resource.d/maas/dns
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_dns.py /usr/lib/heartbeat/maas_dns.py
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maasclient/ /usr/lib/heartbeat/maasclient/
2025-03-04 08:55:16 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_stonith_plugin.py /usr/lib/stonith/plugins/external/maas
2025-03-04 08:55:20 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Corosync and Pacemaker are validated as up and running.
2025-03-04 08:55:21 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Installing python-dbus with options: ['--option=Dpkg::Options::=--force-confold']
2025-03-04 08:55:21 WARNING unit.gnocchi-hacluster/3.config-changed logger.go:60 E: Package 'python-dbus' has no installation candidate
2025-03-04 08:55:23 INFO juju.worker.uniter.operation runhook.go:186 ran "config-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:55:23 INFO juju.worker.uniter resolver.go:185 found queued "start" hook
2025-03-04 08:55:30 INFO juju.worker.uniter.operation runhook.go:186 ran "start" hook (via explicit, bespoke hook script)
2025-03-04 08:55:36 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-joined" hook (via explicit, bespoke hook script)
2025-03-04 08:55:42 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 ha:92: Not enough nodes in cluster, deferring configuration
2025-03-04 08:55:43 INFO juju.worker.uniter.operation runhook.go:186 ran "ha-relation-joined" hook (via explicit, bespoke hook script)
2025-03-04 08:55:50 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 ha:92: Not enough nodes in cluster, deferring configuration
2025-03-04 08:55:51 INFO juju.worker.uniter.operation runhook.go:186 ran "ha-relation-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:55:57 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: Checking if any units have notified about a series upgrade
2025-03-04 08:55:57 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: No units have notified a series upgrade
2025-03-04 08:55:57 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: Not enough nodes in cluster, deferring configuration
2025-03-04 08:55:58 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:56:07 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-joined" hook (via explicit, bespoke hook script)
2025-03-04 08:56:13 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: Checking if any units have notified about a series upgrade
2025-03-04 08:56:13 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: No units have notified a series upgrade
2025-03-04 08:56:19 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: Corosync and Pacemaker are validated as up and running.
2025-03-04 08:56:20 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:56:28 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-joined" hook (via explicit, bespoke hook script)
2025-03-04 08:56:49 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 ha:92: Corosync and Pacemaker are validated as up and running.
2025-03-04 08:56:50 INFO juju.worker.uniter.operation runhook.go:186 ran "ha-relation-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:56:57 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: Checking if any units have notified about a series upgrade
2025-03-04 08:56:57 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 hanode:11: No units have notified a series upgrade
2025-03-04 08:57:20 INFO juju.worker.uniter.operation runhook.go:186 ran "hanode-relation-changed" hook (via explicit, bespoke hook script)
2025-03-04 08:59:42 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:04:57 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/ceph root:root 555
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /usr/lib/ocf/resource.d/maas root:root 555
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Making dir /etc/corosync/uidgid.d root:root 555
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/ceph/rbd /usr/lib/ocf/resource.d/ceph/rbd
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/dns /usr/lib/ocf/resource.d/maas/dns
2025-03-04 09:08:29 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_dns.py /usr/lib/heartbeat/maas_dns.py
2025-03-04 09:08:30 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maasclient/ /usr/lib/heartbeat/maasclient/
2025-03-04 09:08:30 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 /usr/bin/rsync -r --delete --executability files/ocf/maas/maas_stonith_plugin.py /usr/lib/stonith/plugins/external/maas
2025-03-04 09:08:30 INFO unit.gnocchi-hacluster/3.juju-log server.go:325 Installing python-dbus with options: ['--option=Dpkg::Options::=--force-confold']
2025-03-04 09:08:31 WARNING unit.gnocchi-hacluster/3.config-changed logger.go:60 E: Package 'python-dbus' has no installation candidate
2025-03-04 09:08:32 WARNING unit.gnocchi-hacluster/3.config-changed logger.go:60 WARNING: (unpack_config) warning: Blind faith: not fencing unseen nodes
2025-03-04 09:08:37 INFO juju.worker.uniter.operation runhook.go:186 ran "config-changed" hook (via explicit, bespoke hook script)
2025-03-04 09:09:53 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:15:48 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:21:08 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:26:25 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:30:53 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:36:15 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:41:03 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:45:25 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
2025-03-04 09:50:36 INFO juju.worker.uniter.operation runhook.go:186 ran "update-status" hook (via explicit, bespoke hook script)
For all the problematic services, they all follow a similar pattern as above. Have tried removing the failed unit and trying again, no joy.
The 3 original units are working flawless. Other items of note: Vault is a cross model relation.
SAAS Status Store URL
alertmanager-karma-dashboard active ixd1-juju-1 admin/cos.alertmanager-karma-dashboard
grafana-dashboards active ixd1-juju-1 admin/cos.grafana-dashboards
keystone-admin-common active ixd1-juju-1 admin/central-tibus-cloud.central-keystone-admin
keystone-common active ixd1-juju-1 admin/central-tibus-cloud.keystone
keystone-credentials-common active ixd1-juju-1 admin/central-tibus-cloud.central-keystone-credentials
keystone-notifications-common active ixd1-juju-1 admin/central-tibus-cloud.central-keystone-notifications
loki-logging active ixd1-juju-1 admin/cos.loki-logging
prometheus-metrics active ixd1-juju-1 admin/cos.prometheus-metrics
prometheus-receive-remote-write active ixd1-juju-1 admin/cos.prometheus-receive-remote-write
vault-common active ixd1-juju-1 admin/central-tibus-cloud.vault
App Version Status Scale Charm Channel Rev Exposed Message
ceilometer 21.0.0 active 4 ceilometer 2024.1/candidate 563 no Unit is ready
ceilometer-agent 21.0.0 active 4 ceilometer-agent 2024.1/candidate 527 no Unit is ready
ceilometer-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
ceph-dashboard active 3 ceph-dashboard reef/stable 51 no Unit is ready
ceph-dashboard-lb active 3 openstack-loadbalancer jammy/stable 10 no Unit is ready
ceph-dashboard-lb-hacluster 2.1.2 active 3 hacluster 2.4/stable 131 no Unit is ready and clustered
ceph-mon 18.2.4 active 3 ceph-mon reef/stable 229 no Unit is ready and clustered
ceph-osd 18.2.4 active 4 ceph-osd reef/stable 616 no Unit is ready (4 OSD)
ceph-radosgw 18.2.4 active 3 ceph-radosgw reef/stable 574 yes Unit is ready
ceph-radosgw-hacluster 2.1.2 active 3 hacluster 2.4/stable 131 no Unit is ready and clustered
cinder 23.0.0 active 3 cinder 2024.1/candidate 690 no Unit is ready
cinder-backup 23.0.0 active 3 cinder-backup 2024.1/candidate 81 no Unit is ready
cinder-ceph 23.0.0 active 3 cinder-ceph 2024.1/candidate 533 no Unit is ready
cinder-hacluster 2.1.2 active 3 hacluster 2.4/stable 131 no Unit is ready and clustered
cinder-mysql-router 8.0.41 active 3 mysql-router 8.0/stable 257 no Unit is ready
dashboard-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
designate 17.0.1 active 4 designate 2024.1/candidate 257 no Unit is ready
designate-bind 9.18.30 active 4 designate-bind 2024.1/candidate 156 no Unit is ready
designate-bind-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
designate-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
designate-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
glance 27.0.0 active 4 glance 2024.1/candidate 621 no Unit is ready
glance-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
glance-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
gnocchi 4.6.0 waiting 4 gnocchi 2024.1/candidate 195 no 'shared-db' incomplete
gnocchi-hacluster 2.1.2 waiting 4 hacluster 2.4/stable 131 no Resource: res_gnocchi_632a38e_vip not yet configured
gnocchi-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
grafana-agent active 6 grafana-agent latest/stable 223 no
masakari 16.0.0 active 3 masakari 2024.1/candidate 87 no Unit is ready
masakari-hacluster 2.1.2 active 3 hacluster 2.4/stable 131 no Unit is ready and clustered
masakari-monitors 16.0.0 active 4 masakari-monitors 2024.1/candidate 103 no Unit is ready
masakari-mysql-router 8.0.41 active 3 mysql-router 8.0/stable 257 no Unit is ready
memcached active 1 memcached latest/stable 39 no Unit is ready
mysql-innodb-cluster 8.0.41 active 3 mysql-innodb-cluster 8.0/stable 153 no Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
neutron-api 23.1.0 active 3 neutron-api 2024.1/candidate 603 no Unit is ready
neutron-api-hacluster 2.1.2 active 3 hacluster 2.4/stable 131 no Unit is ready and clustered
neutron-api-plugin-ovn 23.1.0 active 3 neutron-api-plugin-ovn 2024.1/candidate 137 no Unit is ready
neutron-mysql-router 8.0.41 active 3 mysql-router 8.0/stable 257 no Unit is ready
nova-cloud-controller 28.2.0 active 4 nova-cloud-controller 2024.1/candidate 755 no Unit is ready
nova-cloud-controller-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
nova-compute 28.2.0 active 4 nova-compute 2024.1/candidate 771 no Unit is ready
nova-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
nova-workarounds active 4 nova-workarounds 0 no Unit is ready
openstack-dashboard 23.3.0 active 4 openstack-dashboard 2024.1/candidate 678 no Unit is ready
openstack-dashboard-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
openstack-exporter active 3 openstack-exporter latest/stable 31 no
ovn-central 22.09.1 active 3 ovn-central 23.09/stable 234 no Unit is ready
ovn-chassis 23.09.3 active 4 ovn-chassis 23.09/stable 296 no Unit is ready
pacemaker-remote active 4 pacemaker-remote jammy/stable 23 no Unit is ready
placement 10.0.0 active 4 placement 2024.1/candidate 102 no Unit is ready
placement-hacluster 2.1.2 active 4 hacluster 2.4/stable 131 no Unit is ready and clustered
placement-mysql-router 8.0.41 active 4 mysql-router 8.0/stable 257 no Unit is ready
rabbitmq-server 3.9.27 active 3 rabbitmq-server 3.9/stable 227 no Unit is ready and clustered
Unit Workload Agent Machine Public address Ports Message
ceilometer/3* active idle 4/lxd/8 10.0.10.153 Unit is ready
ceilometer-hacluster/3 active idle 10.0.10.153 Unit is ready and clustered
ceilometer/4 active idle 3/lxd/9 10.0.10.181 Unit is ready
ceilometer-hacluster/4* active idle 10.0.10.181 Unit is ready and clustered
ceilometer/5 active idle 5/lxd/8 10.0.10.217 Unit is ready
ceilometer-hacluster/5 active idle 10.0.10.217 Unit is ready and clustered
ceilometer/6 active idle 6/lxd/8 10.0.10.218 Unit is ready
ceilometer-hacluster/6 active idle 10.0.10.218 Unit is ready and clustered
ceph-dashboard-lb/0* active idle 0/lxd/1 10.0.10.160 Unit is ready
ceph-dashboard-lb-hacluster/1 active idle 10.0.10.160 Unit is ready and clustered
ceph-dashboard-lb/1 active idle 1/lxd/1 10.0.10.196 Unit is ready
ceph-dashboard-lb-hacluster/2* active idle 10.0.10.196 Unit is ready and clustered
ceph-dashboard-lb/2 active idle 2/lxd/1 10.0.10.157 Unit is ready
ceph-dashboard-lb-hacluster/0 active idle 10.0.10.157 Unit is ready and clustered
ceph-mon/0* active idle 0/lxd/2 10.0.10.184 Unit is ready and clustered
ceph-dashboard/2* active idle 10.0.10.184 Unit is ready
grafana-agent/5* active idle 10.0.10.184
ceph-mon/1 active idle 1/lxd/2 10.0.10.177 Unit is ready and clustered
ceph-dashboard/1 active idle 10.0.10.177 Unit is ready
grafana-agent/4 active idle 10.0.10.177
ceph-mon/5 active idle 2/lxd/18 10.0.10.205 Unit is ready and clustered
ceph-dashboard/31 active idle 10.0.10.205 Unit is ready
grafana-agent/42 active idle 10.0.10.205
ceph-osd/0* active idle 3 10.0.10.135 Unit is ready (4 OSD)
ceph-osd/1 active idle 4 10.0.10.134 Unit is ready (4 OSD)
ceph-osd/2 active idle 5 10.0.10.136 Unit is ready (4 OSD)
ceph-osd/3 active idle 6 10.0.10.137 Unit is ready (4 OSD)
ceph-radosgw/0* active idle 0/lxd/3 10.0.10.180 443/tcp Unit is ready
ceph-radosgw-hacluster/1* active idle 10.0.10.180 Unit is ready and clustered
ceph-radosgw/1 active idle 1/lxd/3 10.0.10.192 443/tcp Unit is ready
ceph-radosgw-hacluster/2 active idle 10.0.10.192 Unit is ready and clustered
ceph-radosgw/2 active idle 2/lxd/3 10.0.10.156 443/tcp Unit is ready
ceph-radosgw-hacluster/0 active idle 10.0.10.156 Unit is ready and clustered
cinder/0 active idle 0/lxd/4 10.0.10.162 8776/tcp Unit is ready
cinder-backup/2 active idle 10.0.10.162 Unit is ready
cinder-ceph/2 active idle 10.0.10.162 Unit is ready
cinder-hacluster/2 active idle 10.0.10.162 Unit is ready and clustered
cinder-mysql-router/2* active idle 10.0.10.162 Unit is ready
cinder/1* active idle 1/lxd/4 10.0.10.176 8776/tcp Unit is ready
cinder-backup/1* active idle 10.0.10.176 Unit is ready
cinder-ceph/1* active idle 10.0.10.176 Unit is ready
cinder-hacluster/1* active idle 10.0.10.176 Unit is ready and clustered
cinder-mysql-router/1 active idle 10.0.10.176 Unit is ready
cinder/2 active idle 2/lxd/4 10.0.10.158 8776/tcp Unit is ready
cinder-backup/0 active idle 10.0.10.158 Unit is ready
cinder-ceph/0 active idle 10.0.10.158 Unit is ready
cinder-hacluster/0 active idle 10.0.10.158 Unit is ready and clustered
cinder-mysql-router/0 active idle 10.0.10.158 Unit is ready
designate-bind/3 active idle 6/lxd/1 10.0.10.206 Unit is ready
designate-bind-hacluster/3 active idle 10.0.10.206 Unit is ready and clustered
designate-bind/4 active idle 3/lxd/1 10.0.10.209 Unit is ready
designate-bind-hacluster/5* active idle 10.0.10.209 Unit is ready and clustered
designate-bind/5* active idle 4/lxd/1 10.0.10.212 Unit is ready
designate-bind-hacluster/6 active idle 10.0.10.212 Unit is ready and clustered
designate-bind/6 active idle 5/lxd/1 10.0.10.207 Unit is ready
designate-bind-hacluster/4 active idle 10.0.10.207 Unit is ready and clustered
designate/3 active idle 6/lxd/0 10.0.10.151 9001/tcp Unit is ready
designate-hacluster/3 active idle 10.0.10.151 Unit is ready and clustered
designate-mysql-router/3* active idle 10.0.10.151 Unit is ready
designate/4 active idle 3/lxd/0 10.0.10.210 9001/tcp Unit is ready
designate-hacluster/5 active idle 10.0.10.210 Unit is ready and clustered
designate-mysql-router/5 active idle 10.0.10.210 Unit is ready
designate/5* active idle 4/lxd/0 10.0.10.211 9001/tcp Unit is ready
designate-hacluster/6 active idle 10.0.10.211 Unit is ready and clustered
designate-mysql-router/6 active idle 10.0.10.211 Unit is ready
designate/6 active idle 5/lxd/0 10.0.10.208 9001/tcp Unit is ready
designate-hacluster/4* active idle 10.0.10.208 Unit is ready and clustered
designate-mysql-router/4 active idle 10.0.10.208 Unit is ready
glance/3* active idle 3/lxd/3 10.0.10.150 9292/tcp Unit is ready
glance-hacluster/6 active idle 10.0.10.150 Unit is ready and clustered
glance-mysql-router/6 active idle 10.0.10.150 Unit is ready
glance/4 active idle 4/lxd/3 10.0.10.172 9292/tcp Unit is ready
glance-hacluster/5 active idle 10.0.10.172 Unit is ready and clustered
glance-mysql-router/5* active idle 10.0.10.172 Unit is ready
glance/5 active idle 5/lxd/3 10.0.10.197 9292/tcp Unit is ready
glance-hacluster/3* active idle 10.0.10.197 Unit is ready and clustered
glance-mysql-router/3 active idle 10.0.10.197 Unit is ready
glance/6 active idle 6/lxd/3 10.0.10.203 9292/tcp Unit is ready
glance-hacluster/4 active idle 10.0.10.203 Unit is ready and clustered
glance-mysql-router/4 active idle 10.0.10.203 Unit is ready
gnocchi/0 active idle 0/lxd/6 10.0.10.190 8041/tcp Unit is ready
gnocchi-hacluster/1 active idle 10.0.10.190 Unit is ready and clustered
gnocchi-mysql-router/1 active idle 10.0.10.190 Unit is ready
gnocchi/1* active idle 1/lxd/6 10.0.10.191 8041/tcp Unit is ready
gnocchi-hacluster/2* active idle 10.0.10.191 Unit is ready and clustered
gnocchi-mysql-router/2* active idle 10.0.10.191 Unit is ready
gnocchi/2 active idle 2/lxd/6 10.0.10.164 8041/tcp Unit is ready
gnocchi-hacluster/0 active idle 10.0.10.164 Unit is ready and clustered
gnocchi-mysql-router/0 active idle 10.0.10.164 Unit is ready
gnocchi/3 waiting idle 3/lxd/10 10.0.10.159 8041/tcp 'shared-db' incomplete
gnocchi-hacluster/3 waiting idle 10.0.10.159 Resource: res_gnocchi_632a38e_vip not yet configured
gnocchi-mysql-router/3 active idle 10.0.10.159 Unit is ready
masakari/0* active idle 0/lxd/7 10.0.10.171 15868/tcp Unit is ready
masakari-hacluster/2* active idle 10.0.10.171 Unit is ready and clustered
masakari-mysql-router/2* active idle 10.0.10.171 Unit is ready
masakari/1 active idle 1/lxd/7 10.0.10.174 15868/tcp Unit is ready
masakari-hacluster/0 active idle 10.0.10.174 Unit is ready and clustered
masakari-mysql-router/0 active idle 10.0.10.174 Unit is ready
masakari/2 active idle 2/lxd/7 10.0.10.166 15868/tcp Unit is ready
masakari-hacluster/1 active idle 10.0.10.166 Unit is ready and clustered
masakari-mysql-router/1 active idle 10.0.10.166 Unit is ready
memcached/0* active idle 0/lxd/8 10.0.10.189 11211/tcp Unit is ready
mysql-innodb-cluster/0 active idle 0/lxd/9 10.0.10.183 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/1 active idle 1/lxd/8 10.0.10.194 Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure.
mysql-innodb-cluster/2* active idle 2/lxd/8 10.0.10.167 Unit is ready: Mode: R/W, Cluster is ONLINE and can tolerate up to ONE failure.
neutron-api/0 active idle 0/lxd/10 10.0.10.161 9696/tcp Unit is ready
neutron-api-hacluster/1 active idle 10.0.10.161 Unit is ready and clustered
neutron-api-plugin-ovn/1 active idle 10.0.10.161 Unit is ready
neutron-mysql-router/1 active idle 10.0.10.161 Unit is ready
neutron-api/1* active idle 1/lxd/9 10.0.10.195 9696/tcp Unit is ready
neutron-api-hacluster/2* active idle 10.0.10.195 Unit is ready and clustered
neutron-api-plugin-ovn/2* active idle 10.0.10.195 Unit is ready
neutron-mysql-router/2* active idle 10.0.10.195 Unit is ready
neutron-api/2 active idle 2/lxd/9 10.0.10.165 9696/tcp Unit is ready
neutron-api-hacluster/0 active idle 10.0.10.165 Unit is ready and clustered
neutron-api-plugin-ovn/0 active idle 10.0.10.165 Unit is ready
neutron-mysql-router/0 active idle 10.0.10.165 Unit is ready
nova-cloud-controller/3 active idle 3/lxd/4 10.0.10.154 8774-8775/tcp Unit is ready
nova-cloud-controller-hacluster/6* active idle 10.0.10.154 Unit is ready and clustered
nova-mysql-router/6 active idle 10.0.10.154 Unit is ready
nova-cloud-controller/4* active idle 4/lxd/4 10.0.10.198 8774-8775/tcp Unit is ready
nova-cloud-controller-hacluster/3 active idle 10.0.10.198 Unit is ready and clustered
nova-mysql-router/3 active idle 10.0.10.198 Unit is ready
nova-cloud-controller/5 active idle 5/lxd/4 10.0.10.170 8774-8775/tcp Unit is ready
nova-cloud-controller-hacluster/4 active idle 10.0.10.170 Unit is ready and clustered
nova-mysql-router/4 active idle 10.0.10.170 Unit is ready
nova-cloud-controller/6 active idle 6/lxd/4 10.0.10.204 8774-8775/tcp Unit is ready
nova-cloud-controller-hacluster/5 active idle 10.0.10.204 Unit is ready and clustered
nova-mysql-router/5* active idle 10.0.10.204 Unit is ready
nova-compute/0 active idle 3 10.0.10.135 Unit is ready
ceilometer-agent/0* active idle 10.0.10.135 Unit is ready
masakari-monitors/0 active idle 10.0.10.135 Unit is ready
nova-workarounds/4 active idle 10.0.10.135 Unit is ready
ovn-chassis/0* active idle 10.0.10.135 Unit is ready
pacemaker-remote/0 active idle 10.0.10.135 Unit is ready
nova-compute/1* active idle 4 10.0.10.134 Unit is ready
ceilometer-agent/3 active idle 10.0.10.134 Unit is ready
masakari-monitors/3 active idle 10.0.10.134 Unit is ready
nova-workarounds/3 active idle 10.0.10.134 Unit is ready
ovn-chassis/3 active idle 10.0.10.134 Unit is ready
pacemaker-remote/3 active idle 10.0.10.134 Unit is ready
nova-compute/2 active idle 5 10.0.10.136 Unit is ready
ceilometer-agent/1 active idle 10.0.10.136 Unit is ready
masakari-monitors/1* active idle 10.0.10.136 Unit is ready
nova-workarounds/0* active idle 10.0.10.136 Unit is ready
ovn-chassis/1 active idle 10.0.10.136 Unit is ready
pacemaker-remote/1 active idle 10.0.10.136 Unit is ready
nova-compute/3 active idle 6 10.0.10.137 Unit is ready
ceilometer-agent/2 active idle 10.0.10.137 Unit is ready
masakari-monitors/2 active idle 10.0.10.137 Unit is ready
nova-workarounds/1 active idle 10.0.10.137 Unit is ready
ovn-chassis/2 active idle 10.0.10.137 Unit is ready
pacemaker-remote/2* active idle 10.0.10.137 Unit is ready
openstack-dashboard/3 active idle 3/lxd/2 10.0.10.201 80,443/tcp Unit is ready
dashboard-mysql-router/5 active idle 10.0.10.201 Unit is ready
openstack-dashboard-hacluster/5 active idle 10.0.10.201 Unit is ready and clustered
openstack-dashboard/4* active idle 4/lxd/2 10.0.10.199 80,443/tcp Unit is ready
dashboard-mysql-router/3 active idle 10.0.10.199 Unit is ready
openstack-dashboard-hacluster/3 active idle 10.0.10.199 Unit is ready and clustered
openstack-dashboard/5 active idle 5/lxd/2 10.0.10.202 80,443/tcp Unit is ready
dashboard-mysql-router/4* active idle 10.0.10.202 Unit is ready
openstack-dashboard-hacluster/4 active idle 10.0.10.202 Unit is ready and clustered
openstack-dashboard/6 active idle 6/lxd/2 10.0.10.200 80,443/tcp Unit is ready
dashboard-mysql-router/6 active idle 10.0.10.200 Unit is ready
openstack-dashboard-hacluster/6* active idle 10.0.10.200 Unit is ready and clustered
openstack-exporter/0* active idle 0/lxd/13 10.0.10.178
grafana-agent/1 active idle 10.0.10.178
openstack-exporter/1 active idle 1/lxd/12 10.0.10.187
grafana-agent/2 active idle 10.0.10.187
openstack-exporter/2 active idle 2/lxd/12 10.0.10.152
grafana-agent/0 active idle 10.0.10.152
ovn-central/0* active idle 0/lxd/14 10.0.10.179 6641-6642/tcp Unit is ready
ovn-central/1 active idle 1/lxd/13 10.0.10.175 6641-6642/tcp Unit is ready (leader: ovnnb_db, ovnsb_db northd: active)
ovn-central/2 active idle 2/lxd/13 10.0.10.169 6641-6642/tcp Unit is ready
placement/7 active idle 3/lxd/6 10.0.10.173 8778/tcp Unit is ready
placement-hacluster/12* active idle 10.0.10.173 Unit is ready and clustered
placement-mysql-router/20 active idle 10.0.10.173 Unit is ready
placement/8* active idle 4/lxd/6 10.0.10.213 8778/tcp Unit is ready
placement-hacluster/10 active idle 10.0.10.213 Unit is ready and clustered
placement-mysql-router/17* active idle 10.0.10.213 Unit is ready
placement/9 active idle 5/lxd/6 10.0.10.214 8778/tcp Unit is ready
placement-hacluster/11 active idle 10.0.10.214 Unit is ready and clustered
placement-mysql-router/16 active idle 10.0.10.214 Unit is ready
placement/10 active idle 6/lxd/6 10.0.10.216 8778/tcp Unit is ready
placement-hacluster/13 active idle 10.0.10.216 Unit is ready and clustered
placement-mysql-router/19 active idle 10.0.10.216 Unit is ready
rabbitmq-server/0 active idle 0/lxd/16 10.0.10.182 5672,15672/tcp Unit is ready and clustered
rabbitmq-server/1* active idle 1/lxd/15 10.0.10.188 5672,15672/tcp Unit is ready and clustered
rabbitmq-server/2 active idle 2/lxd/15 10.0.10.155 5672,15672/tcp Unit is ready and clustered
Machine State Address Inst id Base AZ Message
0 started 10.0.10.132 os-eu1-ctrl-2 ubuntu@22.04 eu1 Deployed
0/lxd/1 started 10.0.10.160 juju-e6c4b6-0-lxd-1 ubuntu@22.04 eu1 Container started
0/lxd/2 started 10.0.10.184 juju-e6c4b6-0-lxd-2 ubuntu@22.04 eu1 Container started
0/lxd/3 started 10.0.10.180 juju-e6c4b6-0-lxd-3 ubuntu@22.04 eu1 Container started
0/lxd/4 started 10.0.10.162 juju-e6c4b6-0-lxd-4 ubuntu@22.04 eu1 Container started
0/lxd/6 started 10.0.10.190 juju-e6c4b6-0-lxd-6 ubuntu@22.04 eu1 Container started
0/lxd/7 started 10.0.10.171 juju-e6c4b6-0-lxd-7 ubuntu@22.04 eu1 Container started
0/lxd/8 started 10.0.10.189 juju-e6c4b6-0-lxd-8 ubuntu@22.04 eu1 Container started
0/lxd/9 started 10.0.10.183 juju-e6c4b6-0-lxd-9 ubuntu@22.04 eu1 Container started
0/lxd/10 started 10.0.10.161 juju-e6c4b6-0-lxd-10 ubuntu@22.04 eu1 Container started
0/lxd/13 started 10.0.10.178 juju-e6c4b6-0-lxd-13 ubuntu@22.04 eu1 Container started
0/lxd/14 started 10.0.10.179 juju-e6c4b6-0-lxd-14 ubuntu@22.04 eu1 Container started
0/lxd/16 started 10.0.10.182 juju-e6c4b6-0-lxd-16 ubuntu@22.04 eu1 Container started
1 started 10.0.10.133 os-eu1-ctrl-3 ubuntu@22.04 eu1 Deployed
1/lxd/1 started 10.0.10.196 juju-e6c4b6-1-lxd-1 ubuntu@22.04 eu1 Container started
1/lxd/2 started 10.0.10.177 juju-e6c4b6-1-lxd-2 ubuntu@22.04 eu1 Container started
1/lxd/3 started 10.0.10.192 juju-e6c4b6-1-lxd-3 ubuntu@22.04 eu1 Container started
1/lxd/4 started 10.0.10.176 juju-e6c4b6-1-lxd-4 ubuntu@22.04 eu1 Container started
1/lxd/6 started 10.0.10.191 juju-e6c4b6-1-lxd-6 ubuntu@22.04 eu1 Container started
1/lxd/7 started 10.0.10.174 juju-e6c4b6-1-lxd-7 ubuntu@22.04 eu1 Container started
1/lxd/8 started 10.0.10.194 juju-e6c4b6-1-lxd-8 ubuntu@22.04 eu1 Container started
1/lxd/9 started 10.0.10.195 juju-e6c4b6-1-lxd-9 ubuntu@22.04 eu1 Container started
1/lxd/12 started 10.0.10.187 juju-e6c4b6-1-lxd-12 ubuntu@22.04 eu1 Container started
1/lxd/13 started 10.0.10.175 juju-e6c4b6-1-lxd-13 ubuntu@22.04 eu1 Container started
1/lxd/15 started 10.0.10.188 juju-e6c4b6-1-lxd-15 ubuntu@22.04 eu1 Container started
2 started 10.0.10.131 os-eu1-ctrl-1 ubuntu@22.04 eu1 Deployed
2/lxd/1 started 10.0.10.157 juju-e6c4b6-2-lxd-1 ubuntu@22.04 eu1 Container started
2/lxd/3 started 10.0.10.156 juju-e6c4b6-2-lxd-3 ubuntu@22.04 eu1 Container started
2/lxd/4 started 10.0.10.158 juju-e6c4b6-2-lxd-4 ubuntu@22.04 eu1 Container started
2/lxd/6 started 10.0.10.164 juju-e6c4b6-2-lxd-6 ubuntu@22.04 eu1 Container started
2/lxd/7 started 10.0.10.166 juju-e6c4b6-2-lxd-7 ubuntu@22.04 eu1 Container started
2/lxd/8 started 10.0.10.167 juju-e6c4b6-2-lxd-8 ubuntu@22.04 eu1 Container started
2/lxd/9 started 10.0.10.165 juju-e6c4b6-2-lxd-9 ubuntu@22.04 eu1 Container started
2/lxd/12 started 10.0.10.152 juju-e6c4b6-2-lxd-12 ubuntu@22.04 eu1 Container started
2/lxd/13 started 10.0.10.169 juju-e6c4b6-2-lxd-13 ubuntu@22.04 eu1 Container started
2/lxd/15 started 10.0.10.155 juju-e6c4b6-2-lxd-15 ubuntu@22.04 eu1 Container started
2/lxd/18 started 10.0.10.205 juju-e6c4b6-2-lxd-18 ubuntu@22.04 eu1 Container started
3 started 10.0.10.135 os-eu1-node-b ubuntu@22.04 eu1 Deployed
3/lxd/0 started 10.0.10.210 juju-e6c4b6-3-lxd-0 ubuntu@22.04 eu1 Container started
3/lxd/1 started 10.0.10.209 juju-e6c4b6-3-lxd-1 ubuntu@22.04 eu1 Container started
3/lxd/2 started 10.0.10.201 juju-e6c4b6-3-lxd-2 ubuntu@22.04 eu1 Container started
3/lxd/3 started 10.0.10.150 juju-e6c4b6-3-lxd-3 ubuntu@22.04 eu1 Container started
3/lxd/4 started 10.0.10.154 juju-e6c4b6-3-lxd-4 ubuntu@22.04 eu1 Container started
3/lxd/6 started 10.0.10.173 juju-e6c4b6-3-lxd-6 ubuntu@22.04 eu1 Container started
3/lxd/9 started 10.0.10.181 juju-e6c4b6-3-lxd-9 ubuntu@22.04 eu1 Container started
3/lxd/10 started 10.0.10.159 juju-e6c4b6-3-lxd-10 ubuntu@22.04 eu1 Container started
4 started 10.0.10.134 os-eu1-node-a ubuntu@22.04 eu1 Deployed
4/lxd/0 started 10.0.10.211 juju-e6c4b6-4-lxd-0 ubuntu@22.04 eu1 Container started
4/lxd/1 started 10.0.10.212 juju-e6c4b6-4-lxd-1 ubuntu@22.04 eu1 Container started
4/lxd/2 started 10.0.10.199 juju-e6c4b6-4-lxd-2 ubuntu@22.04 eu1 Container started
4/lxd/3 started 10.0.10.172 juju-e6c4b6-4-lxd-3 ubuntu@22.04 eu1 Container started
4/lxd/4 started 10.0.10.198 juju-e6c4b6-4-lxd-4 ubuntu@22.04 eu1 Container started
4/lxd/6 started 10.0.10.213 juju-e6c4b6-4-lxd-6 ubuntu@22.04 eu1 Container started
4/lxd/8 started 10.0.10.153 juju-e6c4b6-4-lxd-8 ubuntu@22.04 eu1 Container started
5 started 10.0.10.136 os-eu1-node-c ubuntu@22.04 eu1 Deployed
5/lxd/0 started 10.0.10.208 juju-e6c4b6-5-lxd-0 ubuntu@22.04 eu1 Container started
5/lxd/1 started 10.0.10.207 juju-e6c4b6-5-lxd-1 ubuntu@22.04 eu1 Container started
5/lxd/2 started 10.0.10.202 juju-e6c4b6-5-lxd-2 ubuntu@22.04 eu1 Container started
5/lxd/3 started 10.0.10.197 juju-e6c4b6-5-lxd-3 ubuntu@22.04 eu1 Container started
5/lxd/4 started 10.0.10.170 juju-e6c4b6-5-lxd-4 ubuntu@22.04 eu1 Container started
5/lxd/6 started 10.0.10.214 juju-e6c4b6-5-lxd-6 ubuntu@22.04 eu1 Container started
5/lxd/8 started 10.0.10.217 juju-e6c4b6-5-lxd-8 ubuntu@22.04 eu1 Container started
6 started 10.0.10.137 os-eu1-node-d ubuntu@22.04 eu1 Deployed
6/lxd/0 started 10.0.10.151 juju-e6c4b6-6-lxd-0 ubuntu@22.04 eu1 Container started
6/lxd/1 started 10.0.10.206 juju-e6c4b6-6-lxd-1 ubuntu@22.04 eu1 Container started
6/lxd/2 started 10.0.10.200 juju-e6c4b6-6-lxd-2 ubuntu@22.04 eu1 Container started
6/lxd/3 started 10.0.10.203 juju-e6c4b6-6-lxd-3 ubuntu@22.04 eu1 Container started
6/lxd/4 started 10.0.10.204 juju-e6c4b6-6-lxd-4 ubuntu@22.04 eu1 Container started
6/lxd/6 started 10.0.10.216 juju-e6c4b6-6-lxd-6 ubuntu@22.04 eu1 Container started
6/lxd/8 started 10.0.10.218 juju-e6c4b6-6-lxd-8 ubuntu@22.04 eu1 Container started