This is my first install using MAAS/JUJU/Openstack, things are ok so far but I have run into an issue in the Ceph-OSD bundle with adding the multipath disk I have setup. I have one device for each of my 4 compute nodes.
The first issue I had was it couldn’t read he partition table on the device, so I did go ahead and created a GPT partition(2.5T). Once I did that the add disk command did find it and create the pv, vg and lv but I am getting a keyring error with this. Seems to me ceph wasn’t configured correctly on the compute nodes. I have this from one of my compute nodes with the error. I did check for the directories and they don’t exist. I should mention I have had to remove and redeploy the ceph-osd multiple times. I am hesitant on following the manual steps of ceph to create the keyring. Should I do that?
stackadmin@sacmaascntrlr:~$ juju run ceph-osd/65 add-disk osd-devices=’/dev/mapper/mpathb-part1’ Running operation 729 with 1 task
- task 730 on unit-ceph-osd-65
Waiting for task 730… Physical volume “/dev/mapper/mpathb-part1” successfully created. Volume group “ceph-339c3cf3-14b1-433c-8e79-277c8ddd2fce” successfully created Logical volume “osd-block-339c3cf3-14b1-433c-8e79-277c8ddd2fce” created. Failed to find physical volume “/dev/mapper/mpathb-part1”. Failed to find physical volume “/dev/mapper/mpathb-part1”. Running command: /usr/bin/ceph-authtool --gen-print-key Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 339c3cf3-14b1-433c-8e79-277c8ddd2fce stderr: 2023-09-14T22:54:38.001+0000 7fd5c1a26700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory stderr: 2023-09-14T22:54:38.001+0000 7fd5c1a26700 -1 AuthRegistry(0x7fd5bc05b8c8) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx stderr: 2023-09-14T22:54:38.037+0000 7fd5ba7fc700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] stderr: 2023-09-14T22:54:38.041+0000 7fd5baffd700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] stderr: [errno 13] RADOS permission denied (error connecting to the cluster) –> RuntimeError: Unable to create a new OSD id ERROR the following task failed:
- id “730” with return code 1
use ‘juju show-task’ to inspect the failure
This for a xena cloud and this is the status of the applications. if anyone could help that would be great. If I need to include any other logs, etc. please just let me know.
Thanks, Steve
Model Controller Cloud/Region Version SLA Timestamp openstack maas-controller maas/default 3.1.5 unsupported 16:57:34-07:00
App Version Status Scale Charm Channel Rev Exposed Message apache2 active 1 apache2 stable 41 no Unit is ready ceph-mon 16.2.13 waiting 3 ceph-mon quincy/stable 183 no Monitor bootstrapped but waiting for number of OSDs to reach expected-osd-count (4) ceph-osd 16.2.13 blocked 4 ceph-osd quincy/stable 564 no No block devices detected using current configuration ceph-radosgw 16.2.13 waiting 1 ceph-radosgw quincy/stable 563 no Incomplete relations: mon cinder 19.3.0 active 1 cinder yoga/stable 650 no Unit is ready cinder-ceph 19.3.0 waiting 1 cinder-ceph yoga/stable 527 no Ceph broker request incomplete cinder-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready dashboard-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready glance 23.1.0 waiting 1 glance yoga/stable 575 no Incomplete relations: storage-backend glance-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready keystone 20.0.1 active 1 keystone yoga/stable 654 no Application Ready keystone-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready mysql-innodb-cluster 8.0.34 active 3 mysql-innodb-cluster 8.0/stable 56 no Unit is ready: Mode: R/O, Cluster is ONLINE and can tolerate up to ONE failure. mysql-router unknown 0 mysql-router 8.0/stable 90 no ncc-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready neutron-api 19.7.0 active 1 neutron-api yoga/stable 560 no Unit is ready neutron-api-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready neutron-api-plugin-ovn 19.7.0 active 1 neutron-api-plugin-ovn yoga/stable 29 no Unit is ready nova-cloud-controller 24.2.1 active 1 nova-cloud-controller yoga/stable 682 no Unit is ready nova-compute 24.2.1 active 3 nova-compute yoga/stable 686 no Unit is ready ntp 3.5 active 4 ntp stable 50 no chrony: Ready openstack-dashboard 20.1.4 active 1 openstack-dashboard yoga/stable 589 no Unit is ready ovn-central 22.03.2 active 3 ovn-central 22.03/stable 119 no Unit is ready (leader: ovnnb_db, ovnsb_db) ovn-chassis 22.03.2 active 3 ovn-chassis 22.03/stable 143 no Unit is ready placement 6.0.0 active 1 placement yoga/stable 92 no Unit is ready placement-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready rabbitmq-server 3.8.2 active 1 rabbitmq-server 3.9/stable 182 no Unit is ready vault 1.7.9 active 1 vault 1.7/stable 178 no Unit is ready (active: true, mlock: disabled) vault-mysql-router 8.0.34 active 1 mysql-router 8.0/stable 90 no Unit is ready