I have two node MicroStack deployment on the AWS cloud. I use this guide for installation. https://microstack.run/docs/multi-node
I am able to create instances on both Compute and Control node, but those instance created in the compute node are not reachable from both from Compute and Control Nodes. Basically can’t SSH to the VMs.
I am facing similar issue reported in the Bug #1921433 : Instances are not accessible from a compute node
Does anyone know what I am doing wrong ?
Preconditions : Both my Control and Compute Node are in the same subnet and reachable to each other, with security group allowing ping and SSH.
ubuntu@ip-172-31-63-149:~$ openstack hypervisor list
+----+-------------------------------+-----------------+---------------+-------+
| ID | Hypervisor Hostname | Hypervisor Type | Host IP | State |
+----+-------------------------------+-----------------+---------------+-------+
| 1 | ip-172-31-63-149.ec2.internal | QEMU | 172.31.63.149 | up |
| 2 | ip-172-31-51-185.ec2.internal | QEMU | 172.31.51.185 | up |
+----+-------------------------------+-----------------+---------------+-------+
ip-172-31-63-149.ec2.internal => Control Node
ip-172-31-51-185.ec2.internal => Compute Node
ubuntu@ip-172-31-63-149:~$ openstack server list
+--------------------------------------+----------------+--------+------------------------------------+--------+---------+
| ID | Name | Status | Networks | Image | Flavor |
+--------------------------------------+----------------+--------+------------------------------------+--------+---------+
| b38e5f3b-43ac-4ad5-9578-e3712a6c4df1 | testOnCompute1 | ACTIVE | test=192.168.222.51, 10.20.20.210 | cirros | m1.tiny |
| de3112b9-337d-4e4a-8f8c-b1a59cbe616f | testOnControl1 | ACTIVE | test=192.168.222.207, 10.20.20.171 | cirros | m1.tiny |
+--------------------------------------+----------------+--------+------------------------------------+--------+---------+
Ping to instance created on Control Node - testOnControl1 is reachable Ping to instance created on Compute Node - testOnCompute1 is not reachable
ubuntu@ip-172-31-63-149:~$ ping 10.20.20.171
PING 10.20.20.171 (10.20.20.171) 56(84) bytes of data.
64 bytes from 10.20.20.171: icmp_seq=1 ttl=63 time=3.53 ms
64 bytes from 10.20.20.171: icmp_seq=2 ttl=63 time=1.27 ms
^Z
[1]+ Stopped ping 10.20.20.171
ubuntu@ip-172-31-63-149:~$ ping 10.20.20.210
PING 10.20.20.210 (10.20.20.210) 56(84) bytes of data.
^Z
[2]+ Stopped ping 10.20.20.210
ubuntu@ip-172-31-63-149:~$ mtr -rn 10.20.20.171
Start: 2021-11-27T18:11:12+0000
HOST: ip-172-31-63-149 Loss% Snt Last Avg Best Wrst StDev
1.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0
2.|-- 10.20.20.171 0.0% 10 0.5 0.7 0.5 1.9 0.5
ubuntu@ip-172-31-63-149:~$ mtr -rn 10.20.20.210
Start: 2021-11-27T18:11:50+0000
HOST: ip-172-31-63-149 Loss% Snt Last Avg Best Wrst StDev
IP Addresses on Control Node
ubuntu@ip-172-31-63-149:~$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
link/ether 12:d7:7e:f9:92:9f brd ff:ff:ff:ff:ff:ff
inet 172.31.63.149/20 brd 172.31.63.255 scope global dynamic eth0
valid_lft 3062sec preferred_lft 3062sec
inet6 fe80::10d7:7eff:fef9:929f/64 scope link
valid_lft forever preferred_lft forever
3: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether de:35:e0:4f:7a:c6 brd ff:ff:ff:ff:ff:ff
4: br-int: <BROADCAST,MULTICAST> mtu 1442 qdisc noop state DOWN group default qlen 1000
link/ether 1a:d5:c2:30:1c:4b brd ff:ff:ff:ff:ff:ff
5: br-ex: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
link/ether 16:1e:e4:5d:17:4e brd ff:ff:ff:ff:ff:ff
inet 10.20.20.1/24 scope global br-ex
valid_lft forever preferred_lft forever
inet6 fe80::141e:e4ff:fe5d:174e/64 scope link
valid_lft forever preferred_lft forever
6: genev_sys_6081: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65000 qdisc noqueue master ovs-system state UNKNOWN group default qlen 1000
link/ether ae:e1:d7:77:2b:09 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ace1:d7ff:fe77:2b09/64 scope link
valid_lft forever preferred_lft forever
7: tap1538477b-6b: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc fq_codel master ovs-system state UNKNOWN group default qlen 1000
link/ether fe:16:3e:32:a0:0d brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:fe32:a00d/64 scope link
valid_lft forever preferred_lft forever
8: tap84fc65df-30@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether ea:c2:9b:cf:2b:17 brd ff:ff:ff:ff:ff:ff link-netns ovnmeta-84fc65df-3810-41de-a46b-fbfc8062aabe
inet6 fe80::e8c2:9bff:fecf:2b17/64 scope link
valid_lft forever preferred_lft forever
Route Info on Control Node
ubuntu@ip-172-31-63-149:~$ ip route show
default via 172.31.48.1 dev eth0 proto dhcp src 172.31.63.149 metric 100
10.20.20.0/24 dev br-ex proto kernel scope link src 10.20.20.1
172.31.48.0/20 dev eth0 proto kernel scope link src 172.31.63.149
172.31.48.1 dev eth0 proto dhcp scope link src 172.31.63.149 metric 100
ubuntu@ip-172-31-63-149:~$ openstack server show testOnCompute1
+-------------------------------------+----------------------------------------------------------+
| Field | Value |
+-------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | ip-172-31-51-185.ec2.internal |
| OS-EXT-SRV-ATTR:hypervisor_hostname | ip-172-31-51-185.ec2.internal |
| OS-EXT-SRV-ATTR:instance_name | instance-00000002 |
| OS-EXT-STS:power_state | Running |
| OS-EXT-STS:task_state | None |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2021-11-24T17:21:25.000000 |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | test=192.168.222.51, 10.20.20.210 |
| config_drive | |
| created | 2021-11-24T17:21:04Z |
| flavor | m1.tiny (1) |
| hostId | 12552821fba1bf93a69eb501845aefd853fd48051eea2ff9475f60e6 |
| id | b38e5f3b-43ac-4ad5-9578-e3712a6c4df1 |
| image | cirros (3f126576-8400-4d71-9b2d-5bf402bb258f) |
| key_name | microstack |
| name | testOnCompute1 |
| progress | 0 |
| project_id | 5e8a9b874a0e4bc1b5285fe420c6ff81 |
| properties | |
| security_groups | name='default' |
| status | ACTIVE |
| updated | 2021-11-27T18:07:14Z |
| user_id | fbf326f9129d4b208eeaa87f72445fbd |
| volumes_attached | |
+-------------------------------------+----------------------------------------------------------+
ubuntu@ip-172-31-63-149:~$ openstack security group list
+--------------------------------------+---------+------------------------+----------------------------------+------+
| ID | Name | Description | Project | Tags |
+--------------------------------------+---------+------------------------+----------------------------------+------+
| 0ab6b532-6d26-451a-bffb-cf9002a13c86 | default | Default security group | 562bd147695b4801bdf74548e0eae09a | [] |
| 12ed4026-a709-465a-820c-43aa7bc5fcc2 | default | Default security group | 5e8a9b874a0e4bc1b5285fe420c6ff81 | [] |
+--------------------------------------+---------+------------------------+----------------------------------+------+
ubuntu@ip-172-31-63-149:~$ openstack security group show 12ed4026-a709-465a-820c-43aa7bc5fcc2
+-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| created_at | 2021-11-24T17:08:26Z |
| description | Default security group |
| id | 12ed4026-a709-465a-820c-43aa7bc5fcc2 |
| location | cloud='', project.domain_id=, project.domain_name='default', project.id='5e8a9b874a0e4bc1b5285fe420c6ff81', project.name='admin', region_name='', zone= |
| name | default |
| project_id | 5e8a9b874a0e4bc1b5285fe420c6ff81 |
| revision_number | 3 |
| rules | created_at='2021-11-24T17:08:26Z', direction='ingress', ethertype='IPv4', id='2e3e5bfd-6acb-4d87-a8a0-3ad33e5f96ca', remote_group_id='12ed4026-a709-465a-820c-43aa7bc5fcc |
| | created_at='2021-11-24T17:08:26Z', direction='egress', ethertype='IPv6', id='3f7c4ac1-466f-4285-9cd4-2ea6b8aa0129', updated_at='2021-11-24T17:08:26Z' |
| | created_at='2021-11-24T17:08:26Z', direction='egress', ethertype='IPv4', id='4d6be18b-09b3-41ae-ae2f-3b3ddad51f16', updated_at='2021-11-24T17:08:26Z' |
| | created_at='2021-11-24T17:08:26Z', direction='ingress', ethertype='IPv6', id='7247d2a2-ac37-495e-88d7-1b762423b144', remote_group_id='12ed4026-a709-465a-820c-43aa7bc5fcc |
| | created_at='2021-11-24T17:10:08Z', direction='ingress', ethertype='IPv4', id='99e8bd22-86a5-4972-82fb-79d1758be90b', port_range_max='22', port_range_min='22', protocol='2021-11-24T17:10:08Z' |
| | created_at='2021-11-24T17:10:04Z', direction='ingress', ethertype='IPv4', id='e8f965d9-7f84-435e-9a0b-36ee8dbd1a0d', protocol='icmp', remote_ip_prefix='0.0.0.0/0', updat |
| stateful | True |
| tags | [] |
| updated_at | 2021-11-24T17:10:08Z |
+-----------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
ubuntu@ip-172-31-63-149:~$ openstack security group show 0ab6b532-6d26-451a-bffb-cf9002a13c86
+-----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Field | Value
+-----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| created_at | 2021-11-24T17:20:33Z
| description | Default security group
| id | 0ab6b532-6d26-451a-bffb-cf9002a13c86
| location | cloud='', project.domain_id=, project.domain_name=, project.id='562bd147695b4801bdf74548e0eae09a', project.name=, region_name='', zone=
| name | default
| project_id | 562bd147695b4801bdf74548e0eae09a
| revision_number | 1
| rules | created_at='2021-11-24T17:20:33Z', direction='egress', ethertype='IPv6', id='07b754c6-ef07-47c6-9f05-2d40d25c2423', updated_at='2021-11-24T17:20:33Z'
| | created_at='2021-11-24T17:20:33Z', direction='ingress', ethertype='IPv6', id='3dc2c91f-61c8-4222-87af-b156b56b4b2e', remote_group_id='0ab6b532-6d26-451a-bffb-cf9002a13c8
| | created_at='2021-11-24T17:20:33Z', direction='ingress', ethertype='IPv4', id='d4e90713-c764-46fd-83c5-78e24699cfb0', remote_group_id='0ab6b532-6d26-451a-bffb-cf9002a13c8
| | created_at='2021-11-24T17:20:33Z', direction='egress', ethertype='IPv4', id='f4e96e26-bb2f-403b-b1dc-d76e072342e4', updated_at='2021-11-24T17:20:33Z'
| stateful | True
| tags | []
| updated_at | 2021-11-24T17:20:33Z
+-----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
