Thanks to amazing work by Przemek and Odysseus, it is apparently now possible to delete tracks that have not been published to 
Delete the antelope track for 'openstack-hypervisor' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'cinder-ceph-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'cinder-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'glance-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'horizon-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'keystone-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'neutron-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'nova-k8s' charm
{'num_tracks_deleted': 1}
Delete the antelope track for 'placement-k8s' charm
{'num_tracks_deleted': 1}
And creating the new ones:
Create the 2023.1 track for 'openstack-hypervisor' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'cinder-ceph-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'cinder-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'glance-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'horizon-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'keystone-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'neutron-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'nova-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}
Create the 2023.1 track for 'placement-k8s' charm with None version-pattern and None automatic-phasing-percentage
{'num_tracks_created': 1}