Controller upgrade problem

juju
1

Upgraded from 2.9.37 to 2.9.49 yesterday. The new controller is not working properly. I have these messages in the log;

2024-06-27 18:16:24 WARNING juju.core.raftlease client.go:135 response timeout waiting for Command(ver: 1, op: claim, ns: singular-controller, model: ffb2cb, lease: 2df05d78-cbd1-4b3f-83a5-6c95e542138a, holder: machine-0) to be processed

2024-06-27 18:16:29 WARNING juju.core.raftlease client.go:135 response timeout waiting for Command(ver: 1, op: claim, ns: singular-controller, model: ffb2cb, lease: 2df05d78-cbd1-4b3f-83a5-6c95e542138a, holder: machine-0) to be processed

2024-06-27 18:16:29 WARNING juju.worker.lease.raft manager.go:317 [2df05d] retrying timed out while handling claim {“singular-controller” “ffb2cb02-f86c-4cfc-87d1-a6d382f5ff19” “2df05d78-cbd1-4b3f-83a5-6c95e542138a”} for “machine-0”

2024-06-27 18:16:29 ERROR juju.worker.dependency engine.go:695 “is-primary-controller-flag” manifold worker returned unexpected error: lease operation timed out

I have read the post Issues with Juju controller - juju - Charmhub but this seems different. There is only one interface on the controller that was upgraded.

Can anyone suggest how to proceed please?

2

Lease requests not being processed is one symptom of a deeper issue.

You can run juju_engine_report on the controller machine(s) to see which workers are problematic, then attempt to find errors for those workers in the logs.