Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Routers get empty ctrl list on upgrade #2692

Closed
plorenz opened this issue Jan 24, 2025 · 0 comments
Closed

Routers get empty ctrl list on upgrade #2692

plorenz opened this issue Jan 24, 2025 · 0 comments
Assignees
Labels
distributed-control Work related to HA/Raft/other distributed control

Comments

@plorenz
Copy link
Member

plorenz commented Jan 24, 2025

When a cluster was upgraded from 1.2.2 to 1.3.1, the following was observed:

  1. All ERs updated to 1.3.1
  2. One controller updated to 1.3.1
  3. The routers received an empty controller list from the upgraded controller
  4. The routers accepted the empty list and were no longer able to communicate with the controllers.

We should do the following:

  1. Figure out why the controller sent an empty list and fix it
  2. Ignore empty lists when received on the router
  3. If the endpoints file is empty on start up, ignore and it fallback to the initial set configured in the router config.
@plorenz plorenz added the distributed-control Work related to HA/Raft/other distributed control label Jan 24, 2025
@plorenz plorenz self-assigned this Jan 24, 2025
@plorenz plorenz moved this to In Progress in Controller HA Jan 24, 2025
plorenz added a commit that referenced this issue Jan 25, 2025
Fix empty controller list on upgrade. Fixes #2692
@github-project-automation github-project-automation bot moved this from In Progress to Done in Controller HA Jan 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
distributed-control Work related to HA/Raft/other distributed control
Projects
Status: Done
Development

No branches or pull requests

1 participant