Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

crucible agent's apply_smf() is not removing all instances #542

Open
leftwo opened this issue Nov 29, 2022 · 1 comment
Open

crucible agent's apply_smf() is not removing all instances #542

leftwo opened this issue Nov 29, 2022 · 1 comment
Milestone

Comments

@leftwo
Copy link
Contributor

leftwo commented Nov 29, 2022

Something is not cleaning up smf instances when regions are deleted.

After running a test that creates then deletes a disk in a loop, I can see both the
memory usage going up for agent, and the log file listing more and more messages each time apply_smf() runs:

Message like these:

Nov 29 06:27:36.485 ERRO remove downstairs instance: downstairs-66dab510-7749-4191-adb3-330aec2124d7, component: worker
Nov 29 06:27:36.485 INFO instance states: (Some(Disabled), None), component: worker
Nov 29 06:27:36.485 ERRO remove downstairs instance: downstairs-98be2db0-165b-4adb-9c3d-52f2afab8fed, component: worker
Nov 29 06:27:36.486 INFO instance states: (Some(Disabled), None), component: worker
Nov 29 06:27:36.486 ERRO remove downstairs instance: downstairs-0c941299-6abe-427e-9d39-c9ff67f2aa6b, component: worker
Nov 29 06:27:36.487 INFO instance states: (Some(Disabled), None), component: worker
Nov 29 06:27:36.487 ERRO remove downstairs instance: downstairs-de23a0eb-1c79-4f28-8eb5-df689ad5dbd7, component: worker
Nov 29 06:27:36.487 INFO instance states: (Some(Disabled), None), component: worker

Each loop of the create/delete disk script results in another pair of messages printed.

Something yet TBD is not completely removing items from the svc.instances() list.

@leftwo leftwo changed the title apply_smf() is not removing all instances crucible agent's apply_smf() is not removing all instances Nov 30, 2022
@leftwo leftwo added this to the MVP milestone Jan 13, 2023
@jmpesp
Copy link
Contributor

jmpesp commented May 10, 2023

This could be the agent only disabling existing services instead of deleting them:

crucible/agent/src/main.rs

Lines 367 to 370 in 9f69dea

/*
* XXX just disable for now.
*/
inst.disable(false)?;

@morlandi7 morlandi7 modified the milestones: MVP, FCS May 22, 2023
@leftwo leftwo modified the milestones: FCS, MVP Jul 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants