Plugin API, TaskStats not called after RecoverTask after plugin restart

[towe75]

Nomad version

Nomad v0.9.3 (c5e8b66)

Operating system and Environment details

Ubuntu 18.04

Issue

I am working on a driver plugin and i miss stats if the plugin dies and restarts.

My plugin reports stats fine when a task is initially started. So i can see in the logs that "TaskStats" is called and i can watch metrics in the nomad web-ui.

Now, if i kill the plugin process (not nomad itself!) in order to simulate a crash, i can see that "RecoverTask" is invoked. The callback is handled well and i am able to control the task just fine.

"TaskStats", however, is not called after recovery and thus the plugin does not stream stats into nomad resulting in a stuck graph in the UI.

[preetapan]

Thanks for reporting this, I was able to reproduce this with the existing LXC driver

[towe75]

Thanks for checking!
Killing a plugin process is actually a nice shortcut for updating a plugin while working on the code base. It's much quicker compared to restarting a nomad agent. Automatic task recovery ensures a consistent in-memory state as well.

[github-actions]

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.