Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mantle/kola: fix systemd generator failure detection #3374

Merged

Conversation

dustymabe
Copy link
Member

Apparently it can start with systemd or sd-execu. I think the difference may be whether the failure happens in the initramfs or the real root. Let's detect both.

Here is an example:

Feb 23 21:50:38.240188 /usr/lib/systemd/system-generators/coreos-platform-chrony: line 44: /etc/sysconfig/network: Read-only file system
Feb 23 21:50:38.240195 (sd-execu[1020]: /usr/lib/systemd/system-generators/coreos-platform-chrony failed with exit status 1.

mantle/kola/harness.go Outdated Show resolved Hide resolved
Apparently it can start with `systemd` or `sd-execu`. Here is an example:

```
Feb 23 21:50:38.240188 /usr/lib/systemd/system-generators/coreos-platform-chrony: line 44: /etc/sysconfig/network: Read-only file system
Feb 23 21:50:38.240195 (sd-execu[1020]: /usr/lib/systemd/system-generators/coreos-platform-chrony failed with exit status 1.
```

I think the difference may be whether the failure happens in the initramfs
or the real root. Let's make our regex matching more generic and also handle
more cases [1].

[1] https://github.com/systemd/systemd/blob/dafb406383610cc631345815919fd8a77ee0c4dc/src/basic/process-util.c#L663-L679
@dustymabe dustymabe force-pushed the dusty-enhance-generator-failure-detection branch from 8426764 to 6bf12d8 Compare February 27, 2023 15:11
Copy link
Member

@jlebon jlebon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jlebon
Copy link
Member

jlebon commented Feb 27, 2023

Ahhh, looks like CI hit #3372 again. Will have to look at that more seriously today.

@dustymabe
Copy link
Member Author

/retest-required

@dustymabe dustymabe merged commit 8d26a40 into coreos:main Feb 28, 2023
@dustymabe dustymabe deleted the dusty-enhance-generator-failure-detection branch February 28, 2023 02:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants