Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bpm does not work with cgroupv2 #171

Closed
Tracked by #892
ramonskie opened this issue Jun 19, 2024 · 5 comments
Closed
Tracked by #892

bpm does not work with cgroupv2 #171

ramonskie opened this issue Jun 19, 2024 · 5 comments

Comments

@ramonskie
Copy link

for the noble stemcel where we cgroupv2 is now the default
bpm is not starting

linked issue: cloudfoundry/bosh-linux-stemcell-builder#355
slack discussion: https://cloudfoundry.slack.com/archives/C06HTDT78N9/p1717058467990399

@geofffranks
Copy link

Is this still an issue, or is this solved with #172?

@jpalermo
Copy link
Member

We've got some redness in the Noble pipeline currently, but we're going to try and fix that tomorrow and that should tell us if BPM is good on Noble

@geofffranks
Copy link

Did y'all figure out the redness in the Noble pipeline? I'm running into problems where there is no DNS lookup capability inside BPM containers, whether or not bosh-dns is present on the VM. Getting connection refused on all :53 attempts:

vcap@3f588a05-5eff-4077-940c-44a7d8dbb1ac:/var/vcap/jobs/loggregator_agent$ host google.com
;; communications error to ::1#53: connection refused
;; communications error to ::1#53: connection refused
;; communications error to 127.0.0.1#53: connection refused
;; no servers could be reached
vcap@3f588a05-5eff-4077-940c-44a7d8dbb1ac:/var/vcap/jobs/loggregator_agent$ ls -l /etc/resolv.conf
lrwxrwxrwx 1 root root 39 Aug 14 20:27 /etc/resolv.conf -> ../run/systemd/resolve/stub-resolv.conf
vcap@3f588a05-5eff-4077-940c-44a7d8dbb1ac:/var/vcap/jobs/loggregator_agent$ ls /run
ls: cannot access '/run': No such file or directory

Additionally it looks like ping doesn't work inside BPM containers either:

vcap@3f588a05-5eff-4077-940c-44a7d8dbb1ac:/var/vcap/jobs/loggregator_agent$ ping google.com
ping: socktype: SOCK_RAW
ping: socket: Operation not permitted
ping: => missing cap_net_raw+p capability or setuid?

For reference, on a jammy BPM container:

vcap@d3ee922f-0701-44b4-91e5-85a65aece394:/var/vcap/jobs/loggregator_agent$ ping google.com
PING google.com (173.194.206.138) 56(84) bytes of data.
64 bytes from nz-in-f138.1e100.net (173.194.206.138): icmp_seq=1 ttl=115 time=2.18 ms
64 bytes from nz-in-f138.1e100.net (173.194.206.138): icmp_seq=2 ttl=115 time=1.08 ms
^C
--- google.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 1.081/1.629/2.178/0.548 ms
vcap@d3ee922f-0701-44b4-91e5-85a65aece394:/var/vcap/jobs/loggregator_agent$ ls -l /etc/resolv.conf
lrwxrwxrwx 1 root root 27 Sep  4 16:34 /etc/resolv.conf -> /run/resolvconf/resolv.conf
vcap@d3ee922f-0701-44b4-91e5-85a65aece394:/var/vcap/jobs/loggregator_agent$ ls /run
resolvconf

@jpalermo
Copy link
Member

jpalermo commented Oct 2, 2024

Looks like it had to do with how bpm was mounting the resolv.conf file into the container. We fix it today and will get a 1.4.0 cut with the changes.

@jpalermo
Copy link
Member

jpalermo commented Oct 2, 2024

Released

@jpalermo jpalermo closed this as completed Oct 2, 2024
@github-project-automation github-project-automation bot moved this from Waiting for Changes | Open for Contribution to Done in Foundational Infrastructure Working Group Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

No branches or pull requests

3 participants