[kube-prometheus-stack] ARM Support

[eddiezane]

After digging in deep I'm opening this as tracking for anyone that comes here looking to deploy kube-prometheus-stack on an ARM or ARM64 device like a Raspberry Pi.

With #280 merged the last thing remaining is for kube-state-metrics to merge kubernetes/kube-state-metrics#1237 - that's being tracked here at #111.

The default image in the old kube-state-metrics chart was from quay.io and did not have multi-arch support. The new chart mentioned above will use the new multi-arch gcr image and it will switch to v2 of kube-state-metrics which has some breaking changes.

For now you can override the kube-state-metrics image in your values.yml with:

kube-state-metrics:
  image:
    repository: k8s.gcr.io/kube-state-metrics-arm64
    tag: v1.9.5

If you need v1.9.7 you can use the image that I built here. See kubernetes/kube-state-metrics#1037 (comment).

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Any further update will cause the issue/pull request to no longer be considered stale. Thank you for your contributions.

[kfox1111]

/remove-lifecycle stale

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Any further update will cause the issue/pull request to no longer be considered stale. Thank you for your contributions.

[ruckc]

still waiting for kube-state-metrics 2.0 to be GA, which will require an update for something as --collectors is an unknown flag when trying to run with 2.0.0-beta on arm64.

[eddiezane]

Some work in progress here kubernetes/kube-state-metrics#1358

[cablespaghetti]

Kube-state-metrics 1.9.8 has been released which now has multi-arch builds. I'll raise a PR. :) https://github.com/kubernetes/kube-state-metrics/releases/tag/v1.9.8

[cablespaghetti]

Opened this PR on kube-state-metrics helm chart first: kubernetes/kube-state-metrics#1391

[eddiezane]

@cablespaghetti it looks like the grafana-sc-dashboard sidecar image (quay.io/kiwigrid/k8s-sidecar:1.10.6) isn't multi arch?

pikube/kube-prometheus-stack[main ☂ ] kubectl -n monitoring logs kube-prometheus-stack-grafana-984c8bb67-jkhtz grafana-sc-datasources
standard_init_linux.go:219: exec user process caused: exec format error

[disconn3ct]

Simple workaround for anyone that is stuck: the docker hub images are still multiarch.

sidecar.image.repository: kiwigrid/k8s-sidecar

[cablespaghetti]

You're correct. Sorry, this must have been changed on the grafana side, probably to avoid Docker hub rate limiting. I'll raise some more PRs...

[cablespaghetti]

Raised a PR to fix this in the kiwigrid/k8s-sidecar side: kiwigrid/k8s-sidecar#112

[jekkel]

Hi there, thanks for making us aware, we fixed to quay.io mirroring to be multi-arch as well and updated the existing tags accordingly. This means quay.io/kiwigrid/k8s-sidecar:1.10.6 should just work now.