Support for Fedora CoreOS and RedHat CoreOS

[ServerNinja]

What would you like to be added:
Support for installing K8's with Kubespray on Fedora CoreOS and RedHat CoreOS

Why is this needed:
Because RedHat has decided to stop support ("end-of-life") of CoreOS on May 26, 2020

https://devclass.com/2020/02/06/red-hat-kicks-off-long-goodbye-for-coreos-container-linux/

[GuillaumeOuint]

Hi @ServerNinja does actually Kubespray work well with Fedora CoreOS ? Do you have a workaroud if not ?

[GuillaumeOuint]

I've searched on the repository for CoreOS filter.
Here it's what i've found:
ansible_os_family in ["CoreOS", "Coreos", "Container Linux by CoreOS"]
So I think ansible will successfully recognize Fedora CoreOS by the "CoreOS" filter.
I have a new host to setup with Fedora CoreOS and scale my cluster with kubespray, I'll let you know here if it work.

[GuillaumeOuint]

After installing wget with rpm-ostree, tweaking the bootstrap.sh (bootstrap-os task) with --secure-protocol tlsv1 arg to wget and installing dnf (installed with rpm-ostree too) and trying to install libxcrypt-compat (failed), i'm left with a beautiful "/opt/bin/python: error while loading shared libraries: libcrypt.so.1: cannot open shared object file: No such file or directory" with kubespray, I go back to legacy coreos for this time.

[ServerNinja]

@GuillaumeOuint , I just tried the same things that you did and got the same error. This is the version of Fedora CoreOS that I'm using:

[core@k8-master-1 ~]$ cat /etc/redhat-release
Fedora release 31 (Thirty One)
[core@k8-master-1 ~]$ uname -a
Linux k8-master-1 5.4.13-201.fc31.x86_64 #1 SMP Tue Jan 21 17:21:47 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

[GuillaumeOuint]

@ServerNinja I was on the same version (latest version in date of my first post here). It's obvious that kubespray need to be upgraded in order to take support of Fedora CoreOS since that many things are different between Fedora CoreOS and CoreOS Container Linux. Same between Fedora 31 and Fedora CoreOS (rpm-ostree (take a reboot), rpm not available (usr readonly), dnf not available too since it's using rpm to work)
I hope it will be updated soon in order to migrate cluster slowly and securely to Fedora CoreOS. Otherwise I'll need to switch to a more classic distro and with all cons coming with it.

[spaced]

We use fedora coreos with kubespray. i can provide a WIP PR
while bootstrap:

- include_tasks: bootstrap-fedora-coreos.yml
  when: '"ID=fedora" in os_release.stdout and "VARIANT_ID=coreos" in os_release.stdout'

was able to install python via ostree, but then needs a reboot

# ethtool, socat and ipset are required in kubeadm preflight phase for verifying the environment
# dbus-tools is required because of networkManager reload bug (https://bugzilla.redhat.com/show_bug.cgi?id=1745659)
- name: Install crio, python, dbus-tools libselinux-python3, ethtool and ipset on fedora coreos
  raw: "export http_proxy={{ http_proxy | default('') }};rpm-ostree install python libselinux-python3 dbus-tools ethtool ipset crio cri-tools"
  become: true
  when: need_bootstrap.rc != 0

[GuillaumeOuint]

Thanks for the reply @spaced , I already have installed my host, I'll see in the future if a new host need to be configured with your workaround.
The task bootstrap-fedora-coreos is the one below ?

[ServerNinja]

@spaced , I'd be interested in seeing the PR as well. Thanks for working on that :-)