Merge pull request #2466 from wangyira/releaseNote_jul22_jul29

release notes Jul22 to Jul29 2021
Azure · Jul 31, 2021 · 1050d6f · 1050d6f
2 parents b17ed3c + 67cdf1f
commit 1050d6f
Show file tree

Hide file tree

Showing 2 changed files with 283 additions and 3 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,5 +1,24 @@
 # Azure Kubernetes Service Changelog
 
+## Release 2021-07-29
+
+This release is rolling out to all regions - estimated time for completed roll out is 2021-08-05 for public cloud and 2021-08-10 for sovereign clouds.
+
+### Announcements
+
+* Azure Kubernetes Service (AKS) will stop publishing Ubuntu 16.04 image change moving forward. 
+* As a response to customer feedback and issues with previous Kubernetes version patches that left a lot of users with hard options. The AKS Team is extending a limited scope of support for all clusters and nodepools on 1.18 as a courtesy. Customers with clusters and nodepools on 1.18 [after the announced deprecation date of 2021-06-30](https://docs.microsoft.com/azure/aks/supported-kubernetes-versions) will be granted an extension of capabilities outside the [usual scope of support for deprecated versions](https://docs.microsoft.com/azure/aks/supported-kubernetes-versions#aks-kubernetes-release-calendar) .The scope of this limited extension is effective from '2021-06-30 to 2021-07-31' and is limited to the following:
+  * Creation of new clusters and nodepools on 1.18.
+  * CRUD operations on 1.18 clusters.
+  * Azure Support of non-Kubernetes related, platform issues. Platform issues include trouble with networking, storage, or compute running on Azure. Any support requests for K8s patching and troubleshooting will be requested to upgrade into a supported version.
+* Previous [pod security policy (preview)](https://docs.microsoft.com/azure/aks/use-pod-security-policies) deprecation was June 30th 2021. To better align with Kubernetes Upstream pod security policy (preview) deprecation will begin with Kubernetes version 1.21, with its removal in version 1.25. As Kubernetes Upstream approaches that milestone, the Kubernetes community will be working to document viable alternatives.
+
+### Release Notes
+* Bug Fixes
+  * Added missing tolerations to Pod Identity Pods. Closes #2146.
+* Component Updates
+  * AKS Ubuntu 18.04 image updated to [AKSUbuntu-1804-2021.07.17](vhd-notes/aks-ubuntu/AKSUbuntu-1804/2021.07.25.txt).
+
 ## Release 2021-07-22
 
 This release is rolling out to all regions - estimated time for completed roll out is 2021-07-29 for public cloud and 2021-08-03 for sovereign clouds.
@@ -17,9 +36,9 @@ This release is rolling out to all regions - estimated time for completed roll o
 * Features
   * New Kubernetes patch version available, v.1.21.2.
 * Preview Features
-  * Upgrade your Windows nodepool from Docker to Containerd by the following two methods. Note that the Kubernetes version should be > 1.20.0 and the feature flag UseCustomizedWindowsPreview should be registered under your current Azure subscription. Reminder that Docker is removed in Kubernetes 1.24 completely, use the following commands to move your workload from Docker to Containerd now. 
-    * To upgrade a specific nodepool to use containerd: az aks nodepool upgrade --cluster-name $CLUSTERNAME --name $NODEPOOLNAME --resource-group $RGNAME --kubernetes-version 1.21.1  --http-headers WindowsContainerRuntime=containerd
-    * To upgrade the cluster to use containerd for all Windows nodepools: az aks upgrade --cluster-name $CLUSTERNAME --resource-group $RGNAME --kubernetes-version 1.21.1  --http-headers WindowsContainerRuntime=containerd
+  * Upgrade your Windows nodepool from Docker to Containerd by the following two methods. Note that the Kubernetes version should be > 1.20.0 and the feature flag UseCustomizedWindowsContainerRuntime should be registered under your current Azure subscription. Reminder that Docker is removed in Kubernetes 1.24 completely, use the following commands to move your workload from Docker to Containerd now. 
+    * To upgrade a specific nodepool to use containerd: `az aks nodepool upgrade --cluster-name $CLUSTERNAME --name $NODEPOOLNAME --resource-group $RGNAME --kubernetes-version 1.21.1 --aks-custom-headers WindowsContainerRuntime=containerd`
+    * To upgrade the cluster to use containerd for all Windows nodepools: `az aks upgrade --cluster-name $CLUSTERNAME --resource-group $RGNAME --kubernetes-version 1.21.1 --aks-custom-headers WindowsContainerRuntime=containerd`
 * Behavioral Changes
   * Cluster autoscaler will now enforce the minimum count in cases where the actual count drops below that. For example, Spot eviction or changing the minimum count value from the AKS API. In the past, the autoscaler operated and respected the minimum count but never interfered to enforce it if external factors affect it.
 * Component Updates

diff --git a/vhd-notes/aks-ubuntu/AKSUbuntu-1804/2021.07.25.txt b/vhd-notes/aks-ubuntu/AKSUbuntu-1804/2021.07.25.txt
@@ -0,0 +1,261 @@
+Components downloaded in this VHD build (some of the below components might get deleted during cluster provisioning if they are not needed):
+  - apache2-utils
+  - apt-transport-https
+  - blobfuse=1.3.7
+  - ca-certificates
+  - ceph-common
+  - cgroup-lite
+  - cifs-utils
+  - conntrack
+  - cracklib-runtime
+  - ebtables
+  - ethtool
+  - fuse
+  - git
+  - glusterfs-client
+  - init-system-helpers
+  - iproute2
+  - ipset
+  - iptables
+  - jq
+  - libpam-pwquality
+  - libpwquality-tools
+  - mount
+  - nfs-common
+  - pigz socat
+  - traceroute
+  - util-linux
+  - xz-utils
+  - zip
+  - moby v19.03.14
+  - runc version 1.0.0-rc95
+  - [cached] runc 1.0.0-rc92
+  - [cached] runc 1.0.0-rc95
+  - bpftrace
+  - nvidia-docker2 nvidia-container-runtime
+  - nvidia-container-runtime=2.0.0+docker18.09.2-1
+  - nvidia-gpu-driver-version=450.51.06
+  - bcc-tools
+  - libbcc-examples
+  - img
+docker images pre-pulled:
+  - mcr.microsoft.com/oss/kubernetes/kubernetes-dashboard:v1.10.1
+  - mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.0-beta8
+  - mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.0-rc3
+  - mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.0-rc7
+  - mcr.microsoft.com/oss/kubernetes/dashboard:v2.0.1
+  - mcr.microsoft.com/oss/kubernetes/metrics-scraper:v1.0.2
+  - mcr.microsoft.com/oss/kubernetes/metrics-scraper:v1.0.3
+  - mcr.microsoft.com/oss/kubernetes/metrics-scraper:v1.0.4
+  - mcr.microsoft.com/oss/kubernetes/exechealthz:1.2
+  - mcr.microsoft.com/oss/kubernetes/exechealthz:1.2_v0.0.5
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/addon-resizer:1.8.5
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/addon-resizer:1.8.4
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/addon-resizer:1.8.1
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/addon-resizer:1.7
+  - mcr.microsoft.com/oss/kubernetes/metrics-server:v0.3.6
+  - mcr.microsoft.com/oss/kubernetes/metrics-server:v0.4.4
+  - mcr.microsoft.com/k8s/core/pause:1.2.0
+  - mcr.microsoft.com/oss/kubernetes/pause:1.2.0
+  - mcr.microsoft.com/oss/kubernetes/pause:1.3.1
+  - mcr.microsoft.com/oss/kubernetes/pause:1.4.0
+  - mcr.microsoft.com/oss/kubernetes/pause:3.5
+  - mcr.microsoft.com/oss/kubernetes/coredns:1.8.3
+  - mcr.microsoft.com/oss/kubernetes/coredns:1.7.1
+  - mcr.microsoft.com/oss/kubernetes/coredns:1.6.6
+  - mcr.microsoft.com/oss/kubernetes/coredns:1.6.5
+  - mcr.microsoft.com/containernetworking/azure-cns:v1.3.3
+  - mcr.microsoft.com/containernetworking/azure-cns:v1.4.0
+  - mcr.microsoft.com/containernetworking/networkmonitor:v1.1.8_hotfix
+  - mcr.microsoft.com/containernetworking/networkmonitor:v1.1.8post2
+  - mcr.microsoft.com/containernetworking/networkmonitor:v1.1.8
+  - mcr.microsoft.com/containernetworking/azure-npm:v1.2.8
+  - mcr.microsoft.com/containernetworking/azure-npm:v1.2.2_hotfix
+  - mcr.microsoft.com/containernetworking/azure-npm:v1.2.1
+  - mcr.microsoft.com/containernetworking/azure-npm:v1.1.8
+  - mcr.microsoft.com/containernetworking/azure-npm:v1.3.1
+  - mcr.microsoft.com/containernetworking/azure-vnet-telemetry:v1.0.30
+  - mcr.microsoft.com/aks/hcp/hcp-tunnel-front:master.210623.2
+  - mcr.microsoft.com/aks/hcp/hcp-tunnel-front:master.210721.1
+  - mcr.microsoft.com/oss/kubernetes/apiserver-network-proxy/agent:v0.0.19
+  - mcr.microsoft.com/oss/kubernetes/apiserver-network-proxy/agent:v0.0.17
+  - mcr.microsoft.com/oss/kubernetes/apiserver-network-proxy/agent:v0.0.16
+  - mcr.microsoft.com/aks/hcp/tunnel-openvpn:master.210427.1
+  - mcr.microsoft.com/aks/hcp/tunnel-openvpn:master.210524.1
+  - mcr.microsoft.com/aks/hcp/tunnel-openvpn:master.210623.2
+  - mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.19
+  - mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v0.0.21
+  - mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.12
+  - mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.14
+  - mcr.microsoft.com/azuremonitor/containerinsights/ciprod:ciprod03262021
+  - mcr.microsoft.com/azuremonitor/containerinsights/ciprod:ciprod05202021
+  - mcr.microsoft.com/azuremonitor/containerinsights/ciprod:ciprod06112021
+  - mcr.microsoft.com/azuremonitor/containerinsights/ciprod:ciprod05202021-hotfix
+  - mcr.microsoft.com/azuremonitor/containerinsights/ciprod:ciprod06112021-1
+  - mcr.microsoft.com/oss/calico/cni:v3.8.9.2
+  - mcr.microsoft.com/oss/calico/cni:v3.8.9.3
+  - mcr.microsoft.com/oss/calico/node:v3.17.2
+  - mcr.microsoft.com/oss/calico/node:v3.18.1
+  - mcr.microsoft.com/oss/calico/node:v3.19.0
+  - mcr.microsoft.com/oss/calico/node:v3.8.9.2
+  - mcr.microsoft.com/oss/calico/node:v3.8.9.5
+  - mcr.microsoft.com/oss/calico/typha:v3.17.2
+  - mcr.microsoft.com/oss/calico/typha:v3.18.1
+  - mcr.microsoft.com/oss/calico/typha:v3.19.0
+  - mcr.microsoft.com/oss/calico/typha:v3.8.9
+  - mcr.microsoft.com/oss/calico/pod2daemon-flexvol:v3.8.9.1
+  - mcr.microsoft.com/oss/calico/kube-controllers:v3.17.2
+  - mcr.microsoft.com/oss/calico/kube-controllers:v3.18.1
+  - mcr.microsoft.com/oss/calico/kube-controllers:v3.19.0
+  - mcr.microsoft.com/oss/tigera/operator:v1.13.5
+  - mcr.microsoft.com/oss/tigera/operator:v1.15.1
+  - mcr.microsoft.com/oss/tigera/operator:v1.17.1
+  - mcr.microsoft.com/oss/appscode/guard:v0.7.1
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1.3
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.5.1.4
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.6.0
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.4
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v0.7.5
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.1
+  - mcr.microsoft.com/oss/kubernetes/azure-cloud-node-manager:v1.0.2
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.3.0_v0.0.5
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.7.1-hotfix.20200403
+  - mcr.microsoft.com/oss/kubernetes/autoscaler/cluster-proportional-autoscaler:1.8.3
+  - mcr.microsoft.com/k8s/flexvolume/blobfuse-flexvolume:1.0.15
+  - mcr.microsoft.com/k8s/flexvolume/keyvault-flexvolume:v0.0.13
+  - mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0.4
+  - mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0.5
+  - mcr.microsoft.com/oss/kubernetes/ip-masq-agent:v2.5.0.6
+  - mcr.microsoft.com/k8s/kms/keyvault:v0.0.9
+  - mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.2.0
+  - mcr.microsoft.com/oss/kubernetes-csi/azuredisk-csi:v1.4.0
+  - mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.2.0
+  - mcr.microsoft.com/oss/kubernetes-csi/azurefile-csi:v1.4.0
+  - mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.2.0
+  - mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.3.0
+  - mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.1.0
+  - mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.2.0
+  - mcr.microsoft.com/oss/open-policy-agent/gatekeeper:v3.2.3
+  - mcr.microsoft.com/oss/open-policy-agent/gatekeeper:v3.4.1
+  - mcr.microsoft.com/oss/kubernetes/external-dns:v0.8.0
+  - mcr.microsoft.com/oss/kubernetes/external-dns:v0.6.0-hotfix-20200228
+  - mcr.microsoft.com/oss/kubernetes/defaultbackend:1.4
+  - mcr.microsoft.com/oss/kubernetes/ingress/nginx-ingress-controller:0.47.0
+  - mcr.microsoft.com/oss/kubernetes/ingress/nginx-ingress-controller:0.19.0
+  - mcr.microsoft.com/oss/virtual-kubelet/virtual-kubelet:1.3.3
+  - mcr.microsoft.com/oss/virtual-kubelet/virtual-kubelet:1.3.4
+  - mcr.microsoft.com/oss/virtual-kubelet/virtual-kubelet:1.3.5
+  - mcr.microsoft.com/azure-policy/policy-kubernetes-addon-prod:prod_20210325.1
+  - mcr.microsoft.com/azure-policy/policy-kubernetes-addon-prod:prod_20210713.1
+  - mcr.microsoft.com/azure-policy/policy-kubernetes-addon-prod:prod_20210719.1
+  - mcr.microsoft.com/azure-policy/policy-kubernetes-webhook:prod_20210209.1
+  - mcr.microsoft.com/azure-policy/policy-kubernetes-webhook:prod_20210713.1
+  - mcr.microsoft.com/azure-application-gateway/kubernetes-ingress:1.0.1-rc3
+  - mcr.microsoft.com/azure-application-gateway/kubernetes-ingress:1.2.0
+  - mcr.microsoft.com/azure-application-gateway/kubernetes-ingress:1.3.0
+  - mcr.microsoft.com/azure-application-gateway/kubernetes-ingress:1.4.0
+  - mcr.microsoft.com/oss/azure/aad-pod-identity/nmi:v1.7.4
+  - mcr.microsoft.com/oss/azure/aad-pod-identity/nmi:v1.7.5
+  - mcr.microsoft.com/aks/command/runtime:master.210524.9
+  - mcr.microsoft.com/aks/command/init:master.210524.9
+  - Azure CNI version 1.4.0
+  - Azure CNI version 1.2.7
+  - Azure Swift CNI version 1.4.0
+  - Azure Swift CNI version 1.2.7
+  - CNI plugin version 0.7.6
+  - CNI plugin version 0.7.5
+  - CNI plugin version 0.7.1
+  - CNI plugin version 0.8.6
+  - mcr.microsoft.com/oss/nvidia/k8s-device-plugin:v0.9.0
+  - nginx:1.13.12-alpine
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.13-hotfix.20210310.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.17.16-hotfix.20210310.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.8-hotfix.20200924
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.8-hotfix.20201112.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-hotfix.20210118
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.10-hotfix.20210310.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14-hotfix.20210511
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.14-hotfix.20210525
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.17-hotfix.20210525.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.17-hotfix.20210525.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.19-hotfix.20210522.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.18.19-hotfix.20210522.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.1-hotfix.20200923
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.1-hotfix.20200923.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.3
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6-hotfix.20210118
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.6-hotfix.20210310.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.7-hotfix.20210511
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.7-hotfix.20210525
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.9-hotfix.20210526.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.9-hotfix.20210526.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.11-hotfix.20210526.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.11-hotfix.20210526.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.19.12
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.2-hotfix.20210511
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.2-hotfix.20210525
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.5-hotfix.20210603
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.5-hotfix.20210603.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.7-hotfix.20210603
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.7-hotfix.20210603.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.20.8
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.21.1-hotfix.20210713
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.21.1-hotfix.20210713.1
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.21.2
+  - mcr.microsoft.com/oss/kubernetes/kube-proxy:v1.21.2-hotfix.20210715.1
+kubelet/kubectl downloaded:
+-rwxr-xr-x 1 root root 151175456 Sep 24  2020 /usr/local/bin/kubelet-1.19.1
+-rwxr-xr-x 1 root root  60381530 Sep 24  2020 /usr/local/bin/kubectl-1.19.1
+-rwxr-xr-x 1 root root 152696096 Sep 25  2020 /usr/local/bin/kubelet-1.18.8
+-rwxr-xr-x 1 root root  60077962 Sep 25  2020 /usr/local/bin/kubectl-1.18.8
+-rwxr-xr-x 1 root root 151219448 Oct 16  2020 /usr/local/bin/kubelet-1.19.3
+-rwxr-xr-x 1 root root  60381333 Oct 16  2020 /usr/local/bin/kubectl-1.19.3
+-rwxr-xr-x 1 root root 152767208 Jan 18  2021 /usr/local/bin/kubelet-1.18.10
+-rwxr-xr-x 1 root root  60078093 Jan 18  2021 /usr/local/bin/kubectl-1.18.10
+-rwxr-xr-x 1 root root 151019720 Jan 18  2021 /usr/local/bin/kubelet-1.19.6
+-rwxr-xr-x 1 root root  60288196 Jan 18  2021 /usr/local/bin/kubectl-1.19.6
+-rwxr-xr-x 1 root root 109921416 Mar 10 23:55 /usr/local/bin/kubelet-1.19.7
+-rwxr-xr-x 1 root root  42942464 Mar 10 23:55 /usr/local/bin/kubectl-1.19.7
+-rwxr-xr-x 1 root root 113990600 Mar 10 23:59 /usr/local/bin/kubelet-1.20.2
+-rwxr-xr-x 1 root root  40218624 Mar 10 23:59 /usr/local/bin/kubectl-1.20.2
+-rwxr-xr-x 1 root root 152799184 Mar 22 23:18 /usr/local/bin/kubelet-1.18.14
+-rwxr-xr-x 1 root root  60086227 Mar 22 23:18 /usr/local/bin/kubectl-1.18.14
+-rwxr-xr-x 1 root root 113214328 May  6 00:46 /usr/local/bin/kubelet-1.18.17
+-rwxr-xr-x 1 root root  43937792 May  6 00:46 /usr/local/bin/kubectl-1.18.17
+-rwxr-xr-x 1 root root 109970600 May  6 00:50 /usr/local/bin/kubelet-1.19.9
+-rwxr-xr-x 1 root root  42934272 May  6 00:50 /usr/local/bin/kubectl-1.19.9
+-rwxr-xr-x 1 root root 114044008 May  6 00:51 /usr/local/bin/kubelet-1.20.5
+-rwxr-xr-x 1 root root  40210432 May  6 00:51 /usr/local/bin/kubectl-1.20.5
+-rwxr-xr-x 1 root root 114072680 May 13 08:36 /usr/local/bin/kubelet-1.20.7
+-rwxr-xr-x 1 root root  40218624 May 13 08:36 /usr/local/bin/kubectl-1.20.7
+-rwxr-xr-x 1 root root 118054736 May 13 08:41 /usr/local/bin/kubelet-1.21.1
+-rwxr-xr-x 1 root root  47566848 May 13 08:41 /usr/local/bin/kubectl-1.21.1
+-rwxr-xr-x 1 root root 113267576 May 13 17:37 /usr/local/bin/kubelet-1.18.19
+-rwxr-xr-x 1 root root  43950080 May 13 17:37 /usr/local/bin/kubectl-1.18.19
+-rwxr-xr-x 1 root root 109999304 May 13 17:43 /usr/local/bin/kubelet-1.19.11
+-rwxr-xr-x 1 root root  42938368 May 13 17:43 /usr/local/bin/kubectl-1.19.11
+-rwxr-xr-x 1 root root 118123056 Jun 17 17:01 /usr/local/bin/kubelet-1.21.2
+-rwxr-xr-x 1 root root  46403584 Jun 17 17:01 /usr/local/bin/kubectl-1.21.2
+-rwxr-xr-x 1 root root 110032072 Jun 17 20:09 /usr/local/bin/kubelet-1.19.12
+-rwxr-xr-x 1 root root  42938368 Jun 17 20:09 /usr/local/bin/kubectl-1.19.12
+-rwxr-xr-x 1 root root 114109576 Jun 18 08:32 /usr/local/bin/kubelet-1.20.8
+-rwxr-xr-x 1 root root  40214528 Jun 18 08:32 /usr/local/bin/kubectl-1.20.8
+-r-xr--r-- 1 root root      2462 Jul 25 04:34 /usr/local/bin/health-monitor.sh
+-rwxr-xr-x 1 root root  35384960 Jul 25 04:38 /usr/local/bin/bpftrace
+Disk usage:
+Filesystem      Size  Used Avail Use% Mounted on
+udev            3.4G     0  3.4G   0% /dev
+tmpfs           696M  708K  695M   1% /run
+/dev/sdb1        29G   22G  7.6G  74% /
+tmpfs           3.4G     0  3.4G   0% /dev/shm
+tmpfs           5.0M     0  5.0M   0% /run/lock
+tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
+/dev/sdb15      105M  6.6M   98M   7% /boot/efi
+/dev/sda1        14G   41M   13G   1% /mnt
+tmpfs           696M     0  696M   0% /run/user/1000
+Using kernel:
+Linux version 5.4.0-1055-azure (buildd@lcy01-amd64-025) (gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)) #57~18.04.1-Ubuntu SMP Fri Jul 16 19:40:19 UTC 2021