Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Alpha Clusters #2058

Open
palma21 opened this issue Jan 13, 2021 · 39 comments
Open

[Feature Request] Alpha Clusters #2058

palma21 opened this issue Jan 13, 2021 · 39 comments
Assignees
Labels

Comments

@palma21
Copy link
Member

palma21 commented Jan 13, 2021

Support for sandbox clusters with all feature gates open to allow for testing of new k8s features before they become supported.

@ghost
Copy link

ghost commented Jan 13, 2021

@Azure/aks-pm issue needs labels

@qpetraroia qpetraroia self-assigned this Jan 13, 2021
@ghost ghost added the action-required label Feb 9, 2021
@Azure Azure deleted a comment from andyzhangx Mar 2, 2021
@ghost ghost removed the action-required label Mar 2, 2021
@ghost ghost added the action-required label Mar 28, 2021
@ghost ghost added the stale Stale issue label May 27, 2021
@ghost
Copy link

ghost commented May 27, 2021

This issue has been automatically marked as stale because it has not had any activity for 60 days. It will be closed if no further activity occurs within 15 days of this comment.

@rafaribe
Copy link

Would be awesome to get support for this, looking specifically at the LoadBalancer with Mixed Protocol new feature already mentioned in #2193

@drzdbd1
Copy link

drzdbd1 commented Jul 22, 2021

Interested as well, following.

@Shaybs
Copy link

Shaybs commented Sep 2, 2021

Any updates? Ephemeral Containers would be nice, tbh.

@TilmanLacko-TomTom
Copy link

Looking forward to use HPAScaleToZero once this is done..

@philwelz
Copy link
Collaborator

philwelz commented Oct 7, 2021

Any updates? Ephemeral Containers would be nice, tbh.

For this you would need at least Containerd 1.5 which is coming only with AKS 1.22+ Clusters

@yanrez
Copy link

yanrez commented Nov 3, 2021

We are also interested in being able to use feature gates to enable alpha features. In our case it's HostProcess container support on k8s 1.22 . Would be very convenient to have way of enabling alpha features.

@ghost ghost removed the action-required label Nov 3, 2021
@mehmettaskiner
Copy link

Looking forward to have support for this, we need this to enable mixed protocols in load balancers.

@philwelz
Copy link
Collaborator

same here, but i would like a solution where i have to specifically enable alpha feature gates instead of have all enabled.

@palma21 palma21 added the feature-request Requested Features label Nov 27, 2021
@annerajb
Copy link

same here, but i would like a solution where i have to specifically enable alpha feature gates instead of have all enabled.

i agree enabling all of them is way too much compare to selectively enabling individual ones such as MixedProtocolLBSVC hpa scale to zero and a few others.

@TacticalVilius
Copy link

Agree, we also only need the LoadBalancer with mixed protocols feature. Wouldn't want to also enable every other alpha feature.

@ringerc
Copy link

ringerc commented Feb 21, 2022

I couldn't agree more about feature gates being desirable.

For example, I'd like to be able to start development work on supporting ephemeral containers (https://kubernetes.io/docs/concepts/workloads/pods/ephemeral-containers/) before AKS rolls it out as a fully supported option.

@philwelz
Copy link
Collaborator

I couldn't agree more about feature gates being desirable.

For example, I'd like to be able to start development work on supporting ephemeral containers (https://kubernetes.io/docs/concepts/workloads/pods/ephemeral-containers/) before AKS rolls it out as a fully supported option.

You can do this with AKS 1.23 which is public preview at the moment as ephemeral containers graduated to beta in 1.23

@ringerc
Copy link

ringerc commented Feb 23, 2022

Excellent, thankyou @philwelz . I incorrectly thought beta features were still gated off by default, but upon rechecking I can see I was mistaken.

@philwelz
Copy link
Collaborator

Excellent, thankyou @philwelz . I incorrectly thought beta features were still gated off by default, but upon rechecking I can see I was mistaken.

I already tested with AKS 😄

@yanrez
Copy link

yanrez commented Dec 29, 2022

We would like to use StatefulSetStartOrdinal alpha feature gate on 1.26

@ghost ghost removed the action-required label Dec 29, 2022
@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

@rafaribe

Would be awesome to get support for this, looking specifically at the LoadBalancer with Mixed Protocol new feature already mentioned in #2193

Is this still something you are interested in> Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

Interested as well, following.

@drzdbd1 Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

Any updates? Ephemeral Containers would be nice, tbh.

@Shaybs Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

Looking forward to use HPAScaleToZero once this is done..

@TilmanLacko-TomTom Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

We are also interested in being able to use feature gates to enable alpha features. In our case it's HostProcess container support on k8s 1.22 . Would be very convenient to have way of enabling alpha features.

@yanrez Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

Looking forward to have support for this, we need this to enable mixed protocols in load balancers.

@mehmettaskiner Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

same here, but i would like a solution where i have to specifically enable alpha feature gates instead of have all enabled.

@philwelz Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

Agree, we also only need the LoadBalancer with mixed protocols feature. Wouldn't want to also enable every other alpha feature.

@TacticalVilius Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

I couldn't agree more about feature gates being desirable.

For example, I'd like to be able to start development work on supporting ephemeral containers (https://kubernetes.io/docs/concepts/workloads/pods/ephemeral-containers/) before AKS rolls it out as a fully supported option.

@ringerc Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@olsenme
Copy link
Contributor

olsenme commented Feb 9, 2023

came here looking for the StatefulSetAutoDeletePVC alpha feature released in 1.23

@jamesongithub Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

@jamesongithub
Copy link

jamesongithub commented Feb 9, 2023

came here looking for the StatefulSetAutoDeletePVC alpha feature released in 1.23

@jamesongithub Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

StatefulSetAutoDeletePVC useful in dev workloads so you don't have a bunch of orphaned pvc's while testing/developing.

@kaarthis kaarthis assigned olsenme and unassigned qpetraroia Mar 10, 2023
@doubleyewdee
Copy link

back again, we got mixed protocol LB, but now we're interested in HPAContainerMetrics. this issue is really old at this point, it would be nice to either get some commentary from AKS about generally offering alpha-gated k8s features or simply be told "no" and have this issue closed.

thanks!

@olsenme
Copy link
Contributor

olsenme commented Mar 23, 2023

back again, we got mixed protocol LB, but now we're interested in HPAContainerMetrics. this issue is really old at this point, it would be nice to either get some commentary from AKS about generally offering alpha-gated k8s features or simply be told "no" and have this issue closed.

thanks!

What are your thoughts if we were to support only latest stable version of AKS for alpha clusters? Would this meet your needs?

@dhirschfeld
Copy link

What are your thoughts if we were to support only latest stable version of AKS for alpha clusters? Would this meet your needs?

If you're wanting to try out alpha features it seems you'd more likely want to test them on the latest preview cluster.

@bok11
Copy link

bok11 commented Mar 23, 2023

Looking forward to use HPAScaleToZero once this is done..

@TilmanLacko-TomTom Is this still something you are interested in? Would like to learn more about your use case and why you are interested in this.

This is something I am interested in as well.
My use case is this:

My microservices work in a choreography architecture, so I only need them to be on if there are work for them to do.
We use devspace to develop, so we have many environments with idle pods running.

Additionally, one of our workloads require 200gb of memory, so if 5 developers each have their own environment they reserve 1 Tb of memory just to have their helm chart deployed, but without having any actual workload.

@olsenme
Copy link
Contributor

olsenme commented Mar 23, 2023

Anyone else thoughts on the proposal to support only on latest stable version?

@doubleyewdee
Copy link

back again, we got mixed protocol LB, but now we're interested in HPAContainerMetrics. this issue is really old at this point, it would be nice to either get some commentary from AKS about generally offering alpha-gated k8s features or simply be told "no" and have this issue closed.
thanks!

What are your thoughts if we were to support only latest stable version of AKS for alpha clusters? Would this meet your needs?

100% would meet our needs yes. we're happy to upgrade/roll-forward any time we need these things, also happy to flip a specific bit at cluster provisioning time and even totally rebuild our clusters to get features turned on.

@bok11
Copy link

bok11 commented Mar 24, 2023

Anyone else thoughts on the proposal to support only on latest stable version?

This would be fine for me, it shouldn't be an issue to keep our cluster updates to the latest version.

@pohly
Copy link

pohly commented Sep 19, 2023

@olsenme: this was added to the backlog on April 13 and then removed again completely on June 5. Does that mean that it's no longer planned?

I'd like to add one more aspect: besides enabling feature gates, sometimes a feature also needs API groups enabled in the apiserver. Example (my current use case): https://kubernetes.io/docs/concepts/scheduling-eviction/dynamic-resource-allocation/#enabling-dynamic-resource-allocation

@dtzar
Copy link

dtzar commented Oct 25, 2023

CAPZ will support creating and joining alpha/beta worker nodes to AKS control plane. For more information see this PR and recorded demo from the community meeting.
If you're interested to use this, functionality please feel free to ping me or join CAPZ office hours or slack

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests