Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering #37648

andrewsykim · 2022-11-01T13:23:36Z

Signed-off-by: Andrew Sy Kim [email protected]

Add feature blog placeholder PR for KEP-2086

netlify · 2022-11-01T13:36:26Z

✅ Pull request preview available for checking

Built without sensitive environment variables

Name	Link
🔨 Latest commit	`8592fa2`
🔍 Latest deploy log	https://app.netlify.com/sites/kubernetes-io-main-staging/deploys/639163cd7f525900087c5dc8
😎 Deploy Preview	https://deploy-preview-37648--kubernetes-io-main-staging.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

davidmirror-ops · 2022-11-16T10:16:36Z

HI @andrewsykim, Comms Shadow for the 1.26 release here. This feature blog is tracked for release, the deadline for submitting the draft is November 29.
Considering editorial review times, the sooner you can send the draft the better.
Any doubt, me and the Comms team are here to help!
cc @fsmunoz

fsmunoz · 2022-11-24T23:30:52Z

Hello @andrewsykim , we're doing a global reminder about submitting a draft for review for all opted-in feature blogs. If it's at all possible, it is very helpful for the release team to have drafts submitted for review before the hard deadline date, to better plan the release dates and avoid missing out. Thank you!

andrewsykim · 2022-11-28T15:13:00Z

@fsmunoz I have a working draft in a google doc, I'll have it copied over here sometime today or tomorrow

fsmunoz · 2022-11-29T10:27:04Z

Thank you @andrewsykim , moving tracking for Ready for Review!

tengqm · 2022-11-29T14:16:12Z

/label tide/merge-method-squash

sftim · 2022-11-29T17:39:16Z

/remove-label tide/merge-method-squash

sftim

Thanks

/retitle [WIP] Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering

If you have SVG images, or can get them, that's even better.

sftim · 2022-11-29T17:42:45Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+Kubernetes v1.26 includes significant advancements in traffic engineering with the graduation of the
+`ServiceInternalTrafficPolicy` and `EndpointSliceTerminatingCondition` features to GA and the
+`ProxyTerminatingEndpoints` feature to Beta. The combination of these enhancements aim to address
+short-comings in traffic engineering today and unlock new capabilities for the future.


Suggested change

Kubernetes v1.26 includes significant advancements in traffic engineering with the graduation of the

`ServiceInternalTrafficPolicy` and `EndpointSliceTerminatingCondition` features to GA and the

`ProxyTerminatingEndpoints` feature to Beta. The combination of these enhancements aim to address

short-comings in traffic engineering today and unlock new capabilities for the future.

Kubernetes v1.26 includes significant advancements in network traffic engineering with the graduation of

two features (Service internal traffic policy support, and EndpointSlice terminating conditions) GA,

and a third feature (Proxy terminating endpoints) `ProxyTerminatingEndpoints` feature to beta.

The combination of these enhancements aims to address short-comings in traffic engineering that

people face today, and unlock new capabilities for the future.

No need to name the feature gates in the introduction; better to let people know that detail later,
if needed.

sftim · 2022-11-29T17:43:27Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+
+## Traffic Loss from Load Balancers During Rolling Updates
+
+Prior to Kubernetes v1.26, [clusters can experience loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)


Suggested change

Prior to Kubernetes v1.26, [clusters can experience loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)

Prior to Kubernetes v1.26, clusters could experience [loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)

sftim · 2022-11-29T17:44:20Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+from Service load balancers during rolling updates when setting the `externalTrafficPolicy` field to `Local`.
+There are a lot of moving parts at play here so a quick overview of how Kubernetes manages load balancers might help!
+
+In Kubernetes, you can create a Service with Type=LoadBalancer to expose an application externally with a load balancer.


Suggested change

In Kubernetes, you can create a Service with Type=LoadBalancer to expose an application externally with a load balancer.

In Kubernetes, you can create a Service with `type: LoadBalancer` to expose an application externally with a load balancer.

YAML is the norm; JSON is a fallback. Type=LoadBalancer isn't part of the API either way (it's more like Golang).

sftim · 2022-11-29T17:46:31Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+```
+
+Under the hood, Kubernetes allocates a NodePort for the Service, which is then used by kube-proxy to provide a
+network data path from the NodePort to the Pod. A controller running in the Kubernetes Control Plane will then


Suggested change

network data path from the NodePort to the Pod. A controller running in the Kubernetes Control Plane will then

network data path from the NodePort to the Pod. A controller will then

The boundary is blurred here; you can set service.kubernetes.io/service-proxy-name on a Service and use your own load balancer. We can assume that the thing watching for Services is a controller, though.

sftim · 2022-11-29T17:47:00Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+add all available Nodes in the cluster to the load balancer’s backend pool, using the designated NodePort for
+the Service as the backend target port.
+
+{{< figure src="traffic-engineering-service-load-balancer.png" alt="Figure 1: Overview of Service Load Balancers" >}}


(nit) You can caption the image rather than setting the figure name only in the alt attribute.

sftim · 2022-11-29T17:47:25Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+the more likely this will happen, since the load balancer will take longer to realize that a node is no longer
+healthy and unable to accept traffic. This also occurred when Pods started terminating during rolling updates,
+specifically when a Node went from N to 0 healthy pods because Kubernetes does not consider terminating Pods
+as “Ready”, regardless of their readiness probes.


Suggested change

as “Ready”, regardless of their readiness probes.

as `Ready`, regardless of their readiness probes.

sftim · 2022-11-29T17:50:38Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+Starting in Kubernetes v1.26, kube-proxy enables the `ProxyTerminatingEndpoints` feature by default, which
+adds automatic failover and routing to terminating endpoints in scenarios where the traffic would otherwise
+be dropped. More specifically, when there is a rolling update and a Node only contains terminating replicas,
+kube-proxy will route traffic to the terminating replicas as long as their readiness probes are passing.
+By doing so, kube-proxy provides the external load balancer a window of time to gracefully steer traffic
+away from the Node after its next health check probe.


Is this right:

Suggested change

Starting in Kubernetes v1.26, kube-proxy enables the `ProxyTerminatingEndpoints` feature by default, which

adds automatic failover and routing to terminating endpoints in scenarios where the traffic would otherwise

be dropped. More specifically, when there is a rolling update and a Node only contains terminating replicas,

kube-proxy will route traffic to the terminating replicas as long as their readiness probes are passing.

By doing so, kube-proxy provides the external load balancer a window of time to gracefully steer traffic

away from the Node after its next health check probe.

Starting in Kubernetes v1.26, kube-proxy defaults to using _proxy terminating endpoints_ behavior. The

kube-proxy spots when traffic arrives that is destined to a terminating endpoint, and avoids some scenarios where the traffic would otherwise be dropped.

More specifically, when there is a rolling update and a Node only contains terminating replicas,

kube-proxy routes traffic to the terminating replicas only as long as their readiness probes are passing.

By doing so, kube-proxy provides the external load balancer a window of time to gracefully steer traffic

away from the Node after its next health check probe.

If there are no local healthy replicas, kube-proxy looks for another node with healthy endpoints and

tries to send the traffic there.

?

I'm worried that readers won't work out how the new behavior is different.

sftim · 2022-11-29T17:51:46Z

content/en/blog/_posts/2022-MM-DD-service-internal-traffic-policy.md

@@ -0,0 +1 @@
+PLACEHOLDER


Remember to remove this file.

sftim · 2022-11-29T18:59:19Z

/hold

OK to unhold once this has a publication date assigned.

fsmunoz · 2022-11-30T23:54:40Z

Hello, Comms Lead for v1.26 here: this Feature Blog PR is confirmed for the post-release Feature Blog series. We will add the publishing date in the next days. Thank you for your work!

Signed-off-by: Andrew Sy Kim <[email protected]>

sftim · 2022-12-02T12:55:06Z

Let's publish this on the 30th of December.

fsmunoz · 2022-12-03T12:42:41Z

Hello, Comms Lead for v1.26 here. The publication order and date for the Feature Blog series has been finalised and the tracking board updated (cf. discussion).

The publication date for this article is 30-12-2022 (December 30).

Thanks!

fsmunoz · 2022-12-07T15:50:54Z

@sftim I think the latest commits addressed the comments/suggestions, would you say this is ready to publish?

sftim · 2022-12-07T15:54:30Z

/approve
/hold

Don't merge this until v1.26 is released.

sftim · 2022-12-07T15:56:51Z

The publication date in this PR is wrong; it should be 2022-12-30

/approve cancel
I'm happy to approve this otherwise; I think it's good to go.

Between now and publication it would be great to get SVG versions of the images.

fsmunoz · 2022-12-07T16:03:40Z

Thank you @sftim - @andrewsykim , could you correct the publication date to 2022-12-30 ?

sftim · 2022-12-07T22:49:12Z

content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md

+---
+layout: blog
+title: "Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering"
+date: 2022-11-28


Suggested change

date: 2022-11-28

date: 2022-12-30

Please also change the path content/en/blog/_posts/2022-11-28-advancements-in-traffic-engineering/index.md to match.

Updated publication date, thanks

Signed-off-by: Andrew Sy Kim <[email protected]>

sftim · 2022-12-08T10:12:48Z

Thanks

/lgtm
/approve

k8s-ci-robot · 2022-12-08T10:12:55Z

LGTM label has been added.

Git tree hash: 656eea21d1090fec3c7dafee708e02880c174c91

k8s-ci-robot · 2022-12-08T10:12:56Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sftim

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~content/en/blog/OWNERS~~ [sftim]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

andrewsykim · 2022-12-12T20:47:45Z

/hold cancel

k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Nov 1, 2022

k8s-ci-robot requested review from nate-double-u and sftim November 1, 2022 13:23

k8s-ci-robot added area/blog Issues or PRs related to the Kubernetes Blog subproject language/en Issues or PRs related to English language sig/docs Categorizes an issue or PR as relevant to SIG Docs. labels Nov 1, 2022

andrewsykim changed the title ~~Add placeholder feature blog post for KEP-2086~~ [WIP] Add placeholder feature blog post for KEP-2086 Nov 1, 2022

k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Nov 1, 2022

andrewsykim force-pushed the blog-kep-2086 branch from eaa7926 to c1c14e7 Compare November 29, 2022 05:33

k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Nov 29, 2022

andrewsykim changed the title ~~[WIP] Add placeholder feature blog post for KEP-2086~~ Blog: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering Nov 29, 2022

k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 29, 2022

andrewsykim mentioned this pull request Nov 29, 2022

[WIP] Add blog post for KEP-1672 #37646

Closed

k8s-ci-robot added the tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges. label Nov 29, 2022

andrewsykim force-pushed the blog-kep-2086 branch from c1c14e7 to 582448e Compare November 29, 2022 17:29

k8s-ci-robot removed the tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges. label Nov 29, 2022

sftim reviewed Nov 29, 2022

View reviewed changes

k8s-ci-robot changed the title ~~Blog: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering~~ [WIP] Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering Nov 29, 2022

k8s-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 29, 2022

k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 29, 2022

k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 30, 2022

andrewsykim force-pushed the blog-kep-2086 branch from 61b0d45 to 2587e40 Compare November 30, 2022 22:02

k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Nov 30, 2022

andrewsykim force-pushed the blog-kep-2086 branch from 2587e40 to 1fdab41 Compare November 30, 2022 23:47

andrewsykim force-pushed the blog-kep-2086 branch 3 times, most recently from c3deeb1 to c466ce9 Compare December 1, 2022 15:45

Blog: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering

ed681db

Signed-off-by: Andrew Sy Kim <[email protected]>

andrewsykim force-pushed the blog-kep-2086 branch from c466ce9 to ed681db Compare December 1, 2022 19:37

k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Dec 7, 2022

k8s-ci-robot removed the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Dec 7, 2022

sftim reviewed Dec 7, 2022

View reviewed changes

update publication date to 2022-12-30

8592fa2

Signed-off-by: Andrew Sy Kim <[email protected]>

k8s-ci-robot assigned sftim Dec 8, 2022

k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Dec 8, 2022

k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Dec 8, 2022

k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Dec 12, 2022

k8s-ci-robot merged commit bd3fcac into kubernetes:main Dec 12, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering #37648

Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering #37648

andrewsykim commented Nov 1, 2022

netlify bot commented Nov 1, 2022 •

edited

Loading

davidmirror-ops commented Nov 16, 2022

fsmunoz commented Nov 24, 2022

andrewsykim commented Nov 28, 2022

fsmunoz commented Nov 29, 2022

tengqm commented Nov 29, 2022

sftim commented Nov 29, 2022

sftim left a comment

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim Nov 29, 2022

sftim commented Nov 29, 2022

fsmunoz commented Nov 30, 2022

sftim commented Dec 2, 2022

fsmunoz commented Dec 3, 2022

fsmunoz commented Dec 7, 2022

sftim commented Dec 7, 2022

sftim commented Dec 7, 2022

fsmunoz commented Dec 7, 2022

sftim Dec 7, 2022

andrewsykim Dec 8, 2022

sftim commented Dec 8, 2022

k8s-ci-robot commented Dec 8, 2022

k8s-ci-robot commented Dec 8, 2022

andrewsykim commented Dec 12, 2022

-Kubernetes v1.26 includes significant advancements in traffic engineering with the graduation of the
-`ServiceInternalTrafficPolicy` and `EndpointSliceTerminatingCondition` features to GA and the
-`ProxyTerminatingEndpoints` feature to Beta. The combination of these enhancements aim to address
-short-comings in traffic engineering today and unlock new capabilities for the future.
+Kubernetes v1.26 includes significant advancements in network traffic engineering with the graduation of
+two features (Service internal traffic policy support, and EndpointSlice terminating conditions) GA,
+and a third feature (Proxy terminating endpoints) `ProxyTerminatingEndpoints` feature to beta.
+The combination of these enhancements aims to address short-comings in traffic engineering that
+people face today, and unlock new capabilities for the future.


		## Traffic Loss from Load Balancers During Rolling Updates

		Prior to Kubernetes v1.26, [clusters can experience loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)

	Prior to Kubernetes v1.26, [clusters can experience loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)
	Prior to Kubernetes v1.26, clusters could experience [loss of traffic](https://github.com/kubernetes/kubernetes/issues/85643)

	In Kubernetes, you can create a Service with Type=LoadBalancer to expose an application externally with a load balancer.
	In Kubernetes, you can create a Service with `type: LoadBalancer` to expose an application externally with a load balancer.

	network data path from the NodePort to the Pod. A controller running in the Kubernetes Control Plane will then
	network data path from the NodePort to the Pod. A controller will then

	as “Ready”, regardless of their readiness probes.
	as `Ready`, regardless of their readiness probes.

		@@ -0,0 +1 @@
		PLACEHOLDER

Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering #37648

Add blog article: Kubernetes v1.26: Advancements in Kubernetes Traffic Engineering #37648

Conversation

andrewsykim commented Nov 1, 2022

netlify bot commented Nov 1, 2022 • edited Loading

✅ Pull request preview available for checking

davidmirror-ops commented Nov 16, 2022

fsmunoz commented Nov 24, 2022

andrewsykim commented Nov 28, 2022

fsmunoz commented Nov 29, 2022

tengqm commented Nov 29, 2022

sftim commented Nov 29, 2022

sftim left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

sftim commented Nov 29, 2022

fsmunoz commented Nov 30, 2022

sftim commented Dec 2, 2022

fsmunoz commented Dec 3, 2022

fsmunoz commented Dec 7, 2022

sftim commented Dec 7, 2022

sftim commented Dec 7, 2022

fsmunoz commented Dec 7, 2022

Choose a reason for hiding this comment

Choose a reason for hiding this comment

sftim commented Dec 8, 2022

k8s-ci-robot commented Dec 8, 2022

k8s-ci-robot commented Dec 8, 2022

andrewsykim commented Dec 12, 2022

netlify bot commented Nov 1, 2022 •

edited

Loading