Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom listen ports document #3715

Merged
merged 13 commits into from
Jun 22, 2023
159 changes: 159 additions & 0 deletions docs/content/tutorials/custom-listen-ports.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,159 @@
---
title: Customze ports for NGINX Ingress Controller
description: |
Customze ports for NGINX Ingress Controller
weight: 1800
doctypes: ["concept"]
toc: true
docs: "DOCS-1191"
---
## Customizing the `listen` line in NGINX Ingress Controller.
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved

This document will explain how to change the default ports that NGINX Ingress Controller is configured for, as well as add additional `listen` settings. For more information, please read the [NGINX Listen documentation](http://nginx.org/en/docs/http/ngx_http_core_module.html#listen).
jasonwilliams14 marked this conversation as resolved.
Show resolved Hide resolved


## Changing Default Ports

By default, NGINX Ingress Controller listens on ports 80 and 443. These ports can be changed easily, but modifying the `listen` ports for your NGINX Ingress resources will require the editing of .tmpl files.
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved

If you are using `ingress` resource you will need to modify:
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved
- `nginx-plus-ingress.tmpl` if using NGINX Plus
- `nginx-ingress.tmpl` if using NGINX OSS

If you are using NGINX Ingress Controller CRDs (virtualServer):
- `nginx-plus-virtualserver.tmpl` for NGINX Plus
- `nginx-virtualserver.tmpl` if using NGINX OSS

For this example, we will use the `nginx-virtualserver.tmpl` template to change the port from 80 to 85.
You can find the [nginx-virtualserver template files in our repository](https://github.com/nginxinc/kubernetes-ingress/tree/main/internal/configs/version2).


In the following example we modify `nginx-virtualserver.tmpl` to change the port setting:

```nginx
server {
listen 80{{ if $s.ProxyProtocol }} proxy_protocol{{ end }};

server_name {{ $s.ServerName }};

set $resource_type "virtualserver";
set $resource_name "{{$s.VSName}}";
set $resource_namespace "{{$s.VSNamespace}}";
```
To change the listen port from `80` to `85`, we modify the `listen` line at the start of the server configuration block.

After modifying the line, the file looks like this:
```nginx
server {
listen 85{{ if $s.ProxyProtocol }} proxy_protocol{{ end }};

server_name {{ $s.ServerName }};

set $resource_type "virtualserver";
set $resource_name "{{$s.VSName}}";
set $resource_namespace "{{$s.VSNamespace}}";
```

Modify the file you need (per the example above). In the example, we modified `nginx-plus-virtualserver.tmpl`:


## Rebuild your NGINX Ingress controller image

You must build your new NGINX Ingress controller image for the new port settings to take effect.
Once the image is built and pushed, make sure you update your deployment to point to the new image and deploy.
Once deployed, create a new `virtualServer` resource and run `nginx -T` to confirm if the port change has taken effect.
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved

Ensure that your `deployment` and your `service` match up to the new port you configured in the templates.
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved
Below is an example of `deployment` and `service` matching to the new port that NGINX Ingress controller now listens on.

```nginx
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved
apiVersion: apps/v1
kind: Deployment
metadata:
name: nginx-ingress
namespace: nginx-ingress
spec:
replicas: 1
selector:
matchLabels:
app: nginx-ingress
template:
metadata:
labels:
app: nginx-ingress
annotations:
prometheus.io/scrape: "true"
prometheus.io/port: "9113"
prometheus.io/scheme: http
spec:
serviceAccountName: nginx-ingress
containers:
- image: nginx/nginx-ingress:3.0.2
imagePullPolicy: IfNotPresent
name: nginx-ingress
ports:
- name: http
containerPort: 85
- name: https
containerPort: 443
- name: readiness-port
containerPort: 8081
- name: prometheus
containerPort: 9113
readinessProbe:
httpGet:
path: /nginx-ready
port: readiness-port
periodSeconds: 1
securityContext:
```

Notice that now, the `http` port is set to `85`, which reflects the change we made in the template file.

Here is the `service` file:

```nginx
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved
apiVersion: v1
kind: Service
metadata:
name: nginx-ingress
namespace: nginx-ingress
spec:
externalTrafficPolicy: Local
type: LoadBalancer
ports:
- port: 80
targetPort: 85
protocol: TCP
name: http
- port: 8443
targetPort: 8443
protocol: TCP
name: https
selector:
app: nginx-ingress
```

Since NGINX Ingress controller is now listening on ports 85 and 8443, we modify the `targetPort` in the NGINX Ingress controller service to match what we have changed in our deployment and ensure traffic will be sent to the proper port.
The key part above is the `targetPort` section. Since we have changed NGINX Ingress to listen on port 85, we need to match that in the service: Requests will be sent to NGINX Ingress controller on port 85 instead of the default value, port 80.


If you view the `NGINX` configuration .conf file using `nginx -T`, you should see the port you defined in the .template file is now set on the `listen` line.
Here is an example output of the `NGINX` configuration that has been generated:

```bash
k exec -it -n nginx-ingress nginx-ingress-54bffd78d9-v7bns -- nginx -T
ADubhlaoich marked this conversation as resolved.
Show resolved Hide resolved
```

```nginx
server {
listen 85;
listen [::]:85;
listen 8011;

server_name cafe.example.com;

set $resource_type "virtualserver";
set $resource_name "cafe";
set $resource_namespace "default";
```