Add new Consul fields on ConsulIngressService

[horaciomonsalvo]

Description

Changes

• Added support for ConsulIngressService configuration in nomad/structs/services.go and api/consul.go.
  • Added new fields to ConsulIngressService structs and updated their receiver functions.
    • TLS
    • RequestHeaders
    • ResponseHeaders
    • MaxConnections
    • MaxPendingRequests
    • MaxConcurrentRequests
• Updated jobspec/parse_service.go
• Updated command/agent/job_endpoint.go
• Update related tests
• Update Nomad Documentation for ConsulIngressService struct.

Testing Changes

To test these changes you need to build a Nomad binary and deploy a cluster with both Nomad and Consul agents and clients.
When you have your cluster running you can run the following job-spec:

# $ cat ig-http.nomad

job "ig-http" {

  datacenters = ["dc1"]

  group "ingress-group" {

    network {
      mode = "bridge"
      port "inbound" {
        static = 8080
        to     = 8080
      }
    }

    service {
      name = "my-ingress-service"
      port = "8080"

        connect {
            gateway {
                proxy {
                    connect_timeout = "500ms"
                }
                ingress {
                    listener {
                        port     = 8080
                        protocol = "http"
                        service {
                            name = "uuid-api"
                            hosts = ["example.com", "example.com:8080"]
                            # New Fields:
                            response_headers {
                                add {
                                    testAdd = "testAddV"
                                }
                                set {
                                    testSet = "testSetV"
                                }
                                remove = ["testRemove"]
                            }
                            request_headers {
                                add {
                                    testAdd = "testAddV"
                                }
                                set {
                                    testSet = "testSetV"
                                }
                                remove = ["testRemove"]
                            }
                            max_connections = 100
                            max_pending_requests = 100
                            max_concurrent_requests = 100
                            tls {
                                sds_config {
                                    cluster_name = "foo"
                                    cert_resource = "example.com-public-cert"
                                }
                            } 
                        }   
                    }
                }
            }
        }
    }
  }

  group "generator" {
    network {
      mode = "host"
      port "api" {}
    }

    service {
      name = "uuid-api"
      port = "${NOMAD_PORT_api}"

      connect {
        native = true
      }
    }

    task "generate" {
      driver = "docker"

      config {
        image        = "hashicorpnomad/uuid-api:v3"
        network_mode = "host"
      }

      env {
        BIND = "0.0.0.0"
        PORT = "${NOMAD_PORT_api}"
      }
    }
  }
}

Once the job is running and healthy, use Consul's API to get the terminating gateway's configuration:

curl --request GET http://127.0.0.1:8500/v1/config/ingress-gateway | json_pp

You will get the following JSON output:

[
    {
        "Kind": "ingress-gateway",
        "Name": "my-ingress-service",
        "TLS": {
            "Enabled": false
        },
        "Listeners": [
            {
                "Port": 8080,
                "Protocol": "http",
                "TLS": {
                    "Enabled": false
                },
                "Services": [
                    {
                        "Name": "uuid-api",
                        "Hosts": [
                            "example.com",
                            "example.com:8080"
                        ],
                        "TLS": {
                            "SDS": {
                                "ClusterName": "foo",
                                "CertResource": "example.com-public-cert"
                            }
                        },
                        "RequestHeaders": {
                            "Add": {
                                "testAdd": "testAddV"
                            },
                            "Set": {
                                "testSet": "testSetV"
                            },
                            "Remove": [
                                "testRemove"
                            ]
                        },
                        "ResponseHeaders": {
                            "Add": {
                                "testAdd": "testAddV"
                            },
                            "Set": {
                                "testSet": "testSetV"
                            },
                            "Remove": [
                                "testRemove"
                            ]
                        },
                        "MaxConnections": 100,
                        "MaxPendingRequests": 100,
                        "MaxConcurrentRequests": 100
                    }
                ]
            }
        ],
        "Defaults": {
            "MaxConnections": 0,
            "MaxPendingRequests": 0,
            "MaxConcurrentRequests": 0
        },
        "CreateIndex": 51,
        "ModifyIndex": 960
    }
]

Demo Video

ConsulIngressService.mp4

[tgross]

I've pulled down this branch to rebase it on main and fix the merge conflicts, cleaned up some of the bits that aren't idiomatic Nomad code anymore, and had a first pass at improving the docs. I'll try to wrap that up later this week and I'll open a new PR with this branch once that's done.

[tgross]

Closed in lieu of #20176