NFR Test Results for NGF version edge

.github/workflows/nfr.yml

@@ -8,7 +8,7 @@ on:
         required: true
         default: all
         type: choice
-        options: [performance, upgrade, all]
+        options: [performance, upgrade, scale, all]
       version:
         description: Version of NGF under test
         required: true
@@ -129,6 +129,8 @@ jobs:
         echo "PLUS_ENABLED=${{ inputs.nginx_plus }}" >> vars.env
         echo "GINKGO_LABEL=" >> vars.env
         echo "NGF_VERSION=${{ inputs.version }}" >> vars.env
+        echo "GKE_NUM_NODES=12" >> vars.env
+        echo "GKE_MACHINE_TYPE=n2d-standard-16" >> vars.env
 
     - name: Create GKE cluster
       working-directory: ./tests

tests/results/dp-perf/edge/edge.md

@@ -0,0 +1,80 @@
+# Results
+
+## Test environment
+
+NGINX Plus: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.28.8-gke.1095000
+- vCPUs per node: 16
+- RAM per node: 65855088Ki
+- Max pods per node: 110
+- Zone: us-east1-b
+- Instance Type: n2d-standard-16
+
+## Test1: Running latte path based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.04, 1000.01
+Duration      [total, attack, wait]             30s, 29.999s, 888.7µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  676.42µs, 996.68µs, 979.882µs, 1.129ms, 1.179ms, 1.32ms, 12.834ms
+Bytes In      [total, mean]                     4770000, 159.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test2: Running coffee header based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.03, 1000.00
+Duration      [total, attack, wait]             30s, 29.999s, 933.208µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  699.653µs, 1.01ms, 985.029µs, 1.141ms, 1.2ms, 1.341ms, 30.541ms
+Bytes In      [total, mean]                     4800000, 160.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test3: Running coffee query based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.02, 999.99
+Duration      [total, attack, wait]             30s, 29.999s, 948.032µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  671.563µs, 1.037ms, 999.716µs, 1.16ms, 1.216ms, 1.438ms, 13.786ms
+Bytes In      [total, mean]                     5040000, 168.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test4: Running tea GET method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.98
+Duration      [total, attack, wait]             30.001s, 30s, 934.856µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  716.558µs, 1.04ms, 1.015ms, 1.191ms, 1.251ms, 1.425ms, 21.851ms
+Bytes In      [total, mean]                     4710000, 157.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```
+
+## Test5: Running tea POST method based routing
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.03, 1000.00
+Duration      [total, attack, wait]             30s, 29.999s, 855.928µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  714.636µs, 1.032ms, 1.01ms, 1.18ms, 1.236ms, 1.394ms, 13.232ms
+Bytes In      [total, mean]                     4710000, 157.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```

tests/results/ngf-upgrade/edge/edge.md

@@ -0,0 +1,45 @@
+# Results
+
+## Test environment
+
+NGINX Plus: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.28.8-gke.1095000
+- vCPUs per node: 16
+- RAM per node: 65855088Ki
+- Max pods per node: 110
+- Zone: us-east1-b
+- Instance Type: n2d-standard-16
+
+## Test: Send https /tea traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.992s, 59.991s, 1.192ms
+Latencies     [min, mean, 50, 90, 95, 99, max]  867.75µs, 1.215ms, 1.14ms, 1.295ms, 1.357ms, 1.965ms, 24.186ms
+Bytes In      [total, mean]                     914021, 152.34
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![https.png](https.png)
+
+## Test: Send http /coffee traffic
+
+```text
+Requests      [total, rate, throughput]         6000, 100.02, 100.01
+Duration      [total, attack, wait]             59.992s, 59.991s, 996.367µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  824.305µs, 1.172ms, 1.122ms, 1.269ms, 1.329ms, 1.685ms, 13.407ms
+Bytes In      [total, mean]                     954000, 159.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:6000  
+Error Set:
+```
+
+![http.png](http.png)

tests/results/scale/edge/edge.md

@@ -0,0 +1,195 @@
+# Results
+
+## Test environment
+
+NGINX Plus: false
+
+GKE Cluster:
+
+- Node count: 12
+- k8s version: v1.28.8-gke.1095000
+- vCPUs per node: 16
+- RAM per node: 65855088Ki
+- Max pods per node: 110
+- Zone: us-east1-b
+- Instance Type: n2d-standard-16
+
+## Test TestScale_Listeners
+
+### Reloads
+
+- Total: 128
+- Total Errors: 0
+- Average Time: 141ms
+- Reload distribution:
+	- 500ms: 128
+	- 1000ms: 128
+	- 5000ms: 128
+	- 10000ms: 128
+	- 30000ms: 128
+	- +Infms: 128
+
+### Event Batch Processing
+
+- Total: 387
+- Average Time: 125ms
+- Event Batch Processing distribution:
+	- 500ms: 356
+	- 1000ms: 384
+	- 5000ms: 387
+	- 10000ms: 387
+	- 30000ms: 387
+	- +Infms: 387
+
+### Errors
+
+- NGF errors: 0
+- NGF container restarts: 0
+- NGINX errors: 0
+- NGINX container restarts: 0
+
+### Graphs and Logs
+
+See [output directory](./TestScale_Listeners) for more details.
+The logs are attached only if there are errors.
+
+## Test TestScale_HTTPSListeners
+
+### Reloads
+
+- Total: 128
+- Total Errors: 0
+- Average Time: 176ms
+- Reload distribution:
+	- 500ms: 128
+	- 1000ms: 128
+	- 5000ms: 128
+	- 10000ms: 128
+	- 30000ms: 128
+	- +Infms: 128
+
+### Event Batch Processing
+
+- Total: 451
+- Average Time: 122ms
+- Event Batch Processing distribution:
+	- 500ms: 408
+	- 1000ms: 450
+	- 5000ms: 451
+	- 10000ms: 451
+	- 30000ms: 451
+	- +Infms: 451
+
+### Errors
+
+- NGF errors: 0
+- NGF container restarts: 0
+- NGINX errors: 0
+- NGINX container restarts: 0
+
+### Graphs and Logs
+
+See [output directory](./TestScale_HTTPSListeners) for more details.
+The logs are attached only if there are errors.
+
+## Test TestScale_HTTPRoutes
+
+### Reloads
+
+- Total: 1001
+- Total Errors: 0
+- Average Time: 359ms
+- Reload distribution:
+	- 500ms: 779
+	- 1000ms: 1001
+	- 5000ms: 1001
+	- 10000ms: 1001
+	- 30000ms: 1001
+	- +Infms: 1001
+
+### Event Batch Processing
+
+- Total: 1008
+- Average Time: 406ms
+- Event Batch Processing distribution:
+	- 500ms: 683
+	- 1000ms: 1008
+	- 5000ms: 1008
+	- 10000ms: 1008
+	- 30000ms: 1008
+	- +Infms: 1008
+
+### Errors
+
+- NGF errors: 0
+- NGF container restarts: 0
+- NGINX errors: 0
+- NGINX container restarts: 0
+
+### Graphs and Logs
+
+See [output directory](./TestScale_HTTPRoutes) for more details.
+The logs are attached only if there are errors.
+
+## Test TestScale_UpstreamServers
+
+### Reloads
+
+- Total: 81
+- Total Errors: 0
+- Average Time: 126ms
+- Reload distribution:
+	- 500ms: 81
+	- 1000ms: 81
+	- 5000ms: 81
+	- 10000ms: 81
+	- 30000ms: 81
+	- +Infms: 81
+
+### Event Batch Processing
+
+- Total: 83
+- Average Time: 204ms
+- Event Batch Processing distribution:
+	- 500ms: 81
+	- 1000ms: 83
+	- 5000ms: 83
+	- 10000ms: 83
+	- 30000ms: 83
+	- +Infms: 83
+
+### Errors
+
+- NGF errors: 0
+- NGF container restarts: 0
+- NGINX errors: 0
+- NGINX container restarts: 0
+
+### Graphs and Logs
+
+See [output directory](./TestScale_UpstreamServers) for more details.
+The logs are attached only if there are errors.
+
+## Test TestScale_HTTPMatches
+
+```text
+Requests      [total, rate, throughput]         30000, 1000.03, 998.69
+Duration      [total, attack, wait]             30s, 29.999s, 964.397µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  509.471µs, 995.309µs, 961.016µs, 1.108ms, 1.171ms, 1.354ms, 12.787ms
+Bytes In      [total, mean]                     4799883, 160.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           99.87%
+Status Codes  [code:count]                      200:29961  502:39  
+Error Set:
+502 Bad Gateway
+```
+```text
+Requests      [total, rate, throughput]         30000, 1000.01, 999.98
+Duration      [total, attack, wait]             30.001s, 30s, 958.326µs
+Latencies     [min, mean, 50, 90, 95, 99, max]  719.622µs, 1.044ms, 1.023ms, 1.162ms, 1.21ms, 1.361ms, 22.043ms
+Bytes In      [total, mean]                     4800000, 160.00
+Bytes Out     [total, mean]                     0, 0.00
+Success       [ratio]                           100.00%
+Status Codes  [code:count]                      200:30000  
+Error Set:
+```