update test summaries for NFR results

nginxinc · Nov 14, 2024 · a07cdda · a07cdda
1 parent 78e646c
commit a07cdda
Show file tree

Hide file tree

Showing 12 changed files with 47 additions and 7 deletions.
diff --git a/tests/results/dp-perf/1.5.0/1.5.0-oss.md b/tests/results/dp-perf/1.5.0/1.5.0-oss.md
@@ -20,6 +20,11 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems to have improved. There is improved latency and response times across all routing methods.
+
+
 ## Test1: Running latte path based routing
 
 ```text

diff --git a/tests/results/dp-perf/1.5.0/1.5.0-plus.md b/tests/results/dp-perf/1.5.0/1.5.0-plus.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous test run.
+
 ## Test1: Running latte path based routing
 
 ```text

diff --git a/tests/results/longevity/1.5.0/oss.md b/tests/results/longevity/1.5.0/oss.md
@@ -59,6 +59,8 @@ No error logs in nginx-gateway
 
 Error logs in nginx
 
+We could not get non-2xx errors from the cluster but should likely be similar to last release's issues.
+
 ### Key Metrics
 
 #### Containers memory

diff --git a/tests/results/longevity/1.5.0/plus.md b/tests/results/longevity/1.5.0/plus.md
@@ -56,12 +56,7 @@ No error logs in nginx-gateway
 
 Error logs in nginx
 
-Several errors related to R33 integration
-
-```
-2024-11-11 22:57:46.685 PST
-2024/11/12 06:57:46 [crit] 49#49: open() "/var/lib/nginx/state//nginx-mgmt-state" failed (2: No such file or directory)
-```
+We could not get non-2xx errors from the cluster but should likely be similar to last release's issues.
 
 
 ### Key Metrics
@@ -93,4 +88,4 @@ for endpoints changes.
 
 ## Comparison with previous runs
 
-Graphs look similar to 1.3.0 results.
+Graphs look similar to 1.4.0 results.
diff --git a/tests/results/ngf-upgrade/1.5.0/1.5.0-oss.md b/tests/results/ngf-upgrade/1.5.0/1.5.0-oss.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance has slightly improved reduced latencies across both HTTPS and HTTP traffic.
+
 ## Test: Send https /tea traffic
 
 ```text

diff --git a/tests/results/ngf-upgrade/1.5.0/1.5.0-plus.md b/tests/results/ngf-upgrade/1.5.0/1.5.0-plus.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance has slightly improved.
+
 ## Test: Send https /tea traffic
 
 ```text

diff --git a/tests/results/reconfig/1.5.0/1.5.0-oss.md b/tests/results/reconfig/1.5.0/1.5.0-oss.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous run.
+
 ## Test 1: Resources exist before startup - NumResources 30
 
 ### Reloads and Time to Ready

diff --git a/tests/results/reconfig/1.5.0/1.5.0-plus.md b/tests/results/reconfig/1.5.0/1.5.0-plus.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems to be consistent with previous run but has slightly higher reload and event processing times.
+
 ## Test 1: Resources exist before startup - NumResources 30
 
 ### Reloads and Time to Ready

diff --git a/tests/results/scale/1.5.0/1.5.0-oss.md b/tests/results/scale/1.5.0/1.5.0-oss.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous test run with slightly higher reload times and some errors.
+
 ## Test TestScale_Listeners
 
 ### Reloads

diff --git a/tests/results/scale/1.5.0/1.5.0-plus.md b/tests/results/scale/1.5.0/1.5.0-plus.md
@@ -20,6 +20,10 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous run but slightly higher reload and event batch processing times.
+
 ## Test TestScale_Listeners
 
 ### Reloads

diff --git a/tests/results/zero-downtime-scale/1.5.0/1.5.0-oss.md b/tests/results/zero-downtime-scale/1.5.0/1.5.0-oss.md
@@ -20,6 +20,11 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous run. 
+- No errors seen.
+
 ## One NGF Pod runs per node Test Results
 
 ### Scale Up Gradually

diff --git a/tests/results/zero-downtime-scale/1.5.0/1.5.0-plus.md b/tests/results/zero-downtime-scale/1.5.0/1.5.0-plus.md
@@ -20,6 +20,11 @@ GKE Cluster:
 - Zone: us-west2-a
 - Instance Type: n2d-standard-16
 
+## Summary:
+
+- Performance seems consistent with previous run. 
+- No errors seen. 
+
 ## One NGF Pod runs per node Test Results
 
 ### Scale Up Gradually