Add support for additional fields from V2 ALB logs

[kaiyan-sheng]

This PR is to add support for additional fields from V2 ALB logs into integrations.
PR in Beats: elastic/beats#21540

[elasticmachine]

Pinging @elastic/integrations-platforms (Team:Platforms)

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Build Cause: [Pull request #304 updated]

• Start Time: 2020-10-12T17:39:50.894+0000

• Duration: 8 min 1 sec

[mtojek]

LGTM!

[kaiyan-sheng]

Help help 🙂 @mtojek CI failed with the same error I got when I tried to run elastic-package test pipeline locally:

+        },
+        {
+            "message": "",
+            "error": {
+                "message": "Provided Grok expressions do not match field value: []"
+            }
         }
     ]
 }

[mtojek]

Good finding :) I've finished the investigation. It' a bug in elastic-package. As a temporary workaround you can use the following config:

{
  "multiline": {
    "first_line_pattern": "^http"
  }
}

but I will work on the workaround today and post the update here.

[mtojek]

@ycombinator that's a weird HTTP error during system tests:

[2020-10-12T15:49:03.131Z] Error: error running package system tests: could not add data stream config to policy: could not add package to policy; API status code = 502; response body = {"statusCode":502,"error":"Bad Gateway","message":"'404 Not Found' error response from package registry at https://epr.elastic.co/package/apache/0.2.4/"}

EDIT:

not sure why is it using production endpoint.

[mtojek]

jenkins run the tests please

[kaiyan-sheng]

Merging, CI is happy now.