Cherry-pick #19321 to 7.9: DNS over TLS support for DNS processor #20091

marc-gr · 2020-07-21T11:48:14Z

Cherry-pick of PR #19321 to 7.9 branch. Original message:

Label: Enhancement

What does this PR do?

Implement DNS over TLS (DoT) handler for the DNS Processor. #16663

Why is it important?

Now you can securely query for reverseDNS lookups across the internet. E.g. cloudflare 1.1.1.1 supports DNS over TLS

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I would need a bit of help here. Do I have to touch every beat config, or is the DNS processor page in the docs rendered from the libbeat ascii doc file?
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

go to filebeat
make
edit filebeat config to include the at least the DNS processor

Minimum filebeat config

  - dns:
      type: reverse
      transport: tls
      fields:
        source.ip: source.hostname
        destination.ip: destination.hostname
      nameservers: ["1.1.1.1"]

Full filebeat config

filebeat.inputs:
- type: log
  enabled: true
  paths:
    - /Users/e_pkah/Documents/GitHub/pkahr/demodata/*
  json.keys_under_root: true
  json.add_error_key: true
filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: false
setup.template.settings:
  index.number_of_shards: 1
output.elasticsearch:
  hosts: ["localhost:9200"]
processors:
  - decode_json_fields:
      fields: log
      overwrite_keys: true
  - dns:
      type: reverse
      transport: tls
      fields:
        source.ip: source.hostname
        destination.ip: destination.hostname
      nameservers: ["1.1.1.1"]

Example doc

{"source.ip": "1.1.1.1","destination.ip": "8.8.8.8"}

replace transport: either with tls, udp. If left empty it will revert to default udp
Ingest some file that has a source.ip or destination.ip (e.g. use example doc above)

Related issues

Closes [*beats] Reverse DNS processor support DNSoverTLS #16663
Should we create an additional issue that tracks the status of the implementation of DNS over HTTPS in the https://github.com/miekg/dns repo?

Use cases

Allow for secure reverse DNS lookups across the entire Internet and locally

Logs

TLS

./filebeat -e -d "*"
2020-06-22T19:56:00.082+0200    DEBUG   [processor.dns] dns/dns.go:67   DNS processor config: {CacheConfig:{SuccessCache:{TTL:0s InitialCapacity:1000 MaxCapacity:10000} FailureCache:{TTL:1m0s InitialCapacity:1000 MaxCapacity:10000}} Nameservers:[1.1.1.1] Timeout:500ms Type:reverse Action:append TagOnFailure:[] Fields:{"destination":{"ip":"destination.hostname"},"source":{"ip":"source.hostname"}} transport:tls reverseFlat:map[destination.ip:destination.hostname source.ip:source.hostname]}      {"instance_id": 1}

2020-06-22T20:28:31.155+0200    DEBUG   [processors]    processing/processors.go:187    Publish event: {
  "@timestamp": "2020-06-22T18:28:30.854Z",
  "@metadata": {
    "beat": "filebeat",
    "type": "_doc",
    "version": "8.0.0"
  },
  "log": {
    "offset": 0,
    "file": {
      "path": "/Users/e_pkah/Documents/GitHub/pkahr/demodata/apache.json"
    }
  },
  "ecs": {
    "version": "1.5.0"
  },
  "destination": {
    "hostname": "dns.google"
  },
  "agent": {
    "id": "6bc4fd89-5e9e-4382-a2fb-5068f5782406",
    "name": "N1890002",
    "type": "filebeat",
    "version": "8.0.0",
    "ephemeral_id": "b8d53727-48f5-4a6a-9c84-735b7d4d0905"
  },
  "source": {
    "hostname": "one.one.one.one"
  },
  "source.ip": "1.1.1.1",
  "destination.ip": "8.8.8.8",
  "input": {
    "type": "log"
  },
  "host": {
    "name": "N1890002"
  }
}

UDP / no config

./filebeat -e -d "*"
2020-06-22T20:13:33.150+0200    DEBUG   [processor.dns] dns/dns.go:67   DNS processor config: {CacheConfig:{SuccessCache:{TTL:0s InitialCapacity:1000 MaxCapacity:10000} FailureCache:{TTL:1m0s InitialCapacity:1000 MaxCapacity:10000}} Nameservers:[1.1.1.1] Timeout:500ms Type:reverse Action:append TagOnFailure:[] Fields:{"destination":{"ip":"destination.hostname"},"source":{"ip":"source.hostname"}} transport:udp reverseFlat:map[destination.ip:destination.hostname source.ip:source.hostname]}      {"instance_id": 1}

2020-06-22T20:28:31.155+0200    DEBUG   [processors]    processing/processors.go:187    Publish event: {
  "@timestamp": "2020-06-22T18:28:30.854Z",
  "@metadata": {
    "beat": "filebeat",
    "type": "_doc",
    "version": "8.0.0"
  },
  "log": {
    "offset": 0,
    "file": {
      "path": "/Users/e_pkah/Documents/GitHub/pkahr/demodata/apache.json"
    }
  },
  "ecs": {
    "version": "1.5.0"
  },
  "destination": {
    "hostname": "dns.google"
  },
  "agent": {
    "id": "6bc4fd89-5e9e-4382-a2fb-5068f5782406",
    "name": "N1890002",
    "type": "filebeat",
    "version": "8.0.0",
    "ephemeral_id": "b8d53727-48f5-4a6a-9c84-735b7d4d0905"
  },
  "source": {
    "hostname": "one.one.one.one"
  },
  "source.ip": "1.1.1.1",
  "destination.ip": "8.8.8.8",
  "input": {
    "type": "log"
  },
  "host": {
    "name": "N1890002"
  }
}

elasticmachine · 2020-07-21T11:48:18Z

Pinging @elastic/siem (Team:SIEM)

elasticmachine · 2020-07-21T11:48:18Z

Pinging @elastic/integrations (Team:Integrations)

urso

Is this a blocker for 7.9.0?

elasticmachine · 2020-07-21T13:52:20Z

💔 Tests Failed

Expand to view the summary

Build stats

Build Cause: [Pull request #20091 updated]
Start Time: 2020-07-27T08:53:44.876+0000
Duration: 79 min 44 sec

Test stats 🧪

Test	Results
Failed	14
Passed	9424
Skipped	1577
Total	11015

Test errors

Expand to view the tests failures

Name: Build and Test / Metricbeat OSS Unit tests / test_process – test_system.Test
- Age: 1
- Duration: 1.098
- Error Details: False is not true : fd not found in any process events
Name: Build and Test / Auditbeat x-pack / test_connected_udp_ipv4 – test_system_socket.Test
- Age: 1
- Duration: 60.123
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_connected_udp_ipv6 – test_system_socket.Test
- Age: 1
- Duration: 60.034
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_dns_enrichment – test_system_socket.Test
- Age: 1
- Duration: 60.029
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_dns_long_request – test_system_socket.Test
- Age: 1
- Duration: 60.122
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_dns_udp_ipv6 – test_system_socket.Test
- Age: 1
- Duration: 60.119
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_dns_unidirectional_udp – test_system_socket.Test
- Age: 1
- Duration: 60.121
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_multi_udp_upv4 – test_system_socket.Test
- Age: 1
- Duration: 60.024
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_no_dns_enrichment – test_system_socket.Test
- Age: 1
- Duration: 60.03
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_tcp_ipv4 – test_system_socket.Test
- Age: 1
- Duration: 60.122
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_tcp_ipv6_disabled – test_system_socket.Test
- Age: 1
- Duration: 60.03
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_udp_ipv4 – test_system_socket.Test
- Age: 1
- Duration: 60.031
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_udp_ipv6 – test_system_socket.Test
- Age: 1
- Duration: 60.028
- Error Details: Expected exit code to be 0, but it was 1
Name: Build and Test / Auditbeat x-pack / test_udp_ipv6_disabled – test_system_socket.Test
- Age: 1
- Duration: 60.035
- Error Details: Expected exit code to be 0, but it was 1

Steps errors

Expand to view the steps failures

Name: Make testsuite
- Description: make -C filebeat testsuite
- Duration: 7 min 44 sec
- Start Time: 2020-07-27T09:17:49.263+0000
- log
Name: Mage update build test
- Description: mage update build test
- Duration: 23 min 30 sec
- Start Time: 2020-07-27T09:17:51.984+0000
- log
Name: Make testsuite
- Description: make -C libbeat testsuite
- Duration: 8 min 14 sec
- Start Time: 2020-07-27T09:17:49.050+0000
- log
Name: Mage build unitTest
- Description: mage build unitTest
- Duration: 9 min 30 sec
- Start Time: 2020-07-27T09:17:49.945+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-07-27T10:11:59.788Z] + for i in '"$@"'
[2020-07-27T10:11:59.788Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-27T10:11:59.788Z] + '[' -f packetbeat/build/coverage/full.cov ']'
[2020-07-27T10:11:59.788Z] + for i in '"$@"'
[2020-07-27T10:11:59.788Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-27T10:11:59.788Z] + '[' -f winlogbeat/build/coverage/full.cov ']'
[2020-07-27T10:12:00.333Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats
[2020-07-27T10:12:00.638Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-07-27T10:12:00.650Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Lint
[2020-07-27T10:12:00.737Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-07-27T10:12:00.814Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Winlogbeat-oss
[2020-07-27T10:12:00.902Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-07-27T10:12:00.987Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-07-27T10:12:01.059Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-07-27T10:12:01.137Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-07-27T10:12:01.232Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Dockerlogbeat
[2020-07-27T10:12:01.337Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Journalbeat-oss
[2020-07-27T10:12:01.470Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-07-27T10:12:01.567Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-07-27T10:12:01.653Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-07-27T10:12:01.735Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-07-27T10:12:01.817Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-07-27T10:12:01.891Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-oss
[2020-07-27T10:12:01.963Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-07-27T10:12:02.041Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Libbeat-oss
[2020-07-27T10:12:02.118Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-07-27T10:12:02.198Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Heartbeat-oss
[2020-07-27T10:12:02.276Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-07-27T10:12:02.348Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-07-27T10:12:02.424Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-07-27T10:12:02.519Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-07-27T10:12:02.609Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-07-27T10:12:02.687Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-07-27T10:12:02.771Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Libbeat-x-pack
[2020-07-27T10:12:02.846Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-Windows
[2020-07-27T10:12:02.918Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-07-27T10:12:02.989Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-07-27T10:12:03.062Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Packetbeat-oss
[2020-07-27T10:12:03.137Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-07-27T10:12:03.223Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-07-27T10:12:03.314Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-Windows
[2020-07-27T10:12:03.384Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-07-27T10:12:03.456Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-07-27T10:12:03.545Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Heartbeat-Windows
[2020-07-27T10:12:03.621Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Functionbeat-Windows
[2020-07-27T10:12:03.697Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Filebeat-x-pack
[2020-07-27T10:12:03.769Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-07-27T10:12:03.860Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-07-27T10:12:03.948Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-07-27T10:12:04.035Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-07-27T10:12:04.106Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-07-27T10:12:04.183Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-07-27T10:12:04.540Z] + cat
[2020-07-27T10:12:04.540Z] + /usr/local/bin/runbld ./runbld-script
[2020-07-27T10:12:04.540Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-07-27T10:12:11.138Z] runbld>>> runbld started
[2020-07-27T10:12:11.138Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-07-27T10:12:12.551Z] runbld>>> The following profiles matched the job 'Beats/beats/PR-20091' in order of occurrence in the config (last value wins).
[2020-07-27T10:12:13.999Z] runbld>>> Debug logging enabled.
[2020-07-27T10:12:13.999Z] runbld>>> Storing result
[2020-07-27T10:12:13.999Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-07-27T10:12:13.999Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200727101213-154F5E46
[2020-07-27T10:12:13.999Z] runbld>>> Adding system facts.
[2020-07-27T10:12:14.967Z] runbld>>> Adding vcs info for the latest commit:  1ffa935676748a6c479ab36eaa755eb543ed8bdd
[2020-07-27T10:12:14.967Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-07-27T10:12:14.967Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-07-27T10:12:14.967Z] + echo 'Processing JUnit reports with runbld...'
[2020-07-27T10:12:14.967Z] Processing JUnit reports with runbld...
[2020-07-27T10:12:15.555Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-07-27T10:12:15.555Z] runbld>>> DURATION: 25ms
[2020-07-27T10:12:15.555Z] runbld>>> STDOUT: 40 bytes
[2020-07-27T10:12:15.555Z] runbld>>> STDERR: 49 bytes
[2020-07-27T10:12:15.555Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-07-27T10:12:15.555Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats
[2020-07-27T10:12:16.511Z] runbld>>> Storing build metadata: 
[2020-07-27T10:12:16.511Z] runbld>>> Adding test report.
[2020-07-27T10:12:16.511Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats
[2020-07-27T10:12:17.527Z] runbld>>> Found 113 test output files
[2020-07-27T10:12:18.472Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-07-27T10:12:18.472Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-07-27T10:12:18.472Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-07-27T10:12:18.736Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-07-27T10:12:18.736Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-07-27T10:12:18.997Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-07-27T10:12:18.997Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20091/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-07-27T10:12:19.582Z] runbld>>> Test output logs contained: Errors: 0 Failures: 14 Tests: 10869 Skipped: 1340
[2020-07-27T10:12:19.845Z] runbld>>> Storing result
[2020-07-27T10:12:19.845Z] runbld>>> FAILURES: 14
[2020-07-27T10:12:22.392Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-07-27T10:12:22.392Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200727101213-154F5E46
[2020-07-27T10:12:22.653Z] runbld>>> Email notification disabled by environment variable.
[2020-07-27T10:12:22.653Z] runbld>>> Slack notification disabled by environment variable.
[2020-07-27T10:12:28.276Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-20091
[2020-07-27T10:12:28.420Z] [INFO] getVaultSecret: Getting secrets
[2020-07-27T10:12:28.509Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-07-27T10:12:29.396Z] + chmod 755 generate-build-data.sh
[2020-07-27T10:12:29.396Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20091/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20091/runs/6 FAILURE 4724256
[2020-07-27T10:12:29.396Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20091/runs/6/steps/?limit=10000 -o steps-info.json
[2020-07-27T10:12:32.659Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20091/runs/6/tests/?status=FAILED -o tests-errors.json
[2020-07-27T10:12:34.003Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20091/runs/6/log/ -o pipeline-log.txt

Lets try to give some room for backports until BC3. Please don't merge afterwards (especially new features), as we're already testing the releae + CI is constantly red and needs to be investigated.

CHANGELOG.next.asciidoc

* DNS over TLS DoT support elastic#16663 * added changelog elastic#19321 * Update dns.asciidoc * added testsuite for elastic#19321 * Fix CHANGELOG entries and lint fixes * Apply suggestions from code review Co-authored-by: Marc Guasch <[email protected]> Co-authored-by: Andrew Kroh <[email protected]> (cherry picked from commit 89bfb6c)

andrewkroh · 2020-08-11T12:00:55Z

This will land in 7.10 since this is a new feature and 7.9 is frozen.

marc-gr added [zube]: In Review backport Team:Integrations Label for the Integrations team Team:SIEM labels Jul 21, 2020

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 21, 2020

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 21, 2020

urso previously requested changes Jul 21, 2020

View reviewed changes

marc-gr force-pushed the backport_19321_7.9 branch 2 times, most recently from b61c0d0 to f32b264 Compare July 23, 2020 07:29

adriansr suggested changes Jul 23, 2020

View reviewed changes

CHANGELOG.next.asciidoc Outdated Show resolved Hide resolved

marc-gr force-pushed the backport_19321_7.9 branch 2 times, most recently from e382ef3 to c949774 Compare July 27, 2020 08:50

marc-gr force-pushed the backport_19321_7.9 branch from c949774 to 1ffa935 Compare July 27, 2020 08:53

andrewkroh closed this Aug 11, 2020

zube bot added [zube]: Done and removed [zube]: In Review labels Aug 11, 2020

zube bot removed the [zube]: Done label Nov 9, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick #19321 to 7.9: DNS over TLS support for DNS processor #20091

Cherry-pick #19321 to 7.9: DNS over TLS support for DNS processor #20091

marc-gr commented Jul 21, 2020 •

edited by zube bot

Loading

elasticmachine commented Jul 21, 2020

elasticmachine commented Jul 21, 2020

urso left a comment

elasticmachine commented Jul 21, 2020 •

edited by jenkins-beats-ci bot

Loading

Build stats

Test stats 🧪

andrewkroh commented Aug 11, 2020

Cherry-pick #19321 to 7.9: DNS over TLS support for DNS processor #20091

Cherry-pick #19321 to 7.9: DNS over TLS support for DNS processor #20091

Conversation

marc-gr commented Jul 21, 2020 • edited by zube bot Loading

Label: Enhancement

What does this PR do?

Why is it important?

Checklist

How to test this PR locally

Related issues

Use cases

Logs

elasticmachine commented Jul 21, 2020

elasticmachine commented Jul 21, 2020

urso left a comment

Choose a reason for hiding this comment

elasticmachine commented Jul 21, 2020 • edited by jenkins-beats-ci bot Loading

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

andrewkroh commented Aug 11, 2020

marc-gr commented Jul 21, 2020 •

edited by zube bot

Loading

elasticmachine commented Jul 21, 2020 •

edited by jenkins-beats-ci bot

Loading