Publisher Pipeline

[urso]

• Introduce new publisher pipeline with BC layer Update libbeat publisher pipeline #4492
• Move processors, tags and fields into publisher pipeline Move processors into new pipeline #4554
• Remove compat layer:
  • Update packetbeat to new pipeline Use packetbeat protocols to publish beat.Event to new pipeline #4599
  • Update filebeat to new pipeline Publisher pipeline enhancements #4641 Move filebeat to new publisher pipeline #4644
  • Update metricbeat to new pipeline Update metricbeat to use new publisher API #4699
  • Update winlogbeat to new pipeline Move winlogbeat to new publisher pipeline #4690
  • Update heartbeat to new pipeline Convert heartbeat to new publisher pipeline #4591
  • Remove bc/publisher package
    • Remove bc layer Pipeline cleanups #4776
    • merge libbeat/beat and publisher/beat packages Combine libbeat/beat and libbeat/publisher/beat package + move all beat instance handling to libbeat/cmd package #4821
• Improve ACK handler:
  • Add support for pipeline-global ACK handler Publisher pipeline enhancements #4641
• Make pipeline parameters configurable (remove old configurations) Update broker/pipeline setup #4650
• Add checks to libbeat/filebeat/metricbeat to reject 5.x queue/spooler/filters setting on startup Check for removed settings on startup #4726
• improve pipeline/output metrics Unified Pipeline/output metrics #4663
• Update packetbeat code generator Adapt packetbeat tcp protocol generator to new publisher pipeline #4956
• Documentation updates
  • removed unused settings from docs: Remove settings from docs #4753
    • filebeat: filebeat.spool_size, filebeat.publish_async, filebeat.idle_timeout,
    • libbeat: queue_size, bulk_queue_size,
    • metricbeatfilters in modules
  • Document libbeat queue settings: Add queue settings to docs #4884
    • queue.<queue_type> with default (and only available) mem:
    • mem queue settings: events, flush.min_events, flush.timeout.
  • Document local tags, fields and processors settings in heartbeat monitors, filebeat prospectors, winlogbeat eventlogs, metricbeat modules, packetbeat flows/plugins. Remove settings from docs #4753
  • Update developer docs to use new publisher pipeline