[Telemetry] Report the policies that have add_field enabled.

[nimarezainia]

The user has the ability to add multiple fields, at the policy level, to the ingested data from all the agents in that policy. We would like to be able to determine how many fields on average are being added via this mechanism.

• Capture telemtery that shows count of fields added to each policy that's configured in a given cluster.

[ycombinator]

Hey @nimarezainia, would you mind fleshing out some details in the issue description? Thanks!

[ycombinator]

@kpollich Do you think it makes sense for this issue to be transferred to the Kibana repo, since the implementation for the data tagging / add_field feature is being done entirely in Kibana now, e.g. #183563?

[kpollich]

@kpollich Do you think it makes sense for this issue to be transferred to the Kibana repo, since the implementation for the data tagging / add_field feature is being done entirely in Kibana now, e.g. elastic/kibana#183563?

Yes this can move over to Kibana as we can report this data by querying Kibana objects.

[nchaulet]

@nimarezainia Currently in telemetry we capture one field like this for agent policies in .fleet-stats

"agent_policies": {
      "count": 6,
      "output_types": [
        "elasticsearch"
      ]
    },

We can add two properties to that does it make sense to you?

"agent_policies": {
      "count": 6,
      "output_types": [
        "elasticsearch"
      ],
+   "count_with_global_data_tags": 2, // Count of policies using global data tags
+    "avg_number_global_data_tags_per_policy": 3  // Average number of fields per policy
    },

[nimarezainia]

LGTM @nchaulet (thank you)