Added short versions for the configuration files

[tsg]

For now, the short files are named like beatname.short.yml and I kept the
beatname.yml to be the full one. The intention is to switch them around. The
short ones to become the default and the long ones to be something like
beatname.full.yml or similar.

But before doing that I wanted the others in the team to have a look. The
decision of what to include in the short version is fairly arbitrary, I just
did it based on what I thought makes most sense.

I kept the ES and LS outputs in the configuration file. I considered having
only ES for all the beats except Filebeat, but that would complicate the
generation part and I think it's nice to highlight that we support multiple
outputs.

[tsg]

Part of #1417.

[ruflin]

I would leave out encoding

[ruflin]

LGTM. +1 on moving forward with this. We can still make small adjustments later if needed.

Two things for the naming:

• In the repository, I would keep the full one without an extension
• When downloading and starting a beat, it is important to take the short one by default

The above notes unfortunately conflict with each other :-) My suggestion is to not have the short version in the the top level folder, only under _beat or etc. During building the beat.yml is renamed to beat.full.yml and the short and is then beat.yml. The downside is, that this adds complexity. The idea behind is, that everyone who checks out the repo should have the full config available. Probably there is a better way ...

[urso]

alternative name for short: min?

I think these very big comments make the minified version still to verbose. Let's try to have at most 1 or 2 lines commenting an option. Maybe with second line being a link to the docs (like we include link to doc reference at top of file, but it's so easily overlooked)

[ruflin]

I like the 2 lines suggestion by @urso with the docs.

[tsg]

I did the 2 comment lines suggestion (but not the link to the docs, that would be quite an effort to maintain) and removed some more stuff as suggested by @ruflin. Let's discuss the rest in the meeting.

[tsg]

Why not just name the short one beatname.yml and beatname.full.yml the complete one in both the repository and the packages? There are people executing them from source, the principle I used so far in packaging is that running from source feels pretty much the same as running from the binary tar.gz.

[tsg]

Added logging to the short version. I prefer doing the file rename in a follow up PR, so this is ready for merging unless more comments show up or the build fails.

[monicasarbu]

LGTM