[apache spark] Add visualizations and dashboard

[yug-rajani]

• Enhancement

What does this PR do?

This PR adds dashboard for apache-spark integration package.

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.
• I have added an entry to my package's changelog.yml file.
• I have verified that Kibana version constraints are current according to guidelines.

How to test this PR locally

• Clone integrations repo.
• Install elastic-package locally.
• Start elastic stack using elastic-package.
• Move to integrations/packages/apache_spark directory.
• Run the following command to run tests.
  elastic-package test

Related issues

• Relates Create Apache Spark integration #493
• Relates [apache_spark] Add Apache Spark package #2811
• Relates [apache_spark][nodes] Add Apache Spark package with Nodes data stream #2939
• Relates [apache_spark][application] Add Apache Spark package with Application data stream #2941
• Relates [apache_spark][driver] Add Apache Spark package with Driver data stream #2945
• Relates [apache_spark][executor] Add Apache Spark package with Executor data stream #2943

Screenshots

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2022-05-09T07:29:48.682+0000

• Duration: 17 min 47 sec

Test stats 🧪

Test	Results
Failed	0
Passed	33
Skipped	0
Total	33

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

• /test : Re-trigger the build.

[mtojek]

I can share the high-level feedback.

• There are too many counters compared to standard graphs. You don't need to put every metrics on a dashboard
• I suggest showing:
  • counters: executors, jobs, stages, workers
  • graphs: stages, tasks, memory usage, read write bytes
  • gauges: cores
• Please simulate some tough Spark processing, so dashboards don't contain only zeros and flat lines.

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[yug-rajani]

Thanks for the feedback, @mtojek!
We have incorporated the changes. Please take a look at your convenience.

[elasticmachine]

🌐 Coverage report

Name	Metrics % (covered/total)	Diff
Packages	100.0% (0/0)	💚
Files	100.0% (0/0)	💚 3.676
Classes	100.0% (0/0)	💚 3.676
Methods	75.0% (12/16)	👎 -13.786
Lines	100.0% (0/0)	💚 10.026
Conditionals	100.0% (0/0)	💚