Embed metrics credentials and upload metrics if they are present

[IsaacPD]

Description

• Modify generate-statik.sh to look for a secret directory and create a statik package for it.
• Add dependency to OpenTelemetry and GoogleCloudPlatform/opentelemtry-operations-go.
• Count the number of times artifact types appear to track which builders have the most artifacts
• Determine if the skaffold user is running it online by running a function in a go-routine to update a global variable
  • If it does not finish in time, it will get written to a file until the next run where there is enough time to check if it is online

General Flow is:

if shouldExportMetrics:
     go checkIfOnline()
skaffold.Main()
if shouldExportMetrics:
     return
InitCloudMonitoring()
if noCredentials:
     return
readPreviousMetricsFromFile()
if !online:
     return writeToFile()
startExporter() # p.Start()
createMetrics()
uploadMetrics() # p.Stop() triggers uploading metrics

Follow-up Work

• Create more extensive test for exporting of metrics.
• Determine which flags to upload in the error metrics and command metrics
• Address the ~5s latency of uploading metrics that locks the terminal by running it in a go routine and starting it concurrently during the end of normal skaffold execution.
• Set meter.Command prior to the creation of the runner in order to refine collecting error metrics when they happen before the runner is created.
• Fix bug where metrics written to a file are not unmarshalled correctly.

[codecov]

Codecov Report

Merging #5157 (fb3c3ba) into master (6dbe2d2) will decrease coverage by 0.49%.
The diff coverage is 14.03%.

@@            Coverage Diff             @@
##           master    #5157      +/-   ##
==========================================
- Coverage   72.35%   71.85%   -0.50%     
==========================================
  Files         382      384       +2     
  Lines       13589    13729     +140     
==========================================
+ Hits         9832     9865      +33     
- Misses       3038     3138     +100     
- Partials      719      726       +7     

Impacted Files	Coverage Δ
pkg/skaffold/instrumentation/meter.go	23.02% <14.03%> (-41.50%)	⬇️
cmd/skaffold/app/tips/tips.go	54.54% <0.00%> (-12.13%)	⬇️
cmd/skaffold/app/cmd/util.go	65.71% <0.00%> (-0.96%)	⬇️
pkg/skaffold/runner/runner.go	0.00% <0.00%> (ø)
pkg/skaffold/initializer/build/util.go	100.00% <0.00%> (ø)
cmd/skaffold/app/cmd/test.go	53.84% <0.00%> (ø)
pkg/skaffold/initializer/transparent.go	80.00% <0.00%> (ø)
cmd/skaffold/app/cmd/cmd.go	66.15% <0.00%> (+0.26%)	⬆️
pkg/skaffold/runner/build_deploy.go	69.89% <0.00%> (+1.00%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6dbe2d2...fb3c3ba. Read the comment docs.

[MarlonGamez]

Took a first pass look at this and it seems good, I think I'd like another pair of eyes on this tho as there's a lot here. I'll take a second pass to make sure I'm not missing anything

[MarlonGamez]

have one super tiny nit but from what I can gather from the otel docs this seems good