[pkgs/peggy] automatically transform peggy files with babel-register and webpack

[spalger]

In order to get us closer to the developer experience we want for packages, we are trying to move package builds out of bazel and instead we want to build files on demand. In the case of .peggy files this means importing them directly and teaching babel/jest/webpack how to handle these imports by automatically transpiling and caching the results.

This change does just that, adding a @kbn/peggy package which wraps peggy for types, and also adds support for defining peggy config adjacent to a peggy grammar file in a ${basename}.config.json file. This file will be parsed and used to configure things like allowedStartRules as described in the peggy docs.

This PR also implements @kbn/peggy-loader which uses @kbn/peggy to transpile peggy files in webpack, and a peggy transform for both Jest and our custom babel register hook.

[elasticmachine]

Pinging @elastic/kibana-operations (Team:Operations)

[jbudz]

mind if we add the ci:build-storybooks and ci:build-canvas-shareable-runtime labels?

[ThomThomson]

Canvas sharable runtime webpack config change LGTM.

[mistic]

lgtm

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: b7f5881
• Storybooks Preview

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
visTypeTimelion	45	46	+1

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
@kbn/peggy	-	10	+10
@kbn/test	220	221	+1
total			+11

Any counts in public APIs

Total count of every any typed public API. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats any for more detailed information.

id	before	after	diff
@kbn/interpreter	13	12	-1
@kbn/peggy	-	1	+1
total			-0

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
canvas	1.0MB	1.0MB	-23.0B
expressions	28.4KB	28.4KB	+56.0B
lens	1.3MB	1.3MB	-19.0B
presentationUtil	130.8KB	130.7KB	-80.0B
visTypeTimelion	74.5KB	74.6KB	+93.0B
total			+27.0B

Canvas Sharable Runtime

The Canvas "shareable runtime" is an bundle produced to enable running Canvas workpads outside of Kibana. This bundle is included in third-party webpages that embed canvas and therefor should be as slim as possible.

id	before	after	diff
module count	-	5039	+5039
total size	-	7.9MB	+7.9MB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
expressions	98.6KB	98.5KB	-74.0B
kbnUiSharedDeps-srcJs	4.1MB	4.1MB	-124.0B
total			-198.0B

Unknown metric groups

API count

id	before	after	diff
@kbn/interpreter	50	52	+2
@kbn/peggy	-	21	+21
@kbn/test	264	265	+1
total			+24

ESLint disabled in files

id	before	after	diff
osquery	1	2	+1

ESLint disabled line counts

id	before	after	diff
@kbn/peggy-loader	-	1	+1
enterpriseSearch	19	21	+2
fleet	59	65	+6
osquery	109	115	+6
securitySolution	443	449	+6
total			+21

Total ESLint disabled count

id	before	after	diff
@kbn/peggy-loader	-	1	+1
enterpriseSearch	20	22	+2
fleet	68	74	+6
osquery	110	117	+7
securitySolution	520	526	+6
total			+22

History

• 💔 Build #89799 failed 321cd09
• 💔 Build #89793 failed 92d472e
• 💚 Build #89695 succeeded 6282f0a
• 💚 Build #89508 succeeded 46614a3
• 💔 Build #89456 failed b6541fe
• 💔 Build #89451 failed 7ee2e8e17d2be35deff263678d054c007973d8d3

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream