Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT REVIEW] Performance testing minification #51153

Closed
wants to merge 44 commits into from

Conversation

jakebailey
Copy link
Member

With microsoft/monaco-editor#3356 running on the playground, this sort of thing is now possible for us to do. Going to try running without and with minification enabled.

This step makes further commits look clearer by unindenting all of the top level namespaces preemptively.
This step makes all implicit namespace accesses explicit, e.g. "Node" turns into "ts.Node".
This step converts each file into an exported module by hoisting the namespace bodies into the global scope and transferring internal markers down onto declarations as needed.

The namespaces are reconstructed as "barrel"-style modules, which are identical to the old namespace objects in structure. These reconstructed namespaces are then imported in the newly module-ified files, making existing expressions like "ts." valid.
This step converts as many explicit accesses as possible in favor of direct imports from the modules in which things were declared. This restores the code (as much as possible) back to how it looked originally before the explicitify step, e.g. instead of "ts.Node" and "ts.Symbol", we have just "Node" and "Symbol".
Now that we are modules, there's no reason to ban multiple namespaces
per file; each file is its own scope and declaring a namespace won't
merge it into any other files.
If these are regular comments, then they won't appear in our d.ts files.
But, now we are relying on api-extractor to produce out final merged
d.ts files, so they need to be present in the "input" d.ts files,
meaning they have to be JSDoc comments.

These comments only work today because all of our builds load their TS
files from scratch, so they see the actual source files and their
non-JSDoc comments.

The comments also need to be attached to a declaration, not floating,
otherwise they won't be used by api-extractor, so move them if needed.
This project is the same as the (soon added) typescript project.
This file is unreferenced, and just a subset of tsserverlibrary.d.ts.
What I've heard is that this was intended to be used to detect protocol
chagnes, but, no test actually references it, and we have separate
infrastructure in place to ensure that protocol changes get the
attention they need.
This configures the existing build tasks to use esbuild by defualt. If
using the plain files is desired, passing `--bundle=false` will build
using plain files and still produce a runnable system.
Profiling the build roughly half of the time spent loading the
build is spent importing typescript.js, for this one function.

Since this stack is already adding required devDependencies, switch
readJson to use jsonc-parser (published by the VS Code team), rather
than importing the entire LKG typescript.js library.
However, this script appears to not work as designed; the playground
instead requests tsWorker.js, a file that we can't produce in our repo.

Probably, we should just remove this script.
@typescript-bot typescript-bot added Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug labels Oct 12, 2022
@typescript-bot
Copy link
Collaborator

Thanks for the PR! It looks like you've changed the TSServer protocol in some way. Please ensure that any changes here don't break consumers of the current TSServer API. For some extra review, we'll ping @sheetalkamat, @amcasey, @mjbvz, @minestarks for you. Feel free to loop in other consumers/maintainers if necessary

@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 12, 2022

Heya @jakebailey, I've started to run the perf test suite on this PR at e0bfc76. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 352,840k (± 0.02%) 341,514k (± 0.01%) 🟩-11,326k (- 3.21%) 341,459k 341,569k
Parse Time 1.55s (± 0.32%) 1.55s (± 0.74%) +0.00s (+ 0.13%) 1.52s 1.57s
Bind Time 0.61s (± 0.77%) 0.53s (± 0.76%) 🟩-0.08s (-13.28%) 0.52s 0.54s
Check Time 4.40s (± 0.72%) 3.98s (± 0.63%) 🟩-0.42s (- 9.60%) 3.93s 4.04s
Emit Time 4.94s (± 0.67%) 4.28s (± 1.18%) 🟩-0.66s (-13.32%) 4.23s 4.44s
Total Time 11.50s (± 0.57%) 10.34s (± 0.66%) 🟩-1.16s (-10.07%) 10.24s 10.56s
Compiler-Unions - node (v18.10.0, x64)
Memory used 200,062k (± 0.84%) 190,228k (± 0.86%) 🟩-9,834k (- 4.92%) 185,766k 191,508k
Parse Time 0.61s (± 0.78%) 0.61s (± 1.01%) +0.00s (+ 0.66%) 0.60s 0.62s
Bind Time 0.36s (± 0.62%) 0.33s (± 1.12%) 🟩-0.03s (- 9.19%) 0.32s 0.33s
Check Time 5.38s (± 0.41%) 4.98s (± 0.30%) 🟩-0.40s (- 7.44%) 4.95s 5.02s
Emit Time 1.82s (± 0.80%) 1.52s (± 1.38%) 🟩-0.30s (-16.39%) 1.48s 1.57s
Total Time 8.17s (± 0.32%) 7.44s (± 0.46%) 🟩-0.73s (- 8.92%) 7.39s 7.54s
Monaco - node (v18.10.0, x64)
Memory used 331,714k (± 0.02%) 321,779k (± 0.01%) -9,935k (- 3.00%) 321,715k 321,850k
Parse Time 1.17s (± 0.51%) 1.16s (± 1.07%) -0.01s (- 0.60%) 1.14s 1.19s
Bind Time 0.56s (± 1.00%) 0.50s (± 1.55%) 🟩-0.06s (-10.57%) 0.48s 0.52s
Check Time 4.29s (± 0.40%) 3.85s (± 0.47%) 🟩-0.43s (-10.04%) 3.82s 3.89s
Emit Time 2.61s (± 0.41%) 2.25s (± 1.11%) 🟩-0.36s (-13.77%) 2.22s 2.34s
Total Time 8.62s (± 0.31%) 7.77s (± 0.59%) 🟩-0.85s (- 9.90%) 7.70s 7.89s
TFS - node (v18.10.0, x64)
Memory used 294,678k (± 0.01%) 285,602k (± 0.26%) 🟩-9,076k (- 3.08%) 284,570k 286,763k
Parse Time 0.94s (± 0.78%) 0.96s (± 1.38%) +0.03s (+ 2.67%) 0.93s 0.99s
Bind Time 0.59s (± 3.65%) 0.45s (± 0.82%) 🟩-0.14s (-24.15%) 0.44s 0.45s
Check Time 4.01s (± 0.55%) 3.80s (± 0.72%) 🟩-0.21s (- 5.19%) 3.74s 3.88s
Emit Time 2.62s (± 0.54%) 2.18s (± 0.96%) 🟩-0.44s (-16.79%) 2.15s 2.23s
Total Time 8.15s (± 0.47%) 7.39s (± 0.64%) 🟩-0.76s (- 9.37%) 7.30s 7.52s
material-ui - node (v18.10.0, x64)
Memory used 439,978k (± 0.01%) 429,619k (± 0.01%) -10,359k (- 2.35%) 429,525k 429,761k
Parse Time 1.35s (± 0.59%) 1.32s (± 0.71%) -0.03s (- 2.08%) 1.30s 1.34s
Bind Time 0.44s (± 0.82%) 0.47s (± 3.41%) +0.03s (+ 6.08%) 0.44s 0.49s
Check Time 10.86s (± 0.56%) 10.15s (± 0.88%) 🟩-0.71s (- 6.51%) 10.01s 10.33s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 12.65s (± 0.54%) 11.94s (± 0.74%) 🟩-0.71s (- 5.59%) 11.77s 12.12s
xstate - node (v18.10.0, x64)
Memory used 556,574k (± 0.01%) 522,440k (± 0.02%) 🟩-34,133k (- 6.13%) 522,235k 522,579k
Parse Time 1.92s (± 0.47%) 1.91s (± 0.43%) -0.01s (- 0.63%) 1.89s 1.93s
Bind Time 0.68s (± 1.95%) 0.73s (± 1.97%) +0.05s (+ 7.17%) 0.70s 0.76s
Check Time 1.10s (± 0.69%) 1.04s (± 0.57%) 🟩-0.06s (- 5.52%) 1.03s 1.06s
Emit Time 0.06s (± 0.00%) 0.05s (± 6.42%) 🟩-0.01s (-11.67%) 0.05s 0.06s
Total Time 3.76s (± 0.33%) 3.74s (± 0.54%) -0.02s (- 0.61%) 3.69s 3.78s
Angular - node (v16.17.1, x64)
Memory used 352,334k (± 0.02%) 340,881k (± 0.02%) 🟩-11,453k (- 3.25%) 340,685k 341,022k
Parse Time 1.89s (± 0.46%) 1.88s (± 0.34%) -0.01s (- 0.74%) 1.86s 1.89s
Bind Time 0.74s (± 0.78%) 0.64s (± 0.56%) 🟩-0.10s (-13.32%) 0.64s 0.65s
Check Time 5.69s (± 0.73%) 5.12s (± 0.49%) 🟩-0.57s (- 9.95%) 5.08s 5.18s
Emit Time 6.08s (± 0.66%) 5.08s (± 0.82%) 🟩-1.00s (-16.42%) 5.00s 5.20s
Total Time 14.41s (± 0.57%) 12.73s (± 0.50%) 🟩-1.68s (-11.65%) 12.59s 12.92s
Compiler-Unions - node (v16.17.1, x64)
Memory used 198,279k (± 0.57%) 189,060k (± 0.66%) 🟩-9,219k (- 4.65%) 187,335k 190,894k
Parse Time 0.79s (± 0.87%) 0.79s (± 1.13%) +0.00s (+ 0.13%) 0.77s 0.81s
Bind Time 0.45s (± 1.09%) 0.41s (± 1.15%) 🟩-0.04s (- 9.03%) 0.41s 0.43s
Check Time 6.50s (± 0.50%) 5.98s (± 0.39%) 🟩-0.52s (- 7.98%) 5.95s 6.03s
Emit Time 2.31s (± 1.09%) 1.91s (± 0.83%) 🟩-0.39s (-17.09%) 1.88s 1.95s
Total Time 10.05s (± 0.50%) 9.10s (± 0.32%) 🟩-0.95s (- 9.46%) 9.04s 9.16s
Monaco - node (v16.17.1, x64)
Memory used 331,133k (± 0.02%) 321,038k (± 0.01%) 🟩-10,095k (- 3.05%) 320,991k 321,083k
Parse Time 1.42s (± 0.37%) 1.41s (± 0.68%) -0.01s (- 1.06%) 1.38s 1.43s
Bind Time 0.69s (± 0.86%) 0.59s (± 0.75%) 🟩-0.10s (-14.70%) 0.58s 0.60s
Check Time 5.47s (± 0.55%) 4.86s (± 0.66%) 🟩-0.61s (-11.21%) 4.80s 4.91s
Emit Time 3.26s (± 0.55%) 2.73s (± 0.83%) 🟩-0.53s (-16.32%) 2.69s 2.78s
Total Time 10.85s (± 0.44%) 9.59s (± 0.56%) 🟩-1.26s (-11.63%) 9.47s 9.67s
TFS - node (v16.17.1, x64)
Memory used 294,050k (± 0.02%) 284,216k (± 0.15%) 🟩-9,835k (- 3.34%) 283,985k 285,971k
Parse Time 1.22s (± 1.53%) 1.20s (± 1.59%) -0.02s (- 1.31%) 1.16s 1.26s
Bind Time 0.64s (± 0.97%) 0.54s (± 1.34%) 🟩-0.10s (-15.18%) 0.53s 0.56s
Check Time 5.12s (± 0.44%) 4.79s (± 0.30%) 🟩-0.33s (- 6.46%) 4.76s 4.83s
Emit Time 3.47s (± 0.64%) 2.72s (± 2.40%) 🟩-0.75s (-21.57%) 2.64s 2.87s
Total Time 10.45s (± 0.42%) 9.26s (± 0.65%) 🟩-1.19s (-11.39%) 9.15s 9.42s
material-ui - node (v16.17.1, x64)
Memory used 439,350k (± 0.01%) 428,993k (± 0.02%) -10,357k (- 2.36%) 428,879k 429,120k
Parse Time 1.72s (± 1.24%) 1.62s (± 0.46%) 🟩-0.10s (- 5.64%) 1.61s 1.64s
Bind Time 0.54s (± 0.69%) 0.52s (± 1.12%) 🟩-0.02s (- 3.36%) 0.51s 0.53s
Check Time 12.52s (± 0.62%) 11.65s (± 0.76%) 🟩-0.87s (- 6.98%) 11.50s 11.87s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.78s (± 0.53%) 13.79s (± 0.66%) 🟩-0.99s (- 6.70%) 13.62s 14.01s
xstate - node (v16.17.1, x64)
Memory used 554,310k (± 0.02%) 520,028k (± 0.01%) 🟩-34,282k (- 6.18%) 519,882k 520,134k
Parse Time 2.31s (± 0.28%) 2.31s (± 0.39%) -0.00s (- 0.09%) 2.29s 2.33s
Bind Time 0.89s (± 1.49%) 0.84s (± 1.53%) 🟩-0.05s (- 5.62%) 0.82s 0.87s
Check Time 1.43s (± 0.92%) 1.37s (± 0.86%) 🟩-0.06s (- 4.13%) 1.35s 1.40s
Emit Time 0.07s (± 0.00%) 0.06s (± 0.00%) 🟩-0.01s (-14.29%) 0.06s 0.06s
Total Time 4.70s (± 0.23%) 4.58s (± 0.57%) -0.12s (- 2.49%) 4.53s 4.64s
Angular - node (v14.15.1, x64)
Memory used 346,620k (± 0.01%) 334,464k (± 0.01%) 🟩-12,156k (- 3.51%) 334,433k 334,537k
Parse Time 2.08s (± 1.31%) 2.04s (± 0.57%) -0.05s (- 2.21%) 2.02s 2.07s
Bind Time 0.80s (± 0.77%) 0.70s (± 0.64%) 🟩-0.10s (-12.86%) 0.69s 0.71s
Check Time 5.99s (± 0.53%) 5.51s (± 0.41%) 🟩-0.48s (- 8.06%) 5.47s 5.56s
Emit Time 6.33s (± 1.14%) 5.33s (± 0.68%) 🟩-1.00s (-15.82%) 5.26s 5.43s
Total Time 15.21s (± 0.60%) 13.57s (± 0.41%) 🟩-1.63s (-10.72%) 13.45s 13.72s
Compiler-Unions - node (v14.15.1, x64)
Memory used 190,802k (± 0.70%) 182,415k (± 0.02%) 🟩-8,387k (- 4.40%) 182,356k 182,466k
Parse Time 0.86s (± 0.88%) 0.89s (± 0.45%) +0.04s (+ 4.09%) 0.88s 0.90s
Bind Time 0.49s (± 0.96%) 0.46s (± 1.03%) 🟩-0.03s (- 5.51%) 0.45s 0.47s
Check Time 6.80s (± 0.56%) 6.31s (± 0.45%) 🟩-0.49s (- 7.17%) 6.22s 6.35s
Emit Time 2.42s (± 0.78%) 2.06s (± 1.11%) 🟩-0.36s (-14.95%) 2.01s 2.11s
Total Time 10.57s (± 0.45%) 9.73s (± 0.43%) 🟩-0.84s (- 7.98%) 9.61s 9.81s
Monaco - node (v14.15.1, x64)
Memory used 326,600k (± 0.01%) 315,985k (± 0.01%) 🟩-10,615k (- 3.25%) 315,941k 316,029k
Parse Time 1.59s (± 0.75%) 1.57s (± 0.45%) -0.02s (- 1.07%) 1.56s 1.59s
Bind Time 0.73s (± 0.65%) 0.64s (± 1.10%) 🟩-0.09s (-12.82%) 0.63s 0.66s
Check Time 5.78s (± 0.57%) 5.22s (± 0.49%) 🟩-0.55s (- 9.61%) 5.17s 5.29s
Emit Time 3.39s (± 0.79%) 2.90s (± 0.81%) 🟩-0.48s (-14.24%) 2.86s 2.98s
Total Time 11.48s (± 0.43%) 10.33s (± 0.45%) 🟩-1.15s (- 9.99%) 10.27s 10.49s
TFS - node (v14.15.1, x64)
Memory used 289,690k (± 0.01%) 281,050k (± 0.01%) -8,639k (- 2.98%) 280,993k 281,082k
Parse Time 1.30s (± 0.63%) 1.34s (± 1.73%) +0.04s (+ 2.69%) 1.31s 1.42s
Bind Time 0.80s (± 0.59%) 0.59s (± 0.50%) 🟩-0.21s (-26.28%) 0.59s 0.60s
Check Time 5.41s (± 0.47%) 5.09s (± 0.57%) 🟩-0.32s (- 5.89%) 5.04s 5.18s
Emit Time 3.64s (± 0.84%) 3.07s (± 1.12%) 🟩-0.57s (-15.76%) 2.99s 3.13s
Total Time 11.16s (± 0.33%) 10.09s (± 0.61%) 🟩-1.06s (- 9.55%) 9.95s 10.22s
material-ui - node (v14.15.1, x64)
Memory used 435,472k (± 0.01%) 424,374k (± 0.00%) -11,098k (- 2.55%) 424,347k 424,399k
Parse Time 1.87s (± 0.48%) 1.87s (± 0.54%) -0.00s (- 0.05%) 1.85s 1.89s
Bind Time 0.58s (± 0.63%) 0.53s (± 0.56%) 🟩-0.05s (- 9.06%) 0.53s 0.54s
Check Time 12.90s (± 0.61%) 12.08s (± 0.56%) 🟩-0.82s (- 6.35%) 11.96s 12.28s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 15.36s (± 0.55%) 14.49s (± 0.46%) 🟩-0.87s (- 5.67%) 14.38s 14.68s
xstate - node (v14.15.1, x64)
Memory used 543,377k (± 0.01%) 508,162k (± 0.00%) 🟩-35,214k (- 6.48%) 508,105k 508,232k
Parse Time 2.61s (± 0.56%) 2.64s (± 0.40%) +0.03s (+ 1.30%) 2.62s 2.67s
Bind Time 0.99s (± 0.70%) 0.85s (± 1.02%) 🟩-0.14s (-13.91%) 0.83s 0.87s
Check Time 1.53s (± 0.61%) 1.48s (± 0.58%) 🟩-0.05s (- 3.01%) 1.46s 1.50s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 5.20s (± 0.43%) 5.05s (± 0.43%) -0.15s (- 2.87%) 5.00s 5.09s
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

TSServer

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,066ms (± 0.48%) 1,040ms (± 0.50%) -26ms (- 2.42%) 1,027ms 1,049ms
Req 2 - geterr 2,723ms (± 0.55%) 2,490ms (± 0.72%) 🟩-232ms (- 8.54%) 2,448ms 2,542ms
Req 3 - references 192ms (± 1.48%) 166ms (± 1.05%) 🟩-26ms (-13.52%) 163ms 171ms
Req 4 - navto 145ms (± 1.23%) 137ms (± 0.69%) 🟩-8ms (- 5.51%) 136ms 139ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 44ms (± 1.86%) 51ms (± 5.61%) +7ms (+15.09%) 48ms 60ms
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,134ms (± 0.73%) 1,106ms (± 0.65%) -27ms (- 2.41%) 1,094ms 1,124ms
Req 2 - geterr 1,609ms (± 0.46%) 1,494ms (± 0.56%) 🟩-114ms (- 7.11%) 1,481ms 1,512ms
Req 3 - references 198ms (± 0.93%) 170ms (± 0.84%) 🟩-29ms (-14.48%) 167ms 174ms
Req 4 - navto 165ms (± 6.32%) 149ms (± 0.56%) 🟩-17ms (-10.10%) 147ms 151ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 84ms (±11.88%) 51ms (± 3.01%) 🟩-33ms (-39.17%) 49ms 55ms
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,614ms (± 0.55%) 1,516ms (± 0.70%) 🟩-98ms (- 6.07%) 1,491ms 1,542ms
Req 2 - geterr 585ms (± 0.39%) 568ms (± 0.76%) -16ms (- 2.77%) 558ms 579ms
Req 3 - references 54ms (± 1.88%) 60ms (± 2.53%) +6ms (+11.57%) 57ms 64ms
Req 4 - navto 202ms (± 0.74%) 193ms (± 1.28%) 🟩-9ms (- 4.22%) 189ms 200ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 215ms (± 1.89%) 209ms (± 1.11%) -6ms (- 2.70%) 205ms 216ms
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,327ms (± 0.51%) 1,301ms (± 0.58%) -26ms (- 1.97%) 1,286ms 1,322ms
Req 2 - geterr 3,303ms (± 0.63%) 3,075ms (± 0.81%) 🟩-228ms (- 6.91%) 3,037ms 3,148ms
Req 3 - references 222ms (± 1.20%) 196ms (± 1.23%) 🟩-26ms (-11.88%) 192ms 202ms
Req 4 - navto 158ms (± 1.04%) 149ms (± 0.96%) 🟩-9ms (- 5.95%) 147ms 153ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 68ms (±20.24%) 61ms (± 4.07%) 🟩-7ms (-10.56%) 57ms 70ms
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,406ms (± 0.55%) 1,382ms (± 0.76%) -24ms (- 1.69%) 1,360ms 1,401ms
Req 2 - geterr 2,117ms (± 0.55%) 1,969ms (± 0.42%) 🟩-148ms (- 7.00%) 1,950ms 1,986ms
Req 3 - references 232ms (± 0.60%) 201ms (± 0.83%) 🟩-31ms (-13.46%) 198ms 205ms
Req 4 - navto 169ms (± 0.83%) 160ms (± 0.71%) 🟩-9ms (- 5.09%) 158ms 162ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 53ms (± 3.68%) 56ms (± 2.09%) +3ms (+ 6.45%) 54ms 60ms
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,927ms (± 0.52%) 1,834ms (± 0.99%) 🟩-93ms (- 4.81%) 1,803ms 1,892ms
Req 2 - geterr 737ms (± 0.59%) 708ms (± 1.04%) 🟩-29ms (- 3.98%) 692ms 722ms
Req 3 - references 61ms (± 1.45%) 67ms (± 1.38%) +6ms (+ 9.45%) 65ms 69ms
Req 4 - navto 204ms (± 0.88%) 197ms (± 0.67%) 🟩-7ms (- 3.38%) 195ms 201ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 258ms (± 0.60%) 254ms (± 0.58%) -4ms (- 1.59%) 250ms 257ms
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,455ms (± 0.57%) 1,458ms (± 0.51%) +3ms (+ 0.22%) 1,444ms 1,481ms
Req 2 - geterr 3,550ms (± 0.91%) 3,332ms (± 0.67%) 🟩-218ms (- 6.13%) 3,288ms 3,377ms
Req 3 - references 233ms (± 0.49%) 208ms (± 0.40%) 🟩-25ms (-10.63%) 207ms 210ms
Req 4 - navto 171ms (± 0.60%) 162ms (± 1.27%) 🟩-9ms (- 5.27%) 159ms 167ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 59ms (± 6.06%) 67ms (± 7.49%) +8ms (+13.03%) 58ms 74ms
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,524ms (± 0.44%) 1,533ms (± 0.44%) +9ms (+ 0.58%) 1,513ms 1,545ms
Req 2 - geterr 2,334ms (± 0.54%) 2,206ms (± 0.54%) 🟩-128ms (- 5.47%) 2,191ms 2,237ms
Req 3 - references 245ms (± 0.47%) 217ms (± 1.28%) 🟩-28ms (-11.27%) 211ms 223ms
Req 4 - navto 181ms (± 0.45%) 177ms (± 0.57%) -3ms (- 1.83%) 175ms 179ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 55ms (± 1.35%) 56ms (± 1.03%) +1ms (+ 1.81%) 55ms 58ms
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,149ms (± 0.64%) 2,036ms (± 0.86%) 🟩-114ms (- 5.30%) 2,004ms 2,080ms
Req 2 - geterr 767ms (± 0.47%) 757ms (± 0.55%) -10ms (- 1.29%) 750ms 765ms
Req 3 - references 68ms (± 2.84%) 74ms (± 0.65%) +6ms (+ 9.19%) 73ms 75ms
Req 4 - navto 228ms (± 0.87%) 215ms (± 0.62%) 🟩-13ms (- 5.53%) 212ms 218ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 273ms (± 1.53%) 285ms (± 1.19%) +12ms (+ 4.55%) 278ms 292ms
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

Developer Information:

Download Benchmark

@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 12, 2022

Heya @jakebailey, I've started to run the perf test suite on this PR at 51e9c86. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 352,840k (± 0.02%) 339,292k (± 0.03%) 🟩-13,548k (- 3.84%) 338,999k 339,439k
Parse Time 1.55s (± 0.32%) 1.60s (± 0.88%) +0.05s (+ 3.36%) 1.57s 1.64s
Bind Time 0.61s (± 0.77%) 0.53s (± 1.09%) 🟩-0.08s (-13.11%) 0.52s 0.54s
Check Time 4.40s (± 0.72%) 4.46s (± 0.33%) +0.05s (+ 1.18%) 4.43s 4.49s
Emit Time 4.94s (± 0.67%) 4.32s (± 0.62%) 🟩-0.62s (-12.57%) 4.27s 4.40s
Total Time 11.50s (± 0.57%) 10.91s (± 0.39%) 🟩-0.60s (- 5.19%) 10.84s 11.02s
Compiler-Unions - node (v18.10.0, x64)
Memory used 200,062k (± 0.84%) 187,201k (± 1.01%) 🟩-12,861k (- 6.43%) 183,303k 188,972k
Parse Time 0.61s (± 0.78%) 0.63s (± 0.80%) +0.02s (+ 2.97%) 0.61s 0.63s
Bind Time 0.36s (± 0.62%) 0.33s (± 0.89%) 🟩-0.03s (- 7.52%) 0.33s 0.34s
Check Time 5.38s (± 0.41%) 5.43s (± 0.49%) +0.05s (+ 0.91%) 5.37s 5.49s
Emit Time 1.82s (± 0.80%) 1.57s (± 1.15%) 🟩-0.26s (-14.14%) 1.54s 1.61s
Total Time 8.17s (± 0.32%) 7.94s (± 0.45%) -0.22s (- 2.73%) 7.87s 8.04s
Monaco - node (v18.10.0, x64)
Memory used 331,714k (± 0.02%) 319,422k (± 0.06%) 🟩-12,292k (- 3.71%) 319,194k 320,137k
Parse Time 1.17s (± 0.51%) 1.18s (± 1.02%) +0.02s (+ 1.72%) 1.16s 1.21s
Bind Time 0.56s (± 1.00%) 0.48s (± 1.16%) 🟩-0.08s (-14.34%) 0.47s 0.49s
Check Time 4.29s (± 0.40%) 4.29s (± 0.44%) +0.00s (+ 0.02%) 4.25s 4.32s
Emit Time 2.61s (± 0.41%) 2.24s (± 0.72%) 🟩-0.37s (-14.30%) 2.21s 2.27s
Total Time 8.62s (± 0.31%) 8.19s (± 0.22%) 🟩-0.43s (- 4.98%) 8.15s 8.22s
TFS - node (v18.10.0, x64)
Memory used 294,678k (± 0.01%) 282,727k (± 0.23%) 🟩-11,952k (- 4.06%) 281,968k 284,126k
Parse Time 0.94s (± 0.78%) 0.96s (± 2.01%) +0.03s (+ 2.77%) 0.93s 1.03s
Bind Time 0.59s (± 3.65%) 0.45s (± 0.76%) 🟩-0.14s (-23.98%) 0.44s 0.45s
Check Time 4.01s (± 0.55%) 4.29s (± 0.65%) +0.28s (+ 6.96%) 4.23s 4.37s
Emit Time 2.62s (± 0.54%) 2.21s (± 0.84%) 🟩-0.41s (-15.80%) 2.17s 2.25s
Total Time 8.15s (± 0.47%) 7.90s (± 0.39%) 🟩-0.25s (- 3.05%) 7.86s 7.96s
material-ui - node (v18.10.0, x64)
Memory used 439,978k (± 0.01%) 427,462k (± 0.01%) -12,516k (- 2.84%) 427,381k 427,625k
Parse Time 1.35s (± 0.59%) 1.39s (± 0.93%) +0.04s (+ 2.82%) 1.36s 1.42s
Bind Time 0.44s (± 0.82%) 0.46s (± 3.93%) +0.02s (+ 4.28%) 0.44s 0.51s
Check Time 10.86s (± 0.56%) 10.44s (± 0.55%) 🟩-0.41s (- 3.81%) 10.34s 10.60s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 12.65s (± 0.54%) 12.30s (± 0.41%) -0.35s (- 2.79%) 12.18s 12.42s
xstate - node (v18.10.0, x64)
Memory used 556,574k (± 0.01%) 515,160k (± 0.01%) 🟩-41,413k (- 7.44%) 515,072k 515,308k
Parse Time 1.92s (± 0.47%) 2.00s (± 0.49%) +0.08s (+ 4.12%) 1.98s 2.02s
Bind Time 0.68s (± 1.95%) 0.70s (± 1.17%) +0.01s (+ 2.05%) 0.68s 0.72s
Check Time 1.10s (± 0.69%) 1.09s (± 0.34%) -0.01s (- 0.90%) 1.09s 1.10s
Emit Time 0.06s (± 0.00%) 0.06s (± 0.00%) 0.00s ( 0.00%) 0.06s 0.06s
Total Time 3.76s (± 0.33%) 3.85s (± 0.35%) +0.09s (+ 2.34%) 3.83s 3.88s
Angular - node (v16.17.1, x64)
Memory used 352,334k (± 0.02%) 338,704k (± 0.02%) 🟩-13,629k (- 3.87%) 338,550k 338,776k
Parse Time 1.89s (± 0.46%) 1.93s (± 0.89%) +0.04s (+ 2.11%) 1.90s 1.97s
Bind Time 0.74s (± 0.78%) 0.64s (± 0.87%) 🟩-0.11s (-14.13%) 0.63s 0.65s
Check Time 5.69s (± 0.73%) 5.64s (± 0.41%) -0.05s (- 0.97%) 5.59s 5.68s
Emit Time 6.08s (± 0.66%) 5.10s (± 0.47%) 🟩-0.99s (-16.21%) 5.05s 5.15s
Total Time 14.41s (± 0.57%) 13.30s (± 0.26%) 🟩-1.11s (- 7.69%) 13.23s 13.38s
Compiler-Unions - node (v16.17.1, x64)
Memory used 198,279k (± 0.57%) 185,970k (± 0.59%) 🟩-12,309k (- 6.21%) 184,970k 188,278k
Parse Time 0.79s (± 0.87%) 0.79s (± 1.45%) +0.01s (+ 1.02%) 0.77s 0.81s
Bind Time 0.45s (± 1.09%) 0.41s (± 0.72%) 🟩-0.04s (- 9.25%) 0.41s 0.42s
Check Time 6.50s (± 0.50%) 6.44s (± 0.53%) -0.06s (- 0.91%) 6.38s 6.54s
Emit Time 2.31s (± 1.09%) 1.93s (± 0.46%) 🟩-0.38s (-16.52%) 1.90s 1.94s
Total Time 10.05s (± 0.50%) 9.58s (± 0.49%) 🟩-0.47s (- 4.69%) 9.49s 9.70s
Monaco - node (v16.17.1, x64)
Memory used 331,133k (± 0.02%) 318,670k (± 0.01%) 🟩-12,463k (- 3.76%) 318,606k 318,717k
Parse Time 1.42s (± 0.37%) 1.42s (± 0.71%) +0.00s (+ 0.28%) 1.41s 1.46s
Bind Time 0.69s (± 0.86%) 0.60s (± 1.14%) 🟩-0.10s (-14.12%) 0.59s 0.62s
Check Time 5.47s (± 0.55%) 5.35s (± 0.55%) -0.12s (- 2.21%) 5.30s 5.42s
Emit Time 3.26s (± 0.55%) 2.75s (± 1.21%) 🟩-0.52s (-15.80%) 2.69s 2.85s
Total Time 10.85s (± 0.44%) 10.12s (± 0.59%) 🟩-0.73s (- 6.72%) 10.03s 10.28s
TFS - node (v16.17.1, x64)
Memory used 294,050k (± 0.02%) 281,502k (± 0.02%) 🟩-12,548k (- 4.27%) 281,335k 281,577k
Parse Time 1.22s (± 1.53%) 1.19s (± 1.68%) -0.03s (- 2.63%) 1.14s 1.25s
Bind Time 0.64s (± 0.97%) 0.55s (± 4.95%) 🟩-0.09s (-13.62%) 0.53s 0.66s
Check Time 5.12s (± 0.44%) 5.30s (± 0.52%) +0.18s (+ 3.61%) 5.27s 5.40s
Emit Time 3.47s (± 0.64%) 2.83s (± 1.86%) 🟩-0.64s (-18.37%) 2.71s 2.93s
Total Time 10.45s (± 0.42%) 9.88s (± 0.62%) 🟩-0.57s (- 5.50%) 9.69s 10.00s
material-ui - node (v16.17.1, x64)
Memory used 439,350k (± 0.01%) 426,764k (± 0.01%) -12,586k (- 2.86%) 426,704k 426,884k
Parse Time 1.72s (± 1.24%) 1.69s (± 0.57%) -0.03s (- 1.69%) 1.67s 1.71s
Bind Time 0.54s (± 0.69%) 0.52s (± 1.19%) -0.02s (- 2.99%) 0.51s 0.53s
Check Time 12.52s (± 0.62%) 11.99s (± 0.53%) 🟩-0.53s (- 4.26%) 11.87s 12.14s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.78s (± 0.53%) 14.20s (± 0.43%) 🟩-0.58s (- 3.92%) 14.07s 14.34s
xstate - node (v16.17.1, x64)
Memory used 554,310k (± 0.02%) 512,814k (± 0.02%) 🟩-41,496k (- 7.49%) 512,657k 513,042k
Parse Time 2.31s (± 0.28%) 2.40s (± 0.37%) +0.10s (+ 4.16%) 2.39s 2.43s
Bind Time 0.89s (± 1.49%) 0.85s (± 1.09%) 🟩-0.04s (- 4.72%) 0.82s 0.86s
Check Time 1.43s (± 0.92%) 1.43s (± 0.42%) -0.00s (- 0.14%) 1.41s 1.44s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 4.70s (± 0.23%) 4.74s (± 0.31%) +0.05s (+ 0.98%) 4.72s 4.78s
Angular - node (v14.15.1, x64)
Memory used 346,620k (± 0.01%) 332,332k (± 0.01%) 🟩-14,288k (- 4.12%) 332,248k 332,395k
Parse Time 2.08s (± 1.31%) 2.08s (± 0.55%) 0.00s ( 0.00%) 2.06s 2.11s
Bind Time 0.80s (± 0.77%) 0.70s (± 0.57%) 🟩-0.10s (-12.73%) 0.69s 0.71s
Check Time 5.99s (± 0.53%) 6.00s (± 0.47%) +0.01s (+ 0.08%) 5.96s 6.07s
Emit Time 6.33s (± 1.14%) 5.37s (± 0.69%) 🟩-0.97s (-15.26%) 5.29s 5.46s
Total Time 15.21s (± 0.60%) 14.15s (± 0.31%) 🟩-1.06s (- 6.97%) 14.05s 14.25s
Compiler-Unions - node (v14.15.1, x64)
Memory used 190,802k (± 0.70%) 180,075k (± 0.01%) 🟩-10,726k (- 5.62%) 180,027k 180,144k
Parse Time 0.86s (± 0.88%) 0.91s (± 0.77%) +0.05s (+ 6.19%) 0.90s 0.93s
Bind Time 0.49s (± 0.96%) 0.46s (± 0.80%) 🟩-0.03s (- 6.94%) 0.45s 0.46s
Check Time 6.80s (± 0.56%) 6.74s (± 0.50%) -0.06s (- 0.87%) 6.67s 6.81s
Emit Time 2.42s (± 0.78%) 2.07s (± 0.60%) 🟩-0.35s (-14.62%) 2.04s 2.09s
Total Time 10.57s (± 0.45%) 10.18s (± 0.47%) 🟩-0.39s (- 3.70%) 10.09s 10.29s
Monaco - node (v14.15.1, x64)
Memory used 326,600k (± 0.01%) 313,546k (± 0.01%) 🟩-13,053k (- 4.00%) 313,518k 313,585k
Parse Time 1.59s (± 0.75%) 1.57s (± 0.33%) -0.02s (- 1.07%) 1.56s 1.58s
Bind Time 0.73s (± 0.65%) 0.64s (± 0.53%) 🟩-0.10s (-13.10%) 0.63s 0.64s
Check Time 5.78s (± 0.57%) 5.67s (± 0.47%) -0.10s (- 1.78%) 5.64s 5.76s
Emit Time 3.39s (± 0.79%) 2.90s (± 0.74%) 🟩-0.49s (-14.38%) 2.85s 2.96s
Total Time 11.48s (± 0.43%) 10.78s (± 0.31%) 🟩-0.70s (- 6.11%) 10.68s 10.84s
TFS - node (v14.15.1, x64)
Memory used 289,690k (± 0.01%) 278,586k (± 0.01%) 🟩-11,104k (- 3.83%) 278,530k 278,638k
Parse Time 1.30s (± 0.63%) 1.30s (± 0.45%) +0.00s (+ 0.23%) 1.29s 1.32s
Bind Time 0.80s (± 0.59%) 0.59s (± 0.84%) 🟩-0.22s (-27.02%) 0.58s 0.60s
Check Time 5.41s (± 0.47%) 5.57s (± 0.39%) +0.16s (+ 2.90%) 5.53s 5.62s
Emit Time 3.64s (± 0.84%) 3.05s (± 0.90%) 🟩-0.59s (-16.20%) 2.99s 3.13s
Total Time 11.16s (± 0.33%) 10.51s (± 0.47%) 🟩-0.64s (- 5.76%) 10.41s 10.63s
material-ui - node (v14.15.1, x64)
Memory used 435,472k (± 0.01%) 422,229k (± 0.00%) 🟩-13,243k (- 3.04%) 422,213k 422,263k
Parse Time 1.87s (± 0.48%) 1.92s (± 0.60%) +0.05s (+ 2.56%) 1.90s 1.95s
Bind Time 0.58s (± 0.63%) 0.53s (± 0.63%) 🟩-0.05s (- 9.40%) 0.52s 0.54s
Check Time 12.90s (± 0.61%) 12.42s (± 0.41%) 🟩-0.48s (- 3.74%) 12.29s 12.51s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 15.36s (± 0.55%) 14.87s (± 0.39%) 🟩-0.49s (- 3.20%) 14.73s 14.98s
xstate - node (v14.15.1, x64)
Memory used 543,377k (± 0.01%) 501,208k (± 0.01%) 🟩-42,169k (- 7.76%) 501,144k 501,257k
Parse Time 2.61s (± 0.56%) 2.75s (± 0.51%) +0.14s (+ 5.40%) 2.72s 2.79s
Bind Time 0.99s (± 0.70%) 0.82s (± 0.46%) 🟩-0.17s (-17.26%) 0.81s 0.82s
Check Time 1.53s (± 0.61%) 1.53s (± 0.49%) +0.00s (+ 0.33%) 1.52s 1.55s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 5.20s (± 0.43%) 5.17s (± 0.27%) -0.03s (- 0.52%) 5.16s 5.22s
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

TSServer

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,066ms (± 0.48%) 1,050ms (± 0.52%) -16ms (- 1.46%) 1,042ms 1,068ms
Req 2 - geterr 2,723ms (± 0.55%) 2,607ms (± 0.76%) 🟩-116ms (- 4.25%) 2,579ms 2,675ms
Req 3 - references 192ms (± 1.48%) 173ms (± 0.56%) 🟩-18ms (- 9.61%) 171ms 175ms
Req 4 - navto 145ms (± 1.23%) 138ms (± 0.73%) 🟩-8ms (- 5.30%) 136ms 140ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 44ms (± 1.86%) 57ms (± 5.16%) +12ms (+27.93%) 51ms 62ms
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,134ms (± 0.73%) 1,129ms (± 0.78%) -5ms (- 0.45%) 1,110ms 1,154ms
Req 2 - geterr 1,609ms (± 0.46%) 1,628ms (± 0.56%) +19ms (+ 1.20%) 1,610ms 1,643ms
Req 3 - references 198ms (± 0.93%) 182ms (± 0.92%) 🟩-17ms (- 8.43%) 179ms 186ms
Req 4 - navto 165ms (± 6.32%) 149ms (± 0.83%) 🟩-16ms (- 9.68%) 147ms 153ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 84ms (±11.88%) 49ms (± 1.72%) 🟩-35ms (-41.79%) 47ms 50ms
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,614ms (± 0.55%) 1,618ms (± 0.47%) +5ms (+ 0.29%) 1,604ms 1,634ms
Req 2 - geterr 585ms (± 0.39%) 572ms (± 0.51%) -12ms (- 2.10%) 562ms 576ms
Req 3 - references 54ms (± 1.88%) 62ms (± 2.77%) +8ms (+14.74%) 59ms 66ms
Req 4 - navto 202ms (± 0.74%) 193ms (± 0.77%) 🟩-9ms (- 4.37%) 190ms 196ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 215ms (± 1.89%) 210ms (± 1.02%) -5ms (- 2.33%) 207ms 216ms
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,327ms (± 0.51%) 1,303ms (± 0.56%) -24ms (- 1.82%) 1,288ms 1,325ms
Req 2 - geterr 3,303ms (± 0.63%) 3,240ms (± 0.80%) -63ms (- 1.89%) 3,179ms 3,290ms
Req 3 - references 222ms (± 1.20%) 203ms (± 0.97%) 🟩-19ms (- 8.51%) 200ms 210ms
Req 4 - navto 158ms (± 1.04%) 154ms (± 7.12%) -4ms (- 2.53%) 147ms 198ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 68ms (±20.24%) 70ms (±19.70%) +2ms (+ 2.35%) 56ms 100ms
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,406ms (± 0.55%) 1,395ms (± 1.03%) -11ms (- 0.78%) 1,370ms 1,429ms
Req 2 - geterr 2,117ms (± 0.55%) 2,122ms (± 0.57%) +5ms (+ 0.24%) 2,090ms 2,150ms
Req 3 - references 232ms (± 0.60%) 211ms (± 1.16%) 🟩-21ms (- 8.89%) 207ms 219ms
Req 4 - navto 169ms (± 0.83%) 157ms (± 0.43%) 🟩-11ms (- 6.75%) 156ms 159ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 53ms (± 3.68%) 56ms (± 1.21%) +4ms (+ 7.02%) 55ms 58ms
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,927ms (± 0.52%) 1,918ms (± 0.69%) -10ms (- 0.49%) 1,892ms 1,952ms
Req 2 - geterr 737ms (± 0.59%) 733ms (± 0.58%) -4ms (- 0.52%) 727ms 743ms
Req 3 - references 61ms (± 1.45%) 70ms (± 0.74%) +9ms (+14.17%) 69ms 71ms
Req 4 - navto 204ms (± 0.88%) 196ms (± 0.59%) 🟩-8ms (- 4.12%) 193ms 199ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 258ms (± 0.60%) 262ms (± 1.85%) +4ms (+ 1.47%) 251ms 273ms
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,455ms (± 0.57%) 1,458ms (± 0.33%) +3ms (+ 0.19%) 1,447ms 1,469ms
Req 2 - geterr 3,550ms (± 0.91%) 3,441ms (± 0.32%) 🟩-109ms (- 3.06%) 3,418ms 3,475ms
Req 3 - references 233ms (± 0.49%) 213ms (± 0.47%) 🟩-20ms (- 8.49%) 211ms 216ms
Req 4 - navto 171ms (± 0.60%) 159ms (± 0.91%) 🟩-12ms (- 6.79%) 157ms 163ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 59ms (± 6.06%) 67ms (± 6.00%) +8ms (+13.87%) 57ms 72ms
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,524ms (± 0.44%) 1,543ms (± 0.68%) +19ms (+ 1.24%) 1,526ms 1,572ms
Req 2 - geterr 2,334ms (± 0.54%) 2,325ms (± 0.24%) -9ms (- 0.36%) 2,315ms 2,342ms
Req 3 - references 245ms (± 0.47%) 225ms (± 1.17%) 🟩-21ms (- 8.37%) 220ms 231ms
Req 4 - navto 181ms (± 0.45%) 174ms (± 0.45%) 🟩-7ms (- 3.76%) 172ms 176ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 55ms (± 1.35%) 59ms (± 1.49%) +4ms (+ 7.23%) 57ms 61ms
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,149ms (± 0.64%) 2,070ms (± 0.73%) 🟩-79ms (- 3.69%) 2,045ms 2,104ms
Req 2 - geterr 767ms (± 0.47%) 777ms (± 0.35%) +10ms (+ 1.28%) 771ms 785ms
Req 3 - references 68ms (± 2.84%) 72ms (± 1.60%) +5ms (+ 7.26%) 71ms 76ms
Req 4 - navto 228ms (± 0.87%) 216ms (± 0.62%) 🟩-12ms (- 5.35%) 213ms 218ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 273ms (± 1.53%) 272ms (± 0.77%) -0ms (- 0.07%) 269ms 279ms
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

Developer Information:

Download Benchmark

@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 12, 2022

Heya @jakebailey, I've started to run the perf test suite on this PR at dc36aed. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 352,840k (± 0.02%) 337,835k (± 0.01%) 🟩-15,005k (- 4.25%) 337,692k 337,904k
Parse Time 1.55s (± 0.32%) 1.54s (± 0.53%) -0.00s (- 0.19%) 1.53s 1.56s
Bind Time 0.61s (± 0.77%) 0.53s (± 0.84%) 🟩-0.08s (-13.44%) 0.52s 0.54s
Check Time 4.40s (± 0.72%) 3.99s (± 0.32%) 🟩-0.42s (- 9.44%) 3.96s 4.02s
Emit Time 4.94s (± 0.67%) 4.24s (± 0.83%) 🟩-0.70s (-14.15%) 4.19s 4.35s
Total Time 11.50s (± 0.57%) 10.30s (± 0.37%) 🟩-1.20s (-10.45%) 10.23s 10.42s
Compiler-Unions - node (v18.10.0, x64)
Memory used 200,062k (± 0.84%) 184,994k (± 1.13%) 🟩-15,068k (- 7.53%) 182,138k 187,957k
Parse Time 0.61s (± 0.78%) 0.61s (± 1.01%) +0.00s (+ 0.66%) 0.60s 0.62s
Bind Time 0.36s (± 0.62%) 0.32s (± 0.92%) 🟩-0.04s (-10.31%) 0.32s 0.33s
Check Time 5.38s (± 0.41%) 5.03s (± 0.53%) 🟩-0.35s (- 6.51%) 4.97s 5.10s
Emit Time 1.82s (± 0.80%) 1.52s (± 1.16%) 🟩-0.31s (-16.89%) 1.47s 1.55s
Total Time 8.17s (± 0.32%) 7.47s (± 0.30%) 🟩-0.69s (- 8.45%) 7.41s 7.51s
Monaco - node (v18.10.0, x64)
Memory used 331,714k (± 0.02%) 318,112k (± 0.02%) 🟩-13,602k (- 4.10%) 318,007k 318,212k
Parse Time 1.17s (± 0.51%) 1.19s (± 1.62%) +0.02s (+ 1.72%) 1.14s 1.23s
Bind Time 0.56s (± 1.00%) 0.48s (± 0.83%) 🟩-0.08s (-14.16%) 0.47s 0.49s
Check Time 4.29s (± 0.40%) 3.83s (± 0.47%) 🟩-0.46s (-10.67%) 3.79s 3.88s
Emit Time 2.61s (± 0.41%) 2.24s (± 0.43%) 🟩-0.38s (-14.38%) 2.21s 2.26s
Total Time 8.62s (± 0.31%) 7.73s (± 0.29%) 🟩-0.89s (-10.37%) 7.68s 7.78s
TFS - node (v18.10.0, x64)
Memory used 294,678k (± 0.01%) 281,120k (± 0.16%) 🟩-13,558k (- 4.60%) 280,759k 282,888k
Parse Time 0.94s (± 0.78%) 0.96s (± 1.34%) +0.02s (+ 2.35%) 0.93s 0.99s
Bind Time 0.59s (± 3.65%) 0.44s (± 0.51%) 🟩-0.15s (-25.00%) 0.44s 0.45s
Check Time 4.01s (± 0.55%) 3.80s (± 0.71%) 🟩-0.20s (- 5.09%) 3.74s 3.87s
Emit Time 2.62s (± 0.54%) 2.18s (± 0.98%) 🟩-0.44s (-16.76%) 2.14s 2.24s
Total Time 8.15s (± 0.47%) 7.38s (± 0.46%) 🟩-0.77s (- 9.43%) 7.32s 7.47s
material-ui - node (v18.10.0, x64)
Memory used 439,978k (± 0.01%) 426,112k (± 0.02%) 🟩-13,866k (- 3.15%) 425,969k 426,239k
Parse Time 1.35s (± 0.59%) 1.36s (± 0.71%) +0.01s (+ 0.82%) 1.34s 1.38s
Bind Time 0.44s (± 0.82%) 0.40s (± 1.44%) 🟩-0.04s (- 9.91%) 0.39s 0.41s
Check Time 10.86s (± 0.56%) 10.09s (± 0.61%) 🟩-0.77s (- 7.11%) 9.96s 10.21s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 12.65s (± 0.54%) 11.85s (± 0.54%) 🟩-0.80s (- 6.35%) 11.72s 11.99s
xstate - node (v18.10.0, x64)
Memory used 556,574k (± 0.01%) 511,592k (± 0.01%) 🟩-44,981k (- 8.08%) 511,479k 511,786k
Parse Time 1.92s (± 0.47%) 1.90s (± 0.31%) -0.02s (- 0.78%) 1.89s 1.92s
Bind Time 0.68s (± 1.95%) 0.73s (± 3.06%) +0.05s (+ 7.03%) 0.68s 0.78s
Check Time 1.10s (± 0.69%) 1.03s (± 0.43%) 🟩-0.08s (- 6.97%) 1.02s 1.04s
Emit Time 0.06s (± 0.00%) 0.05s (± 0.00%) 🟩-0.01s (-16.67%) 0.05s 0.05s
Total Time 3.76s (± 0.33%) 3.71s (± 0.73%) -0.05s (- 1.35%) 3.64s 3.77s
Angular - node (v16.17.1, x64)
Memory used 352,334k (± 0.02%) 337,220k (± 0.02%) 🟩-15,114k (- 4.29%) 337,043k 337,286k
Parse Time 1.89s (± 0.46%) 1.86s (± 0.37%) -0.04s (- 1.90%) 1.84s 1.87s
Bind Time 0.74s (± 0.78%) 0.65s (± 0.73%) 🟩-0.10s (-12.92%) 0.64s 0.66s
Check Time 5.69s (± 0.73%) 5.13s (± 0.33%) 🟩-0.56s (- 9.77%) 5.10s 5.18s
Emit Time 6.08s (± 0.66%) 5.03s (± 0.70%) 🟩-1.05s (-17.31%) 4.97s 5.13s
Total Time 14.41s (± 0.57%) 12.67s (± 0.33%) 🟩-1.74s (-12.11%) 12.60s 12.79s
Compiler-Unions - node (v16.17.1, x64)
Memory used 198,279k (± 0.57%) 184,753k (± 0.62%) 🟩-13,526k (- 6.82%) 183,675k 187,218k
Parse Time 0.79s (± 0.87%) 0.78s (± 0.63%) -0.01s (- 1.15%) 0.77s 0.79s
Bind Time 0.45s (± 1.09%) 0.41s (± 0.54%) 🟩-0.04s (- 9.47%) 0.41s 0.42s
Check Time 6.50s (± 0.50%) 6.01s (± 0.60%) 🟩-0.49s (- 7.60%) 5.95s 6.10s
Emit Time 2.31s (± 1.09%) 1.92s (± 0.84%) 🟩-0.39s (-16.78%) 1.89s 1.97s
Total Time 10.05s (± 0.50%) 9.12s (± 0.42%) 🟩-0.93s (- 9.24%) 9.02s 9.22s
Monaco - node (v16.17.1, x64)
Memory used 331,133k (± 0.02%) 317,414k (± 0.01%) 🟩-13,719k (- 4.14%) 317,351k 317,477k
Parse Time 1.42s (± 0.37%) 1.40s (± 0.60%) -0.02s (- 1.55%) 1.38s 1.42s
Bind Time 0.69s (± 0.86%) 0.60s (± 0.83%) 🟩-0.10s (-14.12%) 0.59s 0.61s
Check Time 5.47s (± 0.55%) 4.85s (± 0.31%) 🟩-0.63s (-11.47%) 4.82s 4.88s
Emit Time 3.26s (± 0.55%) 2.72s (± 0.56%) 🟩-0.54s (-16.72%) 2.69s 2.76s
Total Time 10.85s (± 0.44%) 9.56s (± 0.26%) 🟩-1.29s (-11.85%) 9.52s 9.64s
TFS - node (v16.17.1, x64)
Memory used 294,050k (± 0.02%) 280,321k (± 0.02%) 🟩-13,729k (- 4.67%) 280,105k 280,375k
Parse Time 1.22s (± 1.53%) 1.16s (± 1.15%) 🟩-0.05s (- 4.51%) 1.14s 1.20s
Bind Time 0.64s (± 0.97%) 0.54s (± 0.89%) 🟩-0.10s (-15.96%) 0.53s 0.55s
Check Time 5.12s (± 0.44%) 4.76s (± 0.62%) 🟩-0.36s (- 7.07%) 4.71s 4.84s
Emit Time 3.47s (± 0.64%) 2.73s (± 2.30%) 🟩-0.74s (-21.34%) 2.63s 2.86s
Total Time 10.45s (± 0.42%) 9.19s (± 0.74%) 🟩-1.26s (-12.04%) 9.08s 9.42s
material-ui - node (v16.17.1, x64)
Memory used 439,350k (± 0.01%) 425,352k (± 0.01%) 🟩-13,997k (- 3.19%) 425,284k 425,541k
Parse Time 1.72s (± 1.24%) 1.66s (± 1.13%) 🟩-0.06s (- 3.20%) 1.64s 1.73s
Bind Time 0.54s (± 0.69%) 0.48s (± 1.02%) 🟩-0.05s (- 9.53%) 0.47s 0.49s
Check Time 12.52s (± 0.62%) 11.56s (± 0.41%) 🟩-0.96s (- 7.70%) 11.47s 11.70s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.78s (± 0.53%) 13.71s (± 0.36%) 🟩-1.07s (- 7.23%) 13.62s 13.85s
xstate - node (v16.17.1, x64)
Memory used 554,310k (± 0.02%) 509,136k (± 0.00%) 🟩-45,174k (- 8.15%) 509,077k 509,170k
Parse Time 2.31s (± 0.28%) 2.30s (± 0.40%) -0.01s (- 0.43%) 2.28s 2.32s
Bind Time 0.89s (± 1.49%) 0.79s (± 0.73%) 🟩-0.10s (-10.90%) 0.78s 0.81s
Check Time 1.43s (± 0.92%) 1.36s (± 0.60%) 🟩-0.07s (- 4.55%) 1.35s 1.39s
Emit Time 0.07s (± 0.00%) 0.06s (± 0.00%) 🟩-0.01s (-14.29%) 0.06s 0.06s
Total Time 4.70s (± 0.23%) 4.52s (± 0.31%) 🟩-0.18s (- 3.85%) 4.48s 4.55s
Angular - node (v14.15.1, x64)
Memory used 346,620k (± 0.01%) 330,812k (± 0.01%) 🟩-15,808k (- 4.56%) 330,753k 330,859k
Parse Time 2.08s (± 1.31%) 2.04s (± 0.47%) -0.04s (- 2.02%) 2.02s 2.06s
Bind Time 0.80s (± 0.77%) 0.70s (± 0.52%) 🟩-0.10s (-12.11%) 0.70s 0.71s
Check Time 5.99s (± 0.53%) 5.49s (± 0.82%) 🟩-0.50s (- 8.33%) 5.42s 5.64s
Emit Time 6.33s (± 1.14%) 5.29s (± 0.92%) 🟩-1.04s (-16.44%) 5.21s 5.46s
Total Time 15.21s (± 0.60%) 13.53s (± 0.62%) 🟩-1.67s (-11.01%) 13.42s 13.76s
Compiler-Unions - node (v14.15.1, x64)
Memory used 190,802k (± 0.70%) 179,124k (± 0.41%) 🟩-11,678k (- 6.12%) 178,734k 182,090k
Parse Time 0.86s (± 0.88%) 0.89s (± 0.38%) +0.04s (+ 4.32%) 0.89s 0.90s
Bind Time 0.49s (± 0.96%) 0.46s (± 0.72%) 🟩-0.03s (- 6.12%) 0.45s 0.47s
Check Time 6.80s (± 0.56%) 6.30s (± 0.45%) 🟩-0.50s (- 7.35%) 6.25s 6.35s
Emit Time 2.42s (± 0.78%) 2.05s (± 0.78%) 🟩-0.38s (-15.49%) 2.01s 2.09s
Total Time 10.57s (± 0.45%) 9.70s (± 0.39%) 🟩-0.87s (- 8.27%) 9.64s 9.79s
Monaco - node (v14.15.1, x64)
Memory used 326,600k (± 0.01%) 312,189k (± 0.01%) 🟩-14,410k (- 4.41%) 312,120k 312,235k
Parse Time 1.59s (± 0.75%) 1.56s (± 0.88%) -0.02s (- 1.57%) 1.54s 1.60s
Bind Time 0.73s (± 0.65%) 0.64s (± 0.63%) 🟩-0.09s (-12.82%) 0.63s 0.65s
Check Time 5.78s (± 0.57%) 5.21s (± 0.45%) 🟩-0.56s (- 9.75%) 5.18s 5.26s
Emit Time 3.39s (± 0.79%) 2.88s (± 0.92%) 🟩-0.51s (-14.94%) 2.83s 2.95s
Total Time 11.48s (± 0.43%) 10.29s (± 0.47%) 🟩-1.19s (-10.33%) 10.19s 10.41s
TFS - node (v14.15.1, x64)
Memory used 289,690k (± 0.01%) 277,330k (± 0.01%) 🟩-12,360k (- 4.27%) 277,262k 277,409k
Parse Time 1.30s (± 0.63%) 1.31s (± 0.51%) +0.01s (+ 0.54%) 1.29s 1.32s
Bind Time 0.80s (± 0.59%) 0.59s (± 1.15%) 🟩-0.21s (-25.90%) 0.59s 0.62s
Check Time 5.41s (± 0.47%) 5.08s (± 0.43%) 🟩-0.33s (- 6.15%) 5.04s 5.12s
Emit Time 3.64s (± 0.84%) 3.01s (± 0.83%) 🟩-0.63s (-17.27%) 2.97s 3.07s
Total Time 11.16s (± 0.33%) 10.00s (± 0.40%) 🟩-1.16s (-10.36%) 9.95s 10.11s
material-ui - node (v14.15.1, x64)
Memory used 435,472k (± 0.01%) 420,820k (± 0.01%) 🟩-14,652k (- 3.36%) 420,774k 420,870k
Parse Time 1.87s (± 0.48%) 1.86s (± 0.51%) -0.01s (- 0.80%) 1.84s 1.88s
Bind Time 0.58s (± 0.63%) 0.53s (± 0.63%) 🟩-0.05s (- 9.40%) 0.52s 0.54s
Check Time 12.90s (± 0.61%) 12.09s (± 0.52%) 🟩-0.82s (- 6.32%) 11.96s 12.23s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 15.36s (± 0.55%) 14.48s (± 0.42%) 🟩-0.88s (- 5.75%) 14.35s 14.63s
xstate - node (v14.15.1, x64)
Memory used 543,377k (± 0.01%) 497,435k (± 0.01%) 🟩-45,941k (- 8.45%) 497,385k 497,513k
Parse Time 2.61s (± 0.56%) 2.63s (± 0.33%) +0.02s (+ 0.73%) 2.61s 2.65s
Bind Time 0.99s (± 0.70%) 0.82s (± 0.36%) 🟩-0.16s (-16.55%) 0.82s 0.83s
Check Time 1.53s (± 0.61%) 1.48s (± 0.64%) 🟩-0.05s (- 3.40%) 1.46s 1.50s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 5.20s (± 0.43%) 5.00s (± 0.30%) 🟩-0.20s (- 3.75%) 4.97s 5.04s
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

TSServer

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,066ms (± 0.48%) 1,040ms (± 0.46%) -26ms (- 2.41%) 1,029ms 1,050ms
Req 2 - geterr 2,723ms (± 0.55%) 2,489ms (± 0.83%) 🟩-234ms (- 8.59%) 2,449ms 2,555ms
Req 3 - references 192ms (± 1.48%) 164ms (± 0.38%) 🟩-27ms (-14.31%) 163ms 166ms
Req 4 - navto 145ms (± 1.23%) 138ms (± 0.32%) 🟩-8ms (- 5.16%) 137ms 139ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 44ms (± 1.86%) 67ms (±15.40%) 🔻+23ms (+50.90%) 48ms 91ms
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,134ms (± 0.73%) 1,100ms (± 0.40%) -34ms (- 2.99%) 1,090ms 1,108ms
Req 2 - geterr 1,609ms (± 0.46%) 1,499ms (± 0.37%) 🟩-110ms (- 6.86%) 1,484ms 1,514ms
Req 3 - references 198ms (± 0.93%) 169ms (± 0.80%) 🟩-29ms (-14.68%) 167ms 174ms
Req 4 - navto 165ms (± 6.32%) 150ms (± 0.64%) 🟩-16ms (- 9.56%) 147ms 151ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 84ms (±11.88%) 51ms (± 2.65%) 🟩-33ms (-39.40%) 48ms 54ms
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,614ms (± 0.55%) 1,544ms (± 0.58%) 🟩-70ms (- 4.32%) 1,527ms 1,569ms
Req 2 - geterr 585ms (± 0.39%) 550ms (± 0.63%) 🟩-35ms (- 5.99%) 544ms 558ms
Req 3 - references 54ms (± 1.88%) 58ms (± 4.25%) +4ms (+ 8.21%) 54ms 64ms
Req 4 - navto 202ms (± 0.74%) 199ms (± 1.31%) -3ms (- 1.34%) 195ms 207ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 215ms (± 1.89%) 210ms (± 1.35%) -5ms (- 2.37%) 204ms 218ms
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,327ms (± 0.51%) 1,283ms (± 0.45%) 🟩-44ms (- 3.34%) 1,267ms 1,296ms
Req 2 - geterr 3,303ms (± 0.63%) 3,080ms (± 0.69%) 🟩-223ms (- 6.76%) 3,028ms 3,122ms
Req 3 - references 222ms (± 1.20%) 196ms (± 1.20%) 🟩-26ms (-11.75%) 192ms 201ms
Req 4 - navto 158ms (± 1.04%) 149ms (± 0.87%) 🟩-9ms (- 5.89%) 146ms 151ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 68ms (±20.24%) 79ms (±19.97%) +11ms (+15.69%) 56ms 103ms
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,406ms (± 0.55%) 1,361ms (± 0.33%) 🟩-45ms (- 3.19%) 1,352ms 1,370ms
Req 2 - geterr 2,117ms (± 0.55%) 1,997ms (± 1.08%) 🟩-120ms (- 5.68%) 1,960ms 2,051ms
Req 3 - references 232ms (± 0.60%) 200ms (± 0.93%) 🟩-32ms (-13.68%) 197ms 205ms
Req 4 - navto 169ms (± 0.83%) 161ms (± 1.43%) 🟩-8ms (- 4.80%) 157ms 167ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 53ms (± 3.68%) 55ms (± 0.95%) +2ms (+ 4.17%) 54ms 56ms
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,927ms (± 0.52%) 1,841ms (± 0.77%) 🟩-86ms (- 4.45%) 1,819ms 1,875ms
Req 2 - geterr 737ms (± 0.59%) 696ms (± 0.35%) 🟩-41ms (- 5.54%) 691ms 701ms
Req 3 - references 61ms (± 1.45%) 65ms (± 3.41%) +4ms (+ 6.19%) 62ms 73ms
Req 4 - navto 204ms (± 0.88%) 196ms (± 0.83%) 🟩-8ms (- 4.02%) 193ms 199ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 258ms (± 0.60%) 257ms (± 1.39%) -1ms (- 0.35%) 251ms 266ms
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,455ms (± 0.57%) 1,449ms (± 0.60%) -6ms (- 0.41%) 1,429ms 1,467ms
Req 2 - geterr 3,550ms (± 0.91%) 3,321ms (± 0.43%) 🟩-229ms (- 6.45%) 3,287ms 3,361ms
Req 3 - references 233ms (± 0.49%) 206ms (± 0.78%) 🟩-27ms (-11.49%) 203ms 211ms
Req 4 - navto 171ms (± 0.60%) 161ms (± 0.85%) 🟩-10ms (- 5.91%) 158ms 164ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 59ms (± 6.06%) 62ms (± 7.12%) +3ms (+ 5.08%) 57ms 71ms
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,524ms (± 0.44%) 1,524ms (± 0.42%) +0ms (+ 0.03%) 1,509ms 1,537ms
Req 2 - geterr 2,334ms (± 0.54%) 2,207ms (± 0.49%) 🟩-127ms (- 5.45%) 2,184ms 2,229ms
Req 3 - references 245ms (± 0.47%) 214ms (± 1.24%) 🟩-31ms (-12.82%) 209ms 221ms
Req 4 - navto 181ms (± 0.45%) 173ms (± 0.46%) 🟩-8ms (- 4.15%) 171ms 175ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 55ms (± 1.35%) 70ms (± 1.80%) +14ms (+25.86%) 66ms 71ms
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,149ms (± 0.64%) 2,007ms (± 0.46%) 🟩-142ms (- 6.61%) 1,984ms 2,023ms
Req 2 - geterr 767ms (± 0.47%) 752ms (± 0.63%) -15ms (- 1.89%) 744ms 765ms
Req 3 - references 68ms (± 2.84%) 72ms (± 1.82%) +4ms (+ 6.52%) 70ms 75ms
Req 4 - navto 228ms (± 0.87%) 216ms (± 0.62%) 🟩-12ms (- 5.22%) 213ms 219ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 273ms (± 1.53%) 282ms (± 1.48%) +10ms (+ 3.48%) 270ms 287ms
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

Developer Information:

Download Benchmark

@jakebailey jakebailey closed this Oct 12, 2022
@jakebailey
Copy link
Member Author

esbuild vs esbuild + minify:

Here they are:

Metric esbuild esbuild + minify Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 341,514k
±0.01%
337,835k
±0.01%
-3,680k
-1.08%
337,692k 337,904k
Parse Time 1.55s
±0.74%
1.54s
±0.53%
-0.01s
-0.32%
1.53s 1.56s
Bind Time 0.53s
±0.76%
0.53s
±0.84%
-0.00s
-0.19%
0.52s 0.54s
Check Time 3.98s
±0.63%
3.99s
±0.32%
+0.01s
+0.18%
3.96s 4.02s
Emit Time 4.28s
±1.18%
4.24s
±0.83%
-0.04s
-0.96%
4.19s 4.35s
Total Time 10.34s
±0.66%
10.30s
±0.37%
-0.04s
-0.43%
10.23s 10.42s
Compiler-Unions - node (v18.10.0, x64)
Memory used 190,228k
±0.86%
184,994k
±1.13%
-5,234k
-2.75%
182,138k 187,957k
Parse Time 0.61s
±1.01%
0.61s
±1.01%
0.00s
0.00%
0.60s 0.62s
Bind Time 0.33s
±1.12%
0.32s
±0.92%
-0.00s
-1.23%
0.32s 0.33s
Check Time 4.98s
±0.30%
5.03s
±0.53%
+0.05s
+1.00%
4.97s 5.10s
Emit Time 1.52s
±1.38%
1.52s
±1.16%
-0.01s
-0.59%
1.47s 1.55s
Total Time 7.44s
±0.46%
7.47s
±0.30%
+0.04s
+0.51%
7.41s 7.51s
Monaco - node (v18.10.0, x64)
Memory used 321,779k
±0.01%
318,112k
±0.02%
-3,667k
-1.14%
318,007k 318,212k
Parse Time 1.16s
±1.07%
1.19s
±1.62%
+0.03s
+2.33%
1.14s 1.23s
Bind Time 0.50s
±1.55%
0.48s
±0.83%
-0.02s
-4.01%
0.47s 0.49s
Check Time 3.85s
±0.47%
3.83s
±0.47%
-0.03s
-0.70%
3.79s 3.88s
Emit Time 2.25s
±1.11%
2.24s
±0.43%
-0.02s
-0.71%
2.21s 2.26s
Total Time 7.77s
±0.59%
7.73s
±0.29%
-0.04s
-0.53%
7.68s 7.78s
TFS - node (v18.10.0, x64)
Memory used 285,602k
±0.26%
281,120k
±0.16%
-4,482k
-1.57%
280,759k 282,888k
Parse Time 0.96s
±1.38%
0.96s
±1.34%
-0.00s
-0.31%
0.93s 0.99s
Bind Time 0.45s
±0.82%
0.44s
±0.51%
-0.01s
-1.12%
0.44s 0.45s
Check Time 3.80s
±0.72%
3.80s
±0.71%
+0.00s
+0.11%
3.74s 3.87s
Emit Time 2.18s
±0.96%
2.18s
±0.98%
+0.00s
+0.05%
2.14s 2.24s
Total Time 7.39s
±0.64%
7.38s
±0.46%
-0.00s
-0.07%
7.32s 7.47s
material-ui - node (v18.10.0, x64)
Memory used 429,619k
±0.01%
426,112k
±0.02%
-3,507k
-0.82%
425,969k 426,239k
Parse Time 1.32s
±0.71%
1.36s
±0.71%
+0.04s
+2.95%
1.34s 1.38s
Bind Time 0.47s
±3.41%
0.40s
±1.44%
-0.07s
-15.07%
0.39s 0.41s
Check Time 10.15s
±0.88%
10.09s
±0.61%
-0.06s
-0.64%
9.96s 10.21s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 11.94s
±0.74%
11.85s
±0.54%
-0.10s
-0.80%
11.72s 11.99s
xstate - node (v18.10.0, x64)
Memory used 522,440k
±0.02%
511,592k
±0.01%
-10,848k
-2.08%
511,479k 511,786k
Parse Time 1.91s
±0.43%
1.90s
±0.31%
-0.00s
-0.16%
1.89s 1.92s
Bind Time 0.73s
±1.97%
0.73s
±3.06%
-0.00s
-0.14%
0.68s 0.78s
Check Time 1.04s
±0.57%
1.03s
±0.43%
-0.02s
-1.53%
1.02s 1.04s
Emit Time 0.05s
±6.42%
0.05s
±0.00%
-0.00s
-5.66%
0.05s 0.05s
Total Time 3.74s
±0.54%
3.71s
±0.73%
-0.03s
-0.75%
3.64s 3.77s
Angular - node (v16.17.1, x64)
Memory used 340,881k
±0.02%
337,220k
±0.02%
-3,661k
-1.07%
337,043k 337,286k
Parse Time 1.88s
±0.34%
1.86s
±0.37%
-0.02s
-1.17%
1.84s 1.87s
Bind Time 0.64s
±0.56%
0.65s
±0.73%
+0.00s
+0.47%
0.64s 0.66s
Check Time 5.12s
±0.49%
5.13s
±0.33%
+0.01s
+0.20%
5.10s 5.18s
Emit Time 5.08s
±0.82%
5.03s
±0.70%
-0.05s
-1.06%
4.97s 5.13s
Total Time 12.73s
±0.50%
12.67s
±0.33%
-0.07s
-0.52%
12.60s 12.79s
Compiler-Unions - node (v16.17.1, x64)
Memory used 189,060k
±0.66%
184,753k
±0.62%
-4,307k
-2.28%
183,675k 187,218k
Parse Time 0.79s
±1.13%
0.78s
±0.63%
-0.01s
-1.27%
0.77s 0.79s
Bind Time 0.41s
±1.15%
0.41s
±0.54%
-0.00s
-0.48%
0.41s 0.42s
Check Time 5.98s
±0.39%
6.01s
±0.60%
+0.03s
+0.42%
5.95s 6.10s
Emit Time 1.91s
±0.83%
1.92s
±0.84%
+0.01s
+0.37%
1.89s 1.97s
Total Time 9.10s
±0.32%
9.12s
±0.42%
+0.02s
+0.24%
9.02s 9.22s
Monaco - node (v16.17.1, x64)
Memory used 321,038k
±0.01%
317,414k
±0.01%
-3,624k
-1.13%
317,351k 317,477k
Parse Time 1.41s
±0.68%
1.40s
±0.60%
-0.01s
-0.50%
1.38s 1.42s
Bind Time 0.59s
±0.75%
0.60s
±0.83%
+0.00s
+0.68%
0.59s 0.61s
Check Time 4.86s
±0.66%
4.85s
±0.31%
-0.01s
-0.29%
4.82s 4.88s
Emit Time 2.73s
±0.83%
2.72s
±0.56%
-0.01s
-0.48%
2.69s 2.76s
Total Time 9.59s
±0.56%
9.56s
±0.26%
-0.02s
-0.24%
9.52s 9.64s
TFS - node (v16.17.1, x64)
Memory used 284,216k
±0.15%
280,321k
±0.02%
-3,894k
-1.37%
280,105k 280,375k
Parse Time 1.20s
±1.59%
1.16s
±1.15%
-0.04s
-3.24%
1.14s 1.20s
Bind Time 0.54s
±1.34%
0.54s
±0.89%
-0.00s
-0.92%
0.53s 0.55s
Check Time 4.79s
±0.30%
4.76s
±0.62%
-0.03s
-0.65%
4.71s 4.84s
Emit Time 2.72s
±2.40%
2.73s
±2.30%
+0.01s
+0.29%
2.63s 2.86s
Total Time 9.26s
±0.65%
9.19s
±0.74%
-0.07s
-0.73%
9.08s 9.42s
material-ui - node (v16.17.1, x64)
Memory used 428,993k
±0.02%
425,352k
±0.01%
-3,640k
-0.85%
425,284k 425,541k
Parse Time 1.62s
±0.46%
1.66s
±1.13%
+0.04s
+2.59%
1.64s 1.73s
Bind Time 0.52s
±1.12%
0.48s
±1.02%
-0.03s
-6.38%
0.47s 0.49s
Check Time 11.65s
±0.76%
11.56s
±0.41%
-0.09s
-0.77%
11.47s 11.70s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 13.79s
±0.66%
13.71s
±0.36%
-0.08s
-0.57%
13.62s 13.85s
xstate - node (v16.17.1, x64)
Memory used 520,028k
±0.01%
509,136k
±0.00%
-10,892k
-2.09%
509,077k 509,170k
Parse Time 2.31s
±0.39%
2.30s
±0.40%
-0.01s
-0.35%
2.28s 2.32s
Bind Time 0.84s
±1.53%
0.79s
±0.73%
-0.05s
-5.60%
0.78s 0.81s
Check Time 1.37s
±0.86%
1.36s
±0.60%
-0.01s
-0.44%
1.35s 1.39s
Emit Time 0.06s
±0.00%
0.06s
±0.00%
0.00s
0.00%
0.06s 0.06s
Total Time 4.58s
±0.57%
4.52s
±0.31%
-0.06s
-1.40%
4.48s 4.55s
Angular - node (v14.15.1, x64)
Memory used 334,464k
±0.01%
330,812k
±0.01%
-3,652k
-1.09%
330,753k 330,859k
Parse Time 2.04s
±0.57%
2.04s
±0.47%
+0.00s
+0.20%
2.02s 2.06s
Bind Time 0.70s
±0.64%
0.70s
±0.52%
+0.01s
+0.86%
0.70s 0.71s
Check Time 5.51s
±0.41%
5.49s
±0.82%
-0.02s
-0.29%
5.42s 5.64s
Emit Time 5.33s
±0.68%
5.29s
±0.92%
-0.04s
-0.73%
5.21s 5.46s
Total Time 13.57s
±0.41%
13.53s
±0.62%
-0.04s
-0.32%
13.42s 13.76s
Compiler-Unions - node (v14.15.1, x64)
Memory used 182,415k
±0.02%
179,124k
±0.41%
-3,291k
-1.80%
178,734k 182,090k
Parse Time 0.89s
±0.45%
0.89s
±0.38%
+0.00s
+0.22%
0.89s 0.90s
Bind Time 0.46s
±1.03%
0.46s
±0.72%
-0.00s
-0.65%
0.45s 0.47s
Check Time 6.31s
±0.45%
6.30s
±0.45%
-0.01s
-0.19%
6.25s 6.35s
Emit Time 2.06s
±1.11%
2.05s
±0.78%
-0.01s
-0.63%
2.01s 2.09s
Total Time 9.73s
±0.43%
9.70s
±0.39%
-0.03s
-0.31%
9.64s 9.79s
Monaco - node (v14.15.1, x64)
Memory used 315,985k
±0.01%
312,189k
±0.01%
-3,795k
-1.20%
312,120k 312,235k
Parse Time 1.57s
±0.45%
1.56s
±0.88%
-0.01s
-0.51%
1.54s 1.60s
Bind Time 0.64s
±1.10%
0.64s
±0.63%
0.00s
0.00%
0.63s 0.65s
Check Time 5.22s
±0.49%
5.21s
±0.45%
-0.01s
-0.15%
5.18s 5.26s
Emit Time 2.90s
±0.81%
2.88s
±0.92%
-0.02s
-0.83%
2.83s 2.95s
Total Time 10.33s
±0.45%
10.29s
±0.47%
-0.04s
-0.38%
10.19s 10.41s
TFS - node (v14.15.1, x64)
Memory used 281,050k
±0.01%
277,330k
±0.01%
-3,720k
-1.32%
277,262k 277,409k
Parse Time 1.34s
±1.73%
1.31s
±0.51%
-0.03s
-2.10%
1.29s 1.32s
Bind Time 0.59s
±0.50%
0.59s
±1.15%
+0.00s
+0.51%
0.59s 0.62s
Check Time 5.09s
±0.57%
5.08s
±0.43%
-0.01s
-0.27%
5.04s 5.12s
Emit Time 3.07s
±1.12%
3.01s
±0.83%
-0.05s
-1.79%
2.97s 3.07s
Total Time 10.09s
±0.61%
10.00s
±0.40%
-0.09s
-0.90%
9.95s 10.11s
material-ui - node (v14.15.1, x64)
Memory used 424,374k
±0.00%
420,820k
±0.01%
-3,554k
-0.84%
420,774k 420,870k
Parse Time 1.87s
±0.54%
1.86s
±0.51%
-0.01s
-0.75%
1.84s 1.88s
Bind Time 0.53s
±0.56%
0.53s
±0.63%
-0.00s
-0.38%
0.52s 0.54s
Check Time 12.08s
±0.56%
12.09s
±0.52%
+0.00s
+0.02%
11.96s 12.23s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 14.49s
±0.46%
14.48s
±0.42%
-0.01s
-0.08%
14.35s 14.63s
xstate - node (v14.15.1, x64)
Memory used 508,162k
±0.00%
497,435k
±0.01%
-10,727k
-2.11%
497,385k 497,513k
Parse Time 2.64s
±0.40%
2.63s
±0.33%
-0.01s
-0.57%
2.61s 2.65s
Bind Time 0.85s
±1.02%
0.82s
±0.36%
-0.03s
-3.07%
0.82s 0.83s
Check Time 1.48s
±0.58%
1.48s
±0.64%
-0.01s
-0.40%
1.46s 1.50s
Emit Time 0.07s
±0.00%
0.07s
±0.00%
0.00s
0.00%
0.07s 0.07s
Total Time 5.05s
±0.43%
5.00s
±0.30%
-0.05s
-0.91%
4.97s 5.04s

System

Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz

Hosts

  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)

Scenarios

  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)

Summary

Benchmark Name Iterations
Current 51153 10
Baseline 51153 10

esbuild vs esbuild + minify + keepNames:

Here they are:

Metric esbuild esbuild + minify + keepNames Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 341,514k
±0.01%
339,292k
±0.03%
-2,222k
-0.65%
338,999k 339,439k
Parse Time 1.55s
±0.74%
1.60s
±0.88%
+0.05s
+3.23%
1.57s 1.64s
Bind Time 0.53s
±0.76%
0.53s
±1.09%
+0.00s
+0.19%
0.52s 0.54s
Check Time 3.98s
±0.63%
4.46s
±0.33%
+0.47s
+11.93%
4.43s 4.49s
Emit Time 4.28s
±1.18%
4.32s
±0.62%
+0.04s
+0.86%
4.27s 4.40s
Total Time 10.34s
±0.66%
10.91s
±0.39%
+0.56s
+5.42%
10.84s 11.02s
Compiler-Unions - node (v18.10.0, x64)
Memory used 190,228k
±0.86%
187,201k
±1.01%
-3,027k
-1.59%
183,303k 188,972k
Parse Time 0.61s
±1.01%
0.63s
±0.80%
+0.01s
+2.29%
0.61s 0.63s
Bind Time 0.33s
±1.12%
0.33s
±0.89%
+0.01s
+1.84%
0.33s 0.34s
Check Time 4.98s
±0.30%
5.43s
±0.49%
+0.45s
+9.02%
5.37s 5.49s
Emit Time 1.52s
±1.38%
1.57s
±1.15%
+0.04s
+2.69%
1.54s 1.61s
Total Time 7.44s
±0.46%
7.94s
±0.45%
+0.51s
+6.79%
7.87s 8.04s
Monaco - node (v18.10.0, x64)
Memory used 321,779k
±0.01%
319,422k
±0.06%
-2,358k
-0.73%
319,194k 320,137k
Parse Time 1.16s
±1.07%
1.18s
±1.02%
+0.03s
+2.33%
1.16s 1.21s
Bind Time 0.50s
±1.55%
0.48s
±1.16%
-0.02s
-4.21%
0.47s 0.49s
Check Time 3.85s
±0.47%
4.29s
±0.44%
+0.43s
+11.18%
4.25s 4.32s
Emit Time 2.25s
±1.11%
2.24s
±0.72%
-0.01s
-0.62%
2.21s 2.27s
Total Time 7.77s
±0.59%
8.19s
±0.22%
+0.42s
+5.46%
8.15s 8.22s
TFS - node (v18.10.0, x64)
Memory used 285,602k
±0.26%
282,727k
±0.23%
-2,876k
-1.01%
281,968k 284,126k
Parse Time 0.96s
±1.38%
0.96s
±2.01%
+0.00s
+0.10%
0.93s 1.03s
Bind Time 0.45s
±0.82%
0.45s
±0.76%
+0.00s
+0.22%
0.44s 0.45s
Check Time 3.80s
±0.72%
4.29s
±0.65%
+0.49s
+12.82%
4.23s 4.37s
Emit Time 2.18s
±0.96%
2.21s
±0.84%
+0.03s
+1.19%
2.17s 2.25s
Total Time 7.39s
±0.64%
7.90s
±0.39%
+0.51s
+6.97%
7.86s 7.96s
material-ui - node (v18.10.0, x64)
Memory used 429,619k
±0.01%
427,462k
±0.01%
-2,157k
-0.50%
427,381k 427,625k
Parse Time 1.32s
±0.71%
1.39s
±0.93%
+0.07s
+5.00%
1.36s 1.42s
Bind Time 0.47s
±3.41%
0.46s
±3.93%
-0.01s
-1.70%
0.44s 0.51s
Check Time 10.15s
±0.88%
10.44s
±0.55%
+0.29s
+2.89%
10.34s 10.60s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 11.94s
±0.74%
12.30s
±0.41%
+0.35s
+2.96%
12.18s 12.42s
xstate - node (v18.10.0, x64)
Memory used 522,440k
±0.02%
515,160k
±0.01%
-7,280k
-1.39%
515,072k 515,308k
Parse Time 1.91s
±0.43%
2.00s
±0.49%
+0.09s
+4.77%
1.98s 2.02s
Bind Time 0.73s
±1.97%
0.70s
±1.17%
-0.04s
-4.78%
0.68s 0.72s
Check Time 1.04s
±0.57%
1.09s
±0.34%
+0.05s
+4.89%
1.09s 1.10s
Emit Time 0.05s
±6.42%
0.06s
±0.00%
+0.01s
+13.21%
0.06s 0.06s
Total Time 3.74s
±0.54%
3.85s
±0.35%
+0.11s
+2.97%
3.83s 3.88s
Angular - node (v16.17.1, x64)
Memory used 340,881k
±0.02%
338,704k
±0.02%
-2,176k
-0.64%
338,550k 338,776k
Parse Time 1.88s
±0.34%
1.93s
±0.89%
+0.05s
+2.88%
1.90s 1.97s
Bind Time 0.64s
±0.56%
0.64s
±0.87%
-0.01s
-0.93%
0.63s 0.65s
Check Time 5.12s
±0.49%
5.64s
±0.41%
+0.51s
+9.97%
5.59s 5.68s
Emit Time 5.08s
±0.82%
5.10s
±0.47%
+0.01s
+0.26%
5.05s 5.15s
Total Time 12.73s
±0.50%
13.30s
±0.26%
+0.57s
+4.48%
13.23s 13.38s
Compiler-Unions - node (v16.17.1, x64)
Memory used 189,060k
±0.66%
185,970k
±0.59%
-3,090k
-1.63%
184,970k 188,278k
Parse Time 0.79s
±1.13%
0.79s
±1.45%
+0.01s
+0.89%
0.77s 0.81s
Bind Time 0.41s
±1.15%
0.41s
±0.72%
-0.00s
-0.24%
0.41s 0.42s
Check Time 5.98s
±0.39%
6.44s
±0.53%
+0.46s
+7.69%
6.38s 6.54s
Emit Time 1.91s
±0.83%
1.93s
±0.46%
+0.01s
+0.68%
1.90s 1.94s
Total Time 9.10s
±0.32%
9.58s
±0.49%
+0.48s
+5.27%
9.49s 9.70s
Monaco - node (v16.17.1, x64)
Memory used 321,038k
±0.01%
318,670k
±0.01%
-2,368k
-0.74%
318,606k 318,717k
Parse Time 1.41s
±0.68%
1.42s
±0.71%
+0.02s
+1.35%
1.41s 1.46s
Bind Time 0.59s
±0.75%
0.60s
±1.14%
+0.00s
+0.68%
0.59s 0.62s
Check Time 4.86s
±0.66%
5.35s
±0.55%
+0.49s
+10.14%
5.30s 5.42s
Emit Time 2.73s
±0.83%
2.75s
±1.21%
+0.02s
+0.62%
2.69s 2.85s
Total Time 9.59s
±0.56%
10.12s
±0.59%
+0.53s
+5.56%
10.03s 10.28s
TFS - node (v16.17.1, x64)
Memory used 284,216k
±0.15%
281,502k
±0.02%
-2,714k
-0.95%
281,335k 281,577k
Parse Time 1.20s
±1.59%
1.19s
±1.68%
-0.02s
-1.33%
1.14s 1.25s
Bind Time 0.54s
±1.34%
0.55s
±4.95%
+0.01s
+1.85%
0.53s 0.66s
Check Time 4.79s
±0.30%
5.30s
±0.52%
+0.52s
+10.77%
5.27s 5.40s
Emit Time 2.72s
±2.40%
2.83s
±1.86%
+0.11s
+4.07%
2.71s 2.93s
Total Time 9.26s
±0.65%
9.88s
±0.62%
+0.62s
+6.64%
9.69s 10.00s
material-ui - node (v16.17.1, x64)
Memory used 428,993k
±0.02%
426,764k
±0.01%
-2,229k
-0.52%
426,704k 426,884k
Parse Time 1.62s
±0.46%
1.69s
±0.57%
+0.07s
+4.19%
1.67s 1.71s
Bind Time 0.52s
±1.12%
0.52s
±1.19%
+0.00s
+0.39%
0.51s 0.53s
Check Time 11.65s
±0.76%
11.99s
±0.53%
+0.34s
+2.92%
11.87s 12.14s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 13.79s
±0.66%
14.20s
±0.43%
+0.41s
+2.97%
14.07s 14.34s
xstate - node (v16.17.1, x64)
Memory used 520,028k
±0.01%
512,814k
±0.02%
-7,214k
-1.39%
512,657k 513,042k
Parse Time 2.31s
±0.39%
2.40s
±0.37%
+0.10s
+4.25%
2.39s 2.43s
Bind Time 0.84s
±1.53%
0.85s
±1.09%
+0.01s
+0.95%
0.82s 0.86s
Check Time 1.37s
±0.86%
1.43s
±0.42%
+0.06s
+4.16%
1.41s 1.44s
Emit Time 0.06s
±0.00%
0.07s
±0.00%
+0.01s
+16.67%
0.07s 0.07s
Total Time 4.58s
±0.57%
4.74s
±0.31%
+0.16s
+3.56%
4.72s 4.78s
Angular - node (v14.15.1, x64)
Memory used 334,464k
±0.01%
332,332k
±0.01%
-2,132k
-0.64%
332,248k 332,395k
Parse Time 2.04s
±0.57%
2.08s
±0.55%
+0.05s
+2.26%
2.06s 2.11s
Bind Time 0.70s
±0.64%
0.70s
±0.57%
+0.00s
+0.14%
0.69s 0.71s
Check Time 5.51s
±0.41%
6.00s
±0.47%
+0.49s
+8.86%
5.96s 6.07s
Emit Time 5.33s
±0.68%
5.37s
±0.69%
+0.04s
+0.68%
5.29s 5.46s
Total Time 13.57s
±0.41%
14.15s
±0.31%
+0.57s
+4.20%
14.05s 14.25s
Compiler-Unions - node (v14.15.1, x64)
Memory used 182,415k
±0.02%
180,075k
±0.01%
-2,339k
-1.28%
180,027k 180,144k
Parse Time 0.89s
±0.45%
0.91s
±0.77%
+0.02s
+2.02%
0.90s 0.93s
Bind Time 0.46s
±1.03%
0.46s
±0.80%
-0.01s
-1.51%
0.45s 0.46s
Check Time 6.31s
±0.45%
6.74s
±0.50%
+0.43s
+6.79%
6.67s 6.81s
Emit Time 2.06s
±1.11%
2.07s
±0.60%
+0.01s
+0.39%
2.04s 2.09s
Total Time 9.73s
±0.43%
10.18s
±0.47%
+0.45s
+4.66%
10.09s 10.29s
Monaco - node (v14.15.1, x64)
Memory used 315,985k
±0.01%
313,546k
±0.01%
-2,438k
-0.77%
313,518k 313,585k
Parse Time 1.57s
±0.45%
1.57s
±0.33%
0.00s
0.00%
1.56s 1.58s
Bind Time 0.64s
±1.10%
0.64s
±0.53%
-0.00s
-0.31%
0.63s 0.64s
Check Time 5.22s
±0.49%
5.67s
±0.47%
+0.45s
+8.66%
5.64s 5.76s
Emit Time 2.90s
±0.81%
2.90s
±0.74%
-0.00s
-0.17%
2.85s 2.96s
Total Time 10.33s
±0.45%
10.78s
±0.31%
+0.45s
+4.32%
10.68s 10.84s
TFS - node (v14.15.1, x64)
Memory used 281,050k
±0.01%
278,586k
±0.01%
-2,465k
-0.88%
278,530k 278,638k
Parse Time 1.34s
±1.73%
1.30s
±0.45%
-0.03s
-2.40%
1.29s 1.32s
Bind Time 0.59s
±0.50%
0.59s
±0.84%
-0.01s
-1.01%
0.58s 0.60s
Check Time 5.09s
±0.57%
5.57s
±0.39%
+0.48s
+9.34%
5.53s 5.62s
Emit Time 3.07s
±1.12%
3.05s
±0.90%
-0.02s
-0.52%
2.99s 3.13s
Total Time 10.09s
±0.61%
10.51s
±0.47%
+0.42s
+4.18%
10.41s 10.63s
material-ui - node (v14.15.1, x64)
Memory used 424,374k
±0.00%
422,229k
±0.00%
-2,145k
-0.51%
422,213k 422,263k
Parse Time 1.87s
±0.54%
1.92s
±0.60%
+0.05s
+2.61%
1.90s 1.95s
Bind Time 0.53s
±0.56%
0.53s
±0.63%
-0.00s
-0.38%
0.52s 0.54s
Check Time 12.08s
±0.56%
12.42s
±0.41%
+0.34s
+2.79%
12.29s 12.51s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 14.49s
±0.46%
14.87s
±0.39%
+0.38s
+2.62%
14.73s 14.98s
xstate - node (v14.15.1, x64)
Memory used 508,162k
±0.00%
501,208k
±0.01%
-6,954k
-1.37%
501,144k 501,257k
Parse Time 2.64s
±0.40%
2.75s
±0.51%
+0.11s
+4.05%
2.72s 2.79s
Bind Time 0.85s
±1.02%
0.82s
±0.46%
-0.03s
-3.89%
0.81s 0.82s
Check Time 1.48s
±0.58%
1.53s
±0.49%
+0.05s
+3.44%
1.52s 1.55s
Emit Time 0.07s
±0.00%
0.07s
±0.00%
0.00s
0.00%
0.07s 0.07s
Total Time 5.05s
±0.43%
5.17s
±0.27%
+0.12s
+2.42%
5.16s 5.22s

System

Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz

Hosts

  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)

Scenarios

  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)

Summary

Benchmark Name Iterations
Current 51153 10
Baseline 51153 10

@jakebailey
Copy link
Member Author

Minifying provides a slight speedup, but keeping the names for stack traces makes it a good bit slower.

@jakebailey jakebailey reopened this Oct 13, 2022
@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 13, 2022

Heya @jakebailey, I've started to run the perf test suite on this PR at 2382b93. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 352,840k (± 0.02%) 339,949k (± 0.02%) 🟩-12,891k (- 3.65%) 339,736k 340,051k
Parse Time 1.55s (± 0.32%) 1.55s (± 0.53%) +0.01s (+ 0.52%) 1.54s 1.57s
Bind Time 0.61s (± 0.77%) 0.53s (± 1.09%) 🟩-0.08s (-13.11%) 0.52s 0.55s
Check Time 4.40s (± 0.72%) 4.02s (± 0.71%) 🟩-0.39s (- 8.79%) 3.97s 4.09s
Emit Time 4.94s (± 0.67%) 4.31s (± 0.86%) 🟩-0.63s (-12.83%) 4.23s 4.41s
Total Time 11.50s (± 0.57%) 10.41s (± 0.52%) 🟩-1.09s (- 9.49%) 10.29s 10.51s
Compiler-Unions - node (v18.10.0, x64)
Memory used 200,062k (± 0.84%) 188,754k (± 0.87%) 🟩-11,308k (- 5.65%) 184,320k 190,079k
Parse Time 0.61s (± 0.78%) 0.61s (± 0.85%) +0.00s (+ 0.66%) 0.60s 0.62s
Bind Time 0.36s (± 0.62%) 0.33s (± 0.91%) 🟩-0.03s (- 8.64%) 0.32s 0.33s
Check Time 5.38s (± 0.41%) 5.00s (± 0.69%) 🟩-0.37s (- 6.92%) 4.94s 5.09s
Emit Time 1.82s (± 0.80%) 1.53s (± 0.79%) 🟩-0.30s (-16.28%) 1.49s 1.55s
Total Time 8.17s (± 0.32%) 7.47s (± 0.40%) 🟩-0.70s (- 8.52%) 7.41s 7.55s
Monaco - node (v18.10.0, x64)
Memory used 331,714k (± 0.02%) 320,266k (± 0.01%) 🟩-11,448k (- 3.45%) 320,145k 320,363k
Parse Time 1.17s (± 0.51%) 1.17s (± 1.18%) +0.00s (+ 0.09%) 1.13s 1.19s
Bind Time 0.56s (± 1.00%) 0.48s (± 1.08%) 🟩-0.08s (-13.80%) 0.47s 0.49s
Check Time 4.29s (± 0.40%) 3.83s (± 0.54%) 🟩-0.45s (-10.62%) 3.79s 3.89s
Emit Time 2.61s (± 0.41%) 2.24s (± 0.88%) 🟩-0.37s (-14.23%) 2.21s 2.29s
Total Time 8.62s (± 0.31%) 7.72s (± 0.42%) 🟩-0.90s (-10.45%) 7.67s 7.80s
TFS - node (v18.10.0, x64)
Memory used 294,678k (± 0.01%) 283,872k (± 0.25%) 🟩-10,806k (- 3.67%) 282,931k 285,236k
Parse Time 0.94s (± 0.78%) 0.96s (± 1.50%) +0.02s (+ 2.13%) 0.93s 1.00s
Bind Time 0.59s (± 3.65%) 0.45s (± 1.35%) 🟩-0.14s (-24.32%) 0.43s 0.46s
Check Time 4.01s (± 0.55%) 3.80s (± 0.72%) 🟩-0.20s (- 5.07%) 3.75s 3.87s
Emit Time 2.62s (± 0.54%) 2.19s (± 0.78%) 🟩-0.43s (-16.45%) 2.15s 2.23s
Total Time 8.15s (± 0.47%) 7.39s (± 0.40%) 🟩-0.76s (- 9.31%) 7.34s 7.45s
material-ui - node (v18.10.0, x64)
Memory used 439,978k (± 0.01%) 428,025k (± 0.01%) -11,953k (- 2.72%) 427,982k 428,086k
Parse Time 1.35s (± 0.59%) 1.33s (± 0.63%) -0.02s (- 1.71%) 1.31s 1.35s
Bind Time 0.44s (± 0.82%) 0.43s (± 2.61%) 🟩-0.02s (- 4.05%) 0.40s 0.45s
Check Time 10.86s (± 0.56%) 10.16s (± 0.75%) 🟩-0.70s (- 6.43%) 10.02s 10.38s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 12.65s (± 0.54%) 11.91s (± 0.68%) 🟩-0.74s (- 5.85%) 11.77s 12.14s
xstate - node (v18.10.0, x64)
Memory used 556,574k (± 0.01%) 517,850k (± 0.01%) 🟩-38,724k (- 6.96%) 517,718k 517,995k
Parse Time 1.92s (± 0.47%) 1.90s (± 0.25%) -0.02s (- 1.15%) 1.89s 1.91s
Bind Time 0.68s (± 1.95%) 0.77s (± 3.80%) +0.09s (+13.18%) 0.71s 0.82s
Check Time 1.10s (± 0.69%) 1.04s (± 0.72%) 🟩-0.07s (- 6.15%) 1.02s 1.05s
Emit Time 0.06s (± 0.00%) 0.05s (± 0.00%) 🟩-0.01s (-16.67%) 0.05s 0.05s
Total Time 3.76s (± 0.33%) 3.76s (± 0.64%) -0.01s (- 0.16%) 3.70s 3.80s
Angular - node (v16.17.1, x64)
Memory used 352,334k (± 0.02%) 339,395k (± 0.01%) 🟩-12,939k (- 3.67%) 339,333k 339,470k
Parse Time 1.89s (± 0.46%) 1.87s (± 0.54%) -0.03s (- 1.37%) 1.85s 1.90s
Bind Time 0.74s (± 0.78%) 0.64s (± 0.46%) 🟩-0.10s (-13.59%) 0.64s 0.65s
Check Time 5.69s (± 0.73%) 5.13s (± 0.70%) 🟩-0.56s (- 9.82%) 5.06s 5.25s
Emit Time 6.08s (± 0.66%) 5.10s (± 1.11%) 🟩-0.98s (-16.11%) 4.97s 5.27s
Total Time 14.41s (± 0.57%) 12.74s (± 0.63%) 🟩-1.67s (-11.59%) 12.61s 13.01s
Compiler-Unions - node (v16.17.1, x64)
Memory used 198,279k (± 0.57%) 186,829k (± 0.61%) 🟩-11,450k (- 5.77%) 185,712k 189,255k
Parse Time 0.79s (± 0.87%) 0.78s (± 0.71%) -0.00s (- 0.38%) 0.77s 0.79s
Bind Time 0.45s (± 1.09%) 0.41s (± 0.88%) 🟩-0.04s (- 8.81%) 0.41s 0.42s
Check Time 6.50s (± 0.50%) 5.96s (± 0.54%) 🟩-0.54s (- 8.32%) 5.89s 6.02s
Emit Time 2.31s (± 1.09%) 1.90s (± 0.81%) 🟩-0.41s (-17.82%) 1.86s 1.92s
Total Time 10.05s (± 0.50%) 9.05s (± 0.36%) 🟩-0.99s (- 9.89%) 8.99s 9.14s
Monaco - node (v16.17.1, x64)
Memory used 331,133k (± 0.02%) 319,502k (± 0.01%) 🟩-11,631k (- 3.51%) 319,410k 319,560k
Parse Time 1.42s (± 0.37%) 1.41s (± 0.48%) -0.01s (- 0.99%) 1.40s 1.43s
Bind Time 0.69s (± 0.86%) 0.59s (± 0.68%) 🟩-0.10s (-14.84%) 0.58s 0.60s
Check Time 5.47s (± 0.55%) 4.84s (± 0.42%) 🟩-0.64s (-11.63%) 4.80s 4.89s
Emit Time 3.26s (± 0.55%) 2.69s (± 0.37%) 🟩-0.57s (-17.33%) 2.67s 2.72s
Total Time 10.85s (± 0.44%) 9.53s (± 0.22%) 🟩-1.32s (-12.13%) 9.50s 9.59s
TFS - node (v16.17.1, x64)
Memory used 294,050k (± 0.02%) 282,466k (± 0.02%) 🟩-11,584k (- 3.94%) 282,267k 282,523k
Parse Time 1.22s (± 1.53%) 1.20s (± 0.84%) -0.01s (- 1.23%) 1.19s 1.24s
Bind Time 0.64s (± 0.97%) 0.54s (± 0.74%) 🟩-0.10s (-15.65%) 0.53s 0.55s
Check Time 5.12s (± 0.44%) 4.78s (± 0.34%) 🟩-0.34s (- 6.70%) 4.73s 4.81s
Emit Time 3.47s (± 0.64%) 2.72s (± 1.95%) 🟩-0.75s (-21.54%) 2.65s 2.84s
Total Time 10.45s (± 0.42%) 9.25s (± 0.59%) 🟩-1.20s (-11.52%) 9.17s 9.37s
material-ui - node (v16.17.1, x64)
Memory used 439,350k (± 0.01%) 427,351k (± 0.01%) -11,999k (- 2.73%) 427,308k 427,402k
Parse Time 1.72s (± 1.24%) 1.63s (± 0.68%) 🟩-0.09s (- 5.23%) 1.61s 1.65s
Bind Time 0.54s (± 0.69%) 0.50s (± 0.95%) 🟩-0.03s (- 5.98%) 0.49s 0.51s
Check Time 12.52s (± 0.62%) 11.55s (± 0.25%) 🟩-0.98s (- 7.79%) 11.47s 11.61s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.78s (± 0.53%) 13.68s (± 0.20%) 🟩-1.10s (- 7.46%) 13.61s 13.75s
xstate - node (v16.17.1, x64)
Memory used 554,310k (± 0.02%) 515,367k (± 0.01%) 🟩-38,942k (- 7.03%) 515,242k 515,594k
Parse Time 2.31s (± 0.28%) 2.29s (± 0.33%) -0.02s (- 0.95%) 2.27s 2.30s
Bind Time 0.89s (± 1.49%) 0.83s (± 1.83%) 🟩-0.06s (- 6.29%) 0.81s 0.86s
Check Time 1.43s (± 0.92%) 1.36s (± 0.55%) 🟩-0.07s (- 4.76%) 1.35s 1.38s
Emit Time 0.07s (± 0.00%) 0.06s (± 0.00%) 🟩-0.01s (-14.29%) 0.06s 0.06s
Total Time 4.70s (± 0.23%) 4.54s (± 0.46%) 🟩-0.15s (- 3.26%) 4.50s 4.59s
Angular - node (v14.15.1, x64)
Memory used 346,620k (± 0.01%) 332,936k (± 0.00%) 🟩-13,684k (- 3.95%) 332,894k 332,968k
Parse Time 2.08s (± 1.31%) 2.03s (± 0.66%) -0.05s (- 2.35%) 2.02s 2.08s
Bind Time 0.80s (± 0.77%) 0.70s (± 0.57%) 🟩-0.10s (-12.48%) 0.69s 0.71s
Check Time 5.99s (± 0.53%) 5.50s (± 0.48%) 🟩-0.49s (- 8.23%) 5.45s 5.55s
Emit Time 6.33s (± 1.14%) 5.27s (± 0.52%) 🟩-1.06s (-16.79%) 5.21s 5.35s
Total Time 15.21s (± 0.60%) 13.50s (± 0.20%) 🟩-1.71s (-11.21%) 13.44s 13.56s
Compiler-Unions - node (v14.15.1, x64)
Memory used 190,802k (± 0.70%) 180,830k (± 0.02%) 🟩-9,972k (- 5.23%) 180,737k 180,882k
Parse Time 0.86s (± 0.88%) 0.89s (± 0.63%) +0.03s (+ 3.74%) 0.88s 0.90s
Bind Time 0.49s (± 0.96%) 0.46s (± 0.65%) 🟩-0.03s (- 6.53%) 0.45s 0.46s
Check Time 6.80s (± 0.56%) 6.30s (± 0.65%) 🟩-0.50s (- 7.35%) 6.23s 6.40s
Emit Time 2.42s (± 0.78%) 2.05s (± 0.52%) 🟩-0.37s (-15.16%) 2.04s 2.08s
Total Time 10.57s (± 0.45%) 9.70s (± 0.43%) 🟩-0.87s (- 8.22%) 9.61s 9.80s
Monaco - node (v14.15.1, x64)
Memory used 326,600k (± 0.01%) 314,429k (± 0.01%) 🟩-12,171k (- 3.73%) 314,381k 314,475k
Parse Time 1.59s (± 0.75%) 1.57s (± 0.64%) -0.02s (- 0.94%) 1.56s 1.60s
Bind Time 0.73s (± 0.65%) 0.64s (± 0.47%) 🟩-0.10s (-12.96%) 0.63s 0.64s
Check Time 5.78s (± 0.57%) 5.21s (± 0.46%) 🟩-0.57s (- 9.84%) 5.18s 5.27s
Emit Time 3.39s (± 0.79%) 2.89s (± 0.54%) 🟩-0.50s (-14.77%) 2.85s 2.93s
Total Time 11.48s (± 0.43%) 10.30s (± 0.28%) 🟩-1.18s (-10.24%) 10.25s 10.38s
TFS - node (v14.15.1, x64)
Memory used 289,690k (± 0.01%) 279,537k (± 0.01%) 🟩-10,153k (- 3.50%) 279,445k 279,591k
Parse Time 1.30s (± 0.63%) 1.33s (± 1.93%) +0.03s (+ 2.00%) 1.30s 1.41s
Bind Time 0.80s (± 0.59%) 0.59s (± 0.80%) 🟩-0.21s (-26.53%) 0.58s 0.60s
Check Time 5.41s (± 0.47%) 5.10s (± 0.59%) 🟩-0.32s (- 5.86%) 5.05s 5.17s
Emit Time 3.64s (± 0.84%) 3.06s (± 0.66%) 🟩-0.59s (-16.09%) 3.02s 3.12s
Total Time 11.16s (± 0.33%) 10.07s (± 0.56%) 🟩-1.08s (- 9.73%) 9.99s 10.25s
material-ui - node (v14.15.1, x64)
Memory used 435,472k (± 0.01%) 422,825k (± 0.00%) -12,647k (- 2.90%) 422,785k 422,849k
Parse Time 1.87s (± 0.48%) 1.87s (± 0.53%) -0.00s (- 0.11%) 1.86s 1.90s
Bind Time 0.58s (± 0.63%) 0.53s (± 0.84%) 🟩-0.06s (- 9.74%) 0.52s 0.54s
Check Time 12.90s (± 0.61%) 12.06s (± 0.22%) 🟩-0.84s (- 6.52%) 11.99s 12.12s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 15.36s (± 0.55%) 14.46s (± 0.22%) 🟩-0.90s (- 5.85%) 14.38s 14.53s
xstate - node (v14.15.1, x64)
Memory used 543,377k (± 0.01%) 503,591k (± 0.01%) 🟩-39,786k (- 7.32%) 503,530k 503,661k
Parse Time 2.61s (± 0.56%) 2.63s (± 0.68%) +0.02s (+ 0.88%) 2.59s 2.68s
Bind Time 0.99s (± 0.70%) 0.82s (± 0.58%) 🟩-0.16s (-16.45%) 0.81s 0.83s
Check Time 1.53s (± 0.61%) 1.48s (± 0.60%) 🟩-0.05s (- 3.40%) 1.46s 1.50s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 5.20s (± 0.43%) 5.01s (± 0.32%) 🟩-0.19s (- 3.66%) 4.97s 5.06s
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

TSServer

Comparison Report - main..51153
Metric main 51153 Delta Best Worst
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,066ms (± 0.48%) 1,039ms (± 0.35%) -27ms (- 2.50%) 1,031ms 1,047ms
Req 2 - geterr 2,723ms (± 0.55%) 2,492ms (± 0.66%) 🟩-231ms (- 8.49%) 2,462ms 2,539ms
Req 3 - references 192ms (± 1.48%) 165ms (± 0.79%) 🟩-27ms (-13.89%) 164ms 170ms
Req 4 - navto 145ms (± 1.23%) 138ms (± 1.03%) 🟩-8ms (- 5.30%) 136ms 143ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 44ms (± 1.86%) 51ms (± 6.28%) +7ms (+14.86%) 48ms 61ms
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,134ms (± 0.73%) 1,111ms (± 0.52%) -23ms (- 2.01%) 1,098ms 1,127ms
Req 2 - geterr 1,609ms (± 0.46%) 1,491ms (± 0.44%) 🟩-118ms (- 7.34%) 1,475ms 1,503ms
Req 3 - references 198ms (± 0.93%) 170ms (± 0.85%) 🟩-28ms (-14.08%) 169ms 175ms
Req 4 - navto 165ms (± 6.32%) 149ms (± 0.77%) 🟩-17ms (- 9.98%) 147ms 152ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 84ms (±11.88%) 51ms (± 2.68%) 🟩-33ms (-38.81%) 49ms 55ms
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,614ms (± 0.55%) 1,536ms (± 1.42%) 🟩-78ms (- 4.83%) 1,497ms 1,580ms
Req 2 - geterr 585ms (± 0.39%) 561ms (± 0.91%) 🟩-24ms (- 4.07%) 553ms 573ms
Req 3 - references 54ms (± 1.88%) 58ms (± 1.52%) +4ms (+ 8.21%) 57ms 61ms
Req 4 - navto 202ms (± 0.74%) 195ms (± 0.95%) 🟩-7ms (- 3.27%) 190ms 199ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 215ms (± 1.89%) 210ms (± 1.12%) -5ms (- 2.19%) 207ms 216ms
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,327ms (± 0.51%) 1,299ms (± 0.25%) -28ms (- 2.12%) 1,292ms 1,304ms
Req 2 - geterr 3,303ms (± 0.63%) 3,066ms (± 0.57%) 🟩-237ms (- 7.17%) 3,029ms 3,122ms
Req 3 - references 222ms (± 1.20%) 196ms (± 0.84%) 🟩-26ms (-11.70%) 192ms 199ms
Req 4 - navto 158ms (± 1.04%) 149ms (± 0.43%) 🟩-9ms (- 5.51%) 148ms 150ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 68ms (±20.24%) 60ms (± 2.38%) 🟩-8ms (-12.17%) 57ms 64ms
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,406ms (± 0.55%) 1,375ms (± 0.61%) -30ms (- 2.16%) 1,355ms 1,390ms
Req 2 - geterr 2,117ms (± 0.55%) 1,966ms (± 0.50%) 🟩-151ms (- 7.14%) 1,951ms 1,996ms
Req 3 - references 232ms (± 0.60%) 200ms (± 0.45%) 🟩-32ms (-13.89%) 197ms 201ms
Req 4 - navto 169ms (± 0.83%) 160ms (± 0.73%) 🟩-9ms (- 5.45%) 157ms 163ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 53ms (± 3.68%) 56ms (± 2.51%) +4ms (+ 6.83%) 54ms 61ms
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,927ms (± 0.52%) 1,836ms (± 0.48%) 🟩-91ms (- 4.70%) 1,817ms 1,853ms
Req 2 - geterr 737ms (± 0.59%) 701ms (± 0.77%) 🟩-37ms (- 4.95%) 691ms 713ms
Req 3 - references 61ms (± 1.45%) 67ms (± 1.60%) +6ms (+ 8.96%) 64ms 69ms
Req 4 - navto 204ms (± 0.88%) 195ms (± 0.65%) 🟩-9ms (- 4.27%) 193ms 199ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 258ms (± 0.60%) 261ms (± 1.22%) +3ms (+ 1.05%) 252ms 267ms
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,455ms (± 0.57%) 1,446ms (± 0.62%) -9ms (- 0.64%) 1,428ms 1,464ms
Req 2 - geterr 3,550ms (± 0.91%) 3,330ms (± 0.54%) 🟩-220ms (- 6.20%) 3,293ms 3,386ms
Req 3 - references 233ms (± 0.49%) 208ms (± 0.51%) 🟩-26ms (-11.02%) 206ms 210ms
Req 4 - navto 171ms (± 0.60%) 162ms (± 0.93%) 🟩-9ms (- 5.27%) 158ms 165ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 59ms (± 6.06%) 69ms (± 5.40%) +10ms (+17.26%) 58ms 73ms
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,524ms (± 0.44%) 1,525ms (± 0.56%) +1ms (+ 0.06%) 1,507ms 1,548ms
Req 2 - geterr 2,334ms (± 0.54%) 2,193ms (± 0.25%) 🟩-141ms (- 6.03%) 2,182ms 2,204ms
Req 3 - references 245ms (± 0.47%) 218ms (± 1.13%) 🟩-27ms (-11.18%) 213ms 222ms
Req 4 - navto 181ms (± 0.45%) 174ms (± 1.12%) 🟩-7ms (- 3.60%) 169ms 178ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 55ms (± 1.35%) 62ms (± 6.04%) +7ms (+12.30%) 56ms 71ms
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,149ms (± 0.64%) 2,023ms (± 0.58%) 🟩-127ms (- 5.89%) 2,001ms 2,050ms
Req 2 - geterr 767ms (± 0.47%) 753ms (± 0.63%) -14ms (- 1.77%) 746ms 765ms
Req 3 - references 68ms (± 2.84%) 72ms (± 1.41%) +4ms (+ 6.07%) 69ms 73ms
Req 4 - navto 228ms (± 0.87%) 217ms (± 0.59%) 🟩-11ms (- 4.70%) 215ms 220ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,146 (± 0.00%) -60 (- 1.87%) 3,146 3,146
Req 5 - completionInfo 273ms (± 1.53%) 274ms (± 0.60%) +1ms (+ 0.37%) 271ms 279ms
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 51153 10
Baseline main 10

Developer Information:

Download Benchmark

@jakebailey
Copy link
Member Author

esbuild vs esbuild + minifyWhitespace:

Here they are:

Metric A B Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 341,514k
±0.01%
339,949k
±0.02%
-1,566k
-0.46%
339,736k 340,051k
Parse Time 1.55s
±0.74%
1.55s
±0.53%
+0.01s
+0.39%
1.54s 1.57s
Bind Time 0.53s
±0.76%
0.53s
±1.09%
+0.00s
+0.19%
0.52s 0.55s
Check Time 3.98s
±0.63%
4.02s
±0.71%
+0.04s
+0.90%
3.97s 4.09s
Emit Time 4.28s
±1.18%
4.31s
±0.86%
+0.02s
+0.56%
4.23s 4.41s
Total Time 10.34s
±0.66%
10.41s
±0.52%
+0.07s
+0.64%
10.29s 10.51s
Compiler-Unions - node (v18.10.0, x64)
Memory used 190,228k
±0.86%
188,754k
±0.87%
-1,474k
-0.77%
184,320k 190,079k
Parse Time 0.61s
±1.01%
0.61s
±0.85%
0.00s
0.00%
0.60s 0.62s
Bind Time 0.33s
±1.12%
0.33s
±0.91%
+0.00s
+0.61%
0.32s 0.33s
Check Time 4.98s
±0.30%
5.00s
±0.69%
+0.03s
+0.56%
4.94s 5.09s
Emit Time 1.52s
±1.38%
1.53s
±0.79%
+0.00s
+0.13%
1.49s 1.55s
Total Time 7.44s
±0.46%
7.47s
±0.40%
+0.03s
+0.43%
7.41s 7.55s
Monaco - node (v18.10.0, x64)
Memory used 321,779k
±0.01%
320,266k
±0.01%
-1,513k
-0.47%
320,145k 320,363k
Parse Time 1.16s
±1.07%
1.17s
±1.18%
+0.01s
+0.69%
1.13s 1.19s
Bind Time 0.50s
±1.55%
0.48s
±1.08%
-0.02s
-3.61%
0.47s 0.49s
Check Time 3.85s
±0.47%
3.83s
±0.54%
-0.02s
-0.65%
3.79s 3.89s
Emit Time 2.25s
±1.11%
2.24s
±0.88%
-0.01s
-0.53%
2.21s 2.29s
Total Time 7.77s
±0.59%
7.72s
±0.42%
-0.05s
-0.62%
7.67s 7.80s
TFS - node (v18.10.0, x64)
Memory used 285,602k
±0.26%
283,872k
±0.25%
-1,730k
-0.61%
282,931k 285,236k
Parse Time 0.96s
±1.38%
0.96s
±1.50%
-0.01s
-0.52%
0.93s 1.00s
Bind Time 0.45s
±0.82%
0.45s
±1.35%
-0.00s
-0.22%
0.43s 0.46s
Check Time 3.80s
±0.72%
3.80s
±0.72%
+0.01s
+0.13%
3.75s 3.87s
Emit Time 2.18s
±0.96%
2.19s
±0.78%
+0.01s
+0.41%
2.15s 2.23s
Total Time 7.39s
±0.64%
7.39s
±0.40%
+0.00s
+0.07%
7.34s 7.45s
material-ui - node (v18.10.0, x64)
Memory used 429,619k
±0.01%
428,025k
±0.01%
-1,594k
-0.37%
427,982k 428,086k
Parse Time 1.32s
±0.71%
1.33s
±0.63%
+0.00s
+0.38%
1.31s 1.35s
Bind Time 0.47s
±3.41%
0.43s
±2.61%
-0.05s
-9.55%
0.40s 0.45s
Check Time 10.15s
±0.88%
10.16s
±0.75%
+0.01s
+0.09%
10.02s 10.38s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 11.94s
±0.74%
11.91s
±0.68%
-0.03s
-0.28%
11.77s 12.14s
xstate - node (v18.10.0, x64)
Memory used 522,440k
±0.02%
517,850k
±0.01%
-4,591k
-0.88%
517,718k 517,995k
Parse Time 1.91s
±0.43%
1.90s
±0.25%
-0.01s
-0.52%
1.89s 1.91s
Bind Time 0.73s
±1.97%
0.77s
±3.80%
+0.04s
+5.60%
0.71s 0.82s
Check Time 1.04s
±0.57%
1.04s
±0.72%
-0.01s
-0.67%
1.02s 1.05s
Emit Time 0.05s
±6.42%
0.05s
±0.00%
-0.00s
-5.66%
0.05s 0.05s
Total Time 3.74s
±0.54%
3.76s
±0.64%
+0.02s
+0.45%
3.70s 3.80s
Angular - node (v16.17.1, x64)
Memory used 340,881k
±0.02%
339,395k
±0.01%
-1,486k
-0.44%
339,333k 339,470k
Parse Time 1.88s
±0.34%
1.87s
±0.54%
-0.01s
-0.64%
1.85s 1.90s
Bind Time 0.64s
±0.56%
0.64s
±0.46%
-0.00s
-0.31%
0.64s 0.65s
Check Time 5.12s
±0.49%
5.13s
±0.70%
+0.01s
+0.14%
5.06s 5.25s
Emit Time 5.08s
±0.82%
5.10s
±1.11%
+0.02s
+0.37%
4.97s 5.27s
Total Time 12.73s
±0.50%
12.74s
±0.63%
+0.01s
+0.07%
12.61s 13.01s
Compiler-Unions - node (v16.17.1, x64)
Memory used 189,060k
±0.66%
186,829k
±0.61%
-2,232k
-1.18%
185,712k 189,255k
Parse Time 0.79s
±1.13%
0.78s
±0.71%
-0.00s
-0.51%
0.77s 0.79s
Bind Time 0.41s
±1.15%
0.41s
±0.88%
+0.00s
+0.24%
0.41s 0.42s
Check Time 5.98s
±0.39%
5.96s
±0.54%
-0.02s
-0.37%
5.89s 6.02s
Emit Time 1.91s
±0.83%
1.90s
±0.81%
-0.02s
-0.89%
1.86s 1.92s
Total Time 9.10s
±0.32%
9.05s
±0.36%
-0.04s
-0.48%
8.99s 9.14s
Monaco - node (v16.17.1, x64)
Memory used 321,038k
±0.01%
319,502k
±0.01%
-1,537k
-0.48%
319,410k 319,560k
Parse Time 1.41s
±0.68%
1.41s
±0.48%
+0.00s
+0.07%
1.40s 1.43s
Bind Time 0.59s
±0.75%
0.59s
±0.68%
-0.00s
-0.17%
0.58s 0.60s
Check Time 4.86s
±0.66%
4.84s
±0.42%
-0.02s
-0.47%
4.80s 4.89s
Emit Time 2.73s
±0.83%
2.69s
±0.37%
-0.03s
-1.21%
2.67s 2.72s
Total Time 9.59s
±0.56%
9.53s
±0.22%
-0.05s
-0.56%
9.50s 9.59s
TFS - node (v16.17.1, x64)
Memory used 284,216k
±0.15%
282,466k
±0.02%
-1,750k
-0.62%
282,267k 282,523k
Parse Time 1.20s
±1.59%
1.20s
±0.84%
+0.00s
+0.08%
1.19s 1.24s
Bind Time 0.54s
±1.34%
0.54s
±0.74%
-0.00s
-0.55%
0.53s 0.55s
Check Time 4.79s
±0.30%
4.78s
±0.34%
-0.01s
-0.25%
4.73s 4.81s
Emit Time 2.72s
±2.40%
2.72s
±1.95%
+0.00s
+0.04%
2.65s 2.84s
Total Time 9.26s
±0.65%
9.25s
±0.59%
-0.01s
-0.15%
9.17s 9.37s
material-ui - node (v16.17.1, x64)
Memory used 428,993k
±0.02%
427,351k
±0.01%
-1,642k
-0.38%
427,308k 427,402k
Parse Time 1.62s
±0.46%
1.63s
±0.68%
+0.01s
+0.43%
1.61s 1.65s
Bind Time 0.52s
±1.12%
0.50s
±0.95%
-0.01s
-2.71%
0.49s 0.51s
Check Time 11.65s
±0.76%
11.55s
±0.25%
-0.10s
-0.88%
11.47s 11.61s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 13.79s
±0.66%
13.68s
±0.20%
-0.11s
-0.81%
13.61s 13.75s
xstate - node (v16.17.1, x64)
Memory used 520,028k
±0.01%
515,367k
±0.01%
-4,661k
-0.90%
515,242k 515,594k
Parse Time 2.31s
±0.39%
2.29s
±0.33%
-0.02s
-0.87%
2.27s 2.30s
Bind Time 0.84s
±1.53%
0.83s
±1.83%
-0.01s
-0.71%
0.81s 0.86s
Check Time 1.37s
±0.86%
1.36s
±0.55%
-0.01s
-0.66%
1.35s 1.38s
Emit Time 0.06s
±0.00%
0.06s
±0.00%
0.00s
0.00%
0.06s 0.06s
Total Time 4.58s
±0.57%
4.54s
±0.46%
-0.04s
-0.79%
4.50s 4.59s
Angular - node (v14.15.1, x64)
Memory used 334,464k
±0.01%
332,936k
±0.00%
-1,528k
-0.46%
332,894k 332,968k
Parse Time 2.04s
±0.57%
2.03s
±0.66%
-0.00s
-0.15%
2.02s 2.08s
Bind Time 0.70s
±0.64%
0.70s
±0.57%
+0.00s
+0.43%
0.69s 0.71s
Check Time 5.51s
±0.41%
5.50s
±0.48%
-0.01s
-0.18%
5.45s 5.55s
Emit Time 5.33s
±0.68%
5.27s
±0.52%
-0.06s
-1.14%
5.21s 5.35s
Total Time 13.57s
±0.41%
13.50s
±0.20%
-0.07s
-0.55%
13.44s 13.56s
Compiler-Unions - node (v14.15.1, x64)
Memory used 182,415k
±0.02%
180,830k
±0.02%
-1,585k
-0.87%
180,737k 180,882k
Parse Time 0.89s
±0.45%
0.89s
±0.63%
-0.00s
-0.34%
0.88s 0.90s
Bind Time 0.46s
±1.03%
0.46s
±0.65%
-0.00s
-1.08%
0.45s 0.46s
Check Time 6.31s
±0.45%
6.30s
±0.65%
-0.01s
-0.19%
6.23s 6.40s
Emit Time 2.06s
±1.11%
2.05s
±0.52%
-0.01s
-0.24%
2.04s 2.08s
Total Time 9.73s
±0.43%
9.70s
±0.43%
-0.02s
-0.26%
9.61s 9.80s
Monaco - node (v14.15.1, x64)
Memory used 315,985k
±0.01%
314,429k
±0.01%
-1,556k
-0.49%
314,381k 314,475k
Parse Time 1.57s
±0.45%
1.57s
±0.64%
+0.00s
+0.13%
1.56s 1.60s
Bind Time 0.64s
±1.10%
0.64s
±0.47%
-0.00s
-0.16%
0.63s 0.64s
Check Time 5.22s
±0.49%
5.21s
±0.46%
-0.01s
-0.25%
5.18s 5.27s
Emit Time 2.90s
±0.81%
2.89s
±0.54%
-0.02s
-0.62%
2.85s 2.93s
Total Time 10.33s
±0.45%
10.30s
±0.28%
-0.03s
-0.28%
10.25s 10.38s
TFS - node (v14.15.1, x64)
Memory used 281,050k
±0.01%
279,537k
±0.01%
-1,514k
-0.54%
279,445k 279,591k
Parse Time 1.34s
±1.73%
1.33s
±1.93%
-0.01s
-0.67%
1.30s 1.41s
Bind Time 0.59s
±0.50%
0.59s
±0.80%
-0.00s
-0.34%
0.58s 0.60s
Check Time 5.09s
±0.57%
5.10s
±0.59%
+0.00s
+0.04%
5.05s 5.17s
Emit Time 3.07s
±1.12%
3.06s
±0.66%
-0.01s
-0.39%
3.02s 3.12s
Total Time 10.09s
±0.61%
10.07s
±0.56%
-0.02s
-0.20%
9.99s 10.25s
material-ui - node (v14.15.1, x64)
Memory used 424,374k
±0.00%
422,825k
±0.00%
-1,549k
-0.37%
422,785k 422,849k
Parse Time 1.87s
±0.54%
1.87s
±0.53%
-0.00s
-0.05%
1.86s 1.90s
Bind Time 0.53s
±0.56%
0.53s
±0.84%
-0.00s
-0.75%
0.52s 0.54s
Check Time 12.08s
±0.56%
12.06s
±0.22%
-0.02s
-0.18%
11.99s 12.12s
Emit Time 0.00s
±0.00%
0.00s
±0.00%
0.00s
NaN%
0.00s 0.00s
Total Time 14.49s
±0.46%
14.46s
±0.22%
-0.03s
-0.19%
14.38s 14.53s
xstate - node (v14.15.1, x64)
Memory used 508,162k
±0.00%
503,591k
±0.01%
-4,571k
-0.90%
503,530k 503,661k
Parse Time 2.64s
±0.40%
2.63s
±0.68%
-0.01s
-0.42%
2.59s 2.68s
Bind Time 0.85s
±1.02%
0.82s
±0.58%
-0.03s
-2.95%
0.81s 0.83s
Check Time 1.48s
±0.58%
1.48s
±0.60%
-0.01s
-0.40%
1.46s 1.50s
Emit Time 0.07s
±0.00%
0.07s
±0.00%
0.00s
0.00%
0.07s 0.07s
Total Time 5.05s
±0.43%
5.01s
±0.32%
-0.04s
-0.81%
4.97s 5.06s

System

Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz

Hosts

  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)

Scenarios

  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)

Summary

Benchmark Name Iterations
Current 51153 10
Baseline 51153 10

@jakebailey
Copy link
Member Author

No surprise, removing whitespace doesn't seem to change execution time in any meaningful way (but, does save us on space!)

@jakebailey jakebailey closed this Oct 13, 2022
@jakebailey jakebailey deleted the typeformer-2-minified branch October 20, 2022 17:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants