WIP: ENH: Add performance benchmark CI builds

[thewtex]

No description provided.

[jhlegarreta]

Speechless. Awesome.

[kwrobot-v1]

Errors:

• Failed to run the checks: service error.

[thewtex]

Errors:

* Failed to run the checks: `service error`.

CC @bradking @mathstuf

[mathstuf]

Hmm. Seems we got a timeout on one of our queries.

Do: check

[thewtex]

/azp run ITK.macOS

[azure-pipelines]

No pipelines are associated with this pull request.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. Thank you for your contributions.

[hjmjohnson]

@thewtex This is now ready for updating (rebasing) and reconsidering!

[jhlegarreta]

Updated macOS version from 10.13:
c93e0c6#diff-c8d4e43125ff7fbe0d808694e0b2ab37de80808b1d9a54fed631330117d3cd4bR90

to macOS 11, and Python from 3.7 to 3.9:
c93e0c6#diff-c8d4e43125ff7fbe0d808694e0b2ab37de80808b1d9a54fed631330117d3cd4bR104

Preferred to avoid style changes to the existing parts, e.g.:
c93e0c6#diff-c8d4e43125ff7fbe0d808694e0b2ab37de80808b1d9a54fed631330117d3cd4bR8

Not sure if this will be enough to have this working.

If Azure allows to re-use workflows, cleanest would be to relocate the performance benchmarking part to a separate file so that the macOS build part can report its status regardless of the benchmarking part.

[jhlegarreta]

So the benchmarks add 22 minutes;
https://dev.azure.com/itkrobotmacos/ITK.macOS/_build/results?buildId=11489&view=logs&j=68e22afd-607b-5133-9236-337c135f0832

If this is deemed excessive, they could be triggered e.g. once or twice a week.

The next thing will be how to display those reports on a website.

[thewtex]

I started an ASV port on the ITKPerformanceBenchmarking repository. Eventually we should be able to run asv compare similar to what @yarikoptic did with datalad.

[yarikoptic]

FWIW we ran into some minor issues with recent asv and our setups, just in case you do too -- might want to restrict for now to < 0.6.2 and make sure that you have asv[virtualenv] in your setup*, as we did in https://github.com/con/fscacher/pull/91/files#diff-fa602a8a75dc9dcc92261bac5f533c2a85e34fcceaff63b3a3a81d9acde2fc52R49 which is yet another project of ours which does similar benchmarking on CI