Add nnbench.State
object holding current benchmark information, inject into setup/teardown tasks
#125
Labels
enhancement
New feature or request
We want to experiment with a global memoization cache, which we want to explicitly clear in a teardown task after a family of benchmarks for a model (say NER on distilbert) has run.
This means that the setup and teardown tasks need to know which benchmark they are currently applied in.
For a single benchmark, say
the corresponding
State
should look something like this:More metadata suggestions welcome. After this, we can try evicting a memo from the cache on the condition
family_index == family_size - 1
.The text was updated successfully, but these errors were encountered: