Implement planemo test --number 2

[frederikcoppens]

If you change one specific test, you want to only run that one specific tests, not all of them

[martenson]

this might be the same feature as @jmchilton meant with #257
We need more description from @jmchilton before we can decide though.

[peterjc]

This (#262) is picking tests by their index, e.g. the third test.

But #257 was just testing tests added since the last time any tests were run.

[jmchilton]

Yeah - I think this is actually even better than --new - given that any implementation of --new would be a little hacky.

[mblue9]

Choosing to run tests by number would be great! At the moment I work around it by copy/pasting out all the tests, adding in the new test (or tests I want to run), then once I've got the test(s) of interest working, copy/pasting back in the other tests.

[mvdbeek]

For this particular pattern you could also use --failed, but I agree that would be good.

[mvdbeek]

This would help with galaxyproject/galaxy-language-server#159. Some of the other testing scripts (galaxy-tool-tests from galaxy-tool-util) and planemo itself (via the failed tests option) support this, this would probably not be a large change.

[bernt-matthias]

Might this also be useful for balancing CI chunking even more: galaxyproject/tools-iuc#2959?