camelyon17 split scheme: in-dist

[thomaspzollo]

I am not able to run Camelyon17 with --split_scheme in-dist (I'm assuming this corresponds to the setting with ID val data).

Any pointers on how to run this, or in general how to run camelyon with the ID val data?

Thank you for the help!

[kohpangwei]

Hi Thomas,

We have two split_schemes defined for Camelyon17: https://github.com/p-lambda/wilds/blob/main/wilds/datasets/camelyon17_dataset.py#L22

If you're just trying to get results on ID val data, that should already be evaluated normally in the standard split. Could you give more details on what you're trying to do?