Do you really need MLJ dependency?

[ablaom]

I notice that CP takes a while to load/precompilel. I'd be surprised if you really need MLJ as a dependency. MLJ essentially just collects these components, and you probably don't need all of them:

• MLJBase
• MLJModels (maybe, if you use some then built-in transformers)
• MLJEnsembles (unlikely)
• MLJIteration (unlikely)
• MLJTuning

Ordinary model interfaces just need MLJModelInterface, which is very lightweight. But you will need MLJBase if you are using composite model tools like learning networks, pipelines, etc. And if you are extending measures (but this will ultimately move out). You need it for machines too, but I thought that was factored out now, yes?

[pat-alt]

Thanks for flagging this @ablaom, good point! And you're right, we don't need all of MLJ. In fact, we can probably do with just MMI.

The only thing (outside of measures) we currently rely on MLJBase for is cross-validation, e.g. here. It might be wiser to just implement CV from scratch, what do you think? Edit: Precompile is still very slow 😞

Have now removed MLJ as a dependency in b7c8b1b and will close once that's merged into main.

Thanks again!

[ablaom]

Resampling (eg, CV) is something else we've thought of moving out to a separate repo, so maybe leave the MLJBase dep for now.