Add support for custom checkpoints in MusicGen

[jla524]

What does this PR do?

Fixes #29873 (issue)

Add a new argument for custom checkpoint and pass it intoget_pretrained

Who can review?

@ElizavetaSedova and @ArthurZucker

[ArthurZucker]

IMO we just have to update the doc here no?

[ArthurZucker]

To mention that it can also be a path to a custom checkpoint

[jla524]

I think decoder_config_from_checkpoint will throw an error with a custom checkpoint

transformers/src/transformers/models/musicgen/convert_musicgen_transformers.py

Lines 105 to 109 in 3cc28d1

	raise ValueError(
	"Checkpoint should be one of `['small', 'medium', 'large']` for the mono checkpoints, "
	"or `['facebook/musicgen-stereo-small', 'facebook/musicgen-stereo-medium', 'facebook/musicgen-stereo-large']` "
	f"for the stereo checkpoints, got {checkpoint}."
	)

Is it possible to infer the config?

[ArthurZucker]

We can update that error as well, the conversion script is not meant to only support official checkpoints.

[jla524]

That makes sense. The script should be flexible enough to support all checkpoints. Can we expect the custom checkpoints to follow the same naming scheme? i.e. musicgen-stereo-[small|medium|large]

[ArthurZucker]

Hey! Can you make sure the CI is green and ping me again for a reveiw!

[jla524]

Hey @ArthurZucker! The CI is green now.

[ArthurZucker]

Delay but thanks for the PR! 🔥

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.