Integrating DINOv2 Backbone into Mask2Former for Semantic Segmentation

[hrishikeshps94]

@NielsRogge

Has anyone come across notebooks that can assist in integrating DINOv2 as the backbone for Mask2Former for semantic segmentation? I attempted this integration, but when configuring Mask2Former with the DINOv2 backbone, I encountered the following error:

ValueError: Unrecognized configuration class <class 'transformers.models.dinov2.configuration_dinov2.Dinov2Config'> for this kind of AutoModel: AutoBackbone. Model type should be one of BitConfig, ConvNextConfig, ConvNextV2Config, DinatConfig, FocalNetConfig, MaskFormerSwinConfig, NatConfig, ResNetConfig, SwinConfig, TimmBackboneConfig.

[hrishikeshps94]

@NielsRogge Should I wait till the PR get merged

[NielsRogge]

Yes :)

[hrishikeshps94]

Ok, Thank you for the prompt reply and confirmation.