LLaVA-NeXT-Video support

[AmazDeng]

Model description

The model to consider.
The llava-next-video project has already been released, and the test results are quite good. Are there any plans to support this project?

Currently, Hugging Face does not support this model.

Open source status

• The model implementation is available
• The model weights are available

Provide useful links for the implementation

https://github.com/LLaVA-VL/LLaVA-NeXT/blob/inference/docs/LLaVA-NeXT-Video.md

[zucchini-nlp]

Hey! LLava-NeXT-Video is planned to be added to transformers. See more here LLaVA-VL/LLaVA-NeXT#9 :)

[AmazDeng]

Hey! LLava-NeXT-Video is planned to be added to transformers. See more here LLaVA-VL/LLaVA-NeXT#9 :)

So is there an approximate point in time?

[zucchini-nlp]

I would say approximately mid of June. I will ping the authors to ask about the state of their next release as we've been getting a lot of requests to add this model. I'll give this model higher priority

[AmazDeng]

I would say approximately mid of June. I will ping the authors to ask about the state of their next release as we've been getting a lot of requests to add this model. I'll give this model higher priority

ok, thanks.