Ollama Reranker support

[drcrallen]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

The docs suggest that rerankers are not supported locally. The feature is not yet available under ollama but seems to be in active development. This issue is to track / link to the ollama issues.

Solution

Related Ollama feature issue ollama/ollama#3368 needs to be resolved, then any needed changes to Continue and the docs can be implemented.

[Patrick-Erichsen]

Thanks for creating this issue to track things @drcrallen ! Sounds like it's close to being merged in Ollama, excited to get this built.

We'll want to at least update these docs: https://docs.continue.dev/customize/model-providers/ollama#reranking-model

[malaki12003]

@sestinj FYI, I've just begun working on this ticket.

[malaki12003]

Just a quick update: I'm still awaiting official support from Ollama for the Ranker feature, as well as the addition of models to test and finalize my code: https://github.com/continuedev/continue/compare/dev...malaki12003:continue:ollama-reranker?expand=1

[magiusdarrigo]

Curious if there are any updates on this! Thanks

[Patrick-Erichsen]

@magiusdarrigo doesn't appear to be any updates on the upstream issue: ollama/ollama#3368