π Continue w/ Granite
π οΈ A Continue fork supporting the Granite model series
This repository started as an experimental side-project to integrate the open-source WatsonX Granite models into Continue
Initially a side-project to understand LLM implementations, it was later re-packaged to integrate with an internal model research tool
Upstream support for Granite via the watsonx provider API has since been implemented - this repository exists as an archive
- π€ Full implementation of the Granite model series with proper context handling and limits
- π· Tailored onboarding flow for quick and easy configuration (below)
- π Streaming and Chat implemenatations for the watsonx API specification
- ποΈ Tokenizer and template modifications to enable streaming Granite responses
- 𧩠Ollama model support for local Granite demonstration and testing
- π Privacy-focused implementation with telemetry removal
Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
Chat makes it easy to ask for help from an LLM without needing to leave the IDE
Autocomplete provides inline code suggestions as you type
Edit is a convenient way to modify code without leaving your current file
Actions are shortcuts for common use cases.
Learn about how to install and use Continue in the docs here
Check out the contribution ideas board, read the contributing guide, and join #contribute on Discord