Skip to content

πŸš€ Continue w/ Granite πŸ› οΈ A Continue fork supporting the Granite model series πŸ”„ Streaming and Chat implementations for the watsonx API specification

License

Notifications You must be signed in to change notification settings

austin0/continue-granite

Β 
Β 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸš€ Continue w/ Granite

πŸ› οΈ A Continue fork supporting the Granite model series

This repository started as an experimental side-project to integrate the open-source WatsonX Granite models into Continue

Initially a side-project to understand LLM implementations, it was later re-packaged to integrate with an internal model research tool

Upstream support for Granite via the watsonx provider API has since been implemented - this repository exists as an archive

  • πŸ€– Full implementation of the Granite model series with proper context handling and limits
  • πŸ“· Tailored onboarding flow for quick and easy configuration (below)
  • πŸ”„ Streaming and Chat implemenatations for the watsonx API specification
  • πŸ—οΈ Tokenizer and template modifications to enable streaming Granite responses
  • 🧩 Ollama model support for local Granite demonstration and testing
  • πŸ“Š Privacy-focused implementation with telemetry removal

Getting Started

UI Example 1 UI Example 2 UI Example 3 UI Example 4

Continue logo

Continue

Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

Chat

Chat makes it easy to ask for help from an LLM without needing to leave the IDE

chat

Autocomplete

Autocomplete provides inline code suggestions as you type

autocomplete

Edit

Edit is a convenient way to modify code without leaving your current file

edit

Actions

Actions are shortcuts for common use cases.

actions

Getting Started

Learn about how to install and use Continue in the docs here

Contributing

Check out the contribution ideas board, read the contributing guide, and join #contribute on Discord

License

Apache 2.0 Β© 2023-2024 Continue Dev, Inc.

About

πŸš€ Continue w/ Granite πŸ› οΈ A Continue fork supporting the Granite model series πŸ”„ Streaming and Chat implementations for the watsonx API specification

Resources

License

Code of conduct

Stars

Watchers

Forks

Languages

  • TypeScript 64.2%
  • JavaScript 22.3%
  • Kotlin 7.4%
  • Rust 2.3%
  • CSS 1.7%
  • Scheme 1.6%
  • Other 0.5%