Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chore: Update in-app copy #4448

Merged
merged 14 commits into from
Jan 15, 2025
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
267 changes: 267 additions & 0 deletions docs/src/pages/docs/extensions.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,273 @@ Extensions are modular components that add functionality to Jan. Each extension

Extensions can be managed through **Settings** (<Settings width={16} height={16} style={{display:"inline"}}/>) > **Extensions**:

<<<<<<< HEAD
louis-menlo marked this conversation as resolved.
Show resolved Hide resolved
## List of Core Extensions
| Extension Name | Version | Description |
|---------------------|----------|-----------------------------------------------------------------------------|
| Jan Assistant | v1.0.1 | Powers the default AI assistant that works with all your installed models. |
| Conversational | v1.0.0 | Enables conversations and state persistence via your filesystem. |
| Model Management | v1.0.33 | Model Management Extension provides model exploration and seamless downloads |
| System Monitoring | v1.0.10 | Provides system health and OS level data. |


## Configure an Extension Settings

To configure an extension settings:

1. Navigate to the `~/jan/data/extensions`.
2. Open the `extensions.json` file
3. Edit the file with options including:

| Option | Description |
| ---------------- | ----------------------------------- |
| `_active` | Enable/disable the extension. |
| `listeners` | Default listener setting. |
| `origin` | Extension file path. |
| `installOptions` | Version and metadata configuration. |
| `name` | Extension name. |
| `productName` | Extension display name. |
| `version` | Extension version. |
| `main` | Main file path. |
| `description` | Extension description. |
| `url` | Extension URL. |

```json title="~/jan/data/extensions/extensions.json"
{
"@janhq/conversational-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-conversational-extension-1.0.0.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/conversational-extension",
"productName": "Conversational",
"version": "1.0.0",
"main": "dist/index.js",
"description": "Enables conversations and state persistence via your filesystem.",
"url": "extension://@janhq/conversational-extension/dist/index.js"
},
"@janhq/inference-anthropic-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-anthropic-extension-1.0.2.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-anthropic-extension",
"productName": "Anthropic Inference Engine",
"version": "1.0.2",
"main": "dist/index.js",
"description": "This extension enables Anthropic chat completion API calls",
"url": "extension://@janhq/inference-anthropic-extension/dist/index.js"
},
"@janhq/inference-triton-trt-llm-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-triton-trt-llm-extension-1.0.0.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-triton-trt-llm-extension",
"productName": "Triton-TRT-LLM Inference Engine",
"version": "1.0.0",
"main": "dist/index.js",
"description": "This extension enables Nvidia's TensorRT-LLM as an inference engine option",
"url": "extension://@janhq/inference-triton-trt-llm-extension/dist/index.js"
},
"@janhq/inference-mistral-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-mistral-extension-1.0.1.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-mistral-extension",
"productName": "MistralAI Inference Engine",
"version": "1.0.1",
"main": "dist/index.js",
"description": "This extension enables Mistral chat completion API calls",
"url": "extension://@janhq/inference-mistral-extension/dist/index.js"
},
"@janhq/inference-martian-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-martian-extension-1.0.1.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-martian-extension",
"productName": "Martian Inference Engine",
"version": "1.0.1",
"main": "dist/index.js",
"description": "This extension enables Martian chat completion API calls",
"url": "extension://@janhq/inference-martian-extension/dist/index.js"
},
"@janhq/inference-openrouter-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-openrouter-extension-1.0.0.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-openrouter-extension",
"productName": "OpenRouter Inference Engine",
"version": "1.0.0",
"main": "dist/index.js",
"description": "This extension enables Open Router chat completion API calls",
"url": "extension://@janhq/inference-openrouter-extension/dist/index.js"
},
"@janhq/inference-nvidia-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-nvidia-extension-1.0.1.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-nvidia-extension",
"productName": "NVIDIA NIM Inference Engine",
"version": "1.0.1",
"main": "dist/index.js",
"description": "This extension enables NVIDIA chat completion API calls",
"url": "extension://@janhq/inference-nvidia-extension/dist/index.js"
},
"@janhq/inference-groq-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-groq-extension-1.0.1.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-groq-extension",
"productName": "Groq Inference Engine",
"version": "1.0.1",
"main": "dist/index.js",
"description": "This extension enables fast Groq chat completion API calls",
"url": "extension://@janhq/inference-groq-extension/dist/index.js"
},
"@janhq/inference-openai-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-openai-extension-1.0.2.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-openai-extension",
"productName": "OpenAI Inference Engine",
"version": "1.0.2",
"main": "dist/index.js",
"description": "This extension enables OpenAI chat completion API calls",
"url": "extension://@janhq/inference-openai-extension/dist/index.js"
},
"@janhq/inference-cohere-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-cohere-extension-1.0.0.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-cohere-extension",
"productName": "Cohere Inference Engine",
"version": "1.0.0",
"main": "dist/index.js",
"description": "This extension enables Cohere chat completion API calls",
"url": "extension://@janhq/inference-cohere-extension/dist/index.js"
},
"@janhq/model-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-model-extension-1.0.33.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/model-extension",
"productName": "Model Management",
"version": "1.0.33",
"main": "dist/index.js",
"description": "Model Management Extension provides model exploration and seamless downloads",
"url": "extension://@janhq/model-extension/dist/index.js"
},
"@janhq/monitoring-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-monitoring-extension-1.0.10.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/monitoring-extension",
"productName": "System Monitoring",
"version": "1.0.10",
"main": "dist/index.js",
"description": "Provides system health and OS level data.",
"url": "extension://@janhq/monitoring-extension/dist/index.js"
},
"@janhq/assistant-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-assistant-extension-1.0.1.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/assistant-extension",
"productName": "Jan Assistant",
"version": "1.0.1",
"main": "dist/index.js",
"description": "Powers the default AI assistant that works with all your installed models.",
"url": "extension://@janhq/assistant-extension/dist/index.js"
},
"@janhq/tensorrt-llm-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-tensorrt-llm-extension-0.0.3.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/tensorrt-llm-extension",
"productName": "TensorRT-LLM Inference Engine",
"version": "0.0.3",
"main": "dist/index.js",
"description": "This extension enables Nvidia's TensorRT-LLM for the fastest GPU acceleration. See the [setup guide](https://jan.ai/guides/providers/tensorrt-llm/) for next steps.",
"url": "extension://@janhq/tensorrt-llm-extension/dist/index.js"
},
"@janhq/inference-cortex-extension": {
"_active": true,
"listeners": {},
"origin": "C:\\Users\\ACER\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\pre-install\\janhq-inference-cortex-extension-1.0.15.tgz",
"installOptions": {
"version": false,
"fullMetadata": true
},
"name": "@janhq/inference-cortex-extension",
"productName": "Cortex Inference Engine",
"version": "1.0.15",
"main": "dist/index.js",
"description": "This extension embeds cortex.cpp, a lightweight inference engine written in C++. See https://nitro.jan.ai.\nAdditional dependencies could be installed to run without Cuda Toolkit installation.",
"url": "extension://@janhq/inference-cortex-extension/dist/index.js"
}
}
```

## Specific Extension Settings
Jan offers an Extensions settings menu for configuring extensions that have registered their settings within the application. Here, you can directly integrate Remote Inference Engines with Jan without inserting the URL and API Key directly in the `JSON` file. Additionally, you can turn the Logging extensions available on or off in Jan. To access the Extension settings, follow the steps below:
1. Navigate to the main dashboard.
2. Click the **gear icon (⚙️)** on the bottom left of your screen.
=======
>>>>>>> e5b6901b57c5b7edcd5895316f84d742a2772202
<br/>
![Remove Model](./_assets/extensions-01.png)
<br/>
Expand Down
2 changes: 1 addition & 1 deletion electron/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "jan",
"version": "0.1.1736316956",
"version": "0.1.1736864554",
"main": "./build/main.js",
"author": "Jan <[email protected]>",
"license": "MIT",
Expand Down
Empty file removed electron/package.tmp
Empty file.
2 changes: 1 addition & 1 deletion extensions/assistant-extension/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"name": "@janhq/assistant-extension",
"productName": "Jan Assistant",
"version": "1.0.2",
"description": "This extension enables assistants, including Jan, a default assistant that can call all downloaded models",
"description": "Powers the default AI assistant that works with all your installed models.",
"main": "dist/index.js",
"node": "dist/node/index.js",
"author": "Jan <[email protected]>",
Expand Down
2 changes: 1 addition & 1 deletion extensions/conversational-extension/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"name": "@janhq/conversational-extension",
"productName": "Conversational",
"version": "1.0.0",
"description": "This extension enables conversations and state persistence via your filesystem",
"description": "Enables conversations and state persistence via your filesystem.",
"main": "dist/index.js",
"author": "Jan <[email protected]>",
"license": "MIT",
Expand Down
2 changes: 1 addition & 1 deletion extensions/engine-management-extension/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"name": "@janhq/engine-management-extension",
"productName": "Engine Management",
"version": "1.0.0",
"description": "Extension for managing engines and their configurations",
"description": "Manages AI engines and their configurations.",
"main": "dist/index.js",
"node": "dist/node/index.cjs.js",
"author": "Jan <[email protected]>",
Expand Down
2 changes: 1 addition & 1 deletion extensions/model-extension/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"name": "@janhq/model-extension",
"productName": "Model Management",
"version": "1.0.35",
"description": "This extension manages model lists, model details, and model configurations",
"description": "Handles model lists, their details, and settings.",
"main": "dist/index.js",
"author": "Jan <[email protected]>",
"license": "AGPL-3.0",
Expand Down
2 changes: 1 addition & 1 deletion extensions/monitoring-extension/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"name": "@janhq/monitoring-extension",
"productName": "System Monitoring",
"version": "1.0.10",
"description": "This extension provides system health and OS level data",
"description": "Provides system health and OS level data.",
"main": "dist/index.js",
"node": "dist/node/index.cjs.js",
"author": "Jan <[email protected]>",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
content={
<div>
<p className="text-[hsla(var(--text-secondary))]">
Restore app to initial state, erasing all models and chat history.
Restore appplication to its initial state, erasing all models and chat history.

Check failure on line 33 in web/screens/Settings/Advanced/FactoryReset/ModalConfirmReset.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Replace `·chat·history.⏎············This·action·is·irreversible·and·recommended·only·if·the·application⏎···········` with `⏎············chat·history.·This·action·is·irreversible·and·recommended·only·if⏎············the·application`

Check failure on line 33 in web/screens/Settings/Advanced/FactoryReset/ModalConfirmReset.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Replace `·chat·history.⏎············This·action·is·irreversible·and·recommended·only·if·the·application⏎···········` with `⏎············chat·history.·This·action·is·irreversible·and·recommended·only·if⏎············the·application`

Check failure on line 33 in web/screens/Settings/Advanced/FactoryReset/ModalConfirmReset.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Replace `·chat·history.⏎············This·action·is·irreversible·and·recommended·only·if·the·application⏎···········` with `⏎············chat·history.·This·action·is·irreversible·and·recommended·only·if⏎············the·application`

Check failure on line 33 in web/screens/Settings/Advanced/FactoryReset/ModalConfirmReset.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Replace `·chat·history.␍⏎············This·action·is·irreversible·and·recommended·only·if·the·application␍⏎···········` with `␍⏎············chat·history.·This·action·is·irreversible·and·recommended·only·if␍⏎············the·application`
This action is irreversible and recommended only if the application
is corrupted.
</p>
Expand Down
2 changes: 1 addition & 1 deletion web/screens/Settings/Advanced/FactoryReset/index.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -17,8 +17,8 @@
</h6>
</div>
<p className="whitespace-pre-wrap font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Restore app to initial state, erasing all models and chat history.
Restore appplication to its initial state, erasing all models and chat history.

Check failure on line 20 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Delete `·history.`

Check failure on line 20 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Delete `·history.`

Check failure on line 20 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Delete `·history.`

Check failure on line 20 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Delete `·history.`
This action is irreversible and recommended only if the application is

Check failure on line 21 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Replace `·This·action·is·irreversible·and·recommended·only·if·the·application·is⏎·········` with `·history.·This·action·is·irreversible·and·recommended·only·if·the⏎··········application·is`

Check failure on line 21 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Replace `·This·action·is·irreversible·and·recommended·only·if·the·application·is⏎·········` with `·history.·This·action·is·irreversible·and·recommended·only·if·the⏎··········application·is`

Check failure on line 21 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Replace `·This·action·is·irreversible·and·recommended·only·if·the·application·is⏎·········` with `·history.·This·action·is·irreversible·and·recommended·only·if·the⏎··········application·is`

Check failure on line 21 in web/screens/Settings/Advanced/FactoryReset/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Replace `·This·action·is·irreversible·and·recommended·only·if·the·application·is␍⏎·········` with `·history.·This·action·is·irreversible·and·recommended·only·if·the␍⏎··········application·is`
corrupted.
</p>
</div>
Expand Down
7 changes: 3 additions & 4 deletions web/screens/Settings/Advanced/index.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@
<h6 className="font-semibold capitalize">Experimental Mode</h6>
</div>
<p className="font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Enable new features that may be unstable.
New features that are still unstable and could affect app performance. Enable with caution.

Check failure on line 235 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Replace `New·features·that·are·still·unstable·and·could·affect·app` with `··New·features·that·are·still·unstable·and·could·affect·app⏎·············`

Check failure on line 235 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Replace `New·features·that·are·still·unstable·and·could·affect·app` with `··New·features·that·are·still·unstable·and·could·affect·app⏎·············`

Check failure on line 235 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Replace `New·features·that·are·still·unstable·and·could·affect·app` with `··New·features·that·are·still·unstable·and·could·affect·app⏎·············`

Check failure on line 235 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Replace `New·features·that·are·still·unstable·and·could·affect·app` with `··New·features·that·are·still·unstable·and·could·affect·app␍⏎·············`
</p>
</div>
<Switch
Expand Down Expand Up @@ -446,8 +446,7 @@
<h6 className="font-semibold capitalize">HTTPS Proxy</h6>
</div>
<p className="font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Specify the HTTPS proxy or leave blank (proxy auto-configuration
and SOCKS not supported).
Optional proxy server for internet connections. Only HTTPS proxies supported.

Check failure on line 449 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Insert `⏎·············`

Check failure on line 449 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Insert `⏎·············`

Check failure on line 449 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Insert `⏎·············`

Check failure on line 449 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Insert `␍⏎·············`
</p>
</div>

Expand Down Expand Up @@ -501,7 +500,7 @@
<h6 className="font-semibold capitalize">Jan Quick Ask</h6>
</div>
<p className="font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Enable Quick Ask to be triggered via the default hotkey{' '}
Enable Quick Ask to be triggered via the default hotkey {' '}.

Check failure on line 503 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-ubuntu

Delete `{'·'}`

Check failure on line 503 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-macos

Delete `{'·'}`

Check failure on line 503 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / coverage-check

Delete `{'·'}`

Check failure on line 503 in web/screens/Settings/Advanced/index.tsx

View workflow job for this annotation

GitHub Actions / test-on-windows-pr

Delete `{'·'}`
<span className="text-[hsla(var(--text-secondary)] bg-secondary inline-flex items-center justify-center rounded-full px-1 py-0.5 text-xs font-bold">
<span className="font-bold">{isMac ? '⌘' : 'Ctrl'} + J</span>
</span>{' '}
Expand Down
4 changes: 2 additions & 2 deletions web/screens/Settings/Appearance/index.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ export default function AppearanceOptions() {
</div>
<p className=" font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Choose the width of the chat area to customize your conversation
view
view.
</p>
</div>
<div className="flex-shrink-0">
Expand Down Expand Up @@ -184,7 +184,7 @@ export default function AppearanceOptions() {
<h6 className="font-semibold capitalize">Spell Check</h6>
</div>
<p className=" font-medium leading-relaxed text-[hsla(var(--text-secondary))]">
Turn on to enable spell check
Turn on to enable spell check.
</p>
</div>
<div className="flex-shrink-0">
Expand Down
2 changes: 1 addition & 1 deletion web/screens/Settings/Engines/LocalEngineItem.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ const LocalEngineItems = ({ engine }: { engine: InferenceEngine }) => {
const manualDescription = (engine: string) => {
switch (engine) {
case InferenceEngine.cortex_llamacpp:
return 'Fast, efficient local inference engine that runs GGUF models directly on your device'
return 'Fast, efficient local inference engine that runs GGUF models directly on your device.'

default:
break
Expand Down
Loading
Loading