Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roadmap: Jan has Model Presets #2845

Open
2 tasks
eckartal opened this issue Apr 29, 2024 · 2 comments
Open
2 tasks

roadmap: Jan has Model Presets #2845

eckartal opened this issue Apr 29, 2024 · 2 comments
Labels
category: model settings Inference params, presets, templates move to Cortex P2: nice to have Nice to have feature type: epic A major feature or initiative

Comments

@eckartal
Copy link
Contributor

eckartal commented Apr 29, 2024

Goal

  • Preset configs for popular models (e.g. prompt templates)

Tasklist

Original Post

# Specs
Preset: https://www.notion.so/jan-ai/Threads-settings-presets-52b14746d1cb41f1b246542794d781cb?pvs=4
Model.yaml: https://www.notion.so/jan-ai/Model-yaml-and-Presets-a968ed13e59c4f828d68c83d29fbd923?pvs=4

# Problem
Users currently lack preset configurations for popular models like Llama-3-8b-Instruct, which results in manual setup that can be error-prone and intimidating for non-expert users. Plus, the "Model Parameters" section does not offer enough flexibility for configuring different models.
### Goals
The Threads experience is smooth, stateful, and ai-enthusiast friendly
# Design

### User flow
<img width="1255" alt="Screenshot 2024-06-06 at 10 31 45 AM" src="https://github.com/janhq/jan/assets/89722390/a38f20ba-ce82-45af-9fdb-778b7aca4973">

### Figma
https://www.figma.com/design/DYfpMhf8qiSReKvYooBgDV/Jan-App-(3rd-version)?node-id=4565-71555&t=a7y8P5tD7zJhF1Fs-4
<img width="417" alt="Screenshot 2024-06-11 at 5 47 03 PM" src="https://github.com/janhq/jan/assets/89722390/84f01f8b-d5d3-4967-8501-8837071daff8">
@eckartal eckartal added the type: feature request A new feature label Apr 29, 2024
@imtuyethan imtuyethan self-assigned this May 1, 2024
@imtuyethan imtuyethan moved this to Icebox in Menlo May 3, 2024
@imtuyethan
Copy link
Contributor

Archive original comments:
Problem
Users currently lack preset configurations for popular models like Llama-3-8b-Instruct, which results in manual setup that can be error-prone and intimidating for non-expert users. Plus, the "Model Parameters" section does not offer enough flexibility for configuring different models.

Success Criteria

  • Introduce preset configurations for commonly used models to simplify setup for users.
  • Improve the "Model Parameters" section to allow for more flexible configurations that can be easily adapted to support various models without manual intervention.

Additional context
Detailed feedback: https://www.reddit.com/r/LocalLLaMA/comments/1cclmjk/comment/l1byjva/?context=3

@imtuyethan imtuyethan added the type: epic A major feature or initiative label Jun 11, 2024
@imtuyethan imtuyethan moved this from Icebox to Planned in Menlo Jun 11, 2024
@imtuyethan imtuyethan added the P1: important Important feature / fix label Jun 11, 2024
@imtuyethan imtuyethan changed the title feat: Jan implements preset configurations for popular models epic: Jan implements preset configurations for popular models Jun 11, 2024
@urmauur urmauur moved this from Planned to In Progress in Menlo Jun 13, 2024
@urmauur urmauur moved this from In Progress to Planned in Menlo Jun 20, 2024
@namchuai namchuai assigned Van-QA and unassigned namchuai Aug 19, 2024
@Van-QA Van-QA added this to the v0.7.1 milestone Aug 19, 2024
@imtuyethan imtuyethan removed P1: important Important feature / fix type: feature request A new feature labels Aug 28, 2024
@imtuyethan imtuyethan removed this from the v0.7.1 milestone Aug 28, 2024
@imtuyethan imtuyethan moved this from Scheduled to Planning in Menlo Aug 30, 2024
@freelerobot freelerobot added the P2: nice to have Nice to have feature label Sep 5, 2024
@dan-menlo dan-menlo changed the title epic: Jan implements preset configurations for popular models epic: Jan has Model Presets Sep 10, 2024
@imtuyethan
Copy link
Contributor

@dan-menlo dan-menlo moved this from Planning to Scheduled in Menlo Sep 26, 2024
@freelerobot freelerobot added category: local engines category: model hub Built in models, latest HF models page category: model settings Inference params, presets, templates and removed category: local engines category: model hub Built in models, latest HF models page labels Oct 14, 2024
@imtuyethan imtuyethan changed the title epic: Jan has Model Presets roadmap: Jan has Model Presets Dec 10, 2024
@imtuyethan imtuyethan moved this from Scheduled to Planning in Menlo Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model settings Inference params, presets, templates move to Cortex P2: nice to have Nice to have feature type: epic A major feature or initiative
Projects
Status: Planning
Development

No branches or pull requests

6 participants