Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Neural-Chat, OpenChat, Orca 2, and OpenLLaMa v2, Starling LM #926

Merged
merged 14 commits into from
Dec 2, 2023
Merged

Add support for Neural-Chat, OpenChat, Orca 2, and OpenLLaMa v2, Starling LM #926

merged 14 commits into from
Dec 2, 2023

Conversation

Smartappli
Copy link
Contributor

@Smartappli Smartappli commented Dec 1, 2023 •
edited
Loading

Add Neural-Chat 7B-v3.1
Add OpenChat 3.5-7B
Add OpenLLaMA 3B-v2, 7B-v2, 13B-v2
Add Orca-2 7B, 13B
Add Starling-LM-7B-Alpha

@Smartappli
Update models.json
10ffb53 
Add support of Orca-2
Add support Open LLaMa
Add Neural-Chat
@Smartappli
Update README.md
50398f8
@Smartappli
Update README.md
f5ec8e3 
add Falcon 180B and Falcon 180B-Chat
@Smartappli
Update README.md
bb11079 
Add support of OpenChat 3.5
@gaby
Copy link
Member

gaby commented Dec 1, 2023

@Smartappli Can the other 2 pr's be closed and consolidated into this one? #928 #927

@Smartappli
Update models.json
8ee9f5c 
bugfix
@Smartappli
Update README.md
585669d 
Typo fix
@Smartappli
Update models.json
30dd671 
Add support of Falcon 180B, Falcon 180B-Chat
Add support of OpenChat 3.5
@Smartappli
Update README.md
3d06517 
bugfix
@Smartappli Smartappli changed the title Add supports of Neural-Chat 3.1, Orca 2, and Open LLaMa Add supports of Neural-Chat 3.1, openChat 3.5, Orca 2, and Open LLaMa, Dec 1, 2023
@Smartappli
Update models.json
4f4cc61 
neural bugfix
@gaby
Copy link
Member

gaby commented Dec 1, 2023

These two are failing:

test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-GGUF-falcon-180b.Q4_K_M.gguf] FAILED [ 35%]

test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-Chat-GGUF-falcon-180b-chat.Q4_K_M.gguf] FAILED [ 39%]

@Smartappli
Update models.json
82e5258 
remove Falcon 180B and 180B-Chat
@Smartappli
Copy link
Contributor Author

These two are failing:

test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-GGUF-falcon-180b.Q4_K_M.gguf] FAILED [ 35%]

test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-Chat-GGUF-falcon-180b-chat.Q4_K_M.gguf] FAILED [ 39%]

Falcon180B and Falcon-180B-Chat guff files are split into three parts. I don't know how to integrate them. I'm using the syntax suggested on Hugging Face but it doesn't work. If you have any ideas on how to proceed, I'd be interested :)

huggingface-cli download TheBloke/Falcon-180B-Chat-GGUF falcon-180b-chat.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False

huggingface-cli download TheBloke/Falcon-180B-GGUF falcon-180b.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False

@Smartappli
Update README.md
3e39754 
remove Falcon 180B and 180B-Chat
@gaby
Copy link
Member

gaby commented Dec 1, 2023

These two are failing:
test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-GGUF-falcon-180b.Q4_K_M.gguf] FAILED [ 35%]
test/healthcheck_models.py::test_model_available[TheBloke/Falcon-180B-Chat-GGUF-falcon-180b-chat.Q4_K_M.gguf] FAILED [ 39%]

Falcon180B and Falcon-180B-Chat guff files are split into three parts. I don't know how to integrate them. I'm using the syntax suggested on Hugging Face but it doesn't work. If you have any ideas on how to proceed, I'd be interested :)

huggingface-cli download TheBloke/Falcon-180B-Chat-GGUF falcon-180b-chat.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False

huggingface-cli download TheBloke/Falcon-180B-GGUF falcon-180b.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False

OHHH, yeah we don't support that yet. We assume 1 file per LLM. You can skip those for a future PR.

@Smartappli
Copy link
Contributor Author

Falcon 180B and Falcon 180B-Chat Temporary deleted :)

@Smartappli Smartappli changed the title Add supports of Neural-Chat 3.1, openChat 3.5, Orca 2, and Open LLaMa, Add supports of Neural-Chat 3.1, openChat 3.5, Orca 2, and Open LLaMa v2 Dec 1, 2023
@Smartappli
Copy link
Contributor Author

Thanks for your help

@gaby gaby changed the title Add supports of Neural-Chat 3.1, openChat 3.5, Orca 2, and Open LLaMa v2 Add support for Neural-Chat, OpenChat, Orca 2, and OpenLLaMa v2 Dec 1, 2023
@Smartappli
Update models.json
62d1e75 
Add support for Starling-LM-7B-Alpha
@Smartappli
Update README.md
cb51217 
Add support for Starling-LM-7B-Alpha
@Smartappli Smartappli changed the title Add support for Neural-Chat, OpenChat, Orca 2, and OpenLLaMa v2 Add support for Neural-Chat, OpenChat, Orca 2, and OpenLLaMa v2, Starling LM Dec 2, 2023
@Smartappli
Copy link
Contributor Author

That's it for this release :)

@gaby gaby merged commit 9fabef6 into serge-chat:main Dec 2, 2023
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
🧠 Models
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Smartappli @gaby