-
Notifications
You must be signed in to change notification settings - Fork 494
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #288 from Anonymitaet/01101
[doc][feat] add docs for hard requirements, learning hub, acknowledgements, etc
- Loading branch information
Showing
3 changed files
with
72 additions
and
15 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
# Hardware requirements | ||
|
||
Before deploying Yi in your environment, make sure your hardware meets the following requirements. | ||
|
||
## Chat models | ||
|
||
| Model | Minimum VRAM | Recommended GPU Example | | ||
|----------------------|--------------|:-------------------------------------:| | ||
| Yi-6B-Chat | 15 GB | RTX 3090 <br> RTX 4090 <br> A10 <br> A30 | | ||
| Yi-6B-Chat-4bits | 4 GB | RTX 3060 <br> RTX 4060 | | ||
| Yi-6B-Chat-8bits | 8 GB | RTX 3070 <br> RTX 4060 | | ||
| Yi-34B-Chat | 72 GB | 4 x RTX 4090 <br> A800 (80GB) | | ||
| Yi-34B-Chat-4bits | 20 GB | RTX 3090 <br> RTX 4090 <br> A10 <br> A30 <br> A100(40GB) | | ||
| Yi-34B-Chat-8bits | 38 GB | 2 x RTX 3090 <br> 2 x RTX 4090 <br> A800 (40GB) | | ||
|
||
## Base models | ||
|
||
| Model | Minimum VRAM | Recommended GPU Example | | ||
|----------------------|--------------|:-------------------------------------:| | ||
| Yi-6B | 15 GB | RTX3090 <br> RTX4090 <br> A10 <br> A30 | | ||
| Yi-6B-200K | 50 GB | A800 (80 GB) | | ||
| Yi-34B | 72 GB | 4 x RTX 4090 <br> A800 (80 GB) | | ||
| Yi-34B-200K | 200 GB | 4 x A800 (80 GB) | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
# Learning hub | ||
|
||
Welcome to the Yi learning hub! | ||
|
||
Whether you're a seasoned developer or a newcomer, you can find a wealth of helpful educational resources to enhance your understanding and skills with Yi models, including insightful blog posts, comprehensive video tutorials, hands-on guides, and more. | ||
|
||
The content you find here has been generously contributed by knowledgeable Yi experts and passionate enthusiasts. We extend our heartfelt gratitude for your invaluable contributions! | ||
|
||
At the same time, we also warmly invite you to join our collaborative effort by contributing to Yi. If you have already made contributions to Yi, please don't hesitate to showcase your remarkable work in the table below. | ||
|
||
With all these resources at your fingertips, you're ready to start your exciting journey with Yi. Happy learning! 🥳 | ||
|
||
## Tutorials | ||
|
||
| Type | Deliverable | Author | | ||
|-------------|--------------------------------------------------------|-------------------------| | ||
| Blog | [零一万物模型折腾笔记:官方 Yi-34B 模型基础使用](https://zhuanlan.zhihu.com/p/671387298) | 苏洋 | | ||
| Video | [只需 24G 显存,用 vllm 跑起来 Yi-34B 中英双语大模型](https://www.bilibili.com/video/BV17t4y1f7Ee/?spm_id_from=333.337.search-card.all.click&vd_source=64a95c92c8c52a184ab3abdf6e8f589a) | 漆妮妮 | | ||
| Video | [Install Yi 34B Locally - Chinese English Bilingual LLM](https://www.youtube.com/watch?v=CVQvj4Wrh4w&t=476s) | Fahd Mirza | |