Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

5x Error Reduction in RAG with gpt-3.5-turbo-0613 Finetuning #678

Merged
merged 38 commits into from
Sep 12, 2023
Merged

5x Error Reduction in RAG with gpt-3.5-turbo-0613 Finetuning #678

Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
ee1ec03
* feat(fine-tuned-RAG): add .gitignore file for ignoring *.parquet files
NirantK Sep 4, 2023
18f5031
Add model finetune nbs
NirantK Sep 4, 2023
18aed3d
Make it easier to follow!
NirantK Sep 4, 2023
b95e5f0
* docs(ModelFinetune.ipynb): update error categories descriptions
NirantK Sep 4, 2023
3088e4d
* docs(fine-tuned-RAG): add documentation for few-shot learning with …
NirantK Sep 4, 2023
d058e3e
Better labels
NirantK Sep 4, 2023
645e56c
Add Few Shot prompt creation
NirantK Sep 5, 2023
147d770
* chore(DatasetPrep.ipynb): remove DatasetPrep.ipynb file
NirantK Sep 6, 2023
03d6c6a
Simplify datasets
NirantK Sep 6, 2023
b63216d
* chore(.gitignore): add examples/fine-tuned-RAG/local_cache/ to the …
NirantK Sep 6, 2023
3c233d6
Clean dataset prep for 1 shot, embed the few shot dataset
NirantK Sep 6, 2023
350393d
Add few shot RAG with Qdrant
NirantK Sep 7, 2023
8278d50
Remove unused code
NirantK Sep 7, 2023
fe59ced
more inline output
NirantK Sep 7, 2023
324a4f3
* fix(ModelFinetune.ipynb): update execution counts for code cells
NirantK Sep 7, 2023
b3d2dfe
* chore(ModelFinetune.ipynb): update section titles and content
NirantK Sep 7, 2023
219fdab
* chore(ModelFinetune.ipynb): update headings and descriptions in the…
NirantK Sep 7, 2023
3fc4256
Reorganise
NirantK Sep 7, 2023
f93cf5d
Add pretty plots ✨
NirantK Sep 7, 2023
5260c4f
* chore(ModelFinetune.ipynb): add introduction and table of contents …
NirantK Sep 7, 2023
2a61773
* chore(ModelFinetune.ipynb): update bullet points in the introductio…
NirantK Sep 7, 2023
448a059
* docs(ModelFinetune.ipynb): update introduction to clarify the aim o…
NirantK Sep 7, 2023
5c6ae43
Replace the data verification with a link
NirantK Sep 7, 2023
4c74a97
* feat(ModelFinetune.ipynb): refactor code to use OpenAIFineTuner cla…
NirantK Sep 7, 2023
4fa2b68
* chore(ModelFinetune.ipynb): update error category descriptions in e…
NirantK Sep 7, 2023
3d13114
* docs(ModelFinetune.ipynb): add link to OpenAI Cookbook guide for fi…
NirantK Sep 7, 2023
b9d633e
* docs(ModelFinetune.ipynb): update link to OpenAI Fine-Tuning Docs a…
NirantK Sep 7, 2023
1c9ea7e
* chore(fine-tuned-RAG): remove .gitignore file for *.parquet
NirantK Sep 8, 2023
f347a9c
Move nbs
NirantK Sep 8, 2023
faca10b
* chore(.gitignore): update ignored directory path for fine-tuned_qa/…
NirantK Sep 8, 2023
d1c0f4e
Better numbering, easier to read, renamed error categories
NirantK Sep 8, 2023
9db7a32
Add clean observations and results
NirantK Sep 8, 2023
b4adbcc
* chore(ft_retrieval_augmented_generation.ipynb): update markdown hea…
NirantK Sep 8, 2023
1ae556e
Crisp story
NirantK Sep 11, 2023
1fdd15a
* chore(ft_retrieval_augmented_generation.ipynb): update markdown con…
NirantK Sep 12, 2023
12f800c
* chore(ft_retrieval_augmented_generation.ipynb): reorganize sections…
NirantK Sep 12, 2023
49a0146
* chore(examples): rename ft_retrieval_augmented_generation.ipynb to …
NirantK Sep 12, 2023
21fa0d9
* chore(ft_retrieval_augmented_generation_qdrant.ipynb): fix pip inst…
NirantK Sep 12, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -132,4 +132,5 @@ dmypy.json
*transactions*.jsonl
/examples/data/transactions*
*.DS_Store
tmp_*
tmp_*
examples/fine-tuned-RAG/local_cache/*
1 change: 1 addition & 0 deletions examples/fine-tuned-RAG/.gitignore
View file
Open in desktop
colin-openai marked this conversation as resolved.
Show resolved Hide resolved
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
*.parquet
Loading