Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Viktoriussuwandi patch #105

Merged
merged 16 commits into from
May 30, 2023
Merged

Viktoriussuwandi patch #105

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
42a971d
Update wandb_log_model on sample.yml
viktoriussuwandi May 29, 2023
f317296
Update wandb_log_model on quickstart.yml
viktoriussuwandi May 29, 2023
84fc217
Update wandb_log_model on gpt_neox_20b.yml
viktoriussuwandi May 29, 2023
0d14e95
Update wandb_log_model on stability_3b.yml
viktoriussuwandi May 29, 2023
7187134
Update wandb_log_model on llama_7B_4bit.yml
viktoriussuwandi May 29, 2023
2aacf75
Update wandb_log_model on galactica_1_3B.yml
viktoriussuwandi May 29, 2023
fad06be
Update wandb_log_model on config.yml
viktoriussuwandi May 29, 2023
d77d736
Update wandb_log_model on llama_7B_alpaca.yml
viktoriussuwandi May 29, 2023
0736f4f
Update wandb_log_model on llama_13B_alpaca.yml
viktoriussuwandi May 29, 2023
232b931
Update wandb_log_model on llama_65B_alpaca.yml
viktoriussuwandi May 29, 2023
15aabd2
Update wandb_log_model on llama_7B_jeopardy.yml
viktoriussuwandi May 29, 2023
abddcf4
Update wandb_log_model on pythia_1_2B_alpaca.yml
viktoriussuwandi May 29, 2023
b6a539b
Update wandb_log_model on cerebras_1_3B_alpaca.yml
viktoriussuwandi May 29, 2023
4eb68ac
Update wandb_log_model on config-3b.yml
viktoriussuwandi May 29, 2023
15e57ba
Update wandb_log_model on config.yml
viktoriussuwandi May 29, 2023
e0ccacc
Update wandb_log_model on vicuna_13B_4bit_reflect.yml
viktoriussuwandi May 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion configs/cerebras_1_3B_alpaca.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ lora_fan_in_fan_out: false
wandb_project: pythia-1.4b-lora
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-alpaca
batch_size: 32
micro_batch_size: 4
Expand Down
2 changes: 1 addition & 1 deletion configs/galactica_1_3B.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-llama-alpaca
batch_size: 32
micro_batch_size: 16
Expand Down
2 changes: 1 addition & 1 deletion configs/gpt_neox_20b.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ lora_fan_in_fan_out: true # pythia/GPTNeoX lora specific
wandb_project: gpt4all-neox-20b
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./gpt4all-neox-20b
batch_size: 48
micro_batch_size: 4
Expand Down
2 changes: 1 addition & 1 deletion configs/llama_13B_alpaca.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./llama-13b-sharegpt
batch_size: 64
micro_batch_size: 2
Expand Down
2 changes: 1 addition & 1 deletion configs/llama_65B_alpaca.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ lora_fan_in_fan_out: false
wandb_project: llama-65b-lora
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-llama-alpaca
batch_size: 128
micro_batch_size: 16
Expand Down
2 changes: 1 addition & 1 deletion configs/llama_7B_4bit.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-test
batch_size: 8
micro_batch_size: 2
Expand Down
2 changes: 1 addition & 1 deletion configs/llama_7B_alpaca.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ lora_fan_in_fan_out: false
wandb_project: llama-7b-lora
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-llama-alpaca
batch_size: 128
micro_batch_size: 16
Expand Down
2 changes: 1 addition & 1 deletion configs/llama_7B_jeopardy.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ lora_fan_in_fan_out: false
wandb_project: jeopardy-bot-7b
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./jeopardy-bot-7b
batch_size: 4
micro_batch_size: 1
Expand Down
2 changes: 1 addition & 1 deletion configs/pythia_1_2B_alpaca.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ lora_fan_in_fan_out: true # pythia/GPTNeoX lora specific
wandb_project: pythia-1.4b-lora
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-alpaca
batch_size: 48
micro_batch_size: 4
Expand Down
2 changes: 1 addition & 1 deletion configs/quickstart.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-test
batch_size: 4
micro_batch_size: 1
Expand Down
2 changes: 1 addition & 1 deletion configs/sample.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
# where to save the finsihed model to
output_dir: ./completed-model
# training hyperparameters
Expand Down
2 changes: 1 addition & 1 deletion configs/stability_3b.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ lora_fan_in_fan_out: false
wandb_project: stable-alpaca-3b
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./stable-alpaca-3b
batch_size: 2
micro_batch_size: 1
Expand Down
2 changes: 1 addition & 1 deletion configs/vicuna_13B_4bit_reflect.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ lora_fan_in_fan_out: false
wandb_project:
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./lora-reflect
batch_size: 8
micro_batch_size: 2
Expand Down
2 changes: 1 addition & 1 deletion examples/gptq-lora-7b/config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ lora_fan_in_fan_out: false
wandb_project: llama-7b-lora-int4
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./llama-7b-lora-int4
batch_size: 1
micro_batch_size: 1
Expand Down
2 changes: 1 addition & 1 deletion examples/mpt-7b/config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ lora_fan_in_fan_out: false
wandb_project: mpt-alpaca-7b
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./mpt-alpaca-7b
batch_size: 1
micro_batch_size: 1
Expand Down
2 changes: 1 addition & 1 deletion examples/redpajama/config-3b.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ lora_fan_in_fan_out: false
wandb_project: redpajama-alpaca-3b
wandb_watch:
wandb_run_id:
wandb_log_model: checkpoint
wandb_log_model:
output_dir: ./redpajama-alpaca-3b
batch_size: 4
micro_batch_size: 1
Expand Down