Skip to content

Commit

Permalink
added sampling for pretraining data
Browse files Browse the repository at this point in the history
  • Loading branch information
VahidooX committed Nov 19, 2023
1 parent b4cef7e commit 9e683b2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/speechlm_sft/sampling_pretraining_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@
TEXP = "starcoder-repo-len-filt/tex/tex_repo_shuf.jsonl"
TYPE = "starcoder-repo-len-filt/typescript/typescript_repo_shuf.jsonl"
VHDL = "starcoder-repo-len-filt/vhdl/vhdl_repo_shuf.jsonl"
VISU = "starcoder-repo-len-filt/vidual-basic/visual-basic_repo_shuf.jsonl"
VISU = "starcoder-repo-len-filt/visual-basic/visual-basic_repo_shuf.jsonl"
XMLL = "starcoder-repo-len-filt/xml_shuf.jsonl"
YAML = "starcoder-repo-len-filt/yaml/yaml_repo_shuf.jsonl"

Expand Down

0 comments on commit 9e683b2

Please sign in to comment.