Skip to content

Commit

Permalink
fix comments
Browse files Browse the repository at this point in the history
  • Loading branch information
BruceZhang@eitug committed Oct 19, 2022
1 parent 08be830 commit 1414bf6
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -296,7 +296,7 @@
"id": "4b3575d9",
"metadata": {},
"source": [
"The batch size below is the maximum batch we could fit into the memory of an ml.p4d.24xlarge instance. If you change the model, instance type, sequence length, and other parameters, you need to do some experiments to find the largest batch size that will fit into GPU memory. We also use Automatic Mixed Precision for faster training.\n",
"The batch size below is the maximum batch we could fit into the memory of an ml.p4d.24xlarge instance. If you change the model, instance type, sequence length, and other parameters, you need to do some experiments to find the largest batch size that will fit into GPU memory.\n",
"\n",
"This example uses HuggingFace training script run_clm.py, which you can find it inside the scripts folder."
]
Expand Down

0 comments on commit 1414bf6

Please sign in to comment.