Fixes a few Sagemaker config issues #4499

Job	Run time
run-tests (latest, test_prod)	1m 51s
run-tests (latest, test_core)	3m 16s
run-tests (latest, test_cli)	3m 31s
run-tests (latest, test_big_modeling)	4m 58s
run-tests (latest, test_deepspeed)	2m 37s
run-tests (latest, test_fsdp)	2m 36s
run-tests (latest, test_example_differences)	2m 41s
run-tests (latest, test_checkpoint_step)	4m 13s
run-tests (latest, test_checkpoint_epoch)	3m 42s
run-tests (latest, test_rest)	8m 5s
run-tests (minimum, test_prod)	2m 2s
run-tests (minimum, test_core)	3m 34s
run-tests (minimum, test_cli)	3m 30s
run-tests (minimum, test_big_modeling)	2m 42s
run-tests (minimum, test_deepspeed)	3m 11s
run-tests (minimum, test_fsdp)	2m 26s
run-tests (minimum, test_example_differences)	2m 50s
run-tests (minimum, test_checkpoint_step)	4m 6s
run-tests (minimum, test_checkpoint_epoch)	3m 45s
run-tests (minimum, test_rest)	7m 55s
	1h 13m 31s

Provide feedback