Skip to content

Fix hsdp_device_mesh=None when enable HSDP and HYBRID_SHARD#402

Merged
mreso merged 2 commits intometa-llama:mainfrom haozhx23:fixDeviceMeshJun 20, 2024

Commits

Commits on Mar 20, 2024

Commits on Jun 20, 2024