Merge pull request #130 from janhq/bach/sp-70Bm-model · janhq/ichigo@75c1fcc

Commit

Merge pull request #130 from janhq/bach/sp-70Bm-model

Add code for training Ichigo llama3.1 70B

tikikun authored Nov 22, 2024

2 parents ee39722 + c8df083 commit 75c1fcc

+118 −0		recipes/configs/jan-llama3-1-s/finetune/70B_full.yaml
+118 −0		recipes/configs/jan-llama3-1-s/pretrain/70B_full.yaml
+2 −0		torchtune/models/llama3_1/__init__.py
+19 −0		torchtune/models/llama3_1/_model_builders.py