Skip to content

Sky-Phi4: Train Phi4 experiment for O1 style thinking

License

Notifications You must be signed in to change notification settings

bigsnarfdude/SkyThought

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# SkyThought for Phi4 trained 3 epochs. Evals didnt move double digits.

Links

Citation

The code in this repository is mostly described in the post below. Please consider citing this work if you find the repository helpful.

@misc{sky_t1_2025,
  author       = {NovaSky Team},
  title        = {Sky-T1: Train your own O1 preview model within $450},
  howpublished = {https://novasky-ai.github.io/posts/sky-t1},
  note         = {Accessed: 2025-01-09},
  year         = {2025}
}

Acknowledgement

This work is originally done at Berkeley Sky Computing Lab

About

Sky-Phi4: Train Phi4 experiment for O1 style thinking

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.2%
  • Other 0.8%