The field of AI continues to grow at an exponential rate, with hundreds of new developments happening daily, making it extremely difficult to keep up with everything! There has also been a growing trend of reduced explainability and open-source models.
This repository is a step towards countering that. It houses a collection of important developments over the years with simple code implementations that are free to use and explore. Each one is accompanied by a Medium article that explains the development's fundamental details and code implementations.
Each item is separated into a folder with a set of respective Python files. Some utility methods, such as activation functions, are stored in the root of the experiments folder for easier access to all individual experiments. Each folder has a corresponding README.md file highlighting a brief description of the development and structure.
My goal is to help push development for more efficient, high-performing, autonomous systems that improve the way we live our lives. All code will remain open-source and hopefully be an asset to the AI community.
Happy reading and exploring! 😄
| Item | Project Link | Article Link |
|---|---|---|
| GLU Feed-Forward Networks |  |
 |
| Titans | - | |
| SAM 2 | - | Coming Soon |
| Multi-Modal Transformer | - | Coming Soon |
| Large Concept Models | - | Coming Soon |