Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
KevinMusgrave committed Jul 8, 2024
1 parent ef7199d commit 6e0baeb
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ This repository contains a variety of Determined examples that are not actively
| [LLM Finetuning 2](blog/llm-finetuning-2) | Finetuning Mistral-7B on Text-to-SQL using LoRA and DeepSpeed. |
| [LLM Finetuning 3](blog/llm-finetuning-3) | Finetuning Gemma-2B using DPO. |
| [Python SDK demo](blog/python_sdk_demo) | Example usage of the Determined Python SDK to run and administer experiments. |
| [Tensor Parallelism](blog/tp) | Profiling tensor parallelism in PyTorch. |

## Computer Vision

Expand Down
5 changes: 5 additions & 0 deletions blog/act-mem-2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,3 +9,8 @@ memory.
- `attn_script.py` shows the cost of activation memory in the attention layer.
- Tests of the code are in `test.py`.
- See `requirements.txt` for versions the code was built against.


## Contributors

- [Garrett Goon](https://github.com/garrett361)
5 changes: 5 additions & 0 deletions blog/tp/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,8 @@ Code accompanying the deep-dive [blog post on Tensor Parallelism](https://determ
- Matmul profiling code in `matmul_profiling.py`
- MLP TP profiling code in `tp_profiling.py`
- Tests of the rearranging tensor sums are in `test_dot_product_{local,distributed}.py`


## Contributors

- [Garrett Goon](https://github.com/garrett361)

0 comments on commit 6e0baeb

Please sign in to comment.