Skip to content

Pull requests: NVIDIA/TransformerEngine

New pull request New
49 Open 944 Closed
49 Open 944 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[PyTorch] Add weights_only=False for torch.load
#1374 opened Dec 13, 2024 by cyanguwa Loading…
8 of 13 tasks
1
[MoE][PyTorch] Add mask-based MoE permutation
#1373 opened Dec 13, 2024 by hxbai Loading…
8 of 13 tasks
[common] Add max_t support for KV in THD
#1370 opened Dec 12, 2024 by cyanguwa Loading…
8 of 13 tasks
1
[common/PyTorch] Add support for SWA (left,0) + padding + CM/BRCM
#1369 opened Dec 12, 2024 by cyanguwa • Draft
8 of 13 tasks
Fix an invalid reference in the doc
#1362 opened Dec 9, 2024 by wujingyue Loading…
Enabling FP8 all-gather for TE Float8Tensor when using Torch FSDP2
#1358 opened Dec 5, 2024 by youngeunkwon0405 Loading…
13 tasks
@youngeunkwon0405
1
[JAX] Move parallel encoder tests to L0 distributed test set.
#1356 opened Dec 4, 2024 by phu0ngng Loading…
7 of 13 tasks
1
Add paged attention support
#1355 opened Dec 4, 2024 by cyanguwa Loading…
8 of 13 tasks
1
[JAX] Fused attention unit tests fixes and refinements
#1352 opened Dec 2, 2024 by zlsh80826 Loading…
9 of 13 tasks
5
[Draft] Introduce NVSHMEM based communication API for pytorch
#1346 opened Nov 22, 2024 by gdengk • Draft
13 tasks
[PyTorch] Adding TP overlap support for te.Linear with parallel_mode="column" 1.13.0 enhancement New feature or request
#1343 opened Nov 20, 2024 by denera Loading…
8 of 13 tasks
1
@denera
5
[PyTorch] Bugfix for wgrad bulk overlap conflict when dgrad overlap is reduce-scatter bug Something isn't working
#1341 opened Nov 18, 2024 by denera Loading…
6 of 13 tasks
@denera
10
[C/JAX] Comm+GEMM Overlap API for TE/JAX enhancement New feature or request jax
#1337 opened Nov 15, 2024 by denera • Draft
3 of 13 tasks
@denera
[JAX] WIP Added L0 Distributed Tests
#1331 opened Nov 14, 2024 by phu0ngng • Draft
13 tasks
2
[COMMON/JAX] Support sliding window on THD format
#1327 opened Nov 11, 2024 by zlsh80826 Loading…
6 of 13 tasks
6
Build with uv instead of just pip
#1324 opened Nov 8, 2024 by jennifgcrl Loading…
5 of 13 tasks
1
4
TP communication overlap: enable the overlap between GEMM chunk at Ho…
#1311 opened Nov 4, 2024 by erhoo82 Loading…
1 of 13 tasks
2
[JAX] Collective GEMM custom op with nvte_cublas_gemm (no comm. overlap) jax
#1307 opened Nov 2, 2024 by denera Loading…
7 of 17 tasks
@denera
14
[PyTorch] Add heuristics for intializing FP8 params enhancement New feature or request
#1300 opened Oct 30, 2024 by timmoon10 Loading…
8 of 13 tasks
2
Offloading example
#1299 opened Oct 29, 2024 by sanandaraj5597 Loading…
[PyTorch] Fix get_swa_mask() for padding masks
#1281 opened Oct 21, 2024 by cyanguwa Loading…
6 of 13 tasks
4
[PyTorch] Fix autocast deprecation warnings
#1277 opened Oct 21, 2024 by yaox12 Loading…
13 tasks
15
[PyTorch] Remove sequence parallel check for setting dropout RNG context
#1272 opened Oct 18, 2024 by ksivaman • Draft
1 of 13 tasks
attention_mask fill with -inf for UnfusedDotProductAttention
#1268 opened Oct 18, 2024 by Agoniii Loading…
1 of 13 tasks
2
Draft: reduce cudagraph mem via preoallcations
#1253 opened Oct 15, 2024 by JimmyZhang12 Loading…
13 tasks
ProTip! Type g i on any issue or pull request to go back to the issue listing page.