Skip to content

Pull requests: NVIDIA/TransformerEngine

New pull request New
53 Open 996 Closed
53 Open 996 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Parallel Cross Entropy using online softmax enhancement New feature or request
#1456 opened Feb 4, 2025 by sanandaraj5597 Loading…
1
[JAX] THD ring attention
#1454 opened Feb 4, 2025 by zlsh80826 • Draft
2 of 13 tasks
Support vectorized local reduction for p2p-based ReduceScatter overlap
#1452 opened Feb 4, 2025 by erhoo82 Loading…
13 tasks
Add NVTX ranges to categorize execution
#1447 opened Jan 31, 2025 by minitu Loading…
13 tasks
1
[PyTorch] Rename and clean up MXFP8 recipe class
#1445 opened Jan 31, 2025 by timmoon10 • Draft
7 of 13 tasks
1
Support store_param_remainders feature from Apex in TE Fused Adam enhancement New feature or request
#1443 opened Jan 30, 2025 by timmoon10 Loading…
6 of 13 tasks
1
[Pytorch] Nvidia-DLFramework-Inspect support
#1441 opened Jan 30, 2025 by pggPL • Draft
8 of 13 tasks
1
Add test for Lightning Thunder integration testing Improvements to tests or testing infrastructure
#1433 opened Jan 28, 2025 by timmoon10 • Draft
6 of 14 tasks
Introduce NVSHMEM based communication API for pytorch
#1430 opened Jan 28, 2025 by gdengk Loading…
13 tasks
Adding remove_caches API to Float8Tensor class
#1425 opened Jan 27, 2025 by youngeunkwon0405 Loading…
13 tasks
6
Initial Support Blackwell Build
#1418 opened Jan 21, 2025 by johnnynunez Loading…
9 of 13 tasks
[PyTorch] cuBLAS workspace size fix for TP overlap unit test bug Something isn't working
#1415 opened Jan 17, 2025 by denera Loading…
8 of 13 tasks
1
@denera
4
Fix Linear Weight Initialization in the PaddlePaddle Implementation
#1413 opened Jan 17, 2025 by GuoxiaWang Loading…
4 of 13 tasks
Better cuBLAS handle management
#1389 opened Jan 2, 2025 by ptrendx Loading…
8 of 13 tasks
1
@ksivaman
8
Update README.rst
#1385 opened Dec 23, 2024 by sbhavani Loading…
1 of 6 tasks
[PyTorch] Add caching for attention backend selection results
#1381 opened Dec 19, 2024 by cyanguwa • Draft
8 of 13 tasks
1
Don't touch nor send messages to the root logger.
#1380 opened Dec 19, 2024 by sagostinho-nvidia Loading…
4 of 13 tasks
1
[common/PyTorch] Add FusedAttention support for SWA (left, right)
#1369 opened Dec 12, 2024 by cyanguwa • Draft
8 of 13 tasks
1
Add paged attention support
#1355 opened Dec 4, 2024 by cyanguwa Loading…
8 of 13 tasks
11
[PyTorch] Bugfix for wgrad bulk overlap conflict when dgrad overlap is reduce-scatter bug Something isn't working
#1341 opened Nov 18, 2024 by denera Loading…
6 of 13 tasks
@denera
10
[C/JAX] Comm+GEMM Overlap API for TE/JAX enhancement New feature or request jax
#1337 opened Nov 15, 2024 by denera • Draft
3 of 13 tasks
@denera
5
Build with uv instead of just pip
#1324 opened Nov 8, 2024 by jennifgcrl Loading…
5 of 13 tasks
1
4
TP communication overlap: enable the overlap between GEMM chunk at Ho…
#1311 opened Nov 4, 2024 by erhoo82 Loading…
1 of 13 tasks
2
[JAX] Collective GEMM custom op with nvte_cublas_gemm (no comm. overlap) jax
#1307 opened Nov 2, 2024 by denera Loading…
7 of 17 tasks
@denera
14
[PyTorch] Add heuristics for intializing FP8 params enhancement New feature or request
#1300 opened Oct 30, 2024 by timmoon10 Loading…
8 of 13 tasks
2
ProTip! Adding no:label will show everything without a label.