Skip to content

[Question] Why Tensor parallel communication/GEMM overlap can happen only when sequence parallelism is enabled? #2536

[Question] Why Tensor parallel communication/GEMM overlap can happen only when sequence parallelism is enabled?

[Question] Why Tensor parallel communication/GEMM overlap can happen only when sequence parallelism is enabled? #2536

Triggered via issue April 9, 2024 20:48
@ptrendxptrendx
commented on #746 bfe21c3
Status Skipped
Total duration 4s
Artifacts

trigger-ci.yml

on: issue_comment
Authorization
0s
Authorization
Vulnerability scan
0s
Vulnerability scan
Start ci job
0s
Start ci job
Fit to window
Zoom out
Zoom in