Fix Batch Size Calculation for Multi-GPU Training#5

Open

cosineai[bot] wants to merge 1 commit intomasterfrom cosine/bug/fix-training-batch-size-rrlfce

Commits on Nov 15, 2024

fix: handle data parallel world size and rank when mpu is None

Insop Song
and
CosineGenie
committed