create _preprare_fsdp to pre- prepare fsdp model training#3213

Open

eljandoubi wants to merge 9 commits intohuggingface:mainfrom eljandoubi:align-optimizer-params-with-the-fsdp-model-parms

+176-2

Commits on Nov 2, 2024

creeate _preprare_fsdp to pre- prepare fsdp model training
eljandoubi
committed

Commits on Nov 3, 2024

Commits on Nov 4, 2024

when use_oring_params=True, skip optimizers params update
eljandoubi
committed

Commits on Nov 20, 2024

Commits on Nov 24, 2024

Merge branch 'huggingface:main' into align-optimizer-params-with-the-fsdp-model-parms
eljandoubi
authored

Commits on Nov 25, 2024