Bunch of changes: GPTneoX for more methods, added Wandb, reorganized, compute optimized modify llama#10

Open

prajwal1210 wants to merge 10 commits intodevelopfrom pca_attn

+2,000-397

Commits on May 3, 2024

Added parallel saving support; added modify_gptneox for all methods
prajwal1210
committed

Commits on May 6, 2024

Reorganized examples/ folder, Added wandb support to track experiment results, passing args to all methods to easily add new args
prajwal1210
committed
Added compute optimised modify_llama_optimised in pca_topk
prajwal1210
committed

Commits on May 10, 2024