Update moe branch for torchrun and fix error while loading trainer.ds_module#7

Open

pnunna93 wants to merge 4 commits intomunael:feature/deepspeed_moefrom pnunna93:feature/deepspeed_moe

+18-7

Commits on Oct 27, 2023

Commits on Sep 13, 2024

transformer_moe_layer: Fix Runtime error
jagadish-amd
committed

Commits on Sep 18, 2024

Merge pull request #1 from jagadish-amd/fix-SWDEV-485020
pnunna93
authored