Support sequence_parallel with main_grad#1060

Merged

sneaxiy merged 11 commits intoPaddlePaddle:developfrom

GhostScreaming:fix_sp_with_main_grad

Mar 14, 2023

Commits on Sep 28, 2022

Commits on Oct 21, 2022

Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into develop
GhostScreaming
committed

Commits on Oct 25, 2022

Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into develop
GhostScreaming
committed
Set sequence_parallel True in default.
GhostScreaming
committed

Commits on Oct 28, 2022

Commits on Dec 28, 2022

Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into develop
GhostScreaming
committed

Commits on Mar 8, 2023

Merge branch 'develop' of https://github.com/PaddlePaddle/FleetX into develop
GhostScreaming
committed

Commits on Mar 13, 2023