Skip to content

Add an opt-in ZeRO-1/2 gradient norm fast path - #8331

Draft
yh0903 wants to merge 1 commit into
deepspeedai:masterfrom
yh0903:yh0903/zero1-optimizer-fastpath
Draft

Add an opt-in ZeRO-1/2 gradient norm fast path#8331
yh0903 wants to merge 1 commit into
deepspeedai:masterfrom
yh0903:yh0903/zero1-optimizer-fastpath

Add an opt-in ZeRO gradient norm fast path

86ae2dd
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 27, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO