Use c10d broadcast_object in Zero #79452
Labels
better-engineering
Relatively self-contained tasks for better engineering contributors
good first issue
module: bootcamp
We plan to do a full writeup on the issue, and then get someone to do it for onboarding
oncall: distributed
Add this issue/PR to distributed oncall triage queue
pt_distributed_rampup
Ramp up tasks for new developers on PT distributed
triaged
This issue has been looked at a team member, and triaged and prioritized into an appropriate module
The current implementation of Zero Redundancy optimizer has its own implementation of object broadcasting.
We should replace it with c10d broadcast_object_list.
To verify the result, run the tests in
test/distributed/optim/test_zero_redundancy_optimizer.py.Alternatives
No response
Additional context
No response
cc @pietern @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar @jiayisuse @SciPioneer @H-Huang @kwen2501
The text was updated successfully, but these errors were encountered: