Search results

[Improvement] use torch.amp instead of get_accelerator().amp

Status: Open.

#7876�?In deepspeedai/DeepSpeed;

· delock opened on Feb 27, 2026

Let PyTorch set <code>-gencode</code> flags

Status: Open.

#7871�?In deepspeedai/DeepSpeed;

· Flamefire opened on Feb 24, 2026

Multi-GPU-Arch pre-compilation of operators not supported

Status: Open.

#7863�?In deepspeedai/DeepSpeed;

· Flamefire opened on Feb 20, 2026

(Draft) [Roadmap] DeepSpeed Roadmap Q2 2026

Status: Open.

#7861�?In deepspeedai/DeepSpeed;

· tohtana opened on Feb 19, 2026

[Bug] Missing input validation for fp16 loss_scale accepts float('inf')

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7852�?In deepspeedai/DeepSpeed;

· amadhan882 opened on Feb 13, 2026

[BUG] DeepSpeed ZeRO-3 deadlock in engine.step() at step 0 under 2-GPU execution (RTX 3090, torch 2.2.1, DS 0.14.2)

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7844�?In deepspeedai/DeepSpeed;

· griffinstalha opened on Feb 11, 2026

[BUG] DistributedAttention produces numerically incorrect results vs its own SeqAllToAll-equivalent baseline when sequence length is not divisible by world size

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7842�?In deepspeedai/DeepSpeed;

· griffinstalha opened on Feb 10, 2026

[BUG] Multiple missing zero-guards cause ZeroDivisionError / non-finite values across DeepSpeed (4 locations)

Status: Open.

#7838�?In deepspeedai/DeepSpeed;

· thehalleyyoung opened on Feb 9, 2026

[REQUEST] Ulysses support for VLMs

enhancementNew feature or requestNew feature or request

Status: Open.

#7834�?In deepspeedai/DeepSpeed;

· avicooper1 opened on Feb 6, 2026

[BUG] Ulysses crashes in Stage 0

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7833�?In deepspeedai/DeepSpeed;

· avicooper1 opened on Feb 6, 2026

[BUG]AttributeError in ZeRO-3 with gradient_checkpointing: 'NoneType' object has no attribute 'next_functions' (DeepSpeed 0.18.5)

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7830�?In deepspeedai/DeepSpeed;

· Hylbcxs opened on Feb 5, 2026

[BUG] DeepSpeed ZeRO Stage-3 + CPU offloaded optimizer (CPUAdam) inconsistency metadata between subgroup

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7819�?In deepspeedai/DeepSpeed;

· st-bang97 opened on Jan 27, 2026