All pull requests

Pull requests

• Fix duplicate CSV monitor headers after restart

  #9005·To3akaRin opened Nov 4, 2026·

  ·
  1

• fix(rollout): pass a pre-built 4-D mask to the static graph decode forward

  #9004·anyadontfly opened Nov 4, 2026·

  ·
  1

  3

• ZeRO-3: honor stage3_max_reuse_distance for forward-gathered parameters

  #9003·YidaWeng opened Nov 4, 2026·

  ·
  1

  4

• ZeRO-3: partition parameters of modules added after initialization

  #9002·YidaWeng opened Nov 4, 2026·

  ·
  1

  11

• ZeRO-1/2: expose original parameter layout on flat optimizer partitions

  #9001·YidaWeng opened Nov 4, 2026·

  ·
  1

  8

• Fix comms logger IndexError when the tensor is passed by keyword

  #8998·ZhuLinsen opened Nov 3, 2026·

  ·
  1

• feat(comm): one-shot P2P custom all-reduce for TP=2 inference

  #8997·delock opened Nov 3, 2026Collaborator·

  ·
  14

• AutoEP activation tests: skip the Triton grouped-GEMM path when Triton cannot run

  #8996·GuCarpenter opened Nov 3, 2026Contributor·

  ·
  2

• Fix quantized storage of nontrainable weights in ZeRO-3

  #8995·VenusTZZ opened Nov 3, 2026Contributor·7 tasks done·

  ·
  1

• Fix DynamicLossScaler never lowering scale when hysteresis <= 0

  #8993·siddhant-rajhans opened Nov 3, 2026·

  ·
  1

  3

• Fix zero.Init: respect explicit dtype in tensor constructors

  #8988·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  4

• Fix FP16 optimizer init: suppress weight decay and reset step counter

  #8987·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  4

• ZeRO-3 CPU offload: fix the step() device memory regression from #8840

  #8986·xylian86 opened Nov 2, 2026Collaborator·

  ·
  5

• DeepNVMe: fix silent I/O failures on misaligned buffers

  #8985·xylian86 opened Nov 2, 2026Collaborator·

  ·
  4

• ZeRO-3 NVMe offload: restore the optimizer state on resume

  #8984·xylian86 opened Nov 2, 2026Collaborator·

  ·
  1

• Fix DynamicLossScaler never lowering the scale when fp16 hysteresis is 0 or less

  #8983·damienen opened Nov 2, 2026·

  ·
  1

  5

• ZeRO-3: fix stale and lost gradients of unused parameters

  #8981·xylian86 opened Nov 2, 2026Collaborator·

  ·
  9

• [Hybrid Engine] Require an explicit accelerator opt-in for graph capture

  #8980·VenusTZZ opened Nov 2, 2026Contributor·

  ·
  16

• Fix OneCycle initial momentum: use cycle_max_mom, not cycle_min_mom

  #8979·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  3

• Propagate the user script's exit code from launcher_helper

  #8978·vineethsaivs opened Nov 1, 2026Contributor·

  ·

• Keep --venv_script out of the pdsh pkill pattern

  #8977·vineethsaivs opened Nov 1, 2026Contributor·

  ·

• Fix bug in Adagrad optimizer initialization

  #8976·hwchen2017 opened Nov 1, 2026Contributor·

  ·
  7

• Check that converting through an affine map writes every element once

  #8975·Achyuthan-S opened Nov 1, 2026Contributor·

  ·
  5

• Keep fp32 CPU optimizer states in fp32 when loading a state_dict

  #8974·xylian86 opened Nov 1, 2026Collaborator·

  ·
  3

• ZeRO-3 partial offload: fix LR schedules and checkpoints of the device sub-groups

  #8973·xylian86 opened Nov 1, 2026Collaborator·

  ·
  4