Repository navigation

fix(pd): avoid first-token cache stats race - #1450

Merged

sufubao merged 17 commits into

ModelTC:mainfrom

sufubao:fix/pd-first-token-cache-stats-race

Aug 21, 2026

Merged

fix(pd): avoid first-token cache stats race#1450
sufubao merged 17 commits into
ModelTC:mainfrom
sufubao:fix/pd-first-token-cache-stats-race

Commits on Aug 13, 2026
- fix(pd): avoid first-token cache stats race
  sufubao
  committed
  928d6bd
- fix(pd): preserve prefill metadata and unblock decode
  sufubao
  committed
  e71f84a
- refactor(pd): simplify first-token fallback
  sufubao
  committed
  c912a63
- chore: keep PD fix PR focused
  sufubao
  committed
  b05ff81
- refactor(pd): consume node mode once
  sufubao
  committed
  00f2698
- refactor(pd): clarify first-token buffering
  sufubao
  committed
  e4604cb
- refactor(pd): make prefill lookup explicit
  sufubao
  committed
  98d8626
- refactor(pd): avoid rescanning buffered tokens
  sufubao
  committed
  29ce20c
- refactor(pd): clarify first-token stream handling
  sufubao
  committed
  c979dd0
- refactor(pd): streamline first-token buffering
  sufubao
  committed
  750a02e
- refactor(pd): reuse async queue for output tokens
  sufubao
  committed
  563e4dd
- style(pd): apply project formatting
  sufubao
  committed
  aabe3b6
- fix(pd): bound missing prefill token fallback
  sufubao
  committed
  0f56003
- Delete unit_tests/server/httpserver/test_pd_master_cached_tokens.py
  sufubao
  committed
  14448c3
- fix(pd): preserve terminal decode marker
  sufubao
  committed
  5923736
Commits on Aug 19, 2026
- fix(pd): wait for prefill cache stats
  hiworldwzj
  committed
  f1b9dcb
- refactor(pd): simplify cache metadata handling
  hiworldwzj
  committed
  6b57948