Skip to content

fix(serve): size tensor parallelism from the target instance's GPUs - #6433

Open
AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/tensor-parallel-degree-target-gpus
Open

fix(serve): size tensor parallelism from the target instance's GPUs#6433
AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/tensor-parallel-degree-target-gpus

Commits

  1. Commits on Oct 12, 2026