Skip to content

feat(LightSpec): Support LightSpec Dynamic Speculative Decoding with EAGLE3, DSpark, and DFlash - #1465

Open
shihaobai wants to merge 42 commits into
mainfrom
lightspec
Open

feat(LightSpec): Support LightSpec Dynamic Speculative Decoding with EAGLE3, DSpark, and DFlash#1465
shihaobai wants to merge 42 commits into
mainfrom
lightspec

refactor: move MTP cost modeling to planners

6e25ddc
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar