Skip to content

TurboQuant: Add distortion benchmark#8070

Open
connortsui20 wants to merge 1 commit into
developfrom
ct/tq-error
Open

TurboQuant: Add distortion benchmark#8070
connortsui20 wants to merge 1 commit into
developfrom
ct/tq-error

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented May 22, 2026

Summary

Tracking issue: #7830

Adds distortion / error benchmarking option for TurboQuant. Note that this benchmark is still over the old implementation of TurboQuant, but because the algorithm is identical it shouldn't affect any numbers.

We will cut over to the new version atomically once everything is implemented in vortex-turboquant.

distortion

Testing

N/A

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 22, 2026

Merging this PR will improve performance by 17.88%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 1250 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime cuda/bitpacked_u8/unpack/3bw[100M] 353 µs 299.4 µs +17.88%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/tq-error (2095616) with develop (495f30e)

Open in CodSpeed

@connortsui20 connortsui20 force-pushed the ct/tq-error branch 2 times, most recently from ab18c6f to 309dcfc Compare May 22, 2026 20:26
@connortsui20
Copy link
Copy Markdown
Contributor Author

connortsui20 commented May 22, 2026

whoops forgot to make sure the binary is always up to date (edit: fixed)

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 enabled auto-merge (squash) May 22, 2026 21:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant