Add native fast reset compressors by TyomaVader · Pull Request #44 · yawkat/lz4-java

TyomaVader · 2026-04-03T12:35:45Z

Introduces JNI-based fast reset compressors, significantly improving the efficiency of compressor reuse by leveraging the native fastReset API from the C library.

When executing consecutive compressions, state re-initialization on each call can be a performance bottleneck. Native LZ4_compress_fast_extState_fastReset and LZ4_compress_HC_extStateHC_fastReset methods solve this by clearing only the necessary parts of the existing external state.

Warning

Unfortunately, that introduces a pointer to native mutable memory, so these new classes are not thread-safe and require explicit release of native resources (via close()).

yawkat · 2026-04-09T07:59:38Z

Thanks! I will wait for @luhenry to test #46 and then i'll cut a release.

### What changes were proposed in this pull request? This PR aims to upgrade `at.yawk.lz4:lz4-java` to 1.11.0. ### Why are the changes needed? To bring new improvements of `lz4-java` library. - https://github.com/yawkat/lz4-java/releases/tag/v1.11.0 - yawkat/lz4-java#44 ### Does this PR introduce _any_ user-facing change? No, this is a dependency-only change. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 4.6 Closes #55295 from dongjoon-hyun/SPARK-56441. Lead-authored-by: Dongjoon Hyun <dongjoon@apache.org> Co-authored-by: dongjoon-hyun <dongjoon-hyun@users.noreply.github.com> Signed-off-by: Cheng Pan <chengpan@apache.org>

Bumps [at.yawk.lz4:lz4-java](https://github.com/yawkat/lz4-java) from 1.10.4 to 1.11.0. Release notes *Sourced from [at.yawk.lz4:lz4-java's releases](https://github.com/yawkat/lz4-java/releases).* > lz4-java v1.11.0 > ---------------- > > What's Changed > -------------- > > * Add linux-riscv64 binary by [`@luhenry`](https://github.com/luhenry) in [yawkat/lz4-java#46](https://redirect.github.com/yawkat/lz4-java/pull/46) > * Bump checkout action version by [`@TyomaVader`](https://github.com/TyomaVader) in [yawkat/lz4-java#47](https://redirect.github.com/yawkat/lz4-java/pull/47) > * Add native fast reset compressors by [`@TyomaVader`](https://github.com/TyomaVader) in [yawkat/lz4-java#44](https://redirect.github.com/yawkat/lz4-java/pull/44) > * Fix docs production deployment by [`@yawkat`](https://github.com/yawkat) in [yawkat/lz4-java#49](https://redirect.github.com/yawkat/lz4-java/pull/49) > * Add testing on native amd64, arm, and riscv runners by [`@luhenry`](https://github.com/luhenry) in [yawkat/lz4-java#50](https://redirect.github.com/yawkat/lz4-java/pull/50) > > New Contributors > ---------------- > > * [`@luhenry`](https://github.com/luhenry) made their first contribution in [yawkat/lz4-java#46](https://redirect.github.com/yawkat/lz4-java/pull/46) > * [`@TyomaVader`](https://github.com/TyomaVader) made their first contribution in [yawkat/lz4-java#47](https://redirect.github.com/yawkat/lz4-java/pull/47) > > **Full Changelog**: <yawkat/lz4-java@v1.10.4...v1.11.0> Commits * [`5049a27`](yawkat/lz4-java@5049a27) Add testing on native amd64, arm, and riscv runners ([#50](https://redirect.github.com/yawkat/lz4-java/issues/50)) * [`dc0e761`](yawkat/lz4-java@dc0e761) Fix docs production deployment ([#49](https://redirect.github.com/yawkat/lz4-java/issues/49)) * [`91d1609`](yawkat/lz4-java@91d1609) Add native fast reset compressors ([#44](https://redirect.github.com/yawkat/lz4-java/issues/44)) * [`e122114`](yawkat/lz4-java@e122114) Bump checkout action version ([#47](https://redirect.github.com/yawkat/lz4-java/issues/47)) * [`ed8f477`](yawkat/lz4-java@ed8f477) Add linux-riscv64 binary ([#46](https://redirect.github.com/yawkat/lz4-java/issues/46)) * See full diff in [compare view](yawkat/lz4-java@v1.10.4...v1.11.0) [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility\_score?dependency-name=at.yawk.lz4:lz4-java&package-manager=maven&previous-version=1.10.4&new-version=1.11.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

TyomaVader added 4 commits April 3, 2026 13:19

Add native fast reset compressors

045b9c8

Add native fast reset compressor tests

c01b7f4

Simplify byte buffer paths

ad9a637

Add constructor normalization for compression level and acceleration

3661c7c