fix: Windows large file support and binary-safe downloads - #248
Conversation
Fixes two Windows (LLP64) issues reported via the VCPKG port: binary file corruption on download and 32-bit 'long' overflow for files larger than 2 GiB. Binary-safe downloads: - DownloadObject: open the temp output stream with std::ios::binary. On Windows the default text mode translates newlines and treats 0x1A as EOF, corrupting downloaded binary content (e.g. zip archives). Large file support (LLP64: 'long' is strictly 32-bit on Windows): - SelectResult (types.h) and the parser in select.cc: bytes_scanned / bytes_processed / bytes_returned switch from 'long int' to 'long long', and std::stol to std::stoll - StatObject (baseclient.cc): parse the content-length header with std::stoll so resp.size (size_t) is not truncated above 2 GiB - ComposeSource (args.h/args.cc): object_size_ member and its assignment switch from 'long' to 'long long' so composing sources larger than 2 GiB does not overflow No behavioral change on LP64 platforms (Linux/macOS), where 'long' is already 64-bit. Files changed: include/miniocpp/args.h, include/miniocpp/types.h, src/args.cc, src/baseclient.cc, src/client.cc, src/select.cc
|
Warning Review limit reached
Next review available in: 42 minutes You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. Review details⚙️ Run configurationConfiguration used: Organization UI Review profile: ASSERTIVE Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: ASSERTIVE Plan: Pro Plus Run ID: 📒 Files selected for processing (4)
📝 WalkthroughWalkthroughThe change replaces sentinel-based size values with optional types, uses 64-bit parsing for object and Select metrics, and opens temporary download files in binary mode. ChangesLarge-file and binary compatibility
Estimated code review effort: 2 (Simple) | ~10 minutes Mergeability Score: ⚪ Minimal · up to The PR fixes Windows binary downloads and large-file handling; the SelectResult API/ABI representation change should be documented for consumers, but no actionable merge-blocking risk remains. Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
@coderabbitai review |
✅ Action performedReview finished.
|
There was a problem hiding this comment.
Actionable comments posted: 3
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@include/miniocpp/args.h`:
- Line 385: Replace ComposeSource::object_size_’s -1 sentinel with
std::optional<size_t>, initialize it empty, and set it when BuildHeaders
succeeds. Update ComposeSource::ObjectSize() to check has_value() and return the
stored size through the existing size_t API without signed-to-unsigned
conversion.
In `@include/miniocpp/types.h`:
- Around line 296-298: Update include/miniocpp/types.h at lines 296-298 and
305-309 to include <optional> and change the three public Select metric fields
and corresponding constructor parameters to std::optional<long long>. Update
src/select.cc lines 198-212 to leave each metric unset when its XML text is
empty and assign the parsed long long value otherwise.
In `@src/select.cc`:
- Around line 198-212: Add focused test coverage for SelectHandler::DataFunction
by supplying a synthetic Stats event whose BytesScanned, BytesProcessed, and
BytesReturned values all exceed INT32_MAX, then assert the callback receives the
exact long long values. Keep the test independent of large objects and ensure it
would detect any regression from std::stoll to std::stol, particularly on
Windows.
🪄 Autofix
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Organization UI
Review profile: ASSERTIVE
Plan: Pro Plus
Run ID: ced86126-1a6c-4cd9-9d7c-2a8a831768b9
📒 Files selected for processing (6)
include/miniocpp/args.hinclude/miniocpp/types.hsrc/args.ccsrc/baseclient.ccsrc/client.ccsrc/select.cc
fix #208
Fixes two Windows (LLP64) issues reported via the VCPKG port: binary file corruption on download and 32-bit 'long' overflow for files larger than 2 GiB.
Binary-safe downloads:
Large file support (LLP64: 'long' is strictly 32-bit on Windows):
No behavioral change on LP64 platforms (Linux/macOS), where 'long' is already 64-bit.
Files changed: include/miniocpp/args.h, include/miniocpp/types.h, src/args.cc, src/baseclient.cc, src/client.cc, src/select.cc
Summary by CodeRabbit