Skip to content

feat(connectors): add BSON payload support to connectors runtime#3299

Draft
Standing-Man wants to merge 3 commits into
apache:masterfrom
Standing-Man:bson-payload
Draft

feat(connectors): add BSON payload support to connectors runtime#3299
Standing-Man wants to merge 3 commits into
apache:masterfrom
Standing-Man:bson-payload

Conversation

@Standing-Man
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes #1847.

Rationale

What changed?

Local Execution

  • Passed / not passed
  • Pre-commit hooks ran / not ran

AI Usage

@github-actions
Copy link
Copy Markdown

Thanks for the pull request. It is now waiting for review, labeled S-waiting-on-review.

You can update that label as the review goes back and forth, with slash commands - each on its own line, in a regular PR comment (not an inline review reply):

  • /ready - mark it S-waiting-on-review again, after addressing feedback
  • /author - mark it S-waiting-on-author (maintainers, or anyone who has had a PR merged before)
  • /request-review @user ... - request reviewers (@user or @org/team)

Commands take up to ~90s to apply. If no reaction (👍 or 😕) appears on your comment, the apply step likely failed - check the repo's Actions tab for the PR Triage Apply run. Commands posted inside a review body (rather than a normal comment) cannot be reacted to, so they stay log-only.

See CONTRIBUTING.md for details.

@github-actions github-actions Bot added the S-waiting-on-review PR is waiting on a reviewer label May 22, 2026
@Standing-Man Standing-Man marked this pull request as draft May 22, 2026 12:15
@github-actions github-actions Bot removed the S-waiting-on-review PR is waiting on a reviewer label May 22, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 22, 2026

Codecov Report

❌ Patch coverage is 75.18519% with 134 lines in your changes missing coverage. Please review.
✅ Project coverage is 57.18%. Comparing base (57fbe04) to head (4202c70).

Files with missing lines Patch % Lines
core/connectors/sdk/src/encoders/avro.rs 82.18% 70 Missing and 18 partials ⚠️
core/connectors/sdk/src/encoders/proto.rs 0.00% 16 Missing ⚠️
core/connectors/sdk/src/lib.rs 0.00% 10 Missing ⚠️
...ore/connectors/sdk/src/transforms/proto_convert.rs 0.00% 6 Missing ⚠️
core/connectors/sdk/src/decoders/bson.rs 0.00% 5 Missing ⚠️
core/connectors/sdk/src/encoders/bson.rs 0.00% 5 Missing ⚠️
core/connectors/sdk/src/encoders/flatbuffer.rs 0.00% 3 Missing ⚠️
core/connectors/sinks/http_sink/src/lib.rs 0.00% 1 Missing ⚠️
Additional details and impacted files
@@              Coverage Diff              @@
##             master    #3299       +/-   ##
=============================================
- Coverage     74.43%   57.18%   -17.26%     
  Complexity      943      943               
=============================================
  Files          1245     1246        +1     
  Lines        121293   108740    -12553     
  Branches      97599    85073    -12526     
=============================================
- Hits          90283    62181    -28102     
- Misses        28049    43790    +15741     
+ Partials       2961     2769      -192     
Components Coverage Δ
Rust Core 53.46% <75.18%> (-22.12%) ⬇️
Java SDK 58.44% <ø> (ø)
C# SDK 69.44% <ø> (-0.48%) ⬇️
Python SDK 81.06% <ø> (ø)
PHP SDK 83.57% <ø> (ø)
Node SDK 91.26% <ø> (+0.03%) ⬆️
Go SDK 40.20% <ø> (ø)
Files with missing lines Coverage Δ
core/connectors/sinks/http_sink/src/lib.rs 85.63% <0.00%> (-0.16%) ⬇️
core/connectors/sdk/src/encoders/flatbuffer.rs 79.67% <0.00%> (-0.99%) ⬇️
core/connectors/sdk/src/decoders/bson.rs 0.00% <0.00%> (ø)
core/connectors/sdk/src/encoders/bson.rs 0.00% <0.00%> (ø)
...ore/connectors/sdk/src/transforms/proto_convert.rs 71.76% <0.00%> (-0.58%) ⬇️
core/connectors/sdk/src/lib.rs 50.50% <0.00%> (-5.68%) ⬇️
core/connectors/sdk/src/encoders/proto.rs 69.03% <0.00%> (-1.52%) ⬇️
core/connectors/sdk/src/encoders/avro.rs 77.85% <82.18%> (+5.23%) ⬆️

... and 311 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@hubcio
Copy link
Copy Markdown
Contributor

hubcio commented May 29, 2026

@Standing-Man what's the status for this one? I see that it's a draft, do you have plans to continue?

@Standing-Man
Copy link
Copy Markdown
Contributor Author

@Standing-Man what's the status for this one? I see that it's a draft, do you have plans to continue?

My schedule has been a bit tight recently. If time permits, I’ll continue working on this PR and move it forward.

That said, if the PR remains inactive for an extended period, other contributors are more than welcome to pick up the issue and continue the work.

@Standing-Man Standing-Man force-pushed the bson-payload branch 2 times, most recently from e83629a to d4c1036 Compare May 30, 2026 05:32
Signed-off-by: StandingMan <jmtangcs@gmail.com>
Signed-off-by: StandingMan <jmtangcs@gmail.com>
Signed-off-by: StandingMan <jmtangcs@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add support for BSON payload to connectors runtime

2 participants