Skip to content

perf: coalesce single-column sort runs to cut merge fan-in #23208

Description

@Dandandan

Is your feature request related to a problem or challenge?

Columns that exceed the threshold are merged using merge.
This causes a lot of small sort runs to be merged, which is slower than larger runs.
For multi column the tradeoff is different as multi row sort using lexsort_to_indices is slower.

Describe the solution you'd like

Coalesce single columns until the threshold (1MiB by default)

No response

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request
No fields configured for Feature.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions