Skip to content

Commit

Permalink
Update datafusion/physical-plan/src/sorts/sort.rs
Browse files Browse the repository at this point in the history
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
  • Loading branch information
2010YOUY01 and alamb authored Feb 26, 2025
1 parent 92ca3b0 commit d5e703a
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions datafusion/physical-plan/src/sorts/sort.rs
Original file line number Diff line number Diff line change
Expand Up @@ -422,6 +422,9 @@ impl ExternalSorter {
/// Reconstruct `self.in_mem_batches` to organize the payload buffers of each
/// `StringViewArray` in sequential order by calling `gc()` on them.
///
/// Note this is a workaround until <https://github.com/apache/arrow-rs/issues/7185> is
/// available
///
/// # Rationale
/// After (merge-based) sorting, all batches will be sorted into a single run,
/// but physically this sorted run is chunked into many small batches. For
Expand Down

0 comments on commit d5e703a

Please sign in to comment.