Repository navigation

Cherry-pick apache/datafusion#25185 - #182

Closed

LiaCastaneda wants to merge 81 commits into

DataDog:branch-55from

LiaCastaneda:lia.castaneda/cherry-pick/apache-pr-25185-20260916

Commits on May 20, 2026
- [branch-54] Bump to version 54.0.0 (#22396)
  mbutrovich
  authored
  7a14d12
- [branch-54] add changelog (#22402)
  mbutrovich
  authored
  c8dddb8
Commits on May 22, 2026
- [branch-54] Revert "Add `ExecutionPlan::apply_expressions()` (#20337)" (#22437) (#22445)
  alamb
  authored
  858ad6b
- [branch-54]: Backport 22404. Fix Spark slice function on negative OOB (#22443)
  comphead
  authored
  a4a0804
Commits on May 24, 2026
- [branch-54] Cherry-pick #22493: restore SortExec elimination after stats-based file reorder (#22501)
  
  authored
  1875365
Commits on May 26, 2026
- [branch-54] Fix: compact view buffers in ScalarValue::compact for all container types (#21934) (#22446)
  
  authored
  1321d60
Commits on May 28, 2026
- [branch-54] Support transparent ExecutionPlan downcasts (#22565)
  geoffreyclaude
  authored
  50aa138
Commits on Jun 1, 2026
Commits on Jun 3, 2026
- [branch-54] refactor: give parquet CDC options an explicit `enabled` flag (backport #22632) (#22648)
  kszucs
  authored
  2a5be51
- [branch-54] Update changelog after backports (#22737)
  
  mbutrovich
  and
  alamb
  authored
  45d943d
Commits on Jun 8, 2026
- [branch-54] fix: preserve null_aware on logical JoinNode proto round-trip (backport #22104) (#22785)
  mithuncy
  authored
  08da279
Commits on Jun 11, 2026
- turn off submodule updating
  
  bcmyers
  authored and
  fred1268
  committed
  3752ac6
- Fix ArrayCompact incompatibility with branch-53
  
  gabotechs
  authored and
  fred1268
  committed
  86548ab
- fix: remove as_any from ArrayCompact, not part of ScalarUDFImpl in branch-54
  fred1268
  committed
  7ecb63b
- fix(substrait): dedupe names of aggregate measures, not just groupings (#22453) (#126)
  
  LiaCastaneda
  authored and
  fred1268
  committed
  6a9a86a
- Add lambda substrait support (#21193) (#134)
  
  authored and
  fred1268
  committed
  b79ddd1
- fix: make PushDownLeafProjections work with unnest (#22620)
  
  pabadrubio
  authored and
  fred1268
  committed
  69ebcb2
Commits on Jun 16, 2026
- add downcast_delegate
  fred1268
  committed
  1edcd20
Commits on Jun 18, 2026
- fix(topk): call attempt_early_completion when filter rejects entire batch (#22852)
  
  ajegou
  and
  gabotechs
  committed
  2223bfd
- Merge pull request #148 from ajegou/arnaud.jegou/cherry-pick/apache-pr-22852-branch54-20260617
  
  gh-worker-dd-mergequeue-cf854d[bot]
  and
  ajegou
  authored
  888b137
Commits on Jun 24, 2026
- fix(proto): honor ExecutionPlan downcast_delegate during serialization
  geoffreyclaude
  committed
  19de38e
- Merge pull request #149 from DataDog/codex/branch-54-proto-downcast-delegate
  geoffreyclaude
  authored
  c884d40
Commits on Jul 1, 2026
Commits on Jul 6, 2026
- fix: Avoid panicing when stats are not available for a file group split (#23277)
  
  mkleen
  authored and
  fred1268
  committed
  ff017d0
- Merge pull request #153 from DataDog/cherry-pick-7b1bffa
  fred1268
  authored
  b523ae4
Commits on Jul 16, 2026
- Cherry-pick apache/datafusion#22744 and #23312 (#157)
  
  Adam-Alani
  and
  alamb
  authored
  4a6f1ba
Commits on Jul 27, 2026
- Add protobuf support for lambdas (#22362)
  
  gstvg
  authored and
  gabotechs
  committed
  9d2114f
- [branch-54] Adapt lambda protobuf backport
  
  Tristan1900
  authored and
  gabotechs
  committed
  b22414e
Commits on Jul 29, 2026
- perf: `array_agg()` performance improvements (#23716)
  
  fred1268
  and
  alamb
  committed
  0fccf15
- cargo fmt
  fred1268
  committed
  dbbd836
- Merge pull request #161 from DataDog/cherry-pick-cd28203e3
  
  gh-worker-dd-mergequeue-cf854d[bot]
  and
  fred1268
  authored
  b632fb7
Commits on Aug 7, 2026
- Preserve grouping ID during aggregate CSE (#24144)
  
  notfilippo
  and
  gabotechs
  committed
  4140411
- Backport physical range partitioning to branch 54
  gene-bordegaray
  committed
  e2d9f84
- Aggregations Support `Partitioning::Range` (#23239)
  gene-bordegaray
  committed
  9baa581
- Add range partitioning sqllogictest fixture (#22607)
  gene-bordegaray
  committed
  5f1da98
- Add logical range partitioning representation (#22777)
  gene-bordegaray
  committed
  3598943
- Add `ListingOptions::output_partitioning` and `FileScanConfig::output_partitioning` for pre-defined file partitioning (#22657)
  
  gene-bordegaray
  and
  gabotechs
  committed
  51c8780
- feat: logical plan protobuf representation for range repartitioning (#23030)
  
  saadtajwar
  authored and
  gene-bordegaray
  committed
  7a05648
- Add `Distribution::HashPartitioned` to `Distribution::KeyPartitioned` API bridge (#23259)
  gene-bordegaray
  committed
  22159ad
- feat: physical execution for range partitioning (#23231)
  
  saadtajwar
  authored and
  gene-bordegaray
  committed
  d3a9271
- Support co-partitioned range inner equi joins (#23184)
  gene-bordegaray
  committed
  1d1ec1e
- feat: allow Partitioning::Range to satisfy window Distribution::KeyPartitioned requirements (#23416)
  
  mithuncy
  authored and
  gene-bordegaray
  committed
  1248881
- Allow Range partitioned inputs to PartitionedTopK (#23355)
  
  stuhood
  authored and
  gene-bordegaray
  committed
  e98fb60
- fix: preserve range partitioning through joins (#23584)
  
  EdsonPetry
  authored and
  gene-bordegaray
  committed
  cd3a218
- Enforce co-partitioning for sort merge and symmetric hash joins (#23480)
  gene-bordegaray
  committed
  a9de07a
- allow interleaveExec to support Range partioning (#23623)
  
  Rich-T-kid
  authored and
  gene-bordegaray
  committed
  6709f72
- feat: allow Full joins to reuse range co-partitioning in HashJoinExec (#23583)
  
  authored and
  gene-bordegaray
  committed
  7d37d4e
- feat: support co-partitioned range right-side equi hash joins (#23484)
  
  Gustavo Schneiter
  authored and
  gene-bordegaray
  committed
  34149d9
- feat: complete range repartition physical planning (#23617)
  
  saadtajwar
  authored and
  gene-bordegaray
  committed
  e95b7a2
- feat(physical-plan): Allow co-partitioned Partitioning::Range inputs for left-side hash joins (#23487)
  
  JSOD11
  authored and
  gene-bordegaray
  committed
  5d0aaf5
- feat: Range Partitioning FFI (#23520)
  
  authored and
  gene-bordegaray
  committed
  a785b2f
- allow range to satisfy key distribution generally (#23680)
  gene-bordegaray
  committed
  7b01c11
- Adapt range partitioning tests for branch 54
  gene-bordegaray
  committed
  4aed15d
- Fix KeyPartitioned co-partitioning docs
  gene-bordegaray
  committed
  b73fd34
- Merge pull request #164 from DataDog/branch-54-range-partitioning-cherry-pick
  
  authored
  f6d73a8
Commits on Aug 12, 2026
- fix(lambda): only push referenced params into the merged batch (#24162) (#166)
  LiaCastaneda
  authored
  79de5e9
Commits on Aug 13, 2026
- Revert "Branch 54 range partitioning cherry pick" (#168)
  LiaCastaneda
  authored
  85fc394
Commits on Aug 14, 2026
- [cherry-pick] fix: keep a CoalescePartitionsExec required by a SinglePartition child (#169)
  
  authored
  a4a9f69
Commits on Aug 17, 2026
- feat(physical-plan): generic Rows-backed GroupColumn keeps mixed schemas on the column-wise path (#23523)
  
  zhuqi-lucas
  authored and
  Rich-T-kid
  committed
  e8b23e0
- Feat: add dictionaries as a supported group column type (#23187)
  Rich-T-kid
  committed
  5914809
- Add FixedSizeBinary support for MultiGroupBy (#23646)
  
  authored and
  Rich-T-kid
  committed
  8d1a677
- [cherry-pick] feat: Support IEEE 754 negative zero semantics (#22835)
  Rich-T-kid
  committed
  2c00faf
- Merge pull request #171 from DataDog/richard.baah/cherry-pick-aggregation-pr
  
  authored
  d87fb2f
Commits on Sep 4, 2026
- Fix shared TopK early exit with shared prefix threshold (#22991)
  
  geoffreyclaude
  and
  kosiew
  committed
  955fff0
- Adapt #22991 tests to branch-54 dynamic filter API
  geoffreyclaude
  committed
  ebe9ad9
- Merge pull request #174 from geoffreyclaude/geoffrey.claude/cherry-pick/apache-pr-22991-branch54-20260904
  
  gh-worker-dd-mergequeue-cf854d[bot]
  and
  geoffreyclaude
  authored
  8231c61
- [cherry-pick] Add support for dictionary for approx_distinct (#24646)
  
  authored and
  Rich-T-kid
  committed
  952a573
- fix lint
  Rich-T-kid
  committed
  d8c10ab
- fix: add blank line after DROP TABLE in aggregate.slt to terminate SLT statement
  
  Rich-T-kid
  and
  claude
  committed
  c0fd2c8
- Merge pull request #175 from DataDog/richard.baah/cherry-pick-dict-branch
  
  authored
  9f545ed
Commits on Sep 8, 2026
- substrait: add an extension point for per-field Arrow metadata on user-defined types (#25015)
  
  moraistejerina
  authored and
  gabotechs
  committed
  b41aefa
Commits on Sep 16, 2026
- perf: reuse cached dictionary value hashes in vectorized_append (#25185)
  LiaCastaneda
  committed
  d128861

Commits

Commits on May 20, 2026

Commits on May 22, 2026

Commits on May 24, 2026

Commits on May 26, 2026

Commits on May 28, 2026

Commits on Jun 1, 2026

Commits on Jun 3, 2026

Commits on Jun 8, 2026

Commits on Jun 11, 2026

Commits on Jun 16, 2026

Commits on Jun 18, 2026

Commits on Jun 24, 2026

Commits on Jul 1, 2026

Commits on Jul 6, 2026

Commits on Jul 16, 2026

Commits on Jul 27, 2026

Commits on Jul 29, 2026

Commits on Aug 7, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

Commits on Aug 14, 2026

Commits on Aug 17, 2026

Commits on Sep 4, 2026

Commits on Sep 8, 2026

Commits on Sep 16, 2026