An open API service providing commit metadata for open source projects.

GitHub / apache/datafusion / commits

Apache DataFusion SQL Query Engine

SHA Message Author Date Stats
ebea0691 docs: Update dev/release/README.md for new crate `datafusion-proto-models` (#... Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
10 days ago
6187d47e fix: make UnnestExec respect datafusion.execution.batch_size (#24384)
Co-authored-by: Andrew Lamb <a****w@n****g>
Andy Grove <a****e@a****g>
Committed by: GitHub <n****y@g****m>
10 days ago
f6ad7810 Fix `cargo audit` by updating `h2` to 0.4.16 (#24467) Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
11 days ago
19f2e85f Add dfbench statistics command (#23975) Gabriel <4****s@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
303ff78a Enable more clippy lints (#24322)
Co-authored-by: Claude Opus 5 (1M context) <n****y@a****m>, Daniël Heres <d****s@g****m>
Emil Ernerfeldt <e****t@g****m>
Committed by: GitHub <n****y@g****m>
11 days ago
65c20d20 IN LIST: centralize primitive filters and optimize Decimal128 (#24283) Geoffrey Claude <g****e@g****m>
Committed by: GitHub <n****y@g****m>
11 days ago
3487c6a8 docs: Update Concepts, Readings, Events page (add Videos section, recent post... Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
11 days ago
a0a6becf chore(deps): bump the codeql-actions group across 1 directory with 2 updates ...
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
29296abc chore(deps): bump tomlkit from 0.14.0 to 0.15.1 (#24448)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
7f51452a chore(deps): bump taiki-e/install-action from 2.85.11 to 2.86.1 (#24451)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
988e097c chore(deps): bump astral-sh/setup-uv from 9.0.0 to 10.0.1 (#24452)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
bec06e75 feat(substrait): serialize correlated subqueries with OuterReference field re... @clflushopt <1****t@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
0a4e9305 feat: null aware RightAnti hash join execution + planning support (#23957) Saad Tajwar <5****r@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
006dffce feat: remove extra Rows from ReusableRows (#23802) Ariel Miculas-Trif <a****s@g****m>
Committed by: GitHub <n****y@g****m>
11 days ago
e16d4535 docs: add Streamling to known users (#24439) Yaroslav Tkachenko <s****y@g****m>
Committed by: GitHub <n****y@g****m>
11 days ago
6eaca8bf perf: Extend WindowTopN to `dense_rank` (#23869) Subham Singhal <S****l@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
708ee7ec refactor: CrossJoinStream (simplifying, less state, async generator pattern) ... Saad Tajwar <5****r@u****m>
Committed by: GitHub <n****y@g****m>
11 days ago
c7be84a1 perf: Reduce record batch memory accounting overhead (#24319) Ryu <1****1@u****m>
Committed by: GitHub <n****y@g****m>
12 days ago
bb038a67 fix: ScalarSubqueryToJoin fails when CTE inside correlated scalar subquery (#... Ruchir Tripathi <1****i@u****m>
Committed by: GitHub <n****y@g****m>
12 days ago
9a83691a docs: add HashJoinExec metrics to user guide (#24055) Yuwei Zhao <z****y@1****m>
Committed by: GitHub <n****y@g****m>
12 days ago
83be77c5 fix: translate SQL wildcards in SIMILAR TO patterns (#22263) (#23188) 0x70 <1****o@u****m>
Committed by: GitHub <n****y@g****m>
12 days ago
710e74e6 Add focused benchmark for Parquet pruning setup cache (#24323) kosiew <k****w@g****m>
Committed by: GitHub <n****y@g****m>
12 days ago
bbf739a3 feat: Add robots.txt to site (#24333)
Co-authored-by: Jeffrey Vo <j****a@g****m>
Narendra <n****1@g****m>
Committed by: GitHub <n****y@g****m>
13 days ago
110a90ae feat: add sphinx-sitemap dependency and configuration for sitemap generation ...
Co-authored-by: Daniël Heres <d****s@g****m>, Claude Opus 5 <n****y@a****m>, Liang-Chi Hsieh <v****a@g****m>, Qi Zhu <z****s@g****m>, dependabot[bot] <4****]@u****m>, linfeng <3****c@u****m>, anchor <c****g@g****m>, codeAnqiang-ma <2****a@u****m>, Adrian Garcia Badaracco <1****b@u****m>, dentiny <d****o@g****m>, kosiew <k****w@g****m>, Tim Saucer <t****r@g****m>, Subham Singhal <S****l@u****m>, Goutam Adwant <8****t@u****m>, Andrew Lamb <a****w@n****g>, Burak Şen <b****b@g****m>, RIchard Baah <1****d@u****m>, rich-T-kid <r****h@M****l>, sakshichitnis27 <1****7@u****m>, Adam Gutglick <a****l@g****m>, Alvaro Balbin <1****n@u****m>, Reid Kaufmann <7****n@u****m>, Andy Grove <a****e@a****g>, kid <1****3@u****m>, Nagato Yuzuru <n****o@y****e>, Jamison-J <j****9@1****m>, jiangzhen <j****n@n****t>
Signed-off-by: dependabot[bot] <s****t@g****m>, Reid Kaufmann <r****n@g****m>
Narendra <n****1@g****m>
Committed by: GitHub <n****y@g****m>
13 days ago
aff5850c Add per-aggregate argument evaluation metrics for grouped hash aggregation (#... kosiew <k****w@g****m>
Committed by: GitHub <n****y@g****m>
13 days ago
9fdf1447 feat: Add support for Map type in SQL (#24397) Nuno Faria <n****a@g****m>
Committed by: GitHub <n****y@g****m>
13 days ago
3359eab0 feat: add implicit native coercion constructor (#24282)
Co-authored-by: jiangzhen <j****n@n****t>
Jamison-J <j****9@1****m>
Committed by: GitHub <n****y@g****m>
13 days ago
b551ba03 fix: skip WindowTopN rewrite when fetch is 0 to avoid PartitionedTopK panic (... Liang-Chi Hsieh <v****a@g****m>
Committed by: GitHub <n****y@g****m>
13 days ago
c1b39bd5 Feat: add dictionaries as a supported group column type (#23187) RIchard Baah <1****d@u****m>
Committed by: GitHub <n****y@g****m>
13 days ago
4042812a fix: consider nulls_first when propagating ordered SortProperties (#24206) Nagato Yuzuru <n****o@y****e>
Committed by: GitHub <n****y@g****m>
13 days ago
2da78d67 fix(spark): correct mod ANSI zero divisor and negative zero handling (#23987) kid <1****3@u****m>
Committed by: GitHub <n****y@g****m>
13 days ago
bf1c17ae feat: union nested Parquet leaves across projection accesses (#24130) Goutam Adwant <8****t@u****m>
Committed by: GitHub <n****y@g****m>
13 days ago
e7e037db docs: add an agent skill for auditing datafusion-spark expressions (#23893) Andy Grove <a****e@a****g>
Committed by: GitHub <n****y@g****m>
14 days ago
16b08db0 fix: preserve NULL semantics when simplifying col ~ '.*' (#24380) Liang-Chi Hsieh <v****a@g****m>
Committed by: GitHub <n****y@g****m>
14 days ago
d3c47b4a fix: drain PiecewiseMergeJoin output before state transitions (#24298) Burak Şen <b****b@g****m>
Committed by: GitHub <n****y@g****m>
14 days ago
4403c5d8 bench: pwmj left semi/anti join (#24160) Subham Singhal <S****l@u****m>
Committed by: GitHub <n****y@g****m>
14 days ago
47794ff2 Improve planning speed: Fast path for `union_schema` when all children share ...
Signed-off-by: Reid Kaufmann <r****n@g****m>
Reid Kaufmann <7****n@u****m>
Committed by: GitHub <n****y@g****m>
14 days ago
bb45fb82 docs(upgrading): document RecursiveQuery schema field in upgrade guide (#23991)
Co-authored-by: Andrew Lamb <a****w@n****g>
Alvaro Balbin <1****n@u****m>
Committed by: GitHub <n****y@g****m>
14 days ago
67502a36 Document decimal AVG wrapping arithmetic (#23685)
Co-authored-by: Adam Gutglick <a****l@g****m>
sakshichitnis27 <1****7@u****m>
Committed by: GitHub <n****y@g****m>
14 days ago
a10d1937 Perf: remove extra allocations for hex operations (#24057)
Co-authored-by: rich-T-kid <r****h@M****l>
RIchard Baah <1****d@u****m>
Committed by: GitHub <n****y@g****m>
14 days ago
f3ef45a5 docs: Document `WindowFn` and add comments (#24118)
Co-authored-by: Claude Fable 5 <n****y@a****m>
Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
14 days ago
f956fd11 fix(proto): preserve Arrow IPC stream format (#24224) Burak Şen <b****b@g****m>
Committed by: GitHub <n****y@g****m>
14 days ago
b9399dc2 perf: Update `TableProvider` to take scan projection as `Option<&[usize]>` (#...
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
cc7565be fix: don't report equi-key equivalence for PiecewiseMergeJoin range joins (#2... Liang-Chi Hsieh <v****a@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
7c079f74 fix: preserve the input list's inner field in array_append/prepend/replace (#... Tim Saucer <t****r@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
ec110cea fix(parquet): don't runtime-prune row groups while a page-index RowSelection ... Qi Zhu <z****s@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
1b67f2e9 Docs: document manual catalog impls and how compilation got faster (#24362) Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
15 days ago
571477c4 feat(cli): add opt-in Spark function registration (#24179) Goutam Adwant <8****t@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
00eba790 feat(pwmj): support LeftSemi/LeftAnti existence joins via classic scan (#23870) Subham Singhal <S****l@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
9f377c44 fix: correct list field inner type in array functions (#24345) Tim Saucer <t****r@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
574fe67f fix(parquet): sync rg_plan to decoder frontier — fix wrong TopK results from ... Qi Zhu <z****s@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
1f0615a1 Fix ArrowBytesViewMap retained capacity accounting (#24257) kosiew <k****w@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
84a8e6db Reduce datafusion-spark dependency footprint (#24351) dentiny <d****o@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
773ef226 docs: update proto-models README for the datafusion-common dependency (#24279)
Co-authored-by: Claude <n****y@a****m>
Adrian Garcia Badaracco <1****b@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
a635b18d docs: fix signum documentation to say zero returns 0 (#24324)
Co-authored-by: codeAnqiang-ma <2****a@u****m>
anchor <c****g@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
6b7da9a9 chore(deps): bump requests from 2.33.0 to 2.34.2 (#24303)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
5a5da23b chore(deps): bump typing-extensions from 4.15.0 to 4.16.0 (#24304)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
c085cdfa chore(deps-dev): bump webpack from 5.105.0 to 5.109.2 in /datafusion/wasmtest...
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
13552dd6 chore(deps): bump rich from 14.3.2 to 15.0.0 (#24305)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
91ead9f8 chore(deps): bump setuptools from 83.0.0 to 84.0.0 (#24301)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
ede32c17 chore(deps): bump pygithub from 2.8.1 to 2.9.1 (#24299)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
50cdbde1 fix: preserve NULL semantics in bitwise xor simplification (#24248) linfeng <3****c@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
90164e1a chore(deps-dev): bump webpack-cli from 5.1.4 to 7.2.2 in /datafusion/wasmtest...
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
473ba171 chore(deps): bump taiki-e/install-action from 2.85.10 to 2.85.11 (#24306)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
34060673 chore(deps): bump Swatinem/rust-cache from 2.8.1 to 2.9.2 in /.github/actions...
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
15 days ago
6adb5043 bench: add parquet_row_filter_skip suite for the fully-matched RowFilter skip...
Co-authored-by: Claude <n****y@a****m>
Qi Zhu <z****s@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
0a429a37 fix: emit unmatched NULL-key right rows in RIGHT/FULL PiecewiseMergeJoin (#24... Liang-Chi Hsieh <v****a@g****m>
Committed by: GitHub <n****y@g****m>
15 days ago
e76f1af0 perf(build): use line-tables-only debug info in the `dev` profile (#24339)
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
f1715873 perf(build): don't build the doc-generator binaries by default (#24338)
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
8c099dc1 perf(session): cut `datafusion-session` compile time ~1.7x (#24326)
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
519687ca perf(catalog-listing): cut `datafusion-catalog-listing` compile time ~4.4x (#...
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
ca1e25e2 perf(core): cut `datafusion` core compile time ~10x (#24329)
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
1a770de0 perf(catalog): cut `datafusion-catalog` compile time ~6x (#24325)
Co-authored-by: Claude Opus 5 <n****y@a****m>
Daniël Heres <d****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
6b051b0b chore(deps): bump the all-other-cargo-deps group across 1 directory with 3 up...
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
16 days ago
1164d602 Minor: avoid a few clones in sum accumulator setup (#24309) Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
16 days ago
ab12f5e4 fix(ffi): preserve TableProvider DML overrides (#23906) Amogh Ramesh <r****4@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
186f96fb refactor(hash-aggr): migrate ordered single aggregation (#24259) Yongting You <2****1@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
3985bd5b Enable more lints (#24066)
Co-authored-by: Claude Opus 5 (1M context) <n****y@a****m>
Emil Ernerfeldt <e****t@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
591ae10c feat: Store only the last row in the previous cursor for round robin tie-brea... Ariel Miculas-Trif <a****s@g****m>
Committed by: GitHub <n****y@g****m>
16 days ago
bbb552f7 [Parquet] Skip bloom filter predicate evaluation when no bloom filters are lo...
Co-authored-by: Andrew Lamb <a****w@n****g>
Renan GEHAN <r****n@g****m>
Committed by: GitHub <n****y@g****m>
17 days ago
766ca588 chore: Expand dependabot coverage (#24290) Neil Conway <n****y@g****m>
Committed by: GitHub <n****y@g****m>
17 days ago
caa3cb4a refactor(physical-plan): Simplify `ExecutionPlan` API with `replace_children`...
Co-authored-by: Andrew Lamb <a****w@n****g>
Justin O'Dwyer <j****r@d****m>
Committed by: GitHub <n****y@g****m>
17 days ago
6459afe6 chore: Update depcheck toolchain and dependencies (#24289) Neil Conway <n****y@g****m>
Committed by: GitHub <n****y@g****m>
17 days ago
ad977b01 Add branch-55 protection (#24293) Tim Saucer <t****r@g****m>
Committed by: GitHub <n****y@g****m>
17 days ago
78b828c1 bench: add standard window function cases to bounded_window (#24151) Neil Conway <n****y@g****m>
Committed by: GitHub <n****y@g****m>
17 days ago
c81e7070 perf: Concretely typed TopK ArrowHashTable storage (#23609) Michal Piatkowski <2****a@u****m>
Committed by: GitHub <n****y@g****m>
17 days ago
9b3b5189 fix: ensure new_list respects data_type argument (#24029) Ruchir Tripathi <1****i@u****m>
Committed by: GitHub <n****y@g****m>
17 days ago
c08832d4 fix: preserve NULL semantics in `log` and `power` simplification (#24247) linfeng <3****c@u****m>
Committed by: GitHub <n****y@g****m>
17 days ago
7e015b74 fix(physical-plan): CTAS panic on wasm32-unknown-unknown (#24275) Kent Wu <k****u@g****m>
Committed by: GitHub <n****y@g****m>
18 days ago
30ca39be fix: Propagate NULLs in `regexp_count`, `regexp_instr` (#24239) Neil Conway <n****y@g****m>
Committed by: GitHub <n****y@g****m>
18 days ago
fc4e43e7 chore(deps): bump the codeql-actions group with 2 updates (#24250)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
18 days ago
8e5c7896 FFI: plumb with_updated_config for FFI_ScalarUDF (#22797)
Co-authored-by: Tim Saucer <t****r@g****m>
Signed-off-by: Amogh Ramesh <r****4@g****m>
Amogh Ramesh <r****4@g****m>
Committed by: GitHub <n****y@g****m>
18 days ago
570d2e1d perf: prune window state only for partitions that made progress (#24148) Neil Conway <n****y@g****m>
Committed by: GitHub <n****y@g****m>
18 days ago
149bdb51 fix: infer placeholder types in GROUP BY, HAVING, QUALIFY and ORDER BY (fix f... Braedon Wooding <b****g@d****m>
Committed by: GitHub <n****y@g****m>
18 days ago
0ef1aaab refactor: moving WindowTopN before EnsureRequirements (#24191) Saad Tajwar <5****r@u****m>
Committed by: GitHub <n****y@g****m>
18 days ago
b5c4bf22 chore(deps): bump toml from 0.9.12+spec-1.1.0 to 1.1.3+spec-1.1.0 (#24256)
Co-authored-by: dependabot[bot] <4****]@u****m>
Signed-off-by: dependabot[bot] <s****t@g****m>
dependabot[bot] <4****]@u****m>
Committed by: GitHub <n****y@g****m>
18 days ago
bc99f409 refactor: make apply_expression_roots more ergonomic (#24226) Jayant Shrivastava <j****a@d****m>
Committed by: GitHub <n****y@g****m>
18 days ago
041a7167 Restore the From / TryFrom proto conversions dropped since 54.1.0 (#24205)
Co-authored-by: Claude Opus 5 <n****y@a****m>, Andrew Lamb <a****w@n****g>
Adrian Garcia Badaracco <1****b@u****m>
Committed by: GitHub <n****y@g****m>
18 days ago
7544051f chore(proto): remove never-released deprecated PhysicalPlanNodeExt scaffoldin...
Co-authored-by: Claude Opus 5 <n****y@a****m>
Adrian Garcia Badaracco <1****b@u****m>
Committed by: GitHub <n****y@g****m>
18 days ago
9ecb75fb Docs: Add PR review guide (#24051)
Co-authored-by: Yongting You <2****1@g****m>
Andrew Lamb <a****w@n****g>
Committed by: GitHub <n****y@g****m>
18 days ago

← Back to repository