Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
74 commits
Select commit Hold shift + click to select a range
ea2e7ab
Implement native support StringView for overlay (#11968)
PsiACE Aug 15, 2024
cb3ec77
disable `with_create_default_catalog_and_schema` if the default catal…
goldmedal Aug 15, 2024
4baa901
Use tracked-consumers memory pool be the default. (#11949)
wiedld Aug 15, 2024
06bcf33
Update REVERSE scalar function to support Utf8View (#11973)
Omega359 Aug 15, 2024
41f6dd9
Support partial aggregation skip for boolean functions (#11847)
2010YOUY01 Aug 15, 2024
6b73c4f
feat/11953: Support StringView for TRANSLATE() fn (#11967)
devanbenz Aug 15, 2024
c1fb989
Update SPLIT_PART scalar function to support Utf8View (#11975)
Lordworms Aug 15, 2024
36158b6
Handle arguments checking of `min`/`max` function to avoid crashes (#…
tlm365 Aug 15, 2024
19ad53d
Fix: support NULL input for regular expression comparison operations …
HuSen8891 Aug 15, 2024
9d1cf74
Remove physical sort parameters on aggregate window functions (#12009)
timsaucer Aug 15, 2024
9f77021
Minor: Use execution error in ScalarValue::iter_to_array for incorrec…
jayzhan211 Aug 16, 2024
58075e2
Fix: support NULL input for like operations (#12025)
HuSen8891 Aug 16, 2024
57d5e0e
Minor: Add error tests for min/max with 2 arguments (#12024)
alamb Aug 16, 2024
5db036e
fix: incorrect aggregation result of `bool_and` (#12017)
jonahgao Aug 16, 2024
bb92181
Improve performance of REPEAT functions (#12015)
tlm365 Aug 16, 2024
300a08c
support Utf8View (#12019)
dmitriibugakov Aug 16, 2024
08f6e54
Minor: Remove wrong comment on `Accumulator::evaluate` and `Accumulat…
lewiszlw Aug 16, 2024
dc84fa5
Minor: cleanup `.gitignore` (#12035)
alamb Aug 16, 2024
2a16704
Improve documentation about `ParquetExec` / Parquet predicate pushdow…
alamb Aug 16, 2024
b06e8b0
catalog.has_header true by default (#11919)
korowa Aug 17, 2024
72b6a49
feat: Add map_extract module and function (#11969)
Weijun-H Aug 17, 2024
e4bc622
refactor: Move `LimitedDistinctAggregation` to `physical-optimizer` …
Weijun-H Aug 17, 2024
bd2d4ee
Convert built-in `row_number` to user-defined window function (#12030)
jcsherin Aug 17, 2024
48416e5
Fix projection name with DataFrame::with_column and window functions …
devanbenz Aug 17, 2024
7fa7689
Update to `sqlparser-rs` v0.50.0 (#12014)
samuelcolvin Aug 17, 2024
186ba4c
Minor: make some physical-plan properties public (#12022)
emgeee Aug 17, 2024
1f90b00
chore: improve variable naming conventions (#12042)
caicancai Aug 17, 2024
e84f343
Fix: handle NULL input for regex match operations (#12028)
HuSen8891 Aug 17, 2024
cb1e3f0
Fix compilation, change row_number() expr_fn to 0 args (#12043)
alamb Aug 17, 2024
cd9237f
Minor: Remove warning when building datafusion-cli from Dockerfile (#…
tlm365 Aug 18, 2024
950dc73
add getter method for LogicalPlanBuilder.plan (#12038)
emgeee Aug 18, 2024
a91be04
Window UDF signature check (#12045)
jayzhan211 Aug 18, 2024
574dfeb
Fix: generate_series function support string type (#12002)
getChan Aug 19, 2024
02eab80
Do not add redundant subquery ordering into plan (#12003)
Aug 19, 2024
c60b798
Fix: Remove Unrelated Fields When Expanding Wildcards in Functional D…
berkaysynnada Aug 19, 2024
a3c0c19
Update async-trait in CLI and catalog crates (#12061)
findepi Aug 19, 2024
b779177
Improve doc (#12053)
lewiszlw Aug 19, 2024
159ab17
Minor: remove clones in `coerce_plan_expr_for_schema` (#12051)
jonahgao Aug 19, 2024
7c5a8eb
fix: support min/max for Float16 type (#12050)
korowa Aug 19, 2024
bd48262
implement utf8_view for replace (#12004)
thinh2 Aug 19, 2024
c2cbba2
Fix CI check when version changes -- remove checked in file that is c…
alamb Aug 19, 2024
67cf1d6
Minor: update sqllogictest to treat Utf8View as text (#12033)
alamb Aug 20, 2024
37e54ee
[MINOR] correct document mistakes (#12068)
Aug 20, 2024
6e34280
Plan `LATERAL` subqueries (#11456)
aalexandrov Aug 20, 2024
ecb5a91
vectorize random() scalar function (#12078)
2010YOUY01 Aug 20, 2024
9bd183f
functions: support strpos with mixed string types (#12072)
nrc Aug 20, 2024
e6e1eb2
Update to `clap` 4.5.16 (#12064)
findepi Aug 20, 2024
6786f15
Fix the schema mismatch between logical and physical for aggregate fu…
jayzhan211 Aug 21, 2024
846befb
minor: Remove unused create_row_hashes (#12083)
andygrove Aug 21, 2024
1c7209b
Use `schema_name` to create the `physical_name` (#11977)
joroKr21 Aug 21, 2024
78f58c8
Add new user doc to translate logical plan to physical plan (#12026)
jc4x4 Aug 21, 2024
7eeac2f
Improve rpad udf by using a GenericStringBuilder (#12070)
Lordworms Aug 21, 2024
9d076bd
fix: Panic non-integer for the second argument of `nth_value` functio…
Weijun-H Aug 21, 2024
eca71c4
Remove vestigal `datafusion-docs` module compilation (#12081)
alamb Aug 21, 2024
ad583a8
Add test to verify count aggregate function should not be nullable (#…
HuSen8891 Aug 21, 2024
121f330
Minor: Extract `BatchCoalescer` to its own module (#12047)
alamb Aug 21, 2024
c6be00d
Add Utf8View support to STRPOS function (#12087)
dmitriibugakov Aug 21, 2024
b2ac83f
Update itertools requirement from 0.12 to 0.13 (#10556)
dependabot[bot] Aug 21, 2024
a50aeef
Fix wildcard expansion for `HAVING` clause (#12046)
goldmedal Aug 22, 2024
4c3b744
fix: ser/der fetch in CoalesceBatchesExec (#12107)
haohuaijin Aug 22, 2024
3c281f6
Convert LogicalPlanBuilder to use Arc<LogicalPlan> (#12040)
jc4x4 Aug 22, 2024
902f1c6
Minor: rename `dictionary_coercion` to `dictionary_comparison_coercio…
alamb Aug 22, 2024
6eea180
Improve documentation on `StringArrayType` trait (#12027)
alamb Aug 22, 2024
89cb6a2
feat: use Substrait's PrecisionTimestamp and PrecisionTimestampTz ins…
Blizzara Aug 22, 2024
beb3d5a
Improve split_part udf by using a GenericStringBuilder (#12093)
Lordworms Aug 22, 2024
9a1a92d
Fix compialtion on main (#12108)
alamb Aug 22, 2024
502ce4b
fix: UDF, UDAF, UDWF with_alias(..) should wrap the inner function fu…
Blizzara Aug 22, 2024
41e7378
minor: SortExec measure elapsed_compute time when sorting (#12099)
mhilton Aug 22, 2024
87c1c17
Support string concat `||` for StringViewArray (#12063)
dharanad Aug 22, 2024
cafbb04
Update row_number.rs (#12110)
berkaysynnada Aug 22, 2024
b8b76bc
Add benchmark for SUBSTR to evaluate improvements using StringView (#…
Kev1n8 Aug 22, 2024
9028d2b
Support HEAD of sqlparser main
samuelcolvin Aug 15, 2024
620fa70
Support arrow @ HEAD
adriangb Aug 8, 2024
6140c5f
Support extract on intervals
nrc Aug 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 1 addition & 45 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -16,45 +16,11 @@
# under the License.

apache-rat-*.jar
arrow-src.tar
arrow-src.tar.gz

# Compiled source
*.a
*.dll
*.o
*.py[ocd]
*.so
*.so.*
*.bundle
*.dylib
.build_cache_dir
dependency-reduced-pom.xml
MANIFEST
compile_commands.json
build.ninja

# Generated Visual Studio files
*.vcxproj
*.vcxproj.*
*.sln
*.iml

# Linux perf sample data
perf.data
perf.data.old

cpp/.idea/
.clangd/
cpp/.clangd/
cpp/apidoc/xml/
docs/example.gz
docs/example1.dat
docs/example3.dat
python/.eggs/
python/doc/
# Egg metadata
*.egg-info

.vscode
.idea/
Expand All @@ -66,16 +32,9 @@ docker_cache
.*.swp
.*.swo

site/

# R files
**/.Rproj.user
**/*.Rcheck/
**/.Rhistory
.Rproj.user
venv/*

# macOS
cpp/Brewfile.lock.json
.DS_Store

# docker volumes used for caching
Expand All @@ -90,9 +49,6 @@ rusty-tags.vi
.history
.flatbuffers/

.vscode
venv/*

# apache release artifacts
dev/dist

Expand Down
39 changes: 26 additions & 13 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ members = [
"datafusion/functions-aggregate",
"datafusion/functions-aggregate-common",
"datafusion/functions-nested",
"datafusion/functions-window",
"datafusion/optimizer",
"datafusion/physical-expr",
"datafusion/physical-expr-common",
Expand All @@ -44,7 +45,6 @@ members = [
"datafusion/substrait",
"datafusion/wasmtest",
"datafusion-examples",
"docs",
"test-utils",
"benchmarks",
]
Expand All @@ -69,22 +69,22 @@ version = "41.0.0"
ahash = { version = "0.8", default-features = false, features = [
"runtime-rng",
] }
arrow = { version = "52.2.0", features = [
arrow = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", features = [
"prettyprint",
] }
arrow-array = { version = "52.2.0", default-features = false, features = [
arrow-array = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false, features = [
"chrono-tz",
] }
arrow-buffer = { version = "52.2.0", default-features = false }
arrow-flight = { version = "52.2.0", features = [
arrow-buffer = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false }
arrow-flight = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", features = [
"flight-sql-experimental",
] }
arrow-ipc = { version = "52.2.0", default-features = false, features = [
arrow-ipc = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false, features = [
"lz4",
] }
arrow-ord = { version = "52.2.0", default-features = false }
arrow-schema = { version = "52.2.0", default-features = false }
arrow-string = { version = "52.2.0", default-features = false }
arrow-ord = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false }
arrow-schema = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false }
arrow-string = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false }
async-trait = "0.1.73"
bigdecimal = "=0.4.1"
bytes = "1.4"
Expand All @@ -102,6 +102,7 @@ datafusion-functions = { path = "datafusion/functions", version = "41.0.0" }
datafusion-functions-aggregate = { path = "datafusion/functions-aggregate", version = "41.0.0" }
datafusion-functions-aggregate-common = { path = "datafusion/functions-aggregate-common", version = "41.0.0" }
datafusion-functions-nested = { path = "datafusion/functions-nested", version = "41.0.0" }
datafusion-functions-window = { path = "datafusion/functions-window", version = "41.0.0" }
datafusion-optimizer = { path = "datafusion/optimizer", version = "41.0.0", default-features = false }
datafusion-physical-expr = { path = "datafusion/physical-expr", version = "41.0.0", default-features = false }
datafusion-physical-expr-common = { path = "datafusion/physical-expr-common", version = "41.0.0", default-features = false }
Expand All @@ -119,12 +120,12 @@ futures = "0.3"
half = { version = "2.2.1", default-features = false }
hashbrown = { version = "0.14.5", features = ["raw"] }
indexmap = "2.0.0"
itertools = "0.12"
itertools = "0.13"
log = "^0.4"
num_cpus = "1.13.0"
object_store = { version = "0.10.2", default-features = false }
object_store = { version = "0.11", default-features = false }
parking_lot = "0.12"
parquet = { version = "52.2.0", default-features = false, features = [
parquet = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94", default-features = false, features = [
"arrow",
"async",
"object_store",
Expand All @@ -133,7 +134,7 @@ rand = "0.8"
regex = "1.8"
rstest = "0.22.0"
serde_json = "1"
sqlparser = { version = "0.49", features = ["visitor"] }
sqlparser = { git = "https://github.com/sqlparser-rs/sqlparser-rs.git", rev = "fab834d", features = ["visitor"] }
tempfile = "3"
thiserror = "1.0.44"
tokio = { version = "1.36", features = ["macros", "rt", "sync"] }
Expand Down Expand Up @@ -164,3 +165,15 @@ large_futures = "warn"
[workspace.lints.rust]
unexpected_cfgs = { level = "warn", check-cfg = ["cfg(tarpaulin)"] }
unused_imports = "deny"

[patch.crates-io]
arrow = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-array = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-buffer = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-data = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-flight = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-ipc = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-ord = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-schema = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-select = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
arrow-string = { git = "https://github.com/apache/arrow-rs.git", rev = "2795b94" }
Loading