[pull] master from apache:master#54

Merged

pull[bot] merged 24 commits intohuangxiaopingRD:masterfrom

Dec 30, 2023

Commits on Dec 28, 2023

[SPARK-46528][BUILD] Upgrade `zstd-jni` to 1.5.5-11

dongjoon-hyun
authored and
HyukjinKwon
committed
[SPARK-46521][PYTHON][DOCS] Refine docstring of `array_remove/array_distinct/array_compact`

LuciferYang
authored and
HyukjinKwon
committed
[SPARK-46514][TESTS] Fix HiveMetastoreLazyInitializationSuite
yaooqinn
committed
[SPARK-45917][PYTHON][SQL] Automatic registration of Python Data Source on startup
HyukjinKwon
committed
[SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: factor out `test_loc2d*`
zhengruifeng
committed
[SPARK-46529][TESTS] Upgrade guava from 18.0 to 19.0 for `docker-integration-tests`
yaooqinn
committed
[SPARK-46366][SQL] Use WITH expression in BETWEEN to avoid duplicate expressions

dbatomic
authored and
cloud-fan
committed
[SPARK-46519][SQL] Clear unused error classes from `error-classes.json` file

panbingkun
authored and
MaxGekk
committed
[SPARK-46532][CONNECT] Pass message parameters in metadata of `ErrorInfo`
MaxGekk
committed
[SPARK-46517][PS][TESTS][FOLLOWUPS] Reorganize `IndexingTest`: Move to `pyspark.pandas.tests.indexes.*` and add the parity test
zhengruifeng
committed
[SPARK-46537][SQL] Convert NPE and asserts from commands to internal errors
MaxGekk
committed
[SPARK-46535][SQL] Fix NPE when describe extended a column without col stats

authored and
MaxGekk
committed

Commits on Dec 29, 2023

Commits on Dec 30, 2023

[SPARK-46530][PYTHON][SQL] Check Python executable when looking up available Data Sources

HyukjinKwon
authored and
zhengruifeng
committed
[SPARK-46509][CORE][SS] Replace `.reverse.find` with `.findLast`

LuciferYang
authored and
dongjoon-hyun
committed
[SPARK-46542][SQL] Remove the check for `c>=0` from `ExternalCatalogUtils#needsEscaping` as it is always true

LuciferYang
authored and
dongjoon-hyun
committed
[SPARK-46545][INFRA] Pin `lxml==4.9.4`

zhengruifeng
authored and
dongjoon-hyun
committed
[SPARK-46531][BUILD] Move the dependency management of `datasketches-java` from `catalyst` to `parent`

LuciferYang
authored and
dongjoon-hyun
committed