Skip to content

Conversation

@LuciferYang
Copy link
Contributor

What changes were proposed in this pull request?

This pr refine docstring of array_min/array_max/array_size/array_repeat and add some new examples.

Why are the changes needed?

To improve PySpark documentation

Does this PR introduce any user-facing change?

No

How was this patch tested?

Pass Github Actions

Was this patch authored or co-authored using generative AI tooling?

No

@LuciferYang LuciferYang marked this pull request as ready for review December 28, 2023 17:20
@github-actions github-actions bot removed the INFRA label Dec 28, 2023
@LuciferYang
Copy link
Contributor Author

The failure of the k8s IT test is unrelated to the current PR

[info] Caused by: org.apache.spark.SparkException: 
[info] Error from python worker:
[info]   /usr/bin/python3: Error while finding module specification for 'pyspark.daemon' (ModuleNotFoundError: No module named 'pyspark')
[info] PYTHONPATH was:
[info]   /opt/spark/python/lib/pyspark.zip:/opt/spark/python/lib/py4j-0.10.9.7-src.zip:/opt/spark/jars/spark-core_2.13-4.0.0-SNAPSHOT.jar:/opt/spark/python:/opt/spark/python/lib/py4j-0.10.9.7-src.zip

@LuciferYang
Copy link
Contributor Author

Merged into master. Thanks @HyukjinKwon

@LuciferYang LuciferYang deleted the SPARK-46533 branch May 1, 2025 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants