Rename "pandas APIs on Spark" to "pandas API on Spark" #49

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Closed

HyukjinKwon wants to merge 1 commit into master from SPARK-34885

Owner

HyukjinKwon commented Jun 14, 2021

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

github-actions bot added CORE PYTHON labels

HyukjinKwon commented

View reviewed changes

python/docs/source/development/ps_design.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/getting_started/ps_10mins.ipynb Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/getting_started/ps_10mins.ipynb Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/getting_started/ps_10mins.ipynb Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/getting_started/ps_install.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/getting_started/ps_install.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/index.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/best_practices.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/from_to_dbms.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/options.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/transform_apply.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/typehints.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/typehints.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/typehints.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/typehints.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/typehints.rst Outdated Show resolved Hide resolved

HyukjinKwon commented

View reviewed changes

python/docs/source/user_guide/pandas_on_spark/types.rst Outdated Show resolved Hide resolved

HyukjinKwon force-pushed the SPARK-34885 branch from 0d4a084 to 023e7cf Compare

June 14, 2021 09:06

github-actions bot added the BUILD label

HyukjinKwon force-pushed the SPARK-34885 branch 2 times, most recently from 023e7cf to 694e7ef Compare

June 14, 2021 09:42


          Rename "pandas APIs on Spark" to "pandas API on Spark"

4ff1b1d

HyukjinKwon force-pushed the SPARK-34885 branch from 694e7ef to 4ff1b1d Compare

June 14, 2021 10:27

HyukjinKwon closed this

HyukjinKwon pushed a commit that referenced this pull request


          [SPARK-46745][INFRA] Purge pip cache in dockerfile

da0c31c

### What changes were proposed in this pull request?
Purge pip cache in dockerfile

### Why are the changes needed?
to save 4~5G disk space:

before

https://github.com/zhengruifeng/spark/actions/runs/7541725028/job/20530432798

```
#45 [39/39] RUN df -h
#45 0.090 Filesystem      Size  Used Avail Use% Mounted on
#45 0.090 overlay          84G   70G   15G  83% /
#45 0.090 tmpfs            64M     0   64M   0% /dev
#45 0.090 shm              64M     0   64M   0% /dev/shm
#45 0.090 /dev/root        84G   70G   15G  83% /etc/resolv.conf
#45 0.090 tmpfs           7.9G     0  7.9G   0% /proc/acpi
#45 0.090 tmpfs           7.9G     0  7.9G   0% /sys/firmware
#45 0.090 tmpfs           7.9G     0  7.9G   0% /proc/scsi
#45 DONE 2.0s
```

after

https://github.com/zhengruifeng/spark/actions/runs/7549204209/job/20552796796

```
#48 [42/43] RUN python3.12 -m pip cache purge
#48 0.670 Files removed: 392
#48 DONE 0.7s

#49 [43/43] RUN df -h
#49 0.075 Filesystem      Size  Used Avail Use% Mounted on
#49 0.075 overlay          84G   65G   19G  79% /
#49 0.075 tmpfs            64M     0   64M   0% /dev
#49 0.075 shm              64M     0   64M   0% /dev/shm
#49 0.075 /dev/root        84G   65G   19G  79% /etc/resolv.conf
#49 0.075 tmpfs           7.9G     0  7.9G   0% /proc/acpi
#49 0.075 tmpfs           7.9G     0  7.9G   0% /sys/firmware
#49 0.075 tmpfs           7.9G     0  7.9G   0% /proc/scsi
```
### Does this PR introduce _any_ user-facing change?
no, infra-only

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#44768 from zhengruifeng/infra_docker_cleanup.

Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

BUILD CORE PYTHON