Skip to content

Conversation

@panbingkun
Copy link
Contributor

@panbingkun panbingkun commented Mar 20, 2024

What changes were proposed in this pull request?

The pr aims to fix python linter issue on branch-3.4 through pinning matplotlib<3.3.0

Why are the changes needed?

image

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass GA.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the BUILD label Mar 20, 2024
@github-actions github-actions bot added the INFRA label Mar 20, 2024
@github-actions github-actions bot removed the INFRA label Mar 20, 2024
@panbingkun
Copy link
Contributor Author

panbingkun commented Mar 20, 2024

@dongjoon-hyun
At present, the python liner issue in branch-3.4 can be resolved by pinning matplotlib<3.3.0. Can we merge this pr first and then observe the execution status of the branch-3.4 scheduling job tomorrow?

Although there are still pyspark-error issues, from the pre PR #45600, it seems that this issue itself exists.
It seems that it is triggered when actively submitting to the branch-3.4, while the daily passive branch-3.4 scheduling jobs does not exist, eg:
https://github.com/apache/spark/actions/runs/8357839104/job/22877919040

I am still continuing to research this issue.

@panbingkun panbingkun changed the title [SPARK-47481][3.4] pin matplotlib<3.3.0 [SPARK-47481][3.4] Fix Python linter Mar 20, 2024
@panbingkun panbingkun marked this pull request as ready for review March 20, 2024 13:54
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @panbingkun , of course.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-47481][3.4] Fix Python linter [SPARK-47481][INFRA][3.4] Fix Python linter Mar 20, 2024
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-47481][INFRA][3.4] Fix Python linter [SPARK-47481][INFRA][3.4] Pin matplotlib<3.3.0 to fix Python linter failure Mar 20, 2024
dongjoon-hyun pushed a commit that referenced this pull request Mar 20, 2024
… failure

### What changes were proposed in this pull request?
The pr aims to fix `python linter issue` on branch-3.4 through pinning `matplotlib<3.3.0`

### Why are the changes needed?
- Through this PR #45600, we found that the version of `matplotlib` in our Docker image was `3.8.2`, which clearly did not meet the original requirements for `branch-3.4`.
  https://github.com/panbingkun/spark/actions/runs/8354370179/job/22869580038
  <img width="1072" alt="image" src="https://github.com/apache/spark/assets/15246973/dd425bfb-ce5f-4a99-a487-a462d6ebbbb9">
  https://github.com/apache/spark/blob/branch-3.4/dev/requirements.txt#L12
  <img width="973" alt="image" src="https://github.com/apache/spark/assets/15246973/70485648-b886-4218-bb21-c41a85d5eecf">

- Fix as follows:
<img width="989" alt="image" src="https://github.com/apache/spark/assets/15246973/db31d8fb-0b6c-4925-95e1-0ca0247bb9f5">

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes #45608 from panbingkun/branch_3.4_pin_matplotlib.

Authored-by: panbingkun <panbingkun@baidu.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@dongjoon-hyun
Copy link
Member

Merged to branch-3.4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants