-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames #16123
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
… to ensure backward compatibility
|
Test build #69585 has finished for PR 16123 at commit
|
|
Test build #69586 has finished for PR 16123 at commit
|
|
Can you put a more descriptive title? |
|
Sorry, long day. I was pretty sure I did. |
| ).columns[0] | ||
|
|
||
| with patch("sys.maxsize", 2 ** 31 - 1): | ||
| importlib.reload(window) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is something I don't like but it looks better than alternatives:
- Converting thresholds to methods so current
sys.maxsizeis picked up. - Mocking thresholds as well.
|
Thanks - merging in master/branch-2.1. |
## What changes were proposed in this pull request? Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible. ## How was this patch tested? Pyspark SQL unittests. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: zero323 <[email protected]> Closes #16123 from zero323/SPARK-17845-follow-up. (cherry picked from commit a9cbfc4) Signed-off-by: Reynold Xin <[email protected]>
## What changes were proposed in this pull request? Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible. ## How was this patch tested? Pyspark SQL unittests. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: zero323 <[email protected]> Closes apache#16123 from zero323/SPARK-17845-follow-up.
## What changes were proposed in this pull request? Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible. ## How was this patch tested? Pyspark SQL unittests. Please review http://spark.apache.org/contributing.html before opening a pull request. Author: zero323 <[email protected]> Closes apache#16123 from zero323/SPARK-17845-follow-up.
What changes were proposed in this pull request?
Makes
Window.unboundedPrecedingandWindow.unboundedFollowingbackward compatible.How was this patch tested?
Pyspark SQL unittests.
Please review http://spark.apache.org/contributing.html before opening a pull request.