Skip to content

Conversation

@zero323
Copy link
Member

@zero323 zero323 commented Dec 2, 2016

What changes were proposed in this pull request?

Makes Window.unboundedPreceding and Window.unboundedFollowing backward compatible.

How was this patch tested?

Pyspark SQL unittests.

Please review http://spark.apache.org/contributing.html before opening a pull request.

@SparkQA
Copy link

SparkQA commented Dec 2, 2016

Test build #69585 has finished for PR 16123 at commit 19e0a24.

  • This patch fails Python style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Dec 2, 2016

Test build #69586 has finished for PR 16123 at commit 2106388.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Dec 2, 2016

Can you put a more descriptive title?

@zero323 zero323 changed the title [SPARK-18690][PYTHON][SQL] [SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames Dec 2, 2016
@zero323
Copy link
Member Author

zero323 commented Dec 2, 2016

Sorry, long day. I was pretty sure I did.

).columns[0]

with patch("sys.maxsize", 2 ** 31 - 1):
importlib.reload(window)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is something I don't like but it looks better than alternatives:

  • Converting thresholds to methods so current sys.maxsize is picked up.
  • Mocking thresholds as well.

@rxin
Copy link
Contributor

rxin commented Dec 3, 2016

Thanks - merging in master/branch-2.1.

asfgit pushed a commit that referenced this pull request Dec 3, 2016
## What changes were proposed in this pull request?

Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible.

## How was this patch tested?

Pyspark SQL unittests.

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: zero323 <[email protected]>

Closes #16123 from zero323/SPARK-17845-follow-up.

(cherry picked from commit a9cbfc4)
Signed-off-by: Reynold Xin <[email protected]>
@asfgit asfgit closed this in a9cbfc4 Dec 3, 2016
robert3005 pushed a commit to palantir/spark that referenced this pull request Dec 15, 2016
## What changes were proposed in this pull request?

Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible.

## How was this patch tested?

Pyspark SQL unittests.

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: zero323 <[email protected]>

Closes apache#16123 from zero323/SPARK-17845-follow-up.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
## What changes were proposed in this pull request?

Makes `Window.unboundedPreceding` and `Window.unboundedFollowing` backward compatible.

## How was this patch tested?

Pyspark SQL unittests.

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: zero323 <[email protected]>

Closes apache#16123 from zero323/SPARK-17845-follow-up.
@zero323 zero323 deleted the SPARK-17845-follow-up branch April 6, 2017 11:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants