Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce column_scols in InternalFrame substitude for data_columns. #956

Merged
merged 17 commits into from
Nov 7, 2019

Conversation

ueshin
Copy link
Collaborator

@ueshin ueshin commented Oct 25, 2019

No description provided.

@itholic
Copy link
Contributor

itholic commented Oct 27, 2019

great work! maybe would it be better to pause my underway works until this PR will be merged?

@codecov-io
Copy link

codecov-io commented Oct 28, 2019

Codecov Report

Merging #956 into master will decrease coverage by 2.47%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #956      +/-   ##
==========================================
- Coverage   94.83%   92.36%   -2.48%     
==========================================
  Files          34       34              
  Lines        6640     6652      +12     
==========================================
- Hits         6297     6144     -153     
- Misses        343      508     +165
Impacted Files Coverage Δ
databricks/koalas/indexes.py 96.41% <ø> (ø) ⬆️
databricks/koalas/utils.py 95% <ø> (-3.13%) ⬇️
databricks/koalas/series.py 96.2% <100%> (-0.14%) ⬇️
databricks/koalas/indexing.py 94.38% <100%> (ø) ⬆️
databricks/koalas/groupby.py 89.34% <100%> (-2.05%) ⬇️
databricks/koalas/window.py 94.28% <100%> (+0.03%) ⬆️
databricks/koalas/namespace.py 85.75% <100%> (-1.51%) ⬇️
databricks/koalas/generic.py 95.73% <100%> (ø) ⬆️
databricks/koalas/mlflow.py 94.87% <100%> (ø) ⬆️
databricks/koalas/internal.py 96.42% <100%> (+0.04%) ⬆️
... and 12 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e596a58...5aa74b7. Read the comment docs.

@ueshin ueshin changed the title [WIP] Introduce column_scols in InternalFrame substitude for data_columns. Introduce column_scols in InternalFrame substitude for data_columns. Oct 28, 2019
@ueshin ueshin requested a review from HyukjinKwon October 28, 2019 18:06
@@ -381,10 +381,10 @@ class _InternalFrame(object):

def __init__(self, sdf: spark.DataFrame,
index_map: Optional[List[IndexMap]] = None,
scol: Optional[spark.Column] = None,
data_columns: Optional[List[str]] = None,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@ueshin ueshin changed the title Introduce column_scols in InternalFrame substitude for data_columns. [WIP] Introduce column_scols in InternalFrame substitude for data_columns. Oct 30, 2019
@softagram-bot
Copy link

Softagram Impact Report for pull/956 (head commit: 5aa74b7)

⭐ Change Overview

Showing the changed files, dependency changes and the impact - click for full size
(Open in Softagram Desktop for full details)

⭐ Details of Dependency Changes

details of dependency changes - click for full size
(Open in Softagram Desktop for full details)

💡 Insights

  • Co-change Alert: You modified frame.py. Often test_dataframe.py (koalas/tests) is modified at the same time.

📄 Full report

Impact Report explained. Give feedback on this report to [email protected]

@HyukjinKwon HyukjinKwon changed the title [WIP] Introduce column_scols in InternalFrame substitude for data_columns. Introduce column_scols in InternalFrame substitude for data_columns. Nov 7, 2019
@HyukjinKwon
Copy link
Member

Test failure seems unrelated. I will track and fix separately.

@HyukjinKwon HyukjinKwon merged commit 1cb4ba0 into databricks:master Nov 7, 2019
@ueshin ueshin deleted the internalframe branch November 7, 2019 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants