-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-11763] [ML] Add save,load to LogisticRegression Estimator #9749
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is awkward, but type issues prevented me from using apply instead of get
|
Oops, I just realized I forgot to save the parent field in both this and Pipeline. Shall we just document that it does not get saved, and handle it for 1.7? |
|
Test build #46032 has finished for PR 9749 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We won't need this if we implement testDefaultReadWrite properly.
|
LGTM except one minor issue commented inline. It should be okay to postpone saving parent to 1.7. |
|
Thanks, updated! |
|
Test build #46102 has finished for PR 9749 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't need pull in Path from Hadoop. This should work:
val subdir = new File(tempDir, subdirName)
val path = new File(subdir, uid).getPath
…dom name, to avoid conflicts between calls
|
Rebased to pull PipelineSuite from master. |
|
Test build #46110 has finished for PR 9749 at commit
|
Add save/load to LogisticRegression Estimator, and refactor tests a little to make it easier to add similar support to other Estimator, Model pairs. Moved LogisticRegressionReader/Writer to within LogisticRegressionModel CC: mengxr Author: Joseph K. Bradley <[email protected]> Closes #9749 from jkbradley/lr-io-2. (cherry picked from commit 6eb7008) Signed-off-by: Xiangrui Meng <[email protected]>
|
Merged into master and branch-1.6. Thanks! |
Add save/load to LogisticRegression Estimator, and refactor tests a little to make it easier to add similar support to other Estimator, Model pairs.
Moved LogisticRegressionReader/Writer to within LogisticRegressionModel
CC: @mengxr