Skip to content

Conversation

@techaddict
Copy link
Contributor

@techaddict techaddict commented Nov 8, 2016

What changes were proposed in this pull request?

ALS.run fail with better message if ratings is empty rdd
ALS.train and ALS.trainImplicit are also affected

How was this patch tested?

added new tests

ALS.train and ALS.trainImplicit are also affected
@srowen
Copy link
Member

srowen commented Nov 8, 2016

What about putting this check in .ml.ALS.train()? I think that's the method at the 'heart' of all the various entry points. That is, you'd catch any usage that didn't go through .mllib.ALS too.

A tiny unit test wouldn't hurt.

@SparkQA
Copy link

SparkQA commented Nov 8, 2016

Test build #68342 has finished for PR 15809 at commit 8080583.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@techaddict techaddict changed the title [SPARK-18268] ALS.run fail with better message if ratings is empty rdd [SPARK-18268] ALS fail with better message if ratings is empty rdd Nov 8, 2016
@SparkQA
Copy link

SparkQA commented Nov 8, 2016

Test build #68347 has finished for PR 15809 at commit 9fd6278.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@techaddict techaddict changed the title [SPARK-18268] ALS fail with better message if ratings is empty rdd [SPARK-18268][MLLib] ALS fail with better message if ratings is empty rdd Nov 9, 2016
@techaddict techaddict changed the title [SPARK-18268][MLLib] ALS fail with better message if ratings is empty rdd [SPARK-18268][ML][MLLib] ALS fail with better message if ratings is empty rdd Nov 9, 2016
@thunterdb
Copy link
Contributor

LGTM

@asfgit asfgit closed this in 96a5910 Nov 10, 2016
@aditya1702
Copy link

aditya1702 commented Nov 10, 2016

@srowen What about the python code? this was for scala only right?

@srowen
Copy link
Member

srowen commented Nov 10, 2016

Python API calls the Scala API so I think this is sufficient.

@aditya1702
Copy link

@srowen Ok. Thanks 👍

uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
…mpty rdd

## What changes were proposed in this pull request?
ALS.run fail with better message if ratings is empty rdd
ALS.train and ALS.trainImplicit are also affected

## How was this patch tested?
added new tests

Author: Sandeep Singh <[email protected]>

Closes apache#15809 from techaddict/SPARK-18268.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants