Skip to content
This repository has been archived by the owner on Jul 13, 2022. It is now read-only.

feature interaction: evaluation scoring on original input fields was too slow. #23

Open
HCMY opened this issue Apr 19, 2022 · 0 comments

Comments

@HCMY
Copy link

HCMY commented Apr 19, 2022

hey guys, i'm reading the source code and i would like to sincerely thank all those works you've done there, and public all of code too. But i noticed that some of code in "FeatureInteraction" is running too slow, for example:

`val nominalScores = nominalFields.map { x =>
x -> ColumnScoreData(
scoreColumn(
df,
modelType,
x,
getFieldType("nominal"),
totalRecordCount
),
"nominal"
)

}.toMap

val continuousScores = continuousFields.map { x =>
  x -> ColumnScoreData(
    scoreColumn(
      df,
      modelType,
      x,
      getFieldType("continuous"),
      totalRecordCount
    ),
    "continuous"
  )
}.toMap`

is there any suggestions for paralisim? looking forward your reply!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant