Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unexpected behavior when running with constraints #23

Open
AniekMarkus opened this issue Aug 8, 2024 · 4 comments
Open

Unexpected behavior when running with constraints #23

AniekMarkus opened this issue Aug 8, 2024 · 4 comments

Comments

@AniekMarkus
Copy link
Contributor

Rerunning mix_4.project, rule length=3 with constraint balancedAccuracy=0.5:

  • usually same B_ACC: 62.28 - same as unconstraint, occasionally no rule found B_ACC: 0
  • total count candidates including constraint: differs across runs
  • happens for both parallel=no and parallel=yes (parallelmethod=ONE or TWO)
@AniekMarkus
Copy link
Contributor Author

Does not occur for other types of constraints?

Accuracy=0.7:
Total Count Cutoff Sets:2194
Total Count Candidates (incl constraints):705

Specificity=0.8
Total Count Cutoff Sets:2194
Total Count Candidates (incl constraints):630

@AniekMarkus
Copy link
Contributor Author

With balanced accuracy constraint on Mac:

expression failed to parse:
error: <user expression 0>:1:1: use of undeclared identifier 'CurrentCondition'
CurrentCondition->NextSame
^

(problem does not occur in Linux)

@AniekMarkus
Copy link
Contributor Author

AniekMarkus commented Aug 9, 2024

OutputMethod=EVERY -> all candidate rules
OutputMethod=INCREMENT -> found new candidates rules
OutputMethod=BEST-> final best candidates rule
-> Printing does work in parallel (with constraints)

PrintCutoffSets=yes -> all generated rules
-> Printing does not work in parallel

AniekMarkus added a commit that referenced this issue Aug 9, 2024
@AniekMarkus
Copy link
Contributor Author

Output C++
Balanced Accuracy >= 0.6 (min and max length = 3)

Best length: 3
Best candidate: '198124209' = "TRUE" OR '316139209' = "TRUE" OR '316139210' = "TRUE"
Performance learn-set: SE:39.11 SP:86.25 ACC:81.81 PPV:22.83 NPV:93.16 B_ACC:62.68 F1:28.83

Total Count Combinations:3
Total Count Feature Operator Pairs:70
Total Count Cutoff Sets:1940
Total Count Candidates (incl constraints):36

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant