-
Notifications
You must be signed in to change notification settings - Fork 103
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CU-86956du3q revisit regression #470
Commits on Jul 26, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8af5c72 - Browse repository at this point
Copy the full SHA 8af5c72View commit details -
CU-86956du3q: Update regression tests to a more reasonable state.
Make sure to compare the correct annotation, not just hoping for any CUI annotated to match the one we are looking for. Output the specifics of the type of match that was found: - Identical - Bigger / smaller span - Random overlap - Parents / grandparetns, or children Add strictness options to summary (success / failure).
Configuration menu - View commit details
-
Copy full SHA for 3437ed0 - Browse repository at this point
Copy the full SHA 3437ed0View commit details -
CU-86956du3q: Further fixes for regression checking:
Remove 'Failure reason' and 'Failre descriptor' - now using Finding instead. Remove simplified success/failure metrics wherever relevant. Fix tests that relied on old logic and fix test-time replacement/cui location.
Configuration menu - View commit details
-
Copy full SHA for f455bb7 - Browse repository at this point
Copy the full SHA f455bb7View commit details -
Configuration menu - View commit details
-
Copy full SHA for f71a206 - Browse repository at this point
Copy the full SHA f71a206View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc02104 - Browse repository at this point
Copy the full SHA cc02104View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52f6344 - Browse repository at this point
Copy the full SHA 52f6344View commit details -
Configuration menu - View commit details
-
Copy full SHA for a2837c8 - Browse repository at this point
Copy the full SHA a2837c8View commit details
Commits on Jul 30, 2024
-
CU-86956du3q: Update regression checking to generate multiple sub-cas…
…es for multiple placeholders
Configuration menu - View commit details
-
Copy full SHA for 343d0b1 - Browse repository at this point
Copy the full SHA 343d0b1View commit details -
Configuration menu - View commit details
-
Copy full SHA for fd6690b - Browse repository at this point
Copy the full SHA fd6690bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 87183cd - Browse repository at this point
Copy the full SHA 87183cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for f7f7ff3 - Browse repository at this point
Copy the full SHA f7f7ff3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 90e1227 - Browse repository at this point
Copy the full SHA 90e1227View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5910629 - Browse repository at this point
Copy the full SHA 5910629View commit details -
Configuration menu - View commit details
-
Copy full SHA for f1b4799 - Browse repository at this point
Copy the full SHA f1b4799View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9c53cc6 - Browse repository at this point
Copy the full SHA 9c53cc6View commit details -
Configuration menu - View commit details
-
Copy full SHA for beb0444 - Browse repository at this point
Copy the full SHA beb0444View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1d75257 - Browse repository at this point
Copy the full SHA 1d75257View commit details -
Configuration menu - View commit details
-
Copy full SHA for d3a565e - Browse repository at this point
Copy the full SHA d3a565eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6e304aa - Browse repository at this point
Copy the full SHA 6e304aaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6b870e6 - Browse repository at this point
Copy the full SHA 6b870e6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 95d92a3 - Browse repository at this point
Copy the full SHA 95d92a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6504bac - Browse repository at this point
Copy the full SHA 6504bacView commit details -
Configuration menu - View commit details
-
Copy full SHA for a7bb30c - Browse repository at this point
Copy the full SHA a7bb30cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0eb8bdf - Browse repository at this point
Copy the full SHA 0eb8bdfView commit details -
Configuration menu - View commit details
-
Copy full SHA for f661129 - Browse repository at this point
Copy the full SHA f661129View commit details -
Configuration menu - View commit details
-
Copy full SHA for d7e59a3 - Browse repository at this point
Copy the full SHA d7e59a3View commit details -
CU-86956du3q: Allow multiple of the same placeholder in a phrase.
And more specifically, treat each one as their own sub-case
Configuration menu - View commit details
-
Copy full SHA for b8ce24c - Browse repository at this point
Copy the full SHA b8ce24cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d45b1f - Browse repository at this point
Copy the full SHA 0d45b1fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 667c009 - Browse repository at this point
Copy the full SHA 667c009View commit details -
Configuration menu - View commit details
-
Copy full SHA for 98f7245 - Browse repository at this point
Copy the full SHA 98f7245View commit details
Commits on Aug 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c0a7747 - Browse repository at this point
Copy the full SHA c0a7747View commit details -
Configuration menu - View commit details
-
Copy full SHA for bcc49ba - Browse repository at this point
Copy the full SHA bcc49baView commit details -
Configuration menu - View commit details
-
Copy full SHA for ba483ae - Browse repository at this point
Copy the full SHA ba483aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3a776a2 - Browse repository at this point
Copy the full SHA 3a776a2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2238e1d - Browse repository at this point
Copy the full SHA 2238e1dView commit details -
Configuration menu - View commit details
-
Copy full SHA for b43de39 - Browse repository at this point
Copy the full SHA b43de39View commit details -
Configuration menu - View commit details
-
Copy full SHA for 747f8e5 - Browse repository at this point
Copy the full SHA 747f8e5View commit details -
CU-86956du3q: Add storage of examples (of a certain strictness) as we…
…ll as relevant output
Configuration menu - View commit details
-
Copy full SHA for a8e709b - Browse repository at this point
Copy the full SHA a8e709bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 10f4f8a - Browse repository at this point
Copy the full SHA 10f4f8aView commit details -
Configuration menu - View commit details
-
Copy full SHA for bb005fd - Browse repository at this point
Copy the full SHA bb005fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5970cd6 - Browse repository at this point
Copy the full SHA 5970cd6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b9a1f2 - Browse repository at this point
Copy the full SHA 5b9a1f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for edf2e3d - Browse repository at this point
Copy the full SHA edf2e3dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 251e720 - Browse repository at this point
Copy the full SHA 251e720View commit details -
Configuration menu - View commit details
-
Copy full SHA for e0a3c5c - Browse repository at this point
Copy the full SHA e0a3c5cView commit details
Commits on Aug 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8528e74 - Browse repository at this point
Copy the full SHA 8528e74View commit details -
Configuration menu - View commit details
-
Copy full SHA for 81a5cb3 - Browse repository at this point
Copy the full SHA 81a5cb3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 66565a4 - Browse repository at this point
Copy the full SHA 66565a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d41ca5 - Browse repository at this point
Copy the full SHA 4d41ca5View commit details -
CU-86956du3q: Update example checking with strictness requirement (in…
…stead of simple boolean)
Configuration menu - View commit details
-
Copy full SHA for 5eee717 - Browse repository at this point
Copy the full SHA 5eee717View commit details -
Configuration menu - View commit details
-
Copy full SHA for b79e5f0 - Browse repository at this point
Copy the full SHA b79e5f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 894fb0f - Browse repository at this point
Copy the full SHA 894fb0fView commit details -
Configuration menu - View commit details
-
Copy full SHA for cf9dd22 - Browse repository at this point
Copy the full SHA cf9dd22View commit details -
Configuration menu - View commit details
-
Copy full SHA for c3be60f - Browse repository at this point
Copy the full SHA c3be60fView commit details -
Configuration menu - View commit details
-
Copy full SHA for c0f99cf - Browse repository at this point
Copy the full SHA c0f99cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d0bc6e - Browse repository at this point
Copy the full SHA 4d0bc6eView commit details -
Configuration menu - View commit details
-
Copy full SHA for df12eba - Browse repository at this point
Copy the full SHA df12ebaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e7465d - Browse repository at this point
Copy the full SHA 2e7465dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e40ec4b - Browse repository at this point
Copy the full SHA e40ec4bView commit details -
CU-86956du3q: Remove option to set the total for progress bar (the au…
…tomated one works fine now)
Configuration menu - View commit details
-
Copy full SHA for 172f101 - Browse repository at this point
Copy the full SHA 172f101View commit details -
Configuration menu - View commit details
-
Copy full SHA for a7670e3 - Browse repository at this point
Copy the full SHA a7670e3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7f429d7 - Browse repository at this point
Copy the full SHA 7f429d7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5bc1ee4 - Browse repository at this point
Copy the full SHA 5bc1ee4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 17fb479 - Browse repository at this point
Copy the full SHA 17fb479View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7ea65a5 - Browse repository at this point
Copy the full SHA 7ea65a5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8860309 - Browse repository at this point
Copy the full SHA 8860309View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7629ac4 - Browse repository at this point
Copy the full SHA 7629ac4View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca600b4 - Browse repository at this point
Copy the full SHA ca600b4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 54ceca4 - Browse repository at this point
Copy the full SHA 54ceca4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1dc8eaf - Browse repository at this point
Copy the full SHA 1dc8eafView commit details
Commits on Aug 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c210ef2 - Browse repository at this point
Copy the full SHA c210ef2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e090704 - Browse repository at this point
Copy the full SHA e090704View commit details -
Configuration menu - View commit details
-
Copy full SHA for 05b490c - Browse repository at this point
Copy the full SHA 05b490cView commit details -
Configuration menu - View commit details
-
Copy full SHA for a086f37 - Browse repository at this point
Copy the full SHA a086f37View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6606cd2 - Browse repository at this point
Copy the full SHA 6606cd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for cd243aa - Browse repository at this point
Copy the full SHA cd243aaView commit details -
CU-86956du3q: Update default regression tests with new extensive (yet…
… simple) test case
Configuration menu - View commit details
-
Copy full SHA for 846a408 - Browse repository at this point
Copy the full SHA 846a408View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4fd8088 - Browse repository at this point
Copy the full SHA 4fd8088View commit details
Commits on Aug 14, 2024
-
CU-86956du3q: Add option to for failing with having found another con…
…cept. Added other incorrect cui that was found (if applicable). Fixed issue with finding grandparents.
Configuration menu - View commit details
-
Copy full SHA for 72ec064 - Browse repository at this point
Copy the full SHA 72ec064View commit details -
CU-86956du3q: Add tests for parent and grandparent finding; fix tests…
… for new changes (with optionally found alternative CUI)
Configuration menu - View commit details
-
Copy full SHA for e4f203e - Browse repository at this point
Copy the full SHA e4f203eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d9b08e - Browse repository at this point
Copy the full SHA 5d9b08eView commit details -
CU-86956du3q: Fix tests for new form of determine cui description; ad…
…d test for exact span grandchild
Configuration menu - View commit details
-
Copy full SHA for 7683a88 - Browse repository at this point
Copy the full SHA 7683a88View commit details -
Configuration menu - View commit details
-
Copy full SHA for 741675e - Browse repository at this point
Copy the full SHA 741675eView commit details -
Configuration menu - View commit details
-
Copy full SHA for d7bcd06 - Browse repository at this point
Copy the full SHA d7bcd06View commit details
Commits on Aug 15, 2024
-
Fix issues with compute_class_weights JSON serialization and enforce fc2 usage when fc3 is enabled * Resolved an issue where compute_class_weights returns a NumPy array, causing an error when saving the configuration as JSON (since JSON does not support NumPy arrays). The fix ensures compatibility by converting the NumPy array to a JSON-serializable format. * Added a safeguard in the model_architecture_config for meta_cat_config. The current architecture assumes fc3 is only used when fc2 is enabled. If fc2 is set to False and fc3 is True, the model would fail due to a mismatch in hidden layer sizes. The fix automatically enables fc2 if fc3 is set to True, preventing potential errors.
Configuration menu - View commit details
-
Copy full SHA for 94b16ab - Browse repository at this point
Copy the full SHA 94b16abView commit details -
CU-86956duhb: Add method to backport a model pack from 1.12 to previo…
…us version (#465) * CU-86956duhb: Add method to backport a model pack from 1.12 to previous version * CU-86956duhb: Fix some doc string issues * CU-86956duhb: Add deprecation decorator to old config-fix * CU-86956duhb: Mark backporting method as deprecated and to be removed in 1.14
Configuration menu - View commit details
-
Copy full SHA for 7116ac7 - Browse repository at this point
Copy the full SHA 7116ac7View commit details -
CU-8694cd9t2: Allow merging config into model pack config before init (…
…#462) * CU-8694cd9t2: Allow merging config into model pack config before init
Configuration menu - View commit details
-
Copy full SHA for 09ec3d4 - Browse repository at this point
Copy the full SHA 09ec3d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6fb68c2 - Browse repository at this point
Copy the full SHA 6fb68c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for fc4ee7f - Browse repository at this point
Copy the full SHA fc4ee7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 680ad64 - Browse repository at this point
Copy the full SHA 680ad64View commit details -
Configuration menu - View commit details
-
Copy full SHA for cad3cb2 - Browse repository at this point
Copy the full SHA cad3cb2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2aa6370 - Browse repository at this point
Copy the full SHA 2aa6370View commit details -
Configuration menu - View commit details
-
Copy full SHA for b7e8c3c - Browse repository at this point
Copy the full SHA b7e8c3cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 37ebb51 - Browse repository at this point
Copy the full SHA 37ebb51View commit details -
Configuration menu - View commit details
-
Copy full SHA for c165bb5 - Browse repository at this point
Copy the full SHA c165bb5View commit details -
Configuration menu - View commit details
-
Copy full SHA for a894ed1 - Browse repository at this point
Copy the full SHA a894ed1View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb0e26a - Browse repository at this point
Copy the full SHA eb0e26aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9187752 - Browse repository at this point
Copy the full SHA 9187752View commit details -
Configuration menu - View commit details
-
Copy full SHA for c29dc33 - Browse repository at this point
Copy the full SHA c29dc33View commit details -
Configuration menu - View commit details
-
Copy full SHA for f416dd1 - Browse repository at this point
Copy the full SHA f416dd1View commit details -
CU-86956du3q: Add comment for only using preferred names to the defau…
…lt regression suite yaml
Configuration menu - View commit details
-
Copy full SHA for 97326a2 - Browse repository at this point
Copy the full SHA 97326a2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5da37b - Browse repository at this point
Copy the full SHA e5da37bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4f30c68 - Browse repository at this point
Copy the full SHA 4f30c68View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6a88d97 - Browse repository at this point
Copy the full SHA 6a88d97View commit details -
CU-86956du3q: Add more tests for runtime doc string addition (to make…
… sure it fails without the change)
Configuration menu - View commit details
-
Copy full SHA for 2491bef - Browse repository at this point
Copy the full SHA 2491befView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d3fad9 - Browse repository at this point
Copy the full SHA 5d3fad9View commit details -
CU-86956du3q: Add CLI option to show the various descriptions of the …
…finding types (--only-describe)
Configuration menu - View commit details
-
Copy full SHA for 7bf7f59 - Browse repository at this point
Copy the full SHA 7bf7f59View commit details
Commits on Aug 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a51f8b0 - Browse repository at this point
Copy the full SHA a51f8b0View commit details -
Configuration menu - View commit details
-
Copy full SHA for a7ebafd - Browse repository at this point
Copy the full SHA a7ebafdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e7a106 - Browse repository at this point
Copy the full SHA 4e7a106View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5db542 - Browse repository at this point
Copy the full SHA e5db542View commit details -
CU-86956du3q: Add usage of regression suite name from the name of the…
… file being read
Configuration menu - View commit details
-
Copy full SHA for 46b66cf - Browse repository at this point
Copy the full SHA 46b66cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for cfc0209 - Browse repository at this point
Copy the full SHA cfc0209View commit details -
Configuration menu - View commit details
-
Copy full SHA for 11211a5 - Browse repository at this point
Copy the full SHA 11211a5View commit details
Commits on Aug 20, 2024
-
CU-86956du3q: Make sure strictness propagates accross all parts of a …
…multi-result descriptor
Configuration menu - View commit details
-
Copy full SHA for ea97a63 - Browse repository at this point
Copy the full SHA ea97a63View commit details -
Configuration menu - View commit details
-
Copy full SHA for b582366 - Browse repository at this point
Copy the full SHA b582366View commit details
Commits on Aug 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 90be850 - Browse repository at this point
Copy the full SHA 90be850View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2390a0f - Browse repository at this point
Copy the full SHA 2390a0fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c3cc3e - Browse repository at this point
Copy the full SHA 4c3cc3eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4000280 - Browse repository at this point
Copy the full SHA 4000280View commit details -
CU-86956du3q: Add option to force a non-0 exit status upon any regres…
…sion test failure
Configuration menu - View commit details
-
Copy full SHA for f70386a - Browse repository at this point
Copy the full SHA f70386aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 682950e - Browse repository at this point
Copy the full SHA 682950eView commit details -
CU-86956du3q: Add new part to main workflow to create and regression …
…check a simple model pack
Configuration menu - View commit details
-
Copy full SHA for b71d1ef - Browse repository at this point
Copy the full SHA b71d1efView commit details -
Configuration menu - View commit details
-
Copy full SHA for eec8fec - Browse repository at this point
Copy the full SHA eec8fecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f10fcd - Browse repository at this point
Copy the full SHA 3f10fcdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9fe402f - Browse repository at this point
Copy the full SHA 9fe402fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ddd4a7 - Browse repository at this point
Copy the full SHA 0ddd4a7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1515548 - Browse repository at this point
Copy the full SHA 1515548View commit details -
CU-86956du3q: Use the python version of creat model pack during test …
…time to avoid conflicts with other python versions running in parallel
Configuration menu - View commit details
-
Copy full SHA for ba35759 - Browse repository at this point
Copy the full SHA ba35759View commit details -
CU-86956du3q: [TEMP] Remove tests from main workflow (for faster iter…
…ation) and add args to output upon regression checking
Configuration menu - View commit details
-
Copy full SHA for 4bf3089 - Browse repository at this point
Copy the full SHA 4bf3089View commit details -
Revert "CU-86956du3q: [TEMP] Remove tests from main workflow (for fas…
…ter iteration) and add args to output upon regression checking" This reverts commit 4bf3089.
Configuration menu - View commit details
-
Copy full SHA for 750e9b8 - Browse repository at this point
Copy the full SHA 750e9b8View commit details -
CU-86956du3q: Make full model path the last line of the output upon c…
…reation model for regression
Configuration menu - View commit details
-
Copy full SHA for b23aba0 - Browse repository at this point
Copy the full SHA b23aba0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 32ebe7f - Browse repository at this point
Copy the full SHA 32ebe7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 101f2e4 - Browse repository at this point
Copy the full SHA 101f2e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 068c2bf - Browse repository at this point
Copy the full SHA 068c2bfView commit details
Commits on Aug 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b5a5b6a - Browse repository at this point
Copy the full SHA b5a5b6aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6e23316 - Browse repository at this point
Copy the full SHA 6e23316View commit details