Code

17 demetr results by language#22

Code

Open

klh5 wants to merge 17 commits intomainalan-turing-institute/ARC-m4st:mainfrom 17-demetr-results-by-languagealan-turing-institute/ARC-m4st:17-demetr-results-by-languageCopy head branch name to clipboard

+2,112-214

Commits

Commits on Jan 27, 2025

• ♻️ Output to JSON files

  klh5

  committed
  e1f96ce

  Copy full SHA for e1f96ce

• 🐛 Fix args

  klh5

  committed
  717a58b

  Copy full SHA for 717a58b

Commits on Feb 4, 2025

• ✨ Add analysis notebook

  klh5

  committed
  59baf10

  Copy full SHA for 59baf10

• ➕ Add category mapping

  klh5

  committed
  a1ee901

  Copy full SHA for a1ee901

Commits on Feb 11, 2025

• 🔧 COMET model now optional

  klh5

  committed
  5a47208

  Copy full SHA for 5a47208

• 🔧 Fix cat severity

  klh5

  committed
  506ea9c

  Copy full SHA for 506ea9c

• 📌 Update github actions

  klh5

  committed
  b3dade4

  Copy full SHA for b3dade4

Commits on Feb 19, 2025

• ♻️ Create separate config dir

  klh5

  committed
  3edce43

  Copy full SHA for 3edce43

• 📝 Add docstrings and fix metric name

  klh5

  committed
  9e825ba

  Copy full SHA for 9e825ba

• 📝 Add docstring to Metric class

  klh5

  committed
  1c93ff8

  Copy full SHA for 1c93ff8

• ♻️ Move category mapping to seperate config

  klh5

  committed
  df8ddc4

  Copy full SHA for df8ddc4

• 🔥 Remove pointless dataframe creation

  klh5

  committed
  af7cfb4

  Copy full SHA for af7cfb4

Commits on Feb 20, 2025

• Add YAML config load

  klh5

  committed
  c160185

  Copy full SHA for c160185

• Test

  klh5

  committed
  0497955

  Copy full SHA for 0497955

Commits on Feb 25, 2025

• ♻️ COMET model is now a command line arg

  klh5

  committed
  c2b19a9

  Copy full SHA for c2b19a9

Commits on Feb 26, 2025

• ⚡ Add slurm script

  klh5

  committed
  35b5581

  Copy full SHA for 35b5581

Commits on Feb 28, 2025

• Additional results for COMET

  klh5

  committed
  8ea6fe6

  Copy full SHA for 8ea6fe6