Audiometrics unification

README.md

@@ -2,6 +2,7 @@
 
 Nemo-Skills is a collection of pipelines to improve "skills" of large language models (LLMs). We support everything needed for LLM development, from synthetic data generation, to model training, to evaluation on a wide range of benchmarks. Start developing on a local workstation and move to a large-scale Slurm cluster with just a one-line change.
 
+
 Here are some of the features we support:
 
 - [Flexible LLM inference](https://nvidia-nemo.github.io/Skills/pipelines/generation/):

nemo_skills/evaluation/evaluator/__init__.py

@@ -15,6 +15,7 @@
 import asyncio
 from typing import Any, Callable, Dict
 
+from nemo_skills.evaluation.evaluator.audio import AudioEvaluator
 from nemo_skills.evaluation.evaluator.base import BaseEvaluator
 from nemo_skills.evaluation.evaluator.bfcl import eval_bfcl
 from nemo_skills.evaluation.evaluator.code import (
@@ -65,6 +66,7 @@
     "code_exec": CodeExecEvaluator,
     "ioi": IOIEvaluator,
     "icpc": ICPCEvaluator,
+    "audio": AudioEvaluator,
 }
 
 # Validation: Ensure no overlap between class and function maps