forked from NVIDIA/NeMo-Curator
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathlm_tasks.yaml
48 lines (48 loc) · 1.39 KB
/
lm_tasks.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
tasks:
# The Python modules below define language model downstream evaluation
# task data. If one of the below tasks is specified, N-grams will
# be constructed from the documents that make up the task data
# using the script prepare_task_data.
# find_matching_ngrams will then search for these N-grams
# in the training documents, and remove_matching_ngrams will
# split the documents based on matches
- name: nemo_curator.tasks.Winogrande
params: {}
- name: nemo_curator.tasks.Squad
params: {}
- name: nemo_curator.tasks.TriviaQA
params: {}
- name: nemo_curator.tasks.Quac
params: {}
- name: nemo_curator.tasks.WebQA
params: {}
- name: nemo_curator.tasks.Race
params: {}
- name: nemo_curator.tasks.Drop
params: {}
- name: nemo_curator.tasks.WiC
params: {}
- name: nemo_curator.tasks.PIQA
params: {}
- name: nemo_curator.tasks.ArcEasy
params: {}
- name: nemo_curator.tasks.ArcChallenge
params: {}
- name: nemo_curator.tasks.OpenBookQA
params: {}
- name: nemo_curator.tasks.BoolQ
params: {}
- name: nemo_curator.tasks.Copa
params: {}
- name: nemo_curator.tasks.RTE
params: {}
- name: nemo_curator.tasks.MultiRC
params: {}
- name: nemo_curator.tasks.WSC
params: {}
- name: nemo_curator.tasks.CB
params: {}
- name: nemo_curator.tasks.ANLI
params: {}
- name: nemo_curator.tasks.Record
params: {}