Skip to content

Commit c200897

Browse files
committed
Adding prompt arguments for Phi3v on MathVista-TestMini
1 parent 7f9fb6b commit c200897

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

Diff for: lmms_eval/tasks/mathvista/mathvista_testmini.yaml

+3-1
Original file line numberDiff line numberDiff line change
@@ -20,10 +20,12 @@ metric_list:
2020
- metric: gpt_eval_score
2121
aggregation: !function utils.mathvista_aggregate_results
2222
higher_is_better: true
23-
23+
2424
model_specific_prompt_kwargs:
2525
default:
2626
shot_type: "format-prompt" # can be "reason-first", "solution", "step-by-step"
27+
phi3v:
28+
shot_type: "solution"
2729
model_specific_generation_kwargs:
2830
llava:
2931
image_aspect_ratio: original

0 commit comments

Comments
 (0)