Skip to content

Commit

Permalink
TIRA Evaluator: Extract top-docs for DiffIR and render them by default.
Browse files Browse the repository at this point in the history
  • Loading branch information
mam10eks committed Jul 19, 2023
1 parent d7aca48 commit e8dde41
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ir-measures/ir_measures_evaluator.py
Original file line number Diff line number Diff line change
Expand Up @@ -880,7 +880,7 @@ def render_results(run_file, irds_id, output_path, top_k=10):
output_file.write(json.dumps(excerpt_for_rendering))

from diffir.run import diff_from_local_data
_, rendered_serp = diff_from_local_data([str(run_file.resolve())], [str((output_path / '.data-top-10-for-rendering.jsonl').resolve())], cli=False, web=True, print_html=False)
_, rendered_serp = diff_from_local_data([str(Path(run_file).resolve())], [str((Path(output_path) / '.data-top-10-for-rendering.jsonl').resolve())], cli=False, web=True, print_html=False)

with open(Path(output_path) / 'serp.html', 'w') as output_file:
output_file.write(rendered_serp)
Expand Down

0 comments on commit e8dde41

Please sign in to comment.