Skip to content

Commit

Permalink
Revert metric name change
Browse files Browse the repository at this point in the history
  • Loading branch information
epwalsh committed Mar 18, 2024
1 parent ca0fe2b commit 856860d
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions olmo/eval/evaluator.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,8 +56,8 @@ def compute_metrics(self) -> Dict[str, float]:
# get to this one within the current evaluation loop.
continue
else:
out[f"eval/ppl/{label}/CrossEntropyLoss"] = loss.item()
out[f"eval/ppl/{label}/Perplexity"] = torch.exp(loss).item()
out[f"eval/{label}/CrossEntropyLoss"] = loss.item()
out[f"eval/{label}/Perplexity"] = torch.exp(loss).item()
return out
else:
raise ValueError(f"Unexpected evaluator type '{self.type}'")
Expand Down

0 comments on commit 856860d

Please sign in to comment.