Skip to content

Commit

Permalink
update content
Browse files Browse the repository at this point in the history
  • Loading branch information
AkshitaB committed Jan 30, 2024
1 parent 13b83f8 commit 780e386
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,10 +71,11 @@ Note: passing CLI overrides like `--reset_trainer_state` is only necessary if yo

## Inference

To run inference on the olmo checkpoints:
You can utilize our HuggingFace integration to run inference on the olmo checkpoints:

```python
from hf_olmo import *
from hf_olmo import * # registers the Auto* classes

from transformers import AutoModelForCausalLM, AutoTokenizer

olmo = AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B")
Expand Down

0 comments on commit 780e386

Please sign in to comment.