From 780e38627d5335ef887012e62026560b9f8a22a3 Mon Sep 17 00:00:00 2001 From: Akshita Bhagia Date: Tue, 30 Jan 2024 11:25:10 -0800 Subject: [PATCH] update content --- README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index a96976b26..d84f5a660 100644 --- a/README.md +++ b/README.md @@ -71,10 +71,11 @@ Note: passing CLI overrides like `--reset_trainer_state` is only necessary if yo ## Inference -To run inference on the olmo checkpoints: +You can utilize our HuggingFace integration to run inference on the olmo checkpoints: ```python -from hf_olmo import * +from hf_olmo import * # registers the Auto* classes + from transformers import AutoModelForCausalLM, AutoTokenizer olmo = AutoModelForCausalLM.from_pretrained("allenai/OLMo-7B")