Skip to content

Commit

Permalink
Update iOS.md (pytorch#361)
Browse files Browse the repository at this point in the history
  • Loading branch information
shoumikhin authored and malfet committed Jul 17, 2024
1 parent 2b83c7c commit 060e186
Showing 1 changed file with 6 additions and 13 deletions.
19 changes: 6 additions & 13 deletions docs/iOS.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,8 @@
# iOS
# Running LLaMA models on iOS

Open the iOS Llama Xcode project at
https://github.com/pytorch/executorch/tree/main/examples/demo-apps/apple_ios/LLaMA/LLaMA.xcodeproj
in Xcode and click Run. You will need to provide a provisioning
profile (similar to what's expected for any iOS dev).
Check out the [tutorial](https://pytorch.org/executorch/main/llm/llama-demo-ios.html) on how to build the iOS demo app running your
PyTorch models with [ExecuTorch](https://github.com/pytorch/executorch).

Once you can run the app on you device,
1 - connect the device to you Mac,
2 - copy the model and tokenizer.bin to the iOS Llama app
3 - select the tokenizer and model with the `(...)` control (bottom left of screen, to the left of the text entrybox)


Detailed step by step in conjunction with ET iOS build, to run on
simulator for iOS.
<a href="https://pytorch.org/executorch/main/_static/img/llama_ios_app.mp4">
<img src="https://pytorch.org/executorch/main/_static/img/llama_ios_app.png" width="600" alt="iOS app running a LlaMA model">
</a>

0 comments on commit 060e186

Please sign in to comment.