Add Gemma-3 vision tutorial to ONNX Runtime GenAI#1793
Conversation
|
We have tutorial documentations in the main ORT repo and here. How are they organized? |
The tutorial organization is a relic of the team's historical work. The ORT transformers folder was the original location for any tutorials. Once ORT GenAI was created, any tutorials specific to running multi-modal models were stored in the Now that we have an Olive recipes repo for getting models, we can move the remaining tutorials there. However, we need to carefully do it in migration phases as we have production customers who depend on the existing tutorials and their associated modeling code changes. |
Description
This PR adds a tutorial to show how to create the ONNX models for Gemma-3 vision (4B, 12B, 27B).
Motivation and Context
This PR requires the changes from the following PRs.
This PR also resolves the following issues.
bad_allocationerror when providing image input to Gemma-3-4b-it CPU FP32 ONNX model #1698