You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Document f32 input casting for vision/audio encoders in multimodal skill (#271)
Update the multimodal-models skill to document why vision/audio encoder
graphs accept f32 inputs and Cast to model dtype at graph entry.
## What this adds
New section in `.agents/skills/multimodal-models/SKILL.md`:
- **Why:** ORT GenAI image/audio processors always output f32,
regardless of model dtype
- **How:** Encoder graph adds `Cast(f32 → model_dtype)` at entry;
weights remain in f16/bf16
- **When:** Handled automatically by mobius with `--runtime ort-genai`
- **Error without it:** `Type Error: Type parameter (T) bound to
different types`
This documents the pattern introduced in PR #265.
---------
Signed-off-by: Justin Chu <justinchu@microsoft.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
0 commit comments