microsoft onnxruntime-genai General · Discussions · GitHub

Welcome to onnxruntime-genai Discussions!
Announcements natke

Sort by: Latest activity

General Discussions

Chat about anything and everything here

You must be logged in to vote

How is genAI compatible with Onnxruntime API?

elephantpanda started Aug 21, 2024 in General

1
You must be logged in to vote

Can someone enlighten me on how exactly the Matmul 4bit quantization works?

han-minhee started Sep 3, 2024 in General

1
You must be logged in to vote

Does onnxruntime or onnxruntime_genai support tool_calling?

jivaniyash started May 30, 2024 in General

5
You must be logged in to vote

It works great.

elephantpanda started Aug 19, 2024 in General

0
You must be logged in to vote

How to suppress info/warnings?

telos00 started May 1, 2024 in General · Closed

2