Skip to content

Rewrite all examples using standardization#1939

Merged
baijumeswani merged 84 commits into
mainfrom
kvaishnavi/guidance-schema
Feb 3, 2026
Merged

Rewrite all examples using standardization#1939
baijumeswani merged 84 commits into
mainfrom
kvaishnavi/guidance-schema

Conversation

@kunal-vaishnavi
Copy link
Copy Markdown
Contributor

@kunal-vaishnavi kunal-vaishnavi commented Jan 7, 2026

Description

This PR rewrites all examples in C/C++, C#, and Python to use standardized approaches for running inference with ONNX Runtime GenAI. It also removes the SLM engine, chat app, and Genny examples since they are now deprecated and not maintained. Users can try out Foundry Local, which is powered by ONNX Runtime GenAI, if interested in similar examples.

Motivation and Context

Examples across the languages and across functionalities are often out-of-sync. For example, a Python example may get updated but its equivalent C/C++ and C# examples do not. This PR fixes this by synchronizing feature parity across the various examples.

We can use this standardization to continue maintaining feature parity in the future.

Comment thread examples/python/common.py Dismissed
Comment thread examples/python/model-qa.py Fixed
Comment thread examples/python/common.py Fixed
Comment thread examples/python/common.py Dismissed
Comment thread examples/python/common.py Dismissed
Comment thread test/python/test_onnxruntime_genai_e2e.py Fixed
Comment thread examples/python/model-qa.py Dismissed
@natke natke self-requested a review January 7, 2026 22:27
Comment thread examples/python/model-chat.py Fixed
Comment thread examples/python/model-chat.py Fixed
Comment thread examples/python/model-chat.py Dismissed
Comment thread examples/python/model-chat.py Dismissed
Comment thread src/csharp/NativeMethods.cs Outdated
@baijumeswani baijumeswani merged commit 42d1bd2 into main Feb 3, 2026
15 checks passed
@baijumeswani baijumeswani deleted the kvaishnavi/guidance-schema branch February 3, 2026 16:55
kunal-vaishnavi added a commit that referenced this pull request Feb 11, 2026
### Description

This PR adds a missing documentation step to download `common.py` in the
Phi-3 tutorial.

### Motivation and Context

This PR is a follow-up to [this
PR](#1939).
baijumeswani pushed a commit that referenced this pull request Feb 12, 2026
### Description

This PR adds a missing documentation step to download `common.py` in the
Phi-3 tutorial.

### Motivation and Context

This PR is a follow-up to [this
PR](#1939).
baijumeswani pushed a commit that referenced this pull request Feb 17, 2026
### Description

This PR updates all of the examples after the v0.12.0 release of ONNX
Runtime GenAI to use new APIs.

### Motivation and Context

Some of the new APIs required an official release to be published before
the examples could use them (as mentioned
[here](#1939 (comment))).
baijumeswani pushed a commit that referenced this pull request Feb 18, 2026
### Description

This PR fixes the Python nightly build of ONNX Runtime GenAI.

### Motivation and Context

A [previous
PR](#1939) introduced
changes to the CIs, and those changes were not brought over to the
nightly pipeline.
baijumeswani pushed a commit that referenced this pull request Mar 4, 2026
This PR updates all of the examples after the v0.12.0 release of ONNX
Runtime GenAI to use new APIs.

Some of the new APIs required an official release to be published before
the examples could use them (as mentioned
[here](#1939 (comment))).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants