Miscellaneous inference cleanup - #2955

Merged

ko3n1g merged 52 commits into

NVIDIA:mainfrom

santhnm2:engine_context_cleanup

Jan 31, 2026

Commits on Jan 15, 2026

WIP engine and context cleanup
santhnm2
committed
85efc1f
Tests pass
santhnm2
committed
ca8b278
Merge with main
santhnm2
committed
fafb2d2
Undo attention.py change
santhnm2
committed
01a8237
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
faa935b
Fix unit tests
santhnm2
committed
6da70fb

Commits on Jan 20, 2026

Fix typo and clean up run_inference_performance_test.py
santhnm2
committed
2f67856

Commits on Jan 21, 2026

Merge branch 'main' into engine_context_cleanup
santhnm2
authored
c8d3934
Address reviewer feedback
santhnm2
committed
b801c9c
Fix copyright
santhnm2
committed
cff3c1e

Commits on Jan 22, 2026

Add back deprecated args with exception
santhnm2
committed
b6d9c93
Merge with main
santhnm2
committed
ed6f96a
Add deprecation exception for GPTInferenceWrapper
santhnm2
committed
98d5acc
Fix wandb test
santhnm2
committed
ec2fad2
Address reviewer comments
santhnm2
committed
2dea9b3
Bug fixes
santhnm2
committed
e5edb9a

Commits on Jan 23, 2026

Major refactor - introduce DynamicInferenceConfig
santhnm2
committed
4b6cb9c
Merge with main
santhnm2
committed
8e8225a
Add inference config unit test
santhnm2
committed
bf66e63
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
d14f476
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
f1af84f
Address reviewer feedback
santhnm2
committed
188dcf2
Fix copyright
santhnm2
committed
92b1a8d
Fix import
santhnm2
committed
c76d953
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
71e790c
Fix mamba test
santhnm2
committed
952dd38
Fix unit tests
santhnm2
committed
84c6123
Merge branch 'main' into engine_context_cleanup
santhnm2
authored
c50d844
Fix example scripts
santhnm2
committed
ef50892

Commits on Jan 24, 2026

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Jan 29, 2026

Merge with main
santhnm2
committed
c40e18e
Merge branch 'main' into engine_context_cleanup
santhnm2
authored
0e4e286

Commits on Jan 30, 2026

Merge with main
santhnm2
committed
6d85bf2
Merge with main
santhnm2
committed
7080773
Fix static functional test
santhnm2
committed
c3e10a2
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
b9fd22a
Try removing arguments that are now in TransformerConfig
santhnm2
committed
a57af29
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
21c6d2d
Bug fixes
santhnm2
committed
dbb8614
Merge remote-tracking branch 'upstream/main' into engine_context_cleanup
santhnm2
committed
5474dea
Fix formatting
santhnm2
committed
ca27708
More bug fixes
santhnm2
committed
80ddc9a

Commits on Jan 31, 2026

Merge branch 'main' into engine_context_cleanup
santhnm2
authored
84b443d