feat(engine): a chained speculative proposal computes where its tensors already are - #1861

feat(engine): a chained speculative proposal computes where its tensors already are#1861

justinchuby merged 3 commits into

mainjustinchuby/onnx-genai:mainfrom

justinchuby/speculative-cuda-residencyjustinchuby/onnx-genai:justinchuby/speculative-cuda-residencyCopy head branch name to clipboard