Skip to content

feat: add MTP support for parallel API#345

Merged
jhen0409 merged 1 commit into
mainfrom
codex/mtp-parallel-api
May 20, 2026
Merged

feat: add MTP support for parallel API#345
jhen0409 merged 1 commit into
mainfrom
codex/mtp-parallel-api

Conversation

@jhen0409
Copy link
Copy Markdown
Member

Summary

  • Add MTP speculative decoding support to the queued parallel completion path.
  • Return draft token metrics from parallel completions and update JSI/test coverage.
  • Update the MTP example to use the parallel API, configurable slot count, grouped output, and per-completion timing UI.

Validation

  • npm run typecheck
  • npm run lint
  • npm test -- --runInBand
  • ./tests/build_and_test.sh
  • ./tests/run_tests.sh
  • git diff --check

@jhen0409 jhen0409 marked this pull request as ready for review May 20, 2026 23:52
@jhen0409 jhen0409 merged commit d6de1df into main May 20, 2026
6 checks passed
@jhen0409 jhen0409 deleted the codex/mtp-parallel-api branch May 20, 2026 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant