Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update TensorRT-LLM #2363

Merged
merged 1 commit into from
Oct 22, 2024
Merged

Update TensorRT-LLM #2363

merged 1 commit into from
Oct 22, 2024

Conversation

kaiyux
Copy link
Member

@kaiyux kaiyux commented Oct 22, 2024

  • Model Support
    • Added support for Llama 3.2 model.
  • Features
    • Added support for Qwen2ForSequenceClassification model architecture.
  • API
    • [BREAKING CHANGE] Modified defaults for BuildConfig class so that they are aligned with the trtllm-build command.
  • Bug fixes
  • Documentation

@kaiyux kaiyux merged commit 1730a58 into main Oct 22, 2024
@kaiyux kaiyux deleted the preview/main branch October 22, 2024 12:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants