Skip to content

fix: Remove reference of tokenizer from generation backend (#75)#82

Merged
parthchadha merged 4 commits intomainfrom
pchadha/remove-tokenizer-generation
Mar 26, 2025
Merged

fix: Remove reference of tokenizer from generation backend (#75)#82
parthchadha merged 4 commits intomainfrom
pchadha/remove-tokenizer-generation

Conversation

@parthchadha
Copy link
Contributor

What does this PR do ?

Remove reference of tokenizer from generation backend

Issues

#75

Usage

N/A

Before your PR is "Ready for review"

Pre checks:

  • [ N/A] Make sure you read and followed Contributor guidelines
  • [Y ] Did you write any new necessary tests?
  • [ Y] Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • [N/A] Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Mar 25, 2025
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
@parthchadha parthchadha force-pushed the pchadha/remove-tokenizer-generation branch from 24fcaad to fbc3bdf Compare March 25, 2025 20:44
@parthchadha parthchadha changed the title #75: Remove reference of tokenizer from generation backend fix: Remove reference of tokenizer from generation backend (#75) Mar 25, 2025
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
@parthchadha parthchadha mentioned this pull request Mar 25, 2025
4 tasks
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
terrykong
terrykong previously approved these changes Mar 25, 2025
SahilJain314
SahilJain314 previously approved these changes Mar 25, 2025
terrykong
terrykong previously approved these changes Mar 25, 2025
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
@parthchadha parthchadha dismissed stale reviews from terrykong and SahilJain314 via 1651311 March 25, 2025 23:57
@parthchadha parthchadha force-pushed the pchadha/remove-tokenizer-generation branch from 521e79a to 1651311 Compare March 25, 2025 23:57
@parthchadha parthchadha enabled auto-merge (squash) March 25, 2025 23:59
@parthchadha parthchadha merged commit cca2aec into main Mar 26, 2025
13 checks passed
@parthchadha parthchadha deleted the pchadha/remove-tokenizer-generation branch March 26, 2025 00:12
yfw pushed a commit that referenced this pull request Apr 2, 2025
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
KiddoZhu pushed a commit that referenced this pull request May 6, 2025
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants