Skip to content

other: support non-fp32 dtype for transformers/v0.5.0#480

Draft
rebel-seinpark wants to merge 15 commits intotransformers/v5.0.0rc3from
transformers/v5.0.0rc3-support_non_fp32_dtype
Draft

other: support non-fp32 dtype for transformers/v0.5.0#480
rebel-seinpark wants to merge 15 commits intotransformers/v5.0.0rc3from
transformers/v5.0.0rc3-support_non_fp32_dtype

Conversation

@rebel-seinpark
Copy link
Copy Markdown
Contributor

@rebel-seinpark rebel-seinpark commented Jan 27, 2026

Pull Request Description

⚠️ Important: Branch Target

  • New features, enhancements, and non-critical fixes: Merge to dev branch
  • Critical hotfixes only: Merge to main branch (must also merge to dev)

Please ensure you've selected the correct base branch before submitting!

Support non-fp32 dtype after this PR

You need to below compiier hash

Type of Change

  • Release (dev → main merge for production release)
  • New Model Support
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update
  • Performance improvement
  • Code refactoring
  • Other (please describe):

Changes Overview

Motivation and Context

Related Issues


Conventional commit

type(optional scope): description

Type candidate

  • Model Updates
    • model: Adding New models or Bugfix for existing models
      • ex) Add LlavaNext
      • ex) Bugfix Whisper
  • Enhancements
    • performance: Optimizing some models or this library itself
      • ex) Loading RBLNModel faster
      • ex) Optimizing Memory Usage of DecoderOnlyModel
  • Code Refactor
    • refactor: Re-arrange class architecture, or more.
      • ex) Refactor Seq2Seq
  • Documentation
    • doc: Update docstring only
  • Library Dependencies
    • dependency: Update requirements, something like that.
  • Release
    • release: Merging dev to main for production release
      • ex) Release v1.2.0
  • Other
    • other: None of above.
      • ex) ci update
      • ex) pdm update

@rebel-seinpark rebel-seinpark changed the title other: prepare non-fp32 dtype other: support non-fp32 dtype Jan 27, 2026
@rebel-seinpark rebel-seinpark changed the title other: support non-fp32 dtype other: support non-fp32 dtype for transformers/v0.5.0 Jan 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant