Skip to content

model.generate doesn't validate kwargs #18130

@stas00

Description

@stas00

Feature request

I made a mistake in a script:

model.generate(**tokens, in_length=num_tokens)

missing m in min_length and I was puzzling over why I was getting unexpected results (as it was using the default value which was quite different from mine)

Would it be possible to have generate validate its input and assert on unexpected args?

Thank you!

@patrickvonplaten

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions