Skip to content

WhisperProcessor::Process doesn't handle payload.prompt being set. #2067

Description

Describe the bug

std::shared_ptr<Tensor> input_ids = tokenizer.EncodeBatch(payload.prompts);
doesn't check payload.prompt. It should check that payload.prompt or payload.prompts is set and use the correct one.

To Reproduce
Run with a single prompt set.

Expected behavior
No divide by zero error.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions