Error when connecting to Claude through OpenRouter

[ghost]

Hi @zeitlings , I've been able to use the workflow to access OpenRouter and the anthropic/claude-3.5-sonnet model, but the following error message appears at the end of every output:

􀇾 [Decoding Error > Data Corrupted] Cannot initialize StopReasonOpenAI from invalid String value endturn.
Coding Path: [CodingKeys(stringValue: "choices", intValue: nil), JSONKey(stringValue: "Index 0", intValue: 0), CodingKeys(stringValue: "finish_reason", intValue: nil)].

Thanks in advance!

[ghost]

And here are the model details from OpenRouter:

[zeitlings]

Hey @glowacky
In general, the API responses are expected to mirror those of OpenAI exactly, including the stop reason.
However, I'll probably add this particular exception. Might take a while to get around to it though.

[ghost]

I think you're right – on this OpenAI page, it seems like the equivalent finish_reason would be "stop"

No rush – will be on the lookout for the exception, thanks! 🙏

[ghost]

Hi @zeitlings ! Was this resolved? Still getting the error in alpha-4.

It occurred to me that finish_reason could maybe become another environment variable (openai_alternative_proxy_finish_reason). What do you think?

[zeitlings]

Hey @glowacky

Thanks for the suggestion, I think that's a very good idea. The next version will consider the environment variable openai_alternative_shared_finish_reasons (a comma separated list) as a fallback where decoding the finish reason initially fails.

[zeitlings]

@glowacky alpha.5 is ready to go now. Let me know if everything works as expected!

[ghost]

Seems to be working great, thanks!