Skip to content

fix: exclude temperature parameter for gpt-5 and similar models #3573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Oct 13, 2025
Merged

fix: exclude temperature parameter for gpt-5 and similar models #3573

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion livekit-agents/livekit/agents/voice/run_result.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -880,13 +880,18 @@ async def check_intent(success: bool, reason: str) -> tuple[bool, str]:
)

arguments: str | None = None
extra_kwargs = {}
excluded_models_temperature = ["gpt-5"] # Add model names here to exclude temperature

if not any(excluded_model in llm_v.model for excluded_model in excluded_models_temperature):
extra_kwargs["temperature"] = 0.0

# TODO(theomonnom): LLMStream should provide utilities to make function calling easier.
async for chunk in llm_v.chat(
chat_ctx=chat_ctx,
tools=[check_intent],
tool_choice={"type": "function", "function": {"name": "check_intent"}},
extra_kwargs={"temperature": 0.0},
extra_kwargs=extra_kwargs,
):
if not chunk.delta:
continue
Expand Down