Skip to content

[Bugfix][CI] Fix flaky entrypoints/openai/test_response_api_with_harmony.py::test_function_calling[openai/gpt-oss-20b]#34624

Merged
DarkLight1337 merged 2 commits intomainfrom
fix-weather
Feb 16, 2026
Merged

[Bugfix][CI] Fix flaky entrypoints/openai/test_response_api_with_harmony.py::test_function_calling[openai/gpt-oss-20b]#34624
DarkLight1337 merged 2 commits intomainfrom
fix-weather

Conversation

@NickLucche
Copy link
Collaborator

Fix flaky test entrypoints/openai/test_response_api_with_harmony.py::test_function_calling[openai/gpt-oss-20b] by mocking the call to open-meteo API to avoid unnecessary connection errors in CI such as:

[2026-02-16T10:16:52Z] FAILED entrypoints/openai/responses/test_harmony.py::test_function_calling[openai/gpt-oss-20b] - requests.exceptions.SSLError: HTTPSConnectionPool(host='api.open-meteo.com', port=443): Max retries exceeded with url: /v1/forecast?latitude=48.8566&longitude=2.3522&current=temperature_2m,wind_speed_10m&hourly=temperature_2m,relative_humidity_2m,wind_speed_10m (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1010)')))

PS we don't actually care about the weather in beautiful Paris

Signed-off-by: NickLucche <nlucches@redhat.com>
@github-project-automation github-project-automation bot moved this from To Triage to Ready in gpt-oss Issues & Enhancements Feb 16, 2026
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) February 16, 2026 14:35
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Feb 16, 2026
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request addresses a flaky test by replacing a live API call to an external weather service with a hardcoded value. This change effectively stubs the external dependency, which is a good practice to ensure test reliability and prevent failures due to network issues. The implementation is straightforward and correctly resolves the flakiness. The change is approved.

@DarkLight1337 DarkLight1337 merged commit 6cc403e into main Feb 16, 2026
18 checks passed
@DarkLight1337 DarkLight1337 deleted the fix-weather branch February 16, 2026 16:11
wzhao18 pushed a commit to wzhao18/vllm that referenced this pull request Feb 18, 2026
…mony.py::test_function_calling[openai/gpt-oss-20b]` (vllm-project#34624)

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
eldarkurtic pushed a commit to eldarkurtic/vllm that referenced this pull request Feb 19, 2026
…mony.py::test_function_calling[openai/gpt-oss-20b]` (vllm-project#34624)

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
ZJY0516 pushed a commit to ZJY0516/vllm that referenced this pull request Feb 23, 2026
…mony.py::test_function_calling[openai/gpt-oss-20b]` (vllm-project#34624)

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
llsj14 pushed a commit to llsj14/vllm that referenced this pull request Mar 1, 2026
…mony.py::test_function_calling[openai/gpt-oss-20b]` (vllm-project#34624)

Signed-off-by: NickLucche <nlucches@redhat.com>
tunglinwood pushed a commit to tunglinwood/vllm that referenced this pull request Mar 4, 2026
…mony.py::test_function_calling[openai/gpt-oss-20b]` (vllm-project#34624)

Signed-off-by: NickLucche <nlucches@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working gpt-oss Related to GPT-OSS models ready ONLY add when PR is ready to merge/full CI is needed

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants