Skip to content

test(benchmarks): add CodSpeed benchmarks for inference, MCP and A2A hot paths - #31716

Merged
yassin-berriai merged 1 commit into
litellm_internal_stagingfrom
litellm_codspeed_inference_mcp_a2a
Jun 30, 2026
Merged

yassin-berriai merged 1 commit into
litellm_internal_stagingfrom
litellm_codspeed_inference_mcp_a2a

test(benchmarks): add CodSpeed benchmarks for inference, MCP and A2A …

af20e75
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis succeeded Jun 30, 2026 in 0s

Performance Gate Passed

✅ 16 untouched benchmarks
🆕 14 new benchmarks

Performance Changes

Benchmark BASE HEAD Efficiency
🆕 test_a2a_inbound_message_to_openai_messages N/A 97.4 µs N/A
🆕 test_convert_messages_to_a2a_prompt N/A 111.1 µs N/A
🆕 test_extract_text_from_a2a_message_response N/A 87.3 µs N/A
🆕 test_extract_text_from_a2a_task_response N/A 87.2 µs N/A
🆕 test_completion_multi_turn N/A 3.1 ms N/A
🆕 test_completion_simple_message N/A 4.9 ms N/A
🆕 test_completion_streaming N/A 59.1 ms N/A
🆕 test_completion_with_tools N/A 4.2 ms N/A
🆕 test_response_to_model_response_object N/A 544 µs N/A
🆕 test_mcp_server_prefix_tool_list N/A 164.8 µs N/A
🆕 test_mcp_server_strip_prefix_on_call N/A 84.1 µs N/A
🆕 test_transform_mcp_tool_list_to_openai N/A 192.1 µs N/A
🆕 test_transform_openai_tool_call_to_mcp N/A 128.3 µs N/A
🆕 test_transform_single_mcp_tool_to_openai N/A 89.8 µs N/A

Comparing litellm_codspeed_inference_mcp_a2a (af20e75) with litellm_internal_staging (cc57fe2)1

Open in CodSpeed

Footnotes

  1. No successful run was found on litellm_internal_staging (70eb4e5) during the generation of this report, so 15ba573 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩