Repository navigation
test(benchmarks): add CodSpeed benchmarks for inference, MCP and A2A hot paths - #31716
Merged
yassin-berriai merged 1 commit intoJun 30, 2026
Merged
CodSpeed / CodSpeed Performance Analysis
succeeded
Jun 30, 2026 in 0s
Performance Gate Passed
✅ 16 untouched benchmarks
🆕 14 new benchmarks
Performance Changes
| Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|
| 🆕 | test_a2a_inbound_message_to_openai_messages |
N/A | 97.4 µs | N/A |
| 🆕 | test_convert_messages_to_a2a_prompt |
N/A | 111.1 µs | N/A |
| 🆕 | test_extract_text_from_a2a_message_response |
N/A | 87.3 µs | N/A |
| 🆕 | test_extract_text_from_a2a_task_response |
N/A | 87.2 µs | N/A |
| 🆕 | test_completion_multi_turn |
N/A | 3.1 ms | N/A |
| 🆕 | test_completion_simple_message |
N/A | 4.9 ms | N/A |
| 🆕 | test_completion_streaming |
N/A | 59.1 ms | N/A |
| 🆕 | test_completion_with_tools |
N/A | 4.2 ms | N/A |
| 🆕 | test_response_to_model_response_object |
N/A | 544 µs | N/A |
| 🆕 | test_mcp_server_prefix_tool_list |
N/A | 164.8 µs | N/A |
| 🆕 | test_mcp_server_strip_prefix_on_call |
N/A | 84.1 µs | N/A |
| 🆕 | test_transform_mcp_tool_list_to_openai |
N/A | 192.1 µs | N/A |
| 🆕 | test_transform_openai_tool_call_to_mcp |
N/A | 128.3 µs | N/A |
| 🆕 | test_transform_single_mcp_tool_to_openai |
N/A | 89.8 µs | N/A |
Comparing litellm_codspeed_inference_mcp_a2a (af20e75) with litellm_internal_staging (cc57fe2)1
Footnotes
Loading