[Fixes] Aiohttp transport fixes - add handling for aiohttp.ClientPayloadError and ssl_verification settings

[ishaan-jaff]

[Fixes] Aiohttp transport fixes

• Use Aiohttp as default transport
• Add explicit handling for aiohttp.ClientPayloadError
• Ensure ssl_verify settings are respected by aiohttp

This PR enhances the Aiohttp transport by adding explicit handling for aiohttp.ClientPayloadError, ensures ssl_verify

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
✅ Test

Changes

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 27, 2025 4:13am

[Copilot]

Pull Request Overview

This PR enhances the Aiohttp transport by adding explicit handling for aiohttp.ClientPayloadError, ensures ssl_verify defaults to True when unset, and standardizes date formats in a backup JSON.

• Gracefully continue streaming on incomplete payload errors in AiohttpResponseStream.
• Default ssl_verify to True in transport builders and update test expectations.
• Normalize deprecation_date to YYYY-MM-DD form in the backup JSON.

Reviewed Changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 6 comments.

File	Description
tests/local_testing/test_ollama.py	Added assertions and debug prints to verify SSL settings in the new Aiohttp transport
litellm/model_prices_and_context_window_backup.json	Updated deprecation_date entries to zero-padded YYYY-MM-DD format
litellm/llms/custom_httpx/http_handler.py	Set ssl_verify=True when None and streamline verify_ssl assignment
litellm/llms/custom_httpx/aiohttp_transport.py	Expanded AIOHTTP_EXC_MAP, added handling for ClientPayloadError, and removed external import

[Copilot]

[nitpick] Remove or replace debug print statements in tests; use assertions directly or a logger if needed to avoid noisy output in CI.

Suggested change

	print("type of transport in client=", type(client.client._transport))
	print("vars in transport in client=", vars(client.client._transport))
	litellm_created_session = client.client._transport._get_valid_client_session()
	print("litellm_created_session=", litellm_created_session)
	# check session ssl
	print("litellm_created_session ssl=", litellm_created_session.connector._ssl)
	# create aiohttp transport with ssl_verify=False
	import aiohttp
	aiohttp_session = aiohttp.ClientSession(connector=aiohttp.TCPConnector(verify_ssl=False))
	print("aiohttp_session ssl=", aiohttp_session.connector._ssl)
	assert isinstance(client.client._transport, object), "Transport type is not as expected"
	assert vars(client.client._transport), "Transport variables are missing or empty"
	litellm_created_session = client.client._transport._get_valid_client_session()
	assert litellm_created_session is not None, "litellm_created_session is None"
	# check session ssl
	assert litellm_created_session.connector._ssl is False, "SSL verification is not disabled in litellm_created_session"
	# create aiohttp transport with ssl_verify=False
	import aiohttp
	aiohttp_session = aiohttp.ClientSession(connector=aiohttp.TCPConnector(verify_ssl=False))
	assert aiohttp_session.connector._ssl is False, "SSL verification is not disabled in aiohttp_session"

[Copilot]

Annotate the exception map with concrete types, e.g., Dict[Type[Exception], Type[Exception]], to improve readability and static analysis.

Suggested change

	AIOHTTP_EXC_MAP: Dict = {
	AIOHTTP_EXC_MAP: Dict[Type[BaseException], Type[BaseException]] = {

[Copilot]

This key is duplicated in AIOHTTP_EXC_MAP; remove one occurrence to avoid confusion and ensure a single mapping per exception.

Suggested change

aiohttp.ClientConnectorError: httpx.ConnectError,

[Copilot]

Duplicate mapping for ClientProxyConnectionError found; consolidate into one entry.

[Copilot]

The ClientPayloadError mapping appears twice; deduplicate this entry to keep the map clear and unambiguous.

Suggested change

aiohttp.ClientPayloadError: httpx.ReadError,