Repository navigation

fix(streaming): keep the served service_tier on streamed chunks and spend rows - #42870

Merged

kerry-berri merged 26 commits into

mainfrom

litellm_stream_served_service_tier

Sep 29, 2026

Commits on Sep 24, 2026
Commits on Sep 25, 2026
- fix(anthropic-adapter): expose streamed chunks so disconnects bill partial spend
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  7039b6d
- test(service-tier): cover anthropic and responses served-tier billing paths
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  909bb4c
- fix(anthropic-adapter): return a chunks-exposing stream so disconnects bill partial spend
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  bf86914
- test(service-tier): bill disconnects through the router's anthropic stream wrapper
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  047b506
- Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier
  kerry
  committed
  38ee5f1
- style: apply ruff format to the anthropic stream changes
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  13377df
- test(coverage): ignore delegating properties the ast scan cannot see
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  2f7e0e7
- style: keep the cast-ok reasons on the cast call line
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  8a563ef
- test(integration): cover served service_tier billing for streamed chat and messages, complete and disconnected
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  d3b8af9
- fix(anthropic-cache): delegate chunks/messages/model through the messages stream cache writer
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  d6acd53
- fix(streaming): keep service_tier on OpenAI-compatible parsed chunks
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  d343d3f
- refactor(streaming): parameterize delegated chunks and messages types
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  818e9e4
- Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier
  kerry
  committed
  3d909b9
- Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  d07a7c5
Commits on Sep 26, 2026
- Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier
  kerry
  committed
  cc446c6
- Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier
  kerry
  committed
  9e0d6f5
- fix(tests): follow the anthropic pass_through rename after merging main
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  7276946
- test(anthropic): drain the logging worker between response cache tests
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  761f369
Commits on Sep 27, 2026
- test(spend): cover azure, databricks, responses bridge and gemini served tiers in the stream billing integration test
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  0d8fad7
- fix(databricks): keep the served service_tier on streamed chunks and bill it
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  fc268b1
- fix(databricks): type the served service_tier chunk without a loose kwargs dict
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  bc9cb9f
Commits on Sep 29, 2026
- fix(cost): bill the served service_tier over the requested one
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  4db1654
- refactor(cost): drop explanatory comment from the tier resolution
  
  kerry
  and
  devin-ai-integration[bot]
  committed
  aaf6c94

Navigation Menu

Repository navigation

fix(streaming): keep the served service_tier on streamed chunks and spend rows - #42870

fix(streaming): keep the served service_tier on streamed chunks and spend rows#42870
kerry-berri merged 26 commits into
mainfrom
litellm_stream_served_service_tier

Commits on Sep 24, 2026

fix(streaming): keep the provider's served service_tier on streamed chunks and spend rows

fix(streaming): satisfy type-discipline and strict ruff budgets

fix(streaming): stamp the served service_tier on every Responses bridge chunk

Commits on Sep 25, 2026

fix(anthropic-adapter): expose streamed chunks so disconnects bill partial spend

test(service-tier): cover anthropic and responses served-tier billing paths

fix(anthropic-adapter): return a chunks-exposing stream so disconnects bill partial spend

test(service-tier): bill disconnects through the router's anthropic stream wrapper

Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier

style: apply ruff format to the anthropic stream changes

test(coverage): ignore delegating properties the ast scan cannot see

style: keep the cast-ok reasons on the cast call line

test(integration): cover served service_tier billing for streamed chat and messages, complete and disconnected

fix(anthropic-cache): delegate chunks/messages/model through the messages stream cache writer

fix(streaming): keep service_tier on OpenAI-compatible parsed chunks

refactor(streaming): parameterize delegated chunks and messages types

Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier

Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier

Commits on Sep 26, 2026

Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier

Merge remote-tracking branch 'origin/main' into litellm_stream_served_service_tier

fix(tests): follow the anthropic pass_through rename after merging main

test(anthropic): drain the logging worker between response cache tests

Commits on Sep 27, 2026

test(spend): cover azure, databricks, responses bridge and gemini served tiers in the stream billing integration test

fix(databricks): keep the served service_tier on streamed chunks and bill it

fix(databricks): type the served service_tier chunk without a loose kwargs dict

Commits on Sep 29, 2026

fix(cost): bill the served service_tier over the requested one

refactor(cost): drop explanatory comment from the tier resolution