Popular repositories Loading

1. llm-d-async llm-d-async Public

   Forked from llm-d/llm-d-async

   Asynchronous Processor for Inference Gateway. Orchestrator of queues

   Go

2. llm-d-batch-gateway llm-d-batch-gateway Public

   Forked from llm-d/llm-d-batch-gateway

   llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine

   Go

3. litellm litellm Public

   Forked from BerriAI/litellm

   The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…

   Python