Repository navigation
Conversation
Tokenify serves DeepSeek and GLM models on /v1/chat/completions, /v1/responses and /v1/messages at https://api.tokenify.dev/v1. Registered through the JSON provider config, following the Cortecs provider. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Adds cost-map entries for the five models Tokenify serves (identical in the root and backup maps), with capabilities taken from its GET /v1/models, and tests that the costs match the published per-1M prices and that the Admin UI placeholder model is priced. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
…or price literals Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
Hi maintainers — this is ready for review whenever you have a moment: all required checks pass, Greptile is at 5/5, and the CLA is signed. It follows the Cortecs provider (#43872): a JSON |
TLDR
Problem this solves:
openai/plus a manualapi_baseHow it solves it:
tokenifythrough the JSON provider config (openai_like/providers.json)User Flow
Before: a developer has to know the base URL and route through the generic OpenAI provider
litellm.completion(model="tokenify/deepseek/deepseek-v4-pro", ...)tokenifyis not a known prefixmodel="openai/deepseek/deepseek-v4-pro"withapi_base="https://api.tokenify.dev/v1"After: the provider prefix works on its own
TOKENIFY_API_KEYand calllitellm.completion(model="tokenify/deepseek/deepseek-v4-pro", ...)https://api.tokenify.dev/v1/chat/completionswith their key and returns a normal completionlitellm.responses(...)andlitellm.anthropic.messages.acreate(...)with the same model reach/v1/responsesand/v1/messagesPre-Submission checklist
tests/unit/llms/openai_like/test_tokenify_provider.py, mirroring the Cortecs tests)pytest tests/unit/llms/openai_like/test_tokenify_provider.py tests/unit/llms/openai_like/test_cortecs_provider.py→ 14 passed;ruff checkandruff format --checkcleanType
🆕 New Feature
Docs: https://www.tokenify.dev/docs/ — models:
GET https://api.tokenify.dev/v1/models. A docs page for docs.litellm.ai can follow inBerriAI/litellm-docsonce this lands.🤖 Generated with Claude Code