fix(catalog): re-audit free-tier quotas against official pages - #12649
Merged
Merged
Conversation
…, ollama-cloud, groq, nara and mistral
…gainst official pages
… its regression test
… fix catalog header
… the last "14.4K RPD" Groq texts
…ier-quota-reaudit # Conflicts: # README.md # docs/diagrams/readme-hero.svg # src/i18n/messages/in.json
…ier-quota-reaudit
…ier-quota-reaudit # Conflicts: # README.md # docs/diagrams/free-tier-budget.svg # docs/diagrams/readme-hero.svg # open-sse/config/freeModelCatalog.data.ts
…c the guide counts
…ier-quota-reaudit # Conflicts: # README.md # docs/diagrams/README.md # docs/diagrams/free-tier-budget.svg # docs/diagrams/readme-hero.svg # docs/getting-started/FREE-TIERS-GUIDE.md # docs/reference/FREE_TIERS.md # open-sse/config/freeTierCatalog.ts # tests/unit/free-tier-catalog.test.ts
…bras reclassified upstream)
…cker; rebaseline gateways.ts (+3)
This was referenced Sep 4, 2026
diegosouzapw
added a commit
to PixmaNts/OmniRoute
that referenced
this pull request
Sep 4, 2026
… merge
check-file-size counts split('\n') = 1477 for the merged gateways.ts
(origin diegosouzapw#12649 nara wrap at 1462 + Lyceum catalog entry). Keep the
god-file cap in lock-step; do not weaken catalog asserts.
Co-authored-by: diegosouzapw <8016841+diegosouzapw@users.noreply.github.com>
muhamadgalihsaputra
pushed a commit
to niyatna/NiyatnaRoute
that referenced
this pull request
Sep 27, 2026
…souzapw#12649) * test(catalog): pin the 2026-09-02 free-tier re-audit facts for gemini, ollama-cloud, groq, nara and mistral * fix(catalog): re-audit gemini, ollama-cloud, groq, nara and mistral against official pages * fix(catalog): restore the console-verified Mistral 1B pool and harden its regression test * docs(free-tiers): move headline to the re-audited ~1.50B and refresh pool counts * chore(free-tiers): retire stale Groq free-tier text and preset model; fix catalog header * docs(free-tiers): state the evidence-comment rule honestly and retire the last "14.4K RPD" Groq texts * docs(free-tiers): retire the stale Gemini onboarding quota text * docs(free-tier): refresh catalog-entry counts to 442 after base sync * docs(free-tiers): restore README spacing lost in the merge and re-sync the guide counts * docs(free-tiers): re-sync numbers after merging release/v3.8.51 (Cerebras reclassified upstream) * fix(docs): keep the NaraRouter plans endpoint out of the API-path checker; rebaseline gateways.ts (+3) --------- Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Re-audits five free-tier entries of the per-model catalog (
open-sse/config/freeModelCatalog.data.ts) against the providers' own pages. On top of the current base (release/v3.8.51@ 2265ce7, which reclassified Cerebras as a one-time $5 signup credit in #12591, −30M) the public headline lands at ~1.47B documented free tokens/month: steady1,473,225,000, first month with signup credits2,099,725,000(~2.10B).Isolated effect of this PR on the base:
−60Mgemini,−20Mollama-cloud,+15Mgroq,+60Mnara → base1,438,225,000→1,473,225,000. The move from the ~1.50B quoted in the first revision of this PR to ~1.47B is entirely the upstream Cerebras reclassification, not a change of this audit.gemini−60M → uncapped (Google removed the per-model free-tier table on 2025-12-23; nothing left to sum)ollama-cloud−20M → uncapped (Free plan is "starter usage credits", no token figure)groq+15M → five per-model 200K-TPD caps (6M each, independent — not a shared pool); three IDs retired from the free tier droppednara+60M → one 7M/day account bucket = 210M, the 8 models of the Free planmistral1B kept — the figure only exists inside the account console; console-verified on 2026-09-02 by the owner (Limits → Free mode → "Tokens per month" = 1,000,000,000) and recorded next to the entryEvery re-audited block now carries an
// evidence:comment with its source; the docs, README, free-tiers guide, budget SVG and the CI-gated counts (442 entries / 34 recurring pool keys / 16 quantified pools + 5 Groq caps) follow the catalog.Provider table
geminigemini-free, 4 models)ollama-cloudgroqgroqpool, 5 models incl.llama-3.3-70b-versatile,llama-4-scout,qwen3-32b)gpt-oss-120b,gpt-oss-20b,gpt-oss-safeguard-20b,qwen3.6-27b,qwen3.8-27b),hardStopGuaranteednarafree:token_cap_daily=7000000,rpm_limit=15, model list (public, unauthenticated)mistralHeadline:
~1.47Bsteady on the current base · pools37 → 34(gemini/ollama-cloud left the steady set; Groq's caps are not a shared pool) · entries437 → 442vs the base (nara +5, groq retired IDs replaced).Evidence classes
Every number added or changed by this PR cites its source in a comment next to the entry (
FREE_TIERS.md→ Methodology → Evidence classes):public-page— a provider page anyone can read (gemini, groq, ollama-cloud);api-public— an unauthenticated endpoint of the provider (nara/api/plans);console-verified <date> por <who>— the figure is only visible inside an account console; the comment records who saw it and when, plus the public page that says the cap exists. Today onlymistralis console-verified. The regression testtests/unit/free-tier-reaudit-2026-09.test.tspins this: the 1B pool is accepted only while a datedconsole-verifiedline is present in the source; otherwise every Mistral row must berecurring-uncapped(0).Entries that predate the 2026-09-02 re-audit inherit the earlier (2026-06-17) research until they are touched; the catalog header now says the file is hand-curated (there never was a generator) and states the rule.
Collateral changes
open-sse/config/freeTierCatalog.ts(legacy provider-level map):gemini/ollama-cloudremoved,nara210M,groq30M (map kept in descending order;cerebrasstays removed as fix(providers): reclassify Cerebras as a one-time $5 signup credit #12591 left it — 17 legacy keys, 1,475,025,000).open-sse/config/providers/registry/{groq,nara}: Groq registry gainsopenai/gpt-oss-safeguard-20b; NaraRouter registry lists the 8 Free-plan models.src/app/(dashboard)/dashboard/combos/page.tsx:FREE_STACK_PRESET_MODELSswaps the retiredgroq/llama-3.3-70b-versatileforgroq/openai/gpt-oss-120b.src/shared/constants/providers/apikey/{frontier-labs,gateways}.ts: GroqfreeNote("30 RPM / 14.4K RPD" was stale) and NaraRouter onboarding note re-written;docs/reference/PROVIDER_REFERENCE.mdregenerated (npm run gen:provider-reference).src/i18n/messages/*.json):providers.onboardingProviderDescriptions.groqand.geminirewritten inenandpt-BR; the other locales carry the documented__MISSING__:<en>sentinel (runtime falls back to English, queued for the translation pipeline) — exceptvi, which must not hold placeholders (tests/unit/i18n-vi-completeness.test.ts) and received a real translation that needs a native-speaker review.README.md(headline, counts, hero/budget alt texts),docs/reference/FREE_TIERS.md(TL;DR, dated re-audit note, contributors, per-provider table, Evidence classes, resolved Groq finding),docs/diagrams/free-tier-budget.svg(bar/grid regenerated for 16 pools + Groq caps; Gemini/Ollama Cloud moved to the "un-countable" row),docs/diagrams/readme-hero.svg,docs/getting-started/FREE-TIERS-GUIDE.md,docs/diagrams/README.md.tests/unit/free-tier-reaudit-2026-09.test.ts(new, pins every re-audited fact incl. retired Groq IDs and registry routability),free-tier-catalog.test.ts,free-providers-batch-2026-07.test.ts,autoCombo/strict-zero-cost-filter.test.ts(fixture re-pointed togroq/openai/gpt-oss-120b).origin/release/v3.8.51merged in (no rebase); the duplicateinlocale removed upstream by feat(i18n): locale-expansion tooling — add-locale orchestrator, aliases, translation-ratio gate; retire duplicate 'in' locale #12496 stays removed.Validation
Base merged:
origin/release/v3.8.51@ 2265ce7 (8 conflicts resolved —freeTierCatalog.ts,free-tier-catalog.test.ts,README.md,FREE_TIERS.md,FREE-TIERS-GUIDE.md,docs/diagrams/README.md,free-tier-budget.svg,readme-hero.svg). Rule applied: keep the base's Cerebras reclassification (one-time $5 credit — rows, legacy-map removal,cerebras === undefinedassertion, per-provider table row) and every re-audited row/prose from this branch, then letnpm run check:docs-countsdecide every published number.docs/screenshots/free-tier-budget-card.svgwas taken from the base unchanged (this branch owns no generator change for it). Totals on the merged head: steady 1,473,225,000 · first month 2,099,725,000 · 34 pool keys · 442 entries · legacyFREE_TIER_BUDGETS17 keys / 1,475,025,000.Local gates run on the merged head (this devbox is saturated and the full unit suite times out here; the full matrix runs in CI on this PR):
npm run check:docs-countsnpm run check:docs-syncnpm run typecheck:corenpm run check:dashboard-typecheckcombos/page.tsxpreset change)npm run check:provider-consistencyfree-tier-reaudit-2026-09,free-providers-batch-2026-07,free-tier-catalog,free-model-catalog,free-tier-summary-route,check-docs-counts-sync,removed-providers-blocklist)tests/unit/autoCombo/strict-zero-cost-filter.test.ts.ts/.tsx/.mjsfiles (project suppressions applied)i18n:check-ui-coverage/i18n:check-value-drift:warn/i18n-vi-completenessRefs: internal research 2026-09-02 (primary-source quota audit).
CI triage (first run on 09942a5)
check:fabricated-docsflagged/api/plansin FREE_TIERS.mdfile-sizegateways.ts1462 > 1459open-sse-typecheckopen-sse/executors/glm.ts TS2554and API Route Typecheck (same error)glm.tswas last changed on the base by #12179; this PR does not touch itsanitizeErrorMessageReDoS timing#7253 release-green: docs contain zero fabricated API/file-ref drift/api/planscause, fixed in 113b608CI triage (final run on 113b608)
open-sse/executors/glm.ts TS2554fix/reset-aware-model-family(run 33825690606) andfix/overloaded-not-provider-breaker(run 33825612505)