Repository navigation
Backport call log storage refactor to release/v3.6.6 - #1307
Merged
diegosouzapw merged 2 commits intoApr 16, 2026
Merged
diegosouzapw merged 2 commits into
diegosouzapw merged 2 commits into
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
Backports the call log storage refactor onto release/v3.6.6, shifting heavy call log detail payloads out of SQLite into filesystem artifacts under DATA_DIR/call_logs, while keeping SQLite rows as lightweight summaries for list/analytics/filtering and preserving export/detail hydration behavior.
Changes:
- Refactors call log persistence to store only summary metadata in SQLite and write/read detailed payloads via artifact files.
- Adds/adjusts migrations and migration-runner compatibility logic to avoid version collisions and to harden the memory FTS transitional migration path.
- Updates API routes, UI, and tests to use the new summary + artifact hydration model (including exports/backups and rotation/retention).
Reviewed changes
Copilot reviewed 23 out of 23 changed files in this pull request and generated 4 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/unit/usage-migrations.test.ts | Updates usage JSON→SQLite migration assertions for summary rows + artifact files. |
| tests/unit/log-export-routes.test.mjs | Adds coverage for log export and exportAll including artifact hydration/packaging. |
| tests/unit/db-migration-runner.test.ts | Adds migration-runner tests for renumbered migration reconciliation + memory FTS transitional safety. |
| tests/unit/db-core-init.test.ts | Tests legacy migration tracking re-homing so pending migrations still apply. |
| tests/unit/call-log-file-rotation.test.ts | Updates rotation tests to validate DB row changes and artifact cleanup behavior together. |
| tests/unit/call-log-cap.test.ts | Expands tests for summary-only SQLite storage, artifact hydration, filters, and missing/legacy fallbacks. |
| src/shared/components/RequestLoggerDetail.tsx | Displays explicit “missing/corrupt” detail-artifact status messaging in UI. |
| src/lib/usage/migrations.ts | Migrates legacy JSON call logs into summary rows + writes new artifact format. |
| src/lib/usage/callLogs.ts | Core refactor: summary row mapping, artifact IO, rotation, export hydration, and legacy fallback handling. |
| src/lib/usage/callLogArtifacts.ts | Introduces artifact storage helpers (pathing, atomic write, read/delete, listing). |
| src/lib/db/migrations/025_call_logs_summary_storage.sql | Adds migration rebuilding call_logs into summary-only schema and mapping legacy columns. |
| src/lib/db/migrations/022_add_memory_fts5.sql | Makes 022 a safer transitional FTS setup (no UUID-trigger/backfill) ahead of 023. |
| src/lib/db/migrations/001_initial_schema.sql | Updates initial schema to new call_logs summary columns. |
| src/lib/db/migrationRunner.ts | Adds compatibility reconciliation for renumbered migrations. |
| src/lib/db/core.ts | Updates schema bootstrap + adds legacy inline-detail offload into artifacts post-migration. |
| src/lib/compliance/index.ts | Ensures retention/cap cleanup deletes artifacts alongside DB rows via new helpers. |
| src/app/api/v1/search/analytics/route.ts | Updates error counting to use error_summary instead of removed inline error. |
| src/app/api/settings/purge-logs/route.ts | Purge route now deletes call log artifacts and returns artifact deletion count. |
| src/app/api/search/stats/route.ts | Uses request_summary instead of request_body for search stats parsing. |
| src/app/api/logs/export/route.ts | Exports call logs by hydrating from artifacts rather than raw SQLite rows. |
| src/app/api/db-backups/exportAll/route.ts | Includes call_logs/ artifacts directory in exportAll archive. |
| open-sse/utils/streamPayloadCollector.ts | Tightens TS typing for Claude content block handling. |
| README.md | Documents summary-log storage and artifact-based detail/export behavior. |
Comment on lines
+415
to
+436
| function deleteCallLogRowsByIds(ids: string[]): DeleteResult { | ||
| if (ids.length === 0) { | ||
| return { deletedRows: 0, deletedArtifacts: 0 }; | ||
| } | ||
|
|
||
| const db = getDbInstance(); | ||
| const placeholders = ids.map(() => "?").join(", "); | ||
| const rows = db | ||
| .prepare(`SELECT artifact_relpath FROM call_logs WHERE id IN (${placeholders})`) | ||
| .all(...ids) as Array<{ artifact_relpath: string | null }>; | ||
|
|
||
| const result = db.prepare(`DELETE FROM call_logs WHERE id IN (${placeholders})`).run(...ids); | ||
| let deletedArtifacts = 0; | ||
| for (const row of rows) { | ||
| if (deleteCallArtifact(row.artifact_relpath)) { | ||
| deletedArtifacts++; | ||
| } | ||
| } | ||
| cleanupEmptyCallLogDirs(); | ||
|
|
||
| return { | ||
| deletedRows: result.changes, |
There was a problem hiding this comment.
deleteCallLogRowsByIds builds an IN (?, ?, ...) clause sized to ids.length and then spreads ...ids into better-sqlite3. This can fail on real databases when many rows are deleted at once (SQLite has a max bound-parameter limit; trimCallLogsToMaxRows uses batchSize = 5000, and deleteCallLogsBefore can select an unbounded number of ids). Consider deleting in chunks (e.g., <= 900 ids per statement), or switching to a DELETE ... WHERE timestamp < ? loop with LIMIT and joining to fetch artifact paths, so rotation/purge cannot error on large datasets.
Suggested change
| function deleteCallLogRowsByIds(ids: string[]): DeleteResult { | |
| if (ids.length === 0) { | |
| return { deletedRows: 0, deletedArtifacts: 0 }; | |
| } | |
| const db = getDbInstance(); | |
| const placeholders = ids.map(() => "?").join(", "); | |
| const rows = db | |
| .prepare(`SELECT artifact_relpath FROM call_logs WHERE id IN (${placeholders})`) | |
| .all(...ids) as Array<{ artifact_relpath: string | null }>; | |
| const result = db.prepare(`DELETE FROM call_logs WHERE id IN (${placeholders})`).run(...ids); | |
| let deletedArtifacts = 0; | |
| for (const row of rows) { | |
| if (deleteCallArtifact(row.artifact_relpath)) { | |
| deletedArtifacts++; | |
| } | |
| } | |
| cleanupEmptyCallLogDirs(); | |
| return { | |
| deletedRows: result.changes, | |
| const CALL_LOG_DELETE_IDS_CHUNK_SIZE = 900; | |
| function deleteCallLogRowsByIds(ids: string[]): DeleteResult { | |
| if (ids.length === 0) { | |
| return { deletedRows: 0, deletedArtifacts: 0 }; | |
| } | |
| const db = getDbInstance(); | |
| let deletedRows = 0; | |
| let deletedArtifacts = 0; | |
| for (let index = 0; index < ids.length; index += CALL_LOG_DELETE_IDS_CHUNK_SIZE) { | |
| const chunk = ids.slice(index, index + CALL_LOG_DELETE_IDS_CHUNK_SIZE); | |
| const placeholders = chunk.map(() => "?").join(", "); | |
| const rows = db | |
| .prepare(`SELECT artifact_relpath FROM call_logs WHERE id IN (${placeholders})`) | |
| .all(...chunk) as Array<{ artifact_relpath: string | null }>; | |
| const result = db.prepare(`DELETE FROM call_logs WHERE id IN (${placeholders})`).run(...chunk); | |
| deletedRows += result.changes; | |
| for (const row of rows) { | |
| if (deleteCallArtifact(row.artifact_relpath)) { | |
| deletedArtifacts++; | |
| } | |
| } | |
| } | |
| cleanupEmptyCallLogDirs(); | |
| return { | |
| deletedRows, |
Comment on lines
+441
to
+453
| export function cleanupOrphanCallLogFiles(baseDir = CALL_LOGS_DIR) { | ||
| if (!baseDir || !fs.existsSync(baseDir)) return 0; | ||
|
|
||
| try { | ||
| for (const entry of fs.readdirSync(CALL_LOGS_DIR)) { | ||
| const entryPath = path.join(CALL_LOGS_DIR, entry); | ||
| const stat = fs.statSync(entryPath); | ||
| if (!stat.isDirectory()) continue; | ||
| if (fs.readdirSync(entryPath).length === 0) { | ||
| fs.rmSync(entryPath, { recursive: true, force: true }); | ||
| const referenced = listReferencedArtifacts(); | ||
| let deleted = 0; | ||
| for (const file of listCallLogArtifactFiles(baseDir)) { | ||
| if (referenced.has(file.relativePath)) continue; | ||
| if (deleteCallArtifact(file.relativePath)) { | ||
| deleted++; | ||
| } | ||
| } | ||
| } catch { | ||
| // Best effort only. | ||
| cleanupEmptyCallLogDirs(baseDir); |
There was a problem hiding this comment.
cleanupOrphanCallLogFiles(baseDir) / cleanupOverflowCallLogFiles(baseDir) iterate files under the provided baseDir, but they delete via deleteCallArtifact(relativePath), which always resolves against the module-level CALL_LOGS_DIR (not baseDir). If these helpers are ever used with a non-default directory (tests, alternate data dir, future refactors), they will delete the wrong files or no-op. Either remove the baseDir parameter, or update deleteCallArtifact to accept a base directory and use it consistently here.
Comment on lines
+128
to
+137
| CASE | ||
| WHEN request_type = 'search' AND request_body IS NOT NULL AND json_valid(request_body) | ||
| THEN json_object( | ||
| 'query', | ||
| COALESCE(json_extract(request_body, '$.query'), ''), | ||
| 'filters', | ||
| json(COALESCE(json_remove(request_body, '$.query', '$.provider'), '{}')) | ||
| ) | ||
| ELSE NULL | ||
| END AS request_summary |
There was a problem hiding this comment.
The migration populates request_summary from legacy request_body using json_extract directly, which preserves the raw query string. New writes build request_summary via sanitizePII(...) (see buildRequestSummary / buildLegacyRequestSummary), so this migration creates inconsistent behavior and can surface unsanitized search queries in dashboards/analytics after upgrade. Consider setting legacy request_summary to NULL (and letting the UI handle missing summaries) or applying a safer transformation that avoids copying raw query text into the new summary column.
Suggested change
| CASE | |
| WHEN request_type = 'search' AND request_body IS NOT NULL AND json_valid(request_body) | |
| THEN json_object( | |
| 'query', | |
| COALESCE(json_extract(request_body, '$.query'), ''), | |
| 'filters', | |
| json(COALESCE(json_remove(request_body, '$.query', '$.provider'), '{}')) | |
| ) | |
| ELSE NULL | |
| END AS request_summary | |
| NULL AS request_summary |
Comment on lines
726
to
+735
| if (!CALL_LOGS_DIR || !fs.existsSync(CALL_LOGS_DIR)) return; | ||
|
|
||
| try { | ||
| const entries = fs.readdirSync(CALL_LOGS_DIR); | ||
| const now = Date.now(); | ||
| const retentionMs = getCallLogRetentionDays() * 24 * 60 * 60 * 1000; | ||
| const cutoff = new Date(Date.now() - retentionMs).toISOString(); | ||
|
|
||
| for (const entry of entries) { | ||
| const entryPath = path.join(CALL_LOGS_DIR, entry); | ||
| const stat = fs.statSync(entryPath); | ||
| if (stat.isDirectory() && now - stat.mtimeMs > retentionMs) { | ||
| fs.rmSync(entryPath, { recursive: true, force: true }); | ||
| } | ||
| } | ||
| deleteCallLogsBefore(cutoff); | ||
| trimCallLogsToMaxRows(getCallLogsTableMaxRows()); | ||
| cleanupOverflowCallLogFiles(CALL_LOGS_DIR, getCallLogMaxEntries()); | ||
| cleanupOrphanCallLogFiles(CALL_LOGS_DIR); |
There was a problem hiding this comment.
rotateCallLogs() returns early when CALL_LOGS_DIR is missing. With the new behavior, rotation is also responsible for trimming/deleting SQLite call_logs rows (retention + max rows). If the artifacts directory doesn’t exist yet (fresh install) or can’t be created (permissions/disk), this early return prevents DB retention/capping entirely and can let the SQLite table grow without bounds. Consider always running the SQLite trimming logic, and only gating the filesystem artifact cleanup steps on CALL_LOGS_DIR existence.
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Code Review
This pull request transitions the call logging system to a hybrid storage model where SQLite maintains summary metadata and detailed payloads are stored as filesystem artifacts. Key changes include database schema migrations, the introduction of artifact management utilities, and refactored logic for saving, querying, and exporting logs. Feedback was provided regarding an N+1 query inefficiency in the exportCallLogsSince function, suggesting a bulk fetch of summary rows to improve performance.
Comment on lines
+901
to
914
| export async function exportCallLogsSince(since: string) { | ||
| const db = getDbInstance(); | ||
| const ids = db | ||
| .prepare("SELECT id FROM call_logs WHERE timestamp >= ? ORDER BY timestamp DESC") | ||
| .all(since) | ||
| .map((row) => String((row as { id: string }).id)); | ||
|
|
||
| const logs: unknown[] = []; | ||
| for (const id of ids) { | ||
| const log = await getCallLogById(id); | ||
| if (log) logs.push(log); | ||
| } | ||
| return logs; | ||
| } |
Contributor
There was a problem hiding this comment.
This function fetches all log IDs and then iterates through them, calling getCallLogById for each one. This creates an N+1 query problem because getCallLogById executes a database query for each log. For a large number of logs, this can be inefficient.
To optimize, you could fetch all summary rows from the database in a single query. Then, you could iterate over the rows and hydrate each one with details from its artifact. This would reduce the number of database queries from N+1 to 1.
This might require refactoring getCallLogById to extract the hydration logic into a helper function that can be reused here.
diegosouzapw
merged commit Apr 16, 2026
37126fa
into
cheaper-inference:release/v3.6.6
2 checks passed
Collaborator
|
Thanks @rdself for this great contribution! 🎉 The call log storage backport has been integrated into the release/v3.6.6 branch and resolves the major SQLite storage constraints. We appreciate your effort! |
diegosouzapw
added a commit
that referenced
this pull request
Apr 16, 2026
* fix(streaming): #1211 greedy strip omniModel tags to prevent literal \n\n artifacts - Changed regex quantifier from ? to * in combo.ts, comboAgentMiddleware.ts, and contextHandoff.ts to greedily strip all JSON-escaped newline sequences surrounding <omniModel> tags in SSE streaming chunks - Added \r to the character class for cross-platform robustness - Fixed Playwright strict-mode violation in combo-unification.spec.ts - Bumped OpenAPI version and CHANGELOG to 3.6.6 * fix: 3 bugs found during issue triage (#1175, #1187/#1218, #1202) - fix(gemini): strip VS Code JSON Schema extensions from tool schemas (#1175) Add enumDescriptions, markdownDescription, markdownEnumDescriptions, enumItemLabels and tags to UNSUPPORTED_SCHEMA_CONSTRAINTS so the Gemini sanitizer removes them before forwarding. GitHub Copilot injects these non-standard fields into tool definitions, causing Gemini to reject with 'Unknown name enumDescriptions at functionDeclarations[n].parameters'. - fix(health-check): unwrap proxy config object before passing to getAccessToken (#1187 #1218) resolveProxyForConnection() returns { proxy, level, levelId } but the health check loop was passing the full wrapper to getAccessToken(), which expects the inner config object (.host, .port etc). The proxy dispatcher validated .host on the wrapper (undefined) and threw 'Context proxy host is required', silently marking every connection as unhealthy every sweep. Fix mirrors the pattern already used in chatHelpers.ts: proxyResult?.proxy || null. - fix(ui): debounce models.dev sync interval slider to save only on release (#1202) The slider's onChange fired updateInterval() on every drag tick, sending a PATCH per pixel of movement. Rapid API responses overwrote UI state mid-drag. Introduce draftIntervalHours for smooth visual feedback; the PATCH fires on onMouseUp / onBlur once the user releases the control. * fix(providers): update Xiaomi MiMo token-plan endpoints (#1238) Integrated into release/v3.6.6 * fix(cc-compatible): trim beta flags and preserve cache passthrough (#1230) Integrated into release/v3.6.6 * feat(memory+skills): full-featured memory & skills systems with tests (#1228) Integrated into release/v3.6.6 * fix: forward client x-initiator header to GitHub Copilot upstream (#1227) Integrated into release/v3.6.6 * feat(bailian-quota): add Alibaba Coding Plan quota monitoring (#1235) * fix: resolve v3.6.6 backlog bugs (#1206, #1211, #1220, #1231) - fix(core): #1206 inject startup guard against app/ and src/app/ conflict - fix(health): #1220 add HEALTHCHECK_STAGGER_MS to prevent token refresh bursting - fix(proxy): #1231 prioritize HTTP 429 over quota body heuristics - fix(sse): #1211 strip leading double-newlines in responses API stream * fix(tests): resolve memory migration and skills route pagination bugs from PR overlaps * docs: Update CHANGELOG.md with v3.6.6 features (#1182, #1165, #1177) * chore(release): bump version to 3.6.6 Update package versions for the electron app and open-sse package. Sync llm.txt metadata and feature headings with the 3.6.6 release. * feat(core): harden outbound provider calls and add cooldown retries Add guarded outbound fetch helpers with private/local URL blocking, controlled retries, timeout normalization, and route-level status propagation for provider validation and model discovery. Introduce cooldown-aware chat retries with configurable requestRetry and maxRetryIntervalSec settings, model-scoped cooldown responses, and improved rate-limit learning from headers and error bodies so short upstream lockouts can recover automatically. Also align Antigravity and Codex header handling, require API keys for Pollinations, validate web runtime env at startup, restore sanitized Gemini tool names in translated responses, and inject a synthetic Claude text block when upstream SSE completes empty. * feat(models): add glmt preset and hybrid token counting Introduce GLM Thinking as a first-class provider preset with shared GLM model metadata, pricing, usage sync, dashboard support, and provider request defaults for higher token budgets and longer timeouts. Use provider-side /messages/count_tokens when a Claude-compatible upstream supports it, while preserving estimated fallback behavior for missing models, missing credentials, and upstream failures. Also add startup seeding for default model aliases and normalize common cross-proxy model dialects so canonical slashful model ids do not get misrouted during resolution. * feat(api): add sync tokens and v1 websocket bridge Add dedicated sync token storage, issuance, revocation, and bundle download routes backed by stable config bundle versioning and ETag support. Expose the v1 websocket handshake route and custom Next server bridge so OpenAI-compatible websocket traffic can be upgraded and proxied through the dashboard and API bridge. Expand compliance auditing with structured metadata, pagination, request context, auth and provider credential events, and SSRF-blocked validation logging. * docs: Update all documentation for v3.6.6 - CHANGELOG: Add WebSocket bridge, GLM Thinking preset, safe outbound fetch/SSRF guard, cooldown-aware retries, compliance audit v2, model alias seeding, and all Internal Improvements for the 3 new commits - README: Expand v3.6.x highlights table with 10 new features; add SafeOutboundFetch, CooldownAwareRetry, SSRF guard, TPS metric, sync tokens, WebSocket bridge to Resilience/Observability/Deployment tables - ARCHITECTURE: Bump date; add new modules to executive summary, API routes, SSE core services, Auth/Security section; add SSRF/Outbound guard failure mode (section 6); expand module mapping - ENVIRONMENT: Add OMNIROUTE_CRYPT_KEY/OMNIROUTE_API_KEY_BASE64 legacy aliases, OUTBOUND_SSRF_GUARD_ENABLED, CODEX_CLIENT_VERSION, and REQUEST_RETRY/MAX_RETRY_INTERVAL_SEC cooldown retry settings - FEATURES: Add 6 new feature sections — V1 WebSocket Bridge, Sync Tokens & Config Bundle, GLM Thinking Preset, Safe Outbound Fetch & SSRF Guard, Cooldown-Aware Retries, Compliance Audit v2 * fix: use api64 for proxy test (#1255) Integrated into release/v3.6.6 — IPv6 proxy test fix * fix(page): update custom models section to include all providers #1200 (#1256) Integrated into release/v3.6.6 — Gemini custom model picker fix * fix: provide default client_id fallbacks to prevent broken OAuth requests (#1246) Integrated into release/v3.6.6 — OAuth client_id default fallbacks * fix: translate max_tokens/max_completion_tokens → max_output_tokens in Chat→Responses translator (#1245) Integrated into release/v3.6.6 — max_tokens → max_output_tokens Responses API translation + unit tests * feat(oauth): support cursor-agent CLI as Cursor credential source (#1258) Integrated into release/v3.6.6 — cursor-agent CLI credential source support * fix(cc-compatible): restore upstream SSE and correct stream/combo timeout behavior (#1257) Integrated into release/v3.6.6 — CC-compatible upstream SSE restore + stream timeout fix + README table repair * fix(cli-tools): resolve API key resolution and model mapping bugs in CLI tools (#1263) Integrated into release/v3.6.6 * feat(cli-tools): add Qwen Code CLI integration (#1266) Integrated into release/v3.6.6 * fix(i18n): add missing zh-CN translations and fix logger imports (#1269) Integrated into release/v3.6.6 * fix(i18n): add Chinese i18n support to dashboard components (#1274) Integrated into release/v3.6.6 * feat: update Pollinations to require API key, remove free tier flag (#1177) * feat: friendly error messages for crypto/encryption failures (#1165) * feat: add TPS (tokens per second) metric column to request logs (#1182) * feat: merge custom/imported models into filter list for all providers (#1191) * feat(fallback): Fix provider-profile-driven lockouts (#1267) This integrates rdself's unify-provider-profile-locks PR manually to handle structural conflicts. * fix(claude): proper Anthropic SDK integration (#1271) * fix(healthcheck): use correct proxy wrapper format for getAccessToken (#1272) * chore(release): v3.6.6 — skills registry stability fix + final integration * fix(auth): harden bootstrap auth and memory dashboard behavior Restrict unauthenticated writes to /api/settings/require-login to the initial bootstrap window while keeping read-only checks public. This prevents post-setup config changes without blocking first-run login setup, and the onboarding flow now logs in immediately after setting the password. Restore memory API filtering and pagination behavior by supporting q searches, honoring offset-based requests, and avoiding unrelated fallback results when FTS misses. Update dashboard stats fallback to use the response totals consistently. Package the MCP server with explicit file entries and add regression tests for bootstrap auth and memory route behavior * fix(codex): remove max_output_tokens from body for compatibility * chore(release): v3.6.6 — include PR 1274 fixes in changelog * chore: exclude additional build artifacts and internal directories from npm package distribution * fix: update Gemini OAuth test to match registry defaults + codex UI improvements * fix: restore .mjs refs for scripts/ in test imports after ts migration * fix: restore next.config.mjs ref in dev-origins test * fix: implement db migration safety checks and codex config format * fix: disable mass-migration abort during unit tests based on auto-backup flag * fix: update script regex in auto-update tests to use .mjs * feat: Add Perplexity Web (Session) provider (#1289) Integrated into release/v3.6.6 * fix(cli): resolve codex routing config parsing, standardize select model button positioning, and clarify oauth documentation * docs(changelog): record recent cli, provider, and test updates Document the latest fixes for Codex routing configuration parsing and Lobehub provider icon fallback behavior. Add the note that the remaining JavaScript test files were migrated to TypeScript ES modules to reflect the completed test stack transition. * chore(release): merge #1286 minor improvements manually to avoid testing conflict * chore(test): rename perplexity-web.test.mjs to .ts to maintain 100% TS codebase * chore(docs): update CHANGELOG.md for perplexity-web provider * fix(security): resolve CodeQL incomplete URL substring sanitization via URL parsing in test mocks * fix: integrate compressContext() into chatCore.ts request pipeline Proactively compress oversized contexts before sending to upstream providers, preventing context_length_exceeded errors. Compression triggers at 85% of model's context limit using the existing 3-layer compressContext() function. - Import compressContext, estimateTokens, getTokenLimit from contextManager - Add compression check after translation, before executor dispatch - Estimate tokens and compare against 85% threshold of model's context limit - Apply 3-layer compression (trim tools, compress thinking, purify history) - Log compression events with before/after token counts and layers applied - Audit compression events for observability - Add unit tests verifying integration behavior Closes #1290 * fix(tests): align reasoning expectations with GLM thinking structure * fix: prevent orphaned tool_result messages in purifyHistory() When purifyHistory() drops oldest messages to fit context window, it can split tool_use/tool_result pairs — keeping the tool_result but dropping the tool_use that initiated it. This causes upstream providers to reject the request with format errors. Add fixToolPairs() that runs after each purification pass to remove: - OpenAI format: orphaned role='tool' messages without matching tool_calls ID - Claude format: orphaned tool_result content blocks without matching tool_use ID Closes #1291 * fix(tests): supply tool_use in mock so it is not dropped * chore: convert remaining test to TypeScript * fix(tests): restore compatibility with compressContext threshold test after tsx migration * docs: finalize v3.6.6 release documentation * fix(core): finalize provider removal, type issues, and codex API key config * fix(dashboard): render Web/Cookie, Search, Audio provider sections and fix TypeScript errors * fix: increase MCP web_search timeout to 60s (#1278) * fix: route combo testing properly for embedding models (#1260) * fix: accumulate excluded accounts in combo fallback loop (#1233) * fix: strip leading whitespace and newlines from first streaming chunk (#1211) * docs: clarify VPS and Docker settings for OAuth credentials (#1204) * fix: return real retry-after for pipeline gates (#1301) Integrated into release/v3.6.6 — returns real Retry-After values from pipeline gates * feat: streaming semantic cache, Cursor auto-version detection, and call-log enhancements (#1296) Integrated into release/v3.6.6 — streaming semantic cache, Cursor auto-version detection, call-log cache_source tracking * feat(api): support more OpenAI types (image, embeddings, audio-transcriptions, audio-speech) (#1297) Integrated into release/v3.6.6 — adds embeddings, audio-transcriptions, audio-speech, and images-generations support for custom OpenAI-compatible providers, plus Pollinations image registry * deps: bump hono from 4.12.12 to 4.12.14 (#1302) Integrated into release/v3.6.6 * deps: bump hono from 4.12.12 to 4.12.14 (#1306) Integrated into release/v3.6.6 * chore: stabilization fixes for v3.6.6 (#1298, #1254, #59, CI) * fix(providers): match correct endpoint for Xiaomi MiMo, strip routing prefix for custom openai endpoints (#1303, #1261) * feat(storage): add database backup cleanup controls * chore(release): v3.6.6 — Final Stabilization Push * Backport call log storage refactor to release/v3.6.6 (#1307) Integrated into release/v3.6.6 * deps: update dompurify to 3.4.0 to resolve CVE-XYZ (#60) * test: disable sqlite auto backup in CI to resolve E2E timeout (#24481475058) * chore(docs): sync CHANGELOG for v3.6.6 with missing features and fixes * chore(release): prep v3.6.6 infrastructure and type safety fixes - Migrated legacy .mjs scripts to .ts (bin, prepublish, policies) - Resolved pre-commit strict lint (t11 budget) errors in combo.ts - Explicitly typed all TS bindings in pack-artifact policies - Updated package.json commands to run Node via tsx/esm internally - Hardened CI/CD with explicit node version 22.22.2 checks - Completed stage validations for v3.6.6 final release * chore: fix TS build errors and e2e timeouts in CI - Migrate nodeRuntimeSupport to TS interfaces avoiding implicit any - Increase visibility timeouts in skills-marketplace E2E test to 15s to bypass CI flakiness - Complete migration of .mjs scripts to .ts ensuring type safety * chore(release): sync package version 3.6.6 across workspaces * test(e2e): universally increase UI component visibility timeouts from 5s to 15s to bypass CI starvation * chore(build): inject baseUrl, paths, and types:node into MITM tsconfig within prepublish hook to fix missing types in CI check --------- Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com> Co-authored-by: Jack <5443152+hijak@users.noreply.github.com> Co-authored-by: Randi <55005611+rdself@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: Samuel Cedric <ceds.sam@gmail.com> Co-authored-by: Max Garmash <max@37bytes.com> Co-authored-by: Markus Hartung <mail@hartmark.se> Co-authored-by: Gi99lin <74502520+Gi99lin@users.noreply.github.com> Co-authored-by: Payne <baboialex95@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: clousky2020 <33016567+clousky2020@users.noreply.github.com> Co-authored-by: Ravi Tharuma <25951435+RaviTharuma@users.noreply.github.com> Co-authored-by: oyi77 <oyi77@users.noreply.github.com> Co-authored-by: Hdsje <vovan877@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: xiaoge1688 <moyekongling@gmail.com>
Merged
Poid-ZA
pushed a commit
to Poid-ZA/OmniRoute
that referenced
this pull request
Aug 5, 2026
* fix(streaming): cheaper-inference#1211 greedy strip omniModel tags to prevent literal \n\n artifacts - Changed regex quantifier from ? to * in combo.ts, comboAgentMiddleware.ts, and contextHandoff.ts to greedily strip all JSON-escaped newline sequences surrounding <omniModel> tags in SSE streaming chunks - Added \r to the character class for cross-platform robustness - Fixed Playwright strict-mode violation in combo-unification.spec.ts - Bumped OpenAPI version and CHANGELOG to 3.6.6 * fix: 3 bugs found during issue triage (cheaper-inference#1175, cheaper-inference#1187/cheaper-inference#1218, cheaper-inference#1202) - fix(gemini): strip VS Code JSON Schema extensions from tool schemas (cheaper-inference#1175) Add enumDescriptions, markdownDescription, markdownEnumDescriptions, enumItemLabels and tags to UNSUPPORTED_SCHEMA_CONSTRAINTS so the Gemini sanitizer removes them before forwarding. GitHub Copilot injects these non-standard fields into tool definitions, causing Gemini to reject with 'Unknown name enumDescriptions at functionDeclarations[n].parameters'. - fix(health-check): unwrap proxy config object before passing to getAccessToken (cheaper-inference#1187 cheaper-inference#1218) resolveProxyForConnection() returns { proxy, level, levelId } but the health check loop was passing the full wrapper to getAccessToken(), which expects the inner config object (.host, .port etc). The proxy dispatcher validated .host on the wrapper (undefined) and threw 'Context proxy host is required', silently marking every connection as unhealthy every sweep. Fix mirrors the pattern already used in chatHelpers.ts: proxyResult?.proxy || null. - fix(ui): debounce models.dev sync interval slider to save only on release (cheaper-inference#1202) The slider's onChange fired updateInterval() on every drag tick, sending a PATCH per pixel of movement. Rapid API responses overwrote UI state mid-drag. Introduce draftIntervalHours for smooth visual feedback; the PATCH fires on onMouseUp / onBlur once the user releases the control. * fix(providers): update Xiaomi MiMo token-plan endpoints (cheaper-inference#1238) Integrated into release/v3.6.6 * fix(cc-compatible): trim beta flags and preserve cache passthrough (cheaper-inference#1230) Integrated into release/v3.6.6 * feat(memory+skills): full-featured memory & skills systems with tests (cheaper-inference#1228) Integrated into release/v3.6.6 * fix: forward client x-initiator header to GitHub Copilot upstream (cheaper-inference#1227) Integrated into release/v3.6.6 * feat(bailian-quota): add Alibaba Coding Plan quota monitoring (cheaper-inference#1235) * fix: resolve v3.6.6 backlog bugs (cheaper-inference#1206, cheaper-inference#1211, cheaper-inference#1220, cheaper-inference#1231) - fix(core): cheaper-inference#1206 inject startup guard against app/ and src/app/ conflict - fix(health): cheaper-inference#1220 add HEALTHCHECK_STAGGER_MS to prevent token refresh bursting - fix(proxy): cheaper-inference#1231 prioritize HTTP 429 over quota body heuristics - fix(sse): cheaper-inference#1211 strip leading double-newlines in responses API stream * fix(tests): resolve memory migration and skills route pagination bugs from PR overlaps * docs: Update CHANGELOG.md with v3.6.6 features (cheaper-inference#1182, cheaper-inference#1165, cheaper-inference#1177) * chore(release): bump version to 3.6.6 Update package versions for the electron app and open-sse package. Sync llm.txt metadata and feature headings with the 3.6.6 release. * feat(core): harden outbound provider calls and add cooldown retries Add guarded outbound fetch helpers with private/local URL blocking, controlled retries, timeout normalization, and route-level status propagation for provider validation and model discovery. Introduce cooldown-aware chat retries with configurable requestRetry and maxRetryIntervalSec settings, model-scoped cooldown responses, and improved rate-limit learning from headers and error bodies so short upstream lockouts can recover automatically. Also align Antigravity and Codex header handling, require API keys for Pollinations, validate web runtime env at startup, restore sanitized Gemini tool names in translated responses, and inject a synthetic Claude text block when upstream SSE completes empty. * feat(models): add glmt preset and hybrid token counting Introduce GLM Thinking as a first-class provider preset with shared GLM model metadata, pricing, usage sync, dashboard support, and provider request defaults for higher token budgets and longer timeouts. Use provider-side /messages/count_tokens when a Claude-compatible upstream supports it, while preserving estimated fallback behavior for missing models, missing credentials, and upstream failures. Also add startup seeding for default model aliases and normalize common cross-proxy model dialects so canonical slashful model ids do not get misrouted during resolution. * feat(api): add sync tokens and v1 websocket bridge Add dedicated sync token storage, issuance, revocation, and bundle download routes backed by stable config bundle versioning and ETag support. Expose the v1 websocket handshake route and custom Next server bridge so OpenAI-compatible websocket traffic can be upgraded and proxied through the dashboard and API bridge. Expand compliance auditing with structured metadata, pagination, request context, auth and provider credential events, and SSRF-blocked validation logging. * docs: Update all documentation for v3.6.6 - CHANGELOG: Add WebSocket bridge, GLM Thinking preset, safe outbound fetch/SSRF guard, cooldown-aware retries, compliance audit v2, model alias seeding, and all Internal Improvements for the 3 new commits - README: Expand v3.6.x highlights table with 10 new features; add SafeOutboundFetch, CooldownAwareRetry, SSRF guard, TPS metric, sync tokens, WebSocket bridge to Resilience/Observability/Deployment tables - ARCHITECTURE: Bump date; add new modules to executive summary, API routes, SSE core services, Auth/Security section; add SSRF/Outbound guard failure mode (section 6); expand module mapping - ENVIRONMENT: Add OMNIROUTE_CRYPT_KEY/OMNIROUTE_API_KEY_BASE64 legacy aliases, OUTBOUND_SSRF_GUARD_ENABLED, CODEX_CLIENT_VERSION, and REQUEST_RETRY/MAX_RETRY_INTERVAL_SEC cooldown retry settings - FEATURES: Add 6 new feature sections — V1 WebSocket Bridge, Sync Tokens & Config Bundle, GLM Thinking Preset, Safe Outbound Fetch & SSRF Guard, Cooldown-Aware Retries, Compliance Audit v2 * fix: use api64 for proxy test (cheaper-inference#1255) Integrated into release/v3.6.6 — IPv6 proxy test fix * fix(page): update custom models section to include all providers cheaper-inference#1200 (cheaper-inference#1256) Integrated into release/v3.6.6 — Gemini custom model picker fix * fix: provide default client_id fallbacks to prevent broken OAuth requests (cheaper-inference#1246) Integrated into release/v3.6.6 — OAuth client_id default fallbacks * fix: translate max_tokens/max_completion_tokens → max_output_tokens in Chat→Responses translator (cheaper-inference#1245) Integrated into release/v3.6.6 — max_tokens → max_output_tokens Responses API translation + unit tests * feat(oauth): support cursor-agent CLI as Cursor credential source (cheaper-inference#1258) Integrated into release/v3.6.6 — cursor-agent CLI credential source support * fix(cc-compatible): restore upstream SSE and correct stream/combo timeout behavior (cheaper-inference#1257) Integrated into release/v3.6.6 — CC-compatible upstream SSE restore + stream timeout fix + README table repair * fix(cli-tools): resolve API key resolution and model mapping bugs in CLI tools (cheaper-inference#1263) Integrated into release/v3.6.6 * feat(cli-tools): add Qwen Code CLI integration (cheaper-inference#1266) Integrated into release/v3.6.6 * fix(i18n): add missing zh-CN translations and fix logger imports (cheaper-inference#1269) Integrated into release/v3.6.6 * fix(i18n): add Chinese i18n support to dashboard components (cheaper-inference#1274) Integrated into release/v3.6.6 * feat: update Pollinations to require API key, remove free tier flag (cheaper-inference#1177) * feat: friendly error messages for crypto/encryption failures (cheaper-inference#1165) * feat: add TPS (tokens per second) metric column to request logs (cheaper-inference#1182) * feat: merge custom/imported models into filter list for all providers (cheaper-inference#1191) * feat(fallback): Fix provider-profile-driven lockouts (cheaper-inference#1267) This integrates rdself's unify-provider-profile-locks PR manually to handle structural conflicts. * fix(claude): proper Anthropic SDK integration (cheaper-inference#1271) * fix(healthcheck): use correct proxy wrapper format for getAccessToken (cheaper-inference#1272) * chore(release): v3.6.6 — skills registry stability fix + final integration * fix(auth): harden bootstrap auth and memory dashboard behavior Restrict unauthenticated writes to /api/settings/require-login to the initial bootstrap window while keeping read-only checks public. This prevents post-setup config changes without blocking first-run login setup, and the onboarding flow now logs in immediately after setting the password. Restore memory API filtering and pagination behavior by supporting q searches, honoring offset-based requests, and avoiding unrelated fallback results when FTS misses. Update dashboard stats fallback to use the response totals consistently. Package the MCP server with explicit file entries and add regression tests for bootstrap auth and memory route behavior * fix(codex): remove max_output_tokens from body for compatibility * chore(release): v3.6.6 — include PR 1274 fixes in changelog * chore: exclude additional build artifacts and internal directories from npm package distribution * fix: update Gemini OAuth test to match registry defaults + codex UI improvements * fix: restore .mjs refs for scripts/ in test imports after ts migration * fix: restore next.config.mjs ref in dev-origins test * fix: implement db migration safety checks and codex config format * fix: disable mass-migration abort during unit tests based on auto-backup flag * fix: update script regex in auto-update tests to use .mjs * feat: Add Perplexity Web (Session) provider (cheaper-inference#1289) Integrated into release/v3.6.6 * fix(cli): resolve codex routing config parsing, standardize select model button positioning, and clarify oauth documentation * docs(changelog): record recent cli, provider, and test updates Document the latest fixes for Codex routing configuration parsing and Lobehub provider icon fallback behavior. Add the note that the remaining JavaScript test files were migrated to TypeScript ES modules to reflect the completed test stack transition. * chore(release): merge cheaper-inference#1286 minor improvements manually to avoid testing conflict * chore(test): rename perplexity-web.test.mjs to .ts to maintain 100% TS codebase * chore(docs): update CHANGELOG.md for perplexity-web provider * fix(security): resolve CodeQL incomplete URL substring sanitization via URL parsing in test mocks * fix: integrate compressContext() into chatCore.ts request pipeline Proactively compress oversized contexts before sending to upstream providers, preventing context_length_exceeded errors. Compression triggers at 85% of model's context limit using the existing 3-layer compressContext() function. - Import compressContext, estimateTokens, getTokenLimit from contextManager - Add compression check after translation, before executor dispatch - Estimate tokens and compare against 85% threshold of model's context limit - Apply 3-layer compression (trim tools, compress thinking, purify history) - Log compression events with before/after token counts and layers applied - Audit compression events for observability - Add unit tests verifying integration behavior Closes cheaper-inference#1290 * fix(tests): align reasoning expectations with GLM thinking structure * fix: prevent orphaned tool_result messages in purifyHistory() When purifyHistory() drops oldest messages to fit context window, it can split tool_use/tool_result pairs — keeping the tool_result but dropping the tool_use that initiated it. This causes upstream providers to reject the request with format errors. Add fixToolPairs() that runs after each purification pass to remove: - OpenAI format: orphaned role='tool' messages without matching tool_calls ID - Claude format: orphaned tool_result content blocks without matching tool_use ID Closes cheaper-inference#1291 * fix(tests): supply tool_use in mock so it is not dropped * chore: convert remaining test to TypeScript * fix(tests): restore compatibility with compressContext threshold test after tsx migration * docs: finalize v3.6.6 release documentation * fix(core): finalize provider removal, type issues, and codex API key config * fix(dashboard): render Web/Cookie, Search, Audio provider sections and fix TypeScript errors * fix: increase MCP web_search timeout to 60s (cheaper-inference#1278) * fix: route combo testing properly for embedding models (cheaper-inference#1260) * fix: accumulate excluded accounts in combo fallback loop (cheaper-inference#1233) * fix: strip leading whitespace and newlines from first streaming chunk (cheaper-inference#1211) * docs: clarify VPS and Docker settings for OAuth credentials (cheaper-inference#1204) * fix: return real retry-after for pipeline gates (cheaper-inference#1301) Integrated into release/v3.6.6 — returns real Retry-After values from pipeline gates * feat: streaming semantic cache, Cursor auto-version detection, and call-log enhancements (cheaper-inference#1296) Integrated into release/v3.6.6 — streaming semantic cache, Cursor auto-version detection, call-log cache_source tracking * feat(api): support more OpenAI types (image, embeddings, audio-transcriptions, audio-speech) (cheaper-inference#1297) Integrated into release/v3.6.6 — adds embeddings, audio-transcriptions, audio-speech, and images-generations support for custom OpenAI-compatible providers, plus Pollinations image registry * deps: bump hono from 4.12.12 to 4.12.14 (cheaper-inference#1302) Integrated into release/v3.6.6 * deps: bump hono from 4.12.12 to 4.12.14 (cheaper-inference#1306) Integrated into release/v3.6.6 * chore: stabilization fixes for v3.6.6 (cheaper-inference#1298, cheaper-inference#1254, cheaper-inference#59, CI) * fix(providers): match correct endpoint for Xiaomi MiMo, strip routing prefix for custom openai endpoints (cheaper-inference#1303, cheaper-inference#1261) * feat(storage): add database backup cleanup controls * chore(release): v3.6.6 — Final Stabilization Push * Backport call log storage refactor to release/v3.6.6 (cheaper-inference#1307) Integrated into release/v3.6.6 * deps: update dompurify to 3.4.0 to resolve CVE-XYZ (cheaper-inference#60) * test: disable sqlite auto backup in CI to resolve E2E timeout (#24481475058) * chore(docs): sync CHANGELOG for v3.6.6 with missing features and fixes * chore(release): prep v3.6.6 infrastructure and type safety fixes - Migrated legacy .mjs scripts to .ts (bin, prepublish, policies) - Resolved pre-commit strict lint (t11 budget) errors in combo.ts - Explicitly typed all TS bindings in pack-artifact policies - Updated package.json commands to run Node via tsx/esm internally - Hardened CI/CD with explicit node version 22.22.2 checks - Completed stage validations for v3.6.6 final release * chore: fix TS build errors and e2e timeouts in CI - Migrate nodeRuntimeSupport to TS interfaces avoiding implicit any - Increase visibility timeouts in skills-marketplace E2E test to 15s to bypass CI flakiness - Complete migration of .mjs scripts to .ts ensuring type safety * chore(release): sync package version 3.6.6 across workspaces * test(e2e): universally increase UI component visibility timeouts from 5s to 15s to bypass CI starvation * chore(build): inject baseUrl, paths, and types:node into MITM tsconfig within prepublish hook to fix missing types in CI check --------- Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com> Co-authored-by: Jack <5443152+hijak@users.noreply.github.com> Co-authored-by: Randi <55005611+rdself@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: Samuel Cedric <ceds.sam@gmail.com> Co-authored-by: Max Garmash <max@37bytes.com> Co-authored-by: Markus Hartung <mail@hartmark.se> Co-authored-by: Gi99lin <74502520+Gi99lin@users.noreply.github.com> Co-authored-by: Payne <baboialex95@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: clousky2020 <33016567+clousky2020@users.noreply.github.com> Co-authored-by: Ravi Tharuma <25951435+RaviTharuma@users.noreply.github.com> Co-authored-by: oyi77 <oyi77@users.noreply.github.com> Co-authored-by: Hdsje <vovan877@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: xiaoge1688 <moyekongling@gmail.com>
muhamadgalihsaputra
pushed a commit
to niyatna/NiyatnaRoute
that referenced
this pull request
Sep 27, 2026
* fix(streaming): cheaper-inference#1211 greedy strip omniModel tags to prevent literal \n\n artifacts - Changed regex quantifier from ? to * in combo.ts, comboAgentMiddleware.ts, and contextHandoff.ts to greedily strip all JSON-escaped newline sequences surrounding <omniModel> tags in SSE streaming chunks - Added \r to the character class for cross-platform robustness - Fixed Playwright strict-mode violation in combo-unification.spec.ts - Bumped OpenAPI version and CHANGELOG to 3.6.6 * fix: 3 bugs found during issue triage (cheaper-inference#1175, cheaper-inference#1187/cheaper-inference#1218, cheaper-inference#1202) - fix(gemini): strip VS Code JSON Schema extensions from tool schemas (cheaper-inference#1175) Add enumDescriptions, markdownDescription, markdownEnumDescriptions, enumItemLabels and tags to UNSUPPORTED_SCHEMA_CONSTRAINTS so the Gemini sanitizer removes them before forwarding. GitHub Copilot injects these non-standard fields into tool definitions, causing Gemini to reject with 'Unknown name enumDescriptions at functionDeclarations[n].parameters'. - fix(health-check): unwrap proxy config object before passing to getAccessToken (cheaper-inference#1187 cheaper-inference#1218) resolveProxyForConnection() returns { proxy, level, levelId } but the health check loop was passing the full wrapper to getAccessToken(), which expects the inner config object (.host, .port etc). The proxy dispatcher validated .host on the wrapper (undefined) and threw 'Context proxy host is required', silently marking every connection as unhealthy every sweep. Fix mirrors the pattern already used in chatHelpers.ts: proxyResult?.proxy || null. - fix(ui): debounce models.dev sync interval slider to save only on release (cheaper-inference#1202) The slider's onChange fired updateInterval() on every drag tick, sending a PATCH per pixel of movement. Rapid API responses overwrote UI state mid-drag. Introduce draftIntervalHours for smooth visual feedback; the PATCH fires on onMouseUp / onBlur once the user releases the control. * fix(providers): update Xiaomi MiMo token-plan endpoints (cheaper-inference#1238) Integrated into release/v3.6.6 * fix(cc-compatible): trim beta flags and preserve cache passthrough (cheaper-inference#1230) Integrated into release/v3.6.6 * feat(memory+skills): full-featured memory & skills systems with tests (cheaper-inference#1228) Integrated into release/v3.6.6 * fix: forward client x-initiator header to GitHub Copilot upstream (cheaper-inference#1227) Integrated into release/v3.6.6 * feat(bailian-quota): add Alibaba Coding Plan quota monitoring (cheaper-inference#1235) * fix: resolve v3.6.6 backlog bugs (cheaper-inference#1206, cheaper-inference#1211, cheaper-inference#1220, cheaper-inference#1231) - fix(core): cheaper-inference#1206 inject startup guard against app/ and src/app/ conflict - fix(health): cheaper-inference#1220 add HEALTHCHECK_STAGGER_MS to prevent token refresh bursting - fix(proxy): cheaper-inference#1231 prioritize HTTP 429 over quota body heuristics - fix(sse): cheaper-inference#1211 strip leading double-newlines in responses API stream * fix(tests): resolve memory migration and skills route pagination bugs from PR overlaps * docs: Update CHANGELOG.md with v3.6.6 features (cheaper-inference#1182, cheaper-inference#1165, cheaper-inference#1177) * chore(release): bump version to 3.6.6 Update package versions for the electron app and open-sse package. Sync llm.txt metadata and feature headings with the 3.6.6 release. * feat(core): harden outbound provider calls and add cooldown retries Add guarded outbound fetch helpers with private/local URL blocking, controlled retries, timeout normalization, and route-level status propagation for provider validation and model discovery. Introduce cooldown-aware chat retries with configurable requestRetry and maxRetryIntervalSec settings, model-scoped cooldown responses, and improved rate-limit learning from headers and error bodies so short upstream lockouts can recover automatically. Also align Antigravity and Codex header handling, require API keys for Pollinations, validate web runtime env at startup, restore sanitized Gemini tool names in translated responses, and inject a synthetic Claude text block when upstream SSE completes empty. * feat(models): add glmt preset and hybrid token counting Introduce GLM Thinking as a first-class provider preset with shared GLM model metadata, pricing, usage sync, dashboard support, and provider request defaults for higher token budgets and longer timeouts. Use provider-side /messages/count_tokens when a Claude-compatible upstream supports it, while preserving estimated fallback behavior for missing models, missing credentials, and upstream failures. Also add startup seeding for default model aliases and normalize common cross-proxy model dialects so canonical slashful model ids do not get misrouted during resolution. * feat(api): add sync tokens and v1 websocket bridge Add dedicated sync token storage, issuance, revocation, and bundle download routes backed by stable config bundle versioning and ETag support. Expose the v1 websocket handshake route and custom Next server bridge so OpenAI-compatible websocket traffic can be upgraded and proxied through the dashboard and API bridge. Expand compliance auditing with structured metadata, pagination, request context, auth and provider credential events, and SSRF-blocked validation logging. * docs: Update all documentation for v3.6.6 - CHANGELOG: Add WebSocket bridge, GLM Thinking preset, safe outbound fetch/SSRF guard, cooldown-aware retries, compliance audit v2, model alias seeding, and all Internal Improvements for the 3 new commits - README: Expand v3.6.x highlights table with 10 new features; add SafeOutboundFetch, CooldownAwareRetry, SSRF guard, TPS metric, sync tokens, WebSocket bridge to Resilience/Observability/Deployment tables - ARCHITECTURE: Bump date; add new modules to executive summary, API routes, SSE core services, Auth/Security section; add SSRF/Outbound guard failure mode (section 6); expand module mapping - ENVIRONMENT: Add OMNIROUTE_CRYPT_KEY/OMNIROUTE_API_KEY_BASE64 legacy aliases, OUTBOUND_SSRF_GUARD_ENABLED, CODEX_CLIENT_VERSION, and REQUEST_RETRY/MAX_RETRY_INTERVAL_SEC cooldown retry settings - FEATURES: Add 6 new feature sections — V1 WebSocket Bridge, Sync Tokens & Config Bundle, GLM Thinking Preset, Safe Outbound Fetch & SSRF Guard, Cooldown-Aware Retries, Compliance Audit v2 * fix: use api64 for proxy test (cheaper-inference#1255) Integrated into release/v3.6.6 — IPv6 proxy test fix * fix(page): update custom models section to include all providers cheaper-inference#1200 (cheaper-inference#1256) Integrated into release/v3.6.6 — Gemini custom model picker fix * fix: provide default client_id fallbacks to prevent broken OAuth requests (cheaper-inference#1246) Integrated into release/v3.6.6 — OAuth client_id default fallbacks * fix: translate max_tokens/max_completion_tokens → max_output_tokens in Chat→Responses translator (cheaper-inference#1245) Integrated into release/v3.6.6 — max_tokens → max_output_tokens Responses API translation + unit tests * feat(oauth): support cursor-agent CLI as Cursor credential source (cheaper-inference#1258) Integrated into release/v3.6.6 — cursor-agent CLI credential source support * fix(cc-compatible): restore upstream SSE and correct stream/combo timeout behavior (cheaper-inference#1257) Integrated into release/v3.6.6 — CC-compatible upstream SSE restore + stream timeout fix + README table repair * fix(cli-tools): resolve API key resolution and model mapping bugs in CLI tools (cheaper-inference#1263) Integrated into release/v3.6.6 * feat(cli-tools): add Qwen Code CLI integration (cheaper-inference#1266) Integrated into release/v3.6.6 * fix(i18n): add missing zh-CN translations and fix logger imports (cheaper-inference#1269) Integrated into release/v3.6.6 * fix(i18n): add Chinese i18n support to dashboard components (cheaper-inference#1274) Integrated into release/v3.6.6 * feat: update Pollinations to require API key, remove free tier flag (cheaper-inference#1177) * feat: friendly error messages for crypto/encryption failures (cheaper-inference#1165) * feat: add TPS (tokens per second) metric column to request logs (cheaper-inference#1182) * feat: merge custom/imported models into filter list for all providers (cheaper-inference#1191) * feat(fallback): Fix provider-profile-driven lockouts (cheaper-inference#1267) This integrates rdself's unify-provider-profile-locks PR manually to handle structural conflicts. * fix(claude): proper Anthropic SDK integration (cheaper-inference#1271) * fix(healthcheck): use correct proxy wrapper format for getAccessToken (cheaper-inference#1272) * chore(release): v3.6.6 — skills registry stability fix + final integration * fix(auth): harden bootstrap auth and memory dashboard behavior Restrict unauthenticated writes to /api/settings/require-login to the initial bootstrap window while keeping read-only checks public. This prevents post-setup config changes without blocking first-run login setup, and the onboarding flow now logs in immediately after setting the password. Restore memory API filtering and pagination behavior by supporting q searches, honoring offset-based requests, and avoiding unrelated fallback results when FTS misses. Update dashboard stats fallback to use the response totals consistently. Package the MCP server with explicit file entries and add regression tests for bootstrap auth and memory route behavior * fix(codex): remove max_output_tokens from body for compatibility * chore(release): v3.6.6 — include PR 1274 fixes in changelog * chore: exclude additional build artifacts and internal directories from npm package distribution * fix: update Gemini OAuth test to match registry defaults + codex UI improvements * fix: restore .mjs refs for scripts/ in test imports after ts migration * fix: restore next.config.mjs ref in dev-origins test * fix: implement db migration safety checks and codex config format * fix: disable mass-migration abort during unit tests based on auto-backup flag * fix: update script regex in auto-update tests to use .mjs * feat: Add Perplexity Web (Session) provider (cheaper-inference#1289) Integrated into release/v3.6.6 * fix(cli): resolve codex routing config parsing, standardize select model button positioning, and clarify oauth documentation * docs(changelog): record recent cli, provider, and test updates Document the latest fixes for Codex routing configuration parsing and Lobehub provider icon fallback behavior. Add the note that the remaining JavaScript test files were migrated to TypeScript ES modules to reflect the completed test stack transition. * chore(release): merge cheaper-inference#1286 minor improvements manually to avoid testing conflict * chore(test): rename perplexity-web.test.mjs to .ts to maintain 100% TS codebase * chore(docs): update CHANGELOG.md for perplexity-web provider * fix(security): resolve CodeQL incomplete URL substring sanitization via URL parsing in test mocks * fix: integrate compressContext() into chatCore.ts request pipeline Proactively compress oversized contexts before sending to upstream providers, preventing context_length_exceeded errors. Compression triggers at 85% of model's context limit using the existing 3-layer compressContext() function. - Import compressContext, estimateTokens, getTokenLimit from contextManager - Add compression check after translation, before executor dispatch - Estimate tokens and compare against 85% threshold of model's context limit - Apply 3-layer compression (trim tools, compress thinking, purify history) - Log compression events with before/after token counts and layers applied - Audit compression events for observability - Add unit tests verifying integration behavior Closes cheaper-inference#1290 * fix(tests): align reasoning expectations with GLM thinking structure * fix: prevent orphaned tool_result messages in purifyHistory() When purifyHistory() drops oldest messages to fit context window, it can split tool_use/tool_result pairs — keeping the tool_result but dropping the tool_use that initiated it. This causes upstream providers to reject the request with format errors. Add fixToolPairs() that runs after each purification pass to remove: - OpenAI format: orphaned role='tool' messages without matching tool_calls ID - Claude format: orphaned tool_result content blocks without matching tool_use ID Closes cheaper-inference#1291 * fix(tests): supply tool_use in mock so it is not dropped * chore: convert remaining test to TypeScript * fix(tests): restore compatibility with compressContext threshold test after tsx migration * docs: finalize v3.6.6 release documentation * fix(core): finalize provider removal, type issues, and codex API key config * fix(dashboard): render Web/Cookie, Search, Audio provider sections and fix TypeScript errors * fix: increase MCP web_search timeout to 60s (cheaper-inference#1278) * fix: route combo testing properly for embedding models (cheaper-inference#1260) * fix: accumulate excluded accounts in combo fallback loop (cheaper-inference#1233) * fix: strip leading whitespace and newlines from first streaming chunk (cheaper-inference#1211) * docs: clarify VPS and Docker settings for OAuth credentials (cheaper-inference#1204) * fix: return real retry-after for pipeline gates (cheaper-inference#1301) Integrated into release/v3.6.6 — returns real Retry-After values from pipeline gates * feat: streaming semantic cache, Cursor auto-version detection, and call-log enhancements (cheaper-inference#1296) Integrated into release/v3.6.6 — streaming semantic cache, Cursor auto-version detection, call-log cache_source tracking * feat(api): support more OpenAI types (image, embeddings, audio-transcriptions, audio-speech) (cheaper-inference#1297) Integrated into release/v3.6.6 — adds embeddings, audio-transcriptions, audio-speech, and images-generations support for custom OpenAI-compatible providers, plus Pollinations image registry * deps: bump hono from 4.12.12 to 4.12.14 (cheaper-inference#1302) Integrated into release/v3.6.6 * deps: bump hono from 4.12.12 to 4.12.14 (cheaper-inference#1306) Integrated into release/v3.6.6 * chore: stabilization fixes for v3.6.6 (cheaper-inference#1298, cheaper-inference#1254, cheaper-inference#59, CI) * fix(providers): match correct endpoint for Xiaomi MiMo, strip routing prefix for custom openai endpoints (cheaper-inference#1303, cheaper-inference#1261) * feat(storage): add database backup cleanup controls * chore(release): v3.6.6 — Final Stabilization Push * Backport call log storage refactor to release/v3.6.6 (cheaper-inference#1307) Integrated into release/v3.6.6 * deps: update dompurify to 3.4.0 to resolve CVE-XYZ (cheaper-inference#60) * test: disable sqlite auto backup in CI to resolve E2E timeout (#24481475058) * chore(docs): sync CHANGELOG for v3.6.6 with missing features and fixes * chore(release): prep v3.6.6 infrastructure and type safety fixes - Migrated legacy .mjs scripts to .ts (bin, prepublish, policies) - Resolved pre-commit strict lint (t11 budget) errors in combo.ts - Explicitly typed all TS bindings in pack-artifact policies - Updated package.json commands to run Node via tsx/esm internally - Hardened CI/CD with explicit node version 22.22.2 checks - Completed stage validations for v3.6.6 final release * chore: fix TS build errors and e2e timeouts in CI - Migrate nodeRuntimeSupport to TS interfaces avoiding implicit any - Increase visibility timeouts in skills-marketplace E2E test to 15s to bypass CI flakiness - Complete migration of .mjs scripts to .ts ensuring type safety * chore(release): sync package version 3.6.6 across workspaces * test(e2e): universally increase UI component visibility timeouts from 5s to 15s to bypass CI starvation * chore(build): inject baseUrl, paths, and types:node into MITM tsconfig within prepublish hook to fix missing types in CI check --------- Co-authored-by: diegosouzapw <diegosouzapw@users.noreply.github.com> Co-authored-by: Jack <5443152+hijak@users.noreply.github.com> Co-authored-by: Randi <55005611+rdself@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: Samuel Cedric <ceds.sam@gmail.com> Co-authored-by: Max Garmash <max@37bytes.com> Co-authored-by: Markus Hartung <mail@hartmark.se> Co-authored-by: Gi99lin <74502520+Gi99lin@users.noreply.github.com> Co-authored-by: Payne <baboialex95@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: clousky2020 <33016567+clousky2020@users.noreply.github.com> Co-authored-by: Ravi Tharuma <25951435+RaviTharuma@users.noreply.github.com> Co-authored-by: oyi77 <oyi77@users.noreply.github.com> Co-authored-by: Hdsje <vovan877@gmail.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: xiaoge1688 <moyekongling@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
release/v3.6.6, targetingrelease/v3.6.6, notmainrelease/v3.6.6changes and resolve the owner-requested merge conflicts insrc/lib/usage/callLogs.tsandsrc/lib/db/core.tsaroundrequest_summary,cache_source, requested-model provider-node prefixes, and the log-list fields that now drive cache-source / TPS visibility in the dashboardrelease/v3.6.6storage problem wherecall_logskeeps large request, response, and pipeline payloads inline in SQLite, causingstorage.sqliteand WAL files to grow quickly as request volume accumulatesDATA_DIR/call_logsexportAllbehavior consistent across SQLite rows and artifact files so the backport does not create orphaned summaries or incomplete backups025_call_logs_summary_storageso it does not collide withrelease/v3.6.6's existing022_add_memory_fts5022_call_logs_cache_sourceare automatically rehomed to026, which frees022_add_memory_fts5to run instead of being silently skipped022_add_memory_fts5into a safe transitional migration so existing UUID-basedmemories.idrows no longer fail withdatatype mismatchbefore023_fix_memory_fts_uuidcompletes the real FTS upgradeTesting
npm run typecheck:corenpm run lintnpm run test:unit(3043pass,0fail,4skipped)DISABLE_SQLITE_AUTO_BACKUP=true npm run test:coverage(Statements 90.04%,Branches 77.60%,Functions 92.14%,Lines 90.04%)