Repository navigation
feat(dashboard): media providers pages + Web Fetch category - #2645
Conversation
Implements task 05 (Phase 3) from the v3.8.3 refactor.
Adds POST /v1/web/fetch with three executors (Firecrawl, Jina Reader,
Tavily Extract), the new "Web Fetch" provider category, dedicated
dashboard pages for every media kind, and a serviceKinds metadata field
that surfaces what each provider can do.
Backend (new)
- src/app/api/v1/web/fetch/route.ts — CORS, Zod-validated body
(url/format/depth/wait_for_selector/include_metadata/provider), optional
API key auth, delegates to handler. Error responses go through
buildErrorBody/sanitizeErrorMessage.
- open-sse/handlers/webFetch.ts — dispatches to the right executor based
on the resolved provider.
- open-sse/executors/firecrawl-fetch.ts — POST api.firecrawl.dev/v1/scrape
with Bearer auth, request/response mapping, timeout, 401/4xx propagation.
- open-sse/executors/jina-reader-fetch.ts — GET r.jina.ai/{url} with Bearer
auth, JSON/plaintext response handling.
- open-sse/executors/tavily-fetch.ts — Tavily Extract POST with API key.
Providers + chip
- New APIKEY providers: firecrawl (hasFree 500/mo, serviceKinds webFetch),
jina-reader (hasFree 1M/mo, serviceKinds webFetch), byteplus (hasFree,
serviceKinds llm).
- tavily-search, exa-search, serper-search gain "webFetch" in their
serviceKinds.
- ServiceKind union exported from providers.ts; serviceKinds optional in
ProviderSchema (Zod) and ProviderCard prop type.
- providers/page.tsx gains webFetchEntriesAll, summaryStats.webfetch, a
"Web Fetch" chip (bg-orange-500), and a top-level "Web Fetch Providers"
section gated by showSection("webfetch").
- ProviderCard shows KIND_LABEL badges (Chat/Embed/Image/TTS/STT/Search/
Fetch/Video/Music) below the provider name when serviceKinds is present.
Dashboard /dashboard/media-providers
- page.tsx redirects to /embedding (default kind).
- [kind]/page.tsx lists providers whose serviceKinds includes the kind;
invalid kinds 404.
- [kind]/[id]/page.tsx server-validates the provider supports the kind,
delegates to MediaProviderPageClient.
- MediaProviderPageClient renders header, connections, and a "Playground
inline — coming in Phase 4" placeholder (no playground logic here).
- Components: MediaProviderHeader (reusable header), MediaProviderKindNav
(horizontal tabs across all kinds).
Validation schema
- shared/validation/schemas.ts gains v1WebFetchSchema.
i18n
- en + pt-BR: providers.webFetch / webFetchTooltip /
webFetchProvidersHeading; media.kinds.* (9 kinds), media.noProviders,
media.addConnection, media.backToProviders, media.connections,
media.noConnections, media.loading.
Tests
- tests/unit/web-fetch-handler.test.ts — routing, 401, error sanitization,
depth/selector forwarding (6 tests).
- tests/unit/firecrawl-executor.test.ts — Bearer auth, 401, format mapping,
response shape (6 tests).
- tests/unit/jina-reader-executor.test.ts — URL format, 401/403, JSON/
plaintext response (6 tests).
- 18/18 new tests pass; typecheck:core and lint clean.
Out of scope (deferred to later phases per plan §9): mini-playground inline
(Phase 4), local TTS providers (edge-tts/google-tts/coqui/tortoise),
integration tests that require a running Next.js server.
|
Warning You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again! |
|
Kilo Code Review could not run — your account is out of credits. Add credits or switch to a free model to enable reviews on this change. |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: eecad67122
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| const serviceKinds = provider.serviceKinds as string[] | undefined; | ||
| if (!Array.isArray(serviceKinds) || !serviceKinds.includes(validKind)) { | ||
| notFound(); |
There was a problem hiding this comment.
Backfill serviceKinds before enforcing kind-based 404s
This new gate makes provider pages depend entirely on provider.serviceKinds, but this commit only tags a small subset of providers with that field. As a result, existing providers that do support a kind (for example common embedding providers) now fail validation and return 404 on /dashboard/media-providers/[kind]/[id], and the kind listing can appear empty even when providers exist. Please derive kind support from existing capability metadata or backfill serviceKinds broadly before enforcing this check.
Useful? React with 👍 / 👎.
| byteplus: { | ||
| id: "byteplus", | ||
| alias: "bpm", |
There was a problem hiding this comment.
Register byteplus in runtime provider registry
This adds byteplus as a connectable API-key provider, but there is no corresponding runtime registry/config entry for that provider, so chat execution falls back to the default OpenAI config path (DefaultExecutor uses PROVIDERS[provider] || PROVIDERS.openai). In practice, BytePlus connections will be accepted in the dashboard but requests will be sent to the wrong upstream endpoint and fail.
Useful? React with 👍 / 👎.
| const requestBody: Record<string, unknown> = { | ||
| api_key: credentials.apiKey, | ||
| urls: [url], | ||
| extract_depth: "basic", | ||
| }; |
There was a problem hiding this comment.
Honor requested format in Tavily web-fetch executor
The API contract and schema allow callers to request specific formats, and handleWebFetch forwards format to Tavily, but this executor drops that option and always builds the same request body. Requests like format: "html" or format: "screenshot" therefore return the default extracted content instead of honoring the requested format, which makes provider behavior inconsistent and misleading for clients.
Useful? React with 👍 / 👎.
Exa's /contents API supports URL extraction (in addition to /search), so it belongs in the Web Fetch chip alongside Tavily.
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
* chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(deepseek-web): fix auth to use userToken + WASM PoW solver Rewrite deepseek-web executor from broken cookie auth to userToken Bearer flow (like Chat2API). Replace pure JS Keccak PoW with WASM solver (5.8s → 86ms). Add 14 models, validation, and dashboard UX. * fix(deepseek-web): update target_path to use challenge property * refactor(deepseek-web): streamline token handling and implement cache eviction * fix(deepseek-web): fix SSE parser, prompt format, and error handling - Handle all 3 DeepSeek SSE stream formats: initial fragments, APPEND operations, and bare string tokens (fixes truncated responses) - Simplify prompt builder to send system + last user message only (DeepSeek web API is single-turn, full history caused marker leakage) - Check json.code before token extraction (fixes "did not return access token: Authorization" on code 40003 with HTTP 200) - Clear session cache alongside token cache on auth errors - Add dev origin for remote testing Co-authored-by: Cursor <cursoragent@cursor.com> * chore: ignore memory-bank and cursor agent rules from tracking Co-authored-by: Cursor <cursoragent@cursor.com> * feat: enhance documentation and configuration for Fumadocs integration - Added Fumadocs MDX support in the Next.js configuration. - Updated transpile packages to include fumadocs-ui and fumadocs-core. - Implemented a comprehensive set of redirects for documentation paths to improve navigation. - Removed the generate-docs-index script as it is no longer needed. - Updated various documentation titles for consistency and clarity. - Enhanced global styles to incorporate Fumadocs UI themes and styles. * refactor(docs): cleanup fumadocs PR — revert deepseek, add i18n fallback, restore LanguageSelector - Revert unrelated deepseek-web.ts changes (should be separate PR) - Add .source/ to .gitignore (Fumadocs generated files) - Remove contributor IP from allowedDevOrigins - Add i18n runtime fallback: reads NEXT_LOCALE cookie, loads translated .md from docs/i18n/<locale>/docs/ (preserves existing translation pipeline) - Restore LanguageSelector in Fumadocs layout nav - Restore SEO metadata (title template, description, robots) * fix(codex): use allowlist to strip non-Responses-API fields in non-passthrough path (#2608) (#2615) Integrated into release/v3.8.3 — fix(codex): allowlist-based sanitization for gpt-5.5 Responses API * fix(deepseek-web): fix SSE parser, prompt format, error handling, and cache keys (#2616) Integrated into release/v3.8.3 — fix(deepseek-web): SSE parser (APPEND + bare tokens), prompt builder, error handling, session cache cleanup * chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(docs): migrate /docs to Fumadocs MDX with nested routes (#2614) Integrated into release/v3.8.3 — Fumadocs MDX migration with nested routes, search API, and 50+ URL redirects * fix(catalog): skip static PROVIDER_MODELS when synced models exist (#2625) Integrated into release/v3.8.3 * fix(qoder): Cosy auth fallback for PAT tokens + vision support for qwen3-vl-plus (#2629) Integrated into release/v3.8.3 * fix(cli): register tsx loader and add opencode config subcommand (#2631) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (#2628) Integrated into release/v3.8.3 * fix(claude): improve Pi and OpenCode compatibility (#2621) Integrated into release/v3.8.3 * fix: restore semantic passthrough system-role-only extraction instead of full normalization (#2620) Integrated into release/v3.8.3 * fix(kiro): stabilize conversationId across prompt compression (#2630) Integrated into release/v3.8.3 * fix(deepseek-web): SSE thinking/search routing and session lifecycle (#2624) Integrated into release/v3.8.3 — DeepSeek Web SSE thinking/search routing overhaul * feat(dashboard): free-tier grouping with symbolic link in /providers (#2632) Integrated into release/v3.8.3 * fix: close implementation gaps — t3-chat-web, stream_options, combo_strategy, batch config (#2634) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (#2633) Integrated into release/v3.8.3 * fix(reasoning): extend reasoning_content injection to Kimi K2 and other replay models (#2639) Integrated into release/v3.8.3 * fix(cli): Linux autostart via systemd user service (fixes #2627) (#2635) Integrated into release/v3.8.3 * Refactor/providers free tier (#2640) Integrated into release/v3.8.3 * fix(tests): remove duplicate assertion in schema coercion & fix(cli): ignore system vars in env check * fix(combo): preserve omniModel tag in streaming output for round-trip context pinning (#2646) Integrated into release/v3.8.3 * feat(dashboard): media providers pages + Web Fetch category (#2645) Integrated into release/v3.8.3 * Feature provider adapta org com tutorial de conexão em modal (#2643) Integrated into release/v3.8.3 * fix(rtk): skip content-based filter matching for non-shell tool results (#2642) Integrated into release/v3.8.3 * fix(translator): enable Claude extended thinking for Copilot Responses-API requests (#2647) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (#2641) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (#2638) Integrated into release/v3.8.3 * feat(dashboard): mini-playground inline (Phase 4) (#2648) Integrated into release/v3.8.3 * fix(settings): fix Require Login modal Cancel button text and dismissal (#2649) Integrated into release/v3.8.3 * feat(combos): universal context handoff for cross-model conversation continuity (#2653) Integrated into release/v3.8.3 * chore(release): bump to v3.8.3 — changelog, docs, version sync * feat(i18n): complete zh-CN translations for 1220 missing keys (#2655) Integrated into release/v3.8.3 * chore(release): include electron package changes in v3.8.3 * docs(changelog): integrate PR #2655 into v3.8.3 * feat(i18n): translate 377 additional zh-CN entries (81 new keys + 296 same-as-en) (#2659) Integrated into release/v3.8.3 * feat(dashboard): add Cmd+K / Ctrl+K command palette for sidebar navigation (#2656) Integrated into release/v3.8.3 * docs: update changelog for PR integrations under v3.8.3 * feat(cli): integrate native updates, autostart and headless CLI mode (#2662) Integrated into release/v3.8.3 * fix(proxy): save dashboard custom proxies in registry (#2661) Integrated into release/v3.8.3 * feat(dashboard): chat-first test slide-over (Option A) (#2660) Integrated into release/v3.8.3 * docs: update changelog with Batch 2 PR merges for v3.8.3 * fix: add xhigh+max to effortLevel schema; add opencode-plugin publish job (#2666) Integrated into release/v3.8.3 * docs: update changelog with Batch 3 PR #2666 merge for v3.8.3 * feat(quota+providers): card-grid layout, provider group headers, Codex race fix (#2667) Integrated into release/v3.8.3 * feat(dashboard): real-time live WebSocket monitoring (#2668) Integrated into release/v3.8.3 * feat(copilot): AI assistant with CodeGraph + CLI + knowledge base (#2669) Integrated into release/v3.8.3 * feat(pipeline): pre-request middleware hooks (#2670) Integrated into release/v3.8.3 * feat(resilience): credential health check + adaptive circuit breaker (#2671) Integrated into release/v3.8.3 * feat(playground): combo routing visual simulator (#2672) Integrated into release/v3.8.3 * feat(auth): API key groups with model-level permissions (#2673) Integrated into release/v3.8.3 * feat(pwa): enhanced manifest + push notification support (#2674) Integrated into release/v3.8.3 * feat(proxy): serverless relay endpoints with rate limiting (#2675) Integrated into release/v3.8.3 * docs(changelog): update changelog for PRs 2667-2675 & fix: resolve typescript compile-time errors * fix(db): remove transactions from migrations Remove explicit transaction wrappers from recent migrations and correct the API key groups migration metadata. Also fix codegraph path resolution for ESM environments and refresh generated fumadocs source output. --------- Co-authored-by: Ömer Vehbe <ovehbe@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Mr. Meowgi <mr@meowgi.dev> Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com> Co-authored-by: amogus22877769 <y.lev357@gmail.com> Co-authored-by: Halil Tezcan KARABULUT <info@hlltzcnkb.com> Co-authored-by: Tentoxa <53821604+Tentoxa@users.noreply.github.com> Co-authored-by: HALDRO <121296348+HALDRO@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: janeza2 <49841619+janeza2@users.noreply.github.com> Co-authored-by: df4p <38404+df4p@users.noreply.github.com> Co-authored-by: ivan-mezentsev <ivan@mezentsev.me> Co-authored-by: Chewji <126886556+Chewji9875@users.noreply.github.com> Co-authored-by: L-aros <107354918+L-aros@users.noreply.github.com> Co-authored-by: M.M <mr.maatoug@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: terence71-glitch <mcdowellterence71@gmail.com>
|
Unable to connect API key. Says invalid |
* chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(deepseek-web): fix auth to use userToken + WASM PoW solver Rewrite deepseek-web executor from broken cookie auth to userToken Bearer flow (like Chat2API). Replace pure JS Keccak PoW with WASM solver (5.8s → 86ms). Add 14 models, validation, and dashboard UX. * fix(deepseek-web): update target_path to use challenge property * refactor(deepseek-web): streamline token handling and implement cache eviction * fix(deepseek-web): fix SSE parser, prompt format, and error handling - Handle all 3 DeepSeek SSE stream formats: initial fragments, APPEND operations, and bare string tokens (fixes truncated responses) - Simplify prompt builder to send system + last user message only (DeepSeek web API is single-turn, full history caused marker leakage) - Check json.code before token extraction (fixes "did not return access token: Authorization" on code 40003 with HTTP 200) - Clear session cache alongside token cache on auth errors - Add dev origin for remote testing Co-authored-by: Cursor <cursoragent@cursor.com> * chore: ignore memory-bank and cursor agent rules from tracking Co-authored-by: Cursor <cursoragent@cursor.com> * feat: enhance documentation and configuration for Fumadocs integration - Added Fumadocs MDX support in the Next.js configuration. - Updated transpile packages to include fumadocs-ui and fumadocs-core. - Implemented a comprehensive set of redirects for documentation paths to improve navigation. - Removed the generate-docs-index script as it is no longer needed. - Updated various documentation titles for consistency and clarity. - Enhanced global styles to incorporate Fumadocs UI themes and styles. * refactor(docs): cleanup fumadocs PR — revert deepseek, add i18n fallback, restore LanguageSelector - Revert unrelated deepseek-web.ts changes (should be separate PR) - Add .source/ to .gitignore (Fumadocs generated files) - Remove contributor IP from allowedDevOrigins - Add i18n runtime fallback: reads NEXT_LOCALE cookie, loads translated .md from docs/i18n/<locale>/docs/ (preserves existing translation pipeline) - Restore LanguageSelector in Fumadocs layout nav - Restore SEO metadata (title template, description, robots) * fix(codex): use allowlist to strip non-Responses-API fields in non-passthrough path (diegosouzapw#2608) (diegosouzapw#2615) Integrated into release/v3.8.3 — fix(codex): allowlist-based sanitization for gpt-5.5 Responses API * fix(deepseek-web): fix SSE parser, prompt format, error handling, and cache keys (diegosouzapw#2616) Integrated into release/v3.8.3 — fix(deepseek-web): SSE parser (APPEND + bare tokens), prompt builder, error handling, session cache cleanup * chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(docs): migrate /docs to Fumadocs MDX with nested routes (diegosouzapw#2614) Integrated into release/v3.8.3 — Fumadocs MDX migration with nested routes, search API, and 50+ URL redirects * fix(catalog): skip static PROVIDER_MODELS when synced models exist (diegosouzapw#2625) Integrated into release/v3.8.3 * fix(qoder): Cosy auth fallback for PAT tokens + vision support for qwen3-vl-plus (diegosouzapw#2629) Integrated into release/v3.8.3 * fix(cli): register tsx loader and add opencode config subcommand (diegosouzapw#2631) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2628) Integrated into release/v3.8.3 * fix(claude): improve Pi and OpenCode compatibility (diegosouzapw#2621) Integrated into release/v3.8.3 * fix: restore semantic passthrough system-role-only extraction instead of full normalization (diegosouzapw#2620) Integrated into release/v3.8.3 * fix(kiro): stabilize conversationId across prompt compression (diegosouzapw#2630) Integrated into release/v3.8.3 * fix(deepseek-web): SSE thinking/search routing and session lifecycle (diegosouzapw#2624) Integrated into release/v3.8.3 — DeepSeek Web SSE thinking/search routing overhaul * feat(dashboard): free-tier grouping with symbolic link in /providers (diegosouzapw#2632) Integrated into release/v3.8.3 * fix: close implementation gaps — t3-chat-web, stream_options, combo_strategy, batch config (diegosouzapw#2634) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2633) Integrated into release/v3.8.3 * fix(reasoning): extend reasoning_content injection to Kimi K2 and other replay models (diegosouzapw#2639) Integrated into release/v3.8.3 * fix(cli): Linux autostart via systemd user service (fixes diegosouzapw#2627) (diegosouzapw#2635) Integrated into release/v3.8.3 * Refactor/providers free tier (diegosouzapw#2640) Integrated into release/v3.8.3 * fix(tests): remove duplicate assertion in schema coercion & fix(cli): ignore system vars in env check * fix(combo): preserve omniModel tag in streaming output for round-trip context pinning (diegosouzapw#2646) Integrated into release/v3.8.3 * feat(dashboard): media providers pages + Web Fetch category (diegosouzapw#2645) Integrated into release/v3.8.3 * Feature provider adapta org com tutorial de conexão em modal (diegosouzapw#2643) Integrated into release/v3.8.3 * fix(rtk): skip content-based filter matching for non-shell tool results (diegosouzapw#2642) Integrated into release/v3.8.3 * fix(translator): enable Claude extended thinking for Copilot Responses-API requests (diegosouzapw#2647) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2641) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2638) Integrated into release/v3.8.3 * feat(dashboard): mini-playground inline (Phase 4) (diegosouzapw#2648) Integrated into release/v3.8.3 * fix(settings): fix Require Login modal Cancel button text and dismissal (diegosouzapw#2649) Integrated into release/v3.8.3 * feat(combos): universal context handoff for cross-model conversation continuity (diegosouzapw#2653) Integrated into release/v3.8.3 * chore(release): bump to v3.8.3 — changelog, docs, version sync * feat(i18n): complete zh-CN translations for 1220 missing keys (diegosouzapw#2655) Integrated into release/v3.8.3 * chore(release): include electron package changes in v3.8.3 * docs(changelog): integrate PR diegosouzapw#2655 into v3.8.3 * feat(i18n): translate 377 additional zh-CN entries (81 new keys + 296 same-as-en) (diegosouzapw#2659) Integrated into release/v3.8.3 * feat(dashboard): add Cmd+K / Ctrl+K command palette for sidebar navigation (diegosouzapw#2656) Integrated into release/v3.8.3 * docs: update changelog for PR integrations under v3.8.3 * feat(cli): integrate native updates, autostart and headless CLI mode (diegosouzapw#2662) Integrated into release/v3.8.3 * fix(proxy): save dashboard custom proxies in registry (diegosouzapw#2661) Integrated into release/v3.8.3 * feat(dashboard): chat-first test slide-over (Option A) (diegosouzapw#2660) Integrated into release/v3.8.3 * docs: update changelog with Batch 2 PR merges for v3.8.3 * fix: add xhigh+max to effortLevel schema; add opencode-plugin publish job (diegosouzapw#2666) Integrated into release/v3.8.3 * docs: update changelog with Batch 3 PR diegosouzapw#2666 merge for v3.8.3 * feat(quota+providers): card-grid layout, provider group headers, Codex race fix (diegosouzapw#2667) Integrated into release/v3.8.3 * feat(dashboard): real-time live WebSocket monitoring (diegosouzapw#2668) Integrated into release/v3.8.3 * feat(copilot): AI assistant with CodeGraph + CLI + knowledge base (diegosouzapw#2669) Integrated into release/v3.8.3 * feat(pipeline): pre-request middleware hooks (diegosouzapw#2670) Integrated into release/v3.8.3 * feat(resilience): credential health check + adaptive circuit breaker (diegosouzapw#2671) Integrated into release/v3.8.3 * feat(playground): combo routing visual simulator (diegosouzapw#2672) Integrated into release/v3.8.3 * feat(auth): API key groups with model-level permissions (diegosouzapw#2673) Integrated into release/v3.8.3 * feat(pwa): enhanced manifest + push notification support (diegosouzapw#2674) Integrated into release/v3.8.3 * feat(proxy): serverless relay endpoints with rate limiting (diegosouzapw#2675) Integrated into release/v3.8.3 * docs(changelog): update changelog for PRs 2667-2675 & fix: resolve typescript compile-time errors * fix(db): remove transactions from migrations Remove explicit transaction wrappers from recent migrations and correct the API key groups migration metadata. Also fix codegraph path resolution for ESM environments and refresh generated fumadocs source output. --------- Co-authored-by: Ömer Vehbe <ovehbe@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Mr. Meowgi <mr@meowgi.dev> Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com> Co-authored-by: amogus22877769 <y.lev357@gmail.com> Co-authored-by: Halil Tezcan KARABULUT <info@hlltzcnkb.com> Co-authored-by: Tentoxa <53821604+Tentoxa@users.noreply.github.com> Co-authored-by: HALDRO <121296348+HALDRO@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: janeza2 <49841619+janeza2@users.noreply.github.com> Co-authored-by: df4p <38404+df4p@users.noreply.github.com> Co-authored-by: ivan-mezentsev <ivan@mezentsev.me> Co-authored-by: Chewji <126886556+Chewji9875@users.noreply.github.com> Co-authored-by: L-aros <107354918+L-aros@users.noreply.github.com> Co-authored-by: M.M <mr.maatoug@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: terence71-glitch <mcdowellterence71@gmail.com>
* chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(deepseek-web): fix auth to use userToken + WASM PoW solver Rewrite deepseek-web executor from broken cookie auth to userToken Bearer flow (like Chat2API). Replace pure JS Keccak PoW with WASM solver (5.8s → 86ms). Add 14 models, validation, and dashboard UX. * fix(deepseek-web): update target_path to use challenge property * refactor(deepseek-web): streamline token handling and implement cache eviction * fix(deepseek-web): fix SSE parser, prompt format, and error handling - Handle all 3 DeepSeek SSE stream formats: initial fragments, APPEND operations, and bare string tokens (fixes truncated responses) - Simplify prompt builder to send system + last user message only (DeepSeek web API is single-turn, full history caused marker leakage) - Check json.code before token extraction (fixes "did not return access token: Authorization" on code 40003 with HTTP 200) - Clear session cache alongside token cache on auth errors - Add dev origin for remote testing Co-authored-by: Cursor <cursoragent@cursor.com> * chore: ignore memory-bank and cursor agent rules from tracking Co-authored-by: Cursor <cursoragent@cursor.com> * feat: enhance documentation and configuration for Fumadocs integration - Added Fumadocs MDX support in the Next.js configuration. - Updated transpile packages to include fumadocs-ui and fumadocs-core. - Implemented a comprehensive set of redirects for documentation paths to improve navigation. - Removed the generate-docs-index script as it is no longer needed. - Updated various documentation titles for consistency and clarity. - Enhanced global styles to incorporate Fumadocs UI themes and styles. * refactor(docs): cleanup fumadocs PR — revert deepseek, add i18n fallback, restore LanguageSelector - Revert unrelated deepseek-web.ts changes (should be separate PR) - Add .source/ to .gitignore (Fumadocs generated files) - Remove contributor IP from allowedDevOrigins - Add i18n runtime fallback: reads NEXT_LOCALE cookie, loads translated .md from docs/i18n/<locale>/docs/ (preserves existing translation pipeline) - Restore LanguageSelector in Fumadocs layout nav - Restore SEO metadata (title template, description, robots) * fix(codex): use allowlist to strip non-Responses-API fields in non-passthrough path (diegosouzapw#2608) (diegosouzapw#2615) Integrated into release/v3.8.3 — fix(codex): allowlist-based sanitization for gpt-5.5 Responses API * fix(deepseek-web): fix SSE parser, prompt format, error handling, and cache keys (diegosouzapw#2616) Integrated into release/v3.8.3 — fix(deepseek-web): SSE parser (APPEND + bare tokens), prompt builder, error handling, session cache cleanup * chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(docs): migrate /docs to Fumadocs MDX with nested routes (diegosouzapw#2614) Integrated into release/v3.8.3 — Fumadocs MDX migration with nested routes, search API, and 50+ URL redirects * fix(catalog): skip static PROVIDER_MODELS when synced models exist (diegosouzapw#2625) Integrated into release/v3.8.3 * fix(qoder): Cosy auth fallback for PAT tokens + vision support for qwen3-vl-plus (diegosouzapw#2629) Integrated into release/v3.8.3 * fix(cli): register tsx loader and add opencode config subcommand (diegosouzapw#2631) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2628) Integrated into release/v3.8.3 * fix(claude): improve Pi and OpenCode compatibility (diegosouzapw#2621) Integrated into release/v3.8.3 * fix: restore semantic passthrough system-role-only extraction instead of full normalization (diegosouzapw#2620) Integrated into release/v3.8.3 * fix(kiro): stabilize conversationId across prompt compression (diegosouzapw#2630) Integrated into release/v3.8.3 * fix(deepseek-web): SSE thinking/search routing and session lifecycle (diegosouzapw#2624) Integrated into release/v3.8.3 — DeepSeek Web SSE thinking/search routing overhaul * feat(dashboard): free-tier grouping with symbolic link in /providers (diegosouzapw#2632) Integrated into release/v3.8.3 * fix: close implementation gaps — t3-chat-web, stream_options, combo_strategy, batch config (diegosouzapw#2634) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2633) Integrated into release/v3.8.3 * fix(reasoning): extend reasoning_content injection to Kimi K2 and other replay models (diegosouzapw#2639) Integrated into release/v3.8.3 * fix(cli): Linux autostart via systemd user service (fixes diegosouzapw#2627) (diegosouzapw#2635) Integrated into release/v3.8.3 * Refactor/providers free tier (diegosouzapw#2640) Integrated into release/v3.8.3 * fix(tests): remove duplicate assertion in schema coercion & fix(cli): ignore system vars in env check * fix(combo): preserve omniModel tag in streaming output for round-trip context pinning (diegosouzapw#2646) Integrated into release/v3.8.3 * feat(dashboard): media providers pages + Web Fetch category (diegosouzapw#2645) Integrated into release/v3.8.3 * Feature provider adapta org com tutorial de conexão em modal (diegosouzapw#2643) Integrated into release/v3.8.3 * fix(rtk): skip content-based filter matching for non-shell tool results (diegosouzapw#2642) Integrated into release/v3.8.3 * fix(translator): enable Claude extended thinking for Copilot Responses-API requests (diegosouzapw#2647) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2641) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2638) Integrated into release/v3.8.3 * feat(dashboard): mini-playground inline (Phase 4) (diegosouzapw#2648) Integrated into release/v3.8.3 * fix(settings): fix Require Login modal Cancel button text and dismissal (diegosouzapw#2649) Integrated into release/v3.8.3 * feat(combos): universal context handoff for cross-model conversation continuity (diegosouzapw#2653) Integrated into release/v3.8.3 * chore(release): bump to v3.8.3 — changelog, docs, version sync * feat(i18n): complete zh-CN translations for 1220 missing keys (diegosouzapw#2655) Integrated into release/v3.8.3 * chore(release): include electron package changes in v3.8.3 * docs(changelog): integrate PR diegosouzapw#2655 into v3.8.3 * feat(i18n): translate 377 additional zh-CN entries (81 new keys + 296 same-as-en) (diegosouzapw#2659) Integrated into release/v3.8.3 * feat(dashboard): add Cmd+K / Ctrl+K command palette for sidebar navigation (diegosouzapw#2656) Integrated into release/v3.8.3 * docs: update changelog for PR integrations under v3.8.3 * feat(cli): integrate native updates, autostart and headless CLI mode (diegosouzapw#2662) Integrated into release/v3.8.3 * fix(proxy): save dashboard custom proxies in registry (diegosouzapw#2661) Integrated into release/v3.8.3 * feat(dashboard): chat-first test slide-over (Option A) (diegosouzapw#2660) Integrated into release/v3.8.3 * docs: update changelog with Batch 2 PR merges for v3.8.3 * fix: add xhigh+max to effortLevel schema; add opencode-plugin publish job (diegosouzapw#2666) Integrated into release/v3.8.3 * docs: update changelog with Batch 3 PR diegosouzapw#2666 merge for v3.8.3 * feat(quota+providers): card-grid layout, provider group headers, Codex race fix (diegosouzapw#2667) Integrated into release/v3.8.3 * feat(dashboard): real-time live WebSocket monitoring (diegosouzapw#2668) Integrated into release/v3.8.3 * feat(copilot): AI assistant with CodeGraph + CLI + knowledge base (diegosouzapw#2669) Integrated into release/v3.8.3 * feat(pipeline): pre-request middleware hooks (diegosouzapw#2670) Integrated into release/v3.8.3 * feat(resilience): credential health check + adaptive circuit breaker (diegosouzapw#2671) Integrated into release/v3.8.3 * feat(playground): combo routing visual simulator (diegosouzapw#2672) Integrated into release/v3.8.3 * feat(auth): API key groups with model-level permissions (diegosouzapw#2673) Integrated into release/v3.8.3 * feat(pwa): enhanced manifest + push notification support (diegosouzapw#2674) Integrated into release/v3.8.3 * feat(proxy): serverless relay endpoints with rate limiting (diegosouzapw#2675) Integrated into release/v3.8.3 * docs(changelog): update changelog for PRs 2667-2675 & fix: resolve typescript compile-time errors * fix(db): remove transactions from migrations Remove explicit transaction wrappers from recent migrations and correct the API key groups migration metadata. Also fix codegraph path resolution for ESM environments and refresh generated fumadocs source output. --------- Co-authored-by: Ömer Vehbe <ovehbe@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Mr. Meowgi <mr@meowgi.dev> Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com> Co-authored-by: amogus22877769 <y.lev357@gmail.com> Co-authored-by: Halil Tezcan KARABULUT <info@hlltzcnkb.com> Co-authored-by: Tentoxa <53821604+Tentoxa@users.noreply.github.com> Co-authored-by: HALDRO <121296348+HALDRO@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: janeza2 <49841619+janeza2@users.noreply.github.com> Co-authored-by: df4p <38404+df4p@users.noreply.github.com> Co-authored-by: ivan-mezentsev <ivan@mezentsev.me> Co-authored-by: Chewji <126886556+Chewji9875@users.noreply.github.com> Co-authored-by: L-aros <107354918+L-aros@users.noreply.github.com> Co-authored-by: M.M <mr.maatoug@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: terence71-glitch <mcdowellterence71@gmail.com>
…zapw#2645) Integrated into release/v3.8.3
* chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(deepseek-web): fix auth to use userToken + WASM PoW solver Rewrite deepseek-web executor from broken cookie auth to userToken Bearer flow (like Chat2API). Replace pure JS Keccak PoW with WASM solver (5.8s → 86ms). Add 14 models, validation, and dashboard UX. * fix(deepseek-web): update target_path to use challenge property * refactor(deepseek-web): streamline token handling and implement cache eviction * fix(deepseek-web): fix SSE parser, prompt format, and error handling - Handle all 3 DeepSeek SSE stream formats: initial fragments, APPEND operations, and bare string tokens (fixes truncated responses) - Simplify prompt builder to send system + last user message only (DeepSeek web API is single-turn, full history caused marker leakage) - Check json.code before token extraction (fixes "did not return access token: Authorization" on code 40003 with HTTP 200) - Clear session cache alongside token cache on auth errors - Add dev origin for remote testing Co-authored-by: Cursor <cursoragent@cursor.com> * chore: ignore memory-bank and cursor agent rules from tracking Co-authored-by: Cursor <cursoragent@cursor.com> * feat: enhance documentation and configuration for Fumadocs integration - Added Fumadocs MDX support in the Next.js configuration. - Updated transpile packages to include fumadocs-ui and fumadocs-core. - Implemented a comprehensive set of redirects for documentation paths to improve navigation. - Removed the generate-docs-index script as it is no longer needed. - Updated various documentation titles for consistency and clarity. - Enhanced global styles to incorporate Fumadocs UI themes and styles. * refactor(docs): cleanup fumadocs PR — revert deepseek, add i18n fallback, restore LanguageSelector - Revert unrelated deepseek-web.ts changes (should be separate PR) - Add .source/ to .gitignore (Fumadocs generated files) - Remove contributor IP from allowedDevOrigins - Add i18n runtime fallback: reads NEXT_LOCALE cookie, loads translated .md from docs/i18n/<locale>/docs/ (preserves existing translation pipeline) - Restore LanguageSelector in Fumadocs layout nav - Restore SEO metadata (title template, description, robots) * fix(codex): use allowlist to strip non-Responses-API fields in non-passthrough path (diegosouzapw#2608) (diegosouzapw#2615) Integrated into release/v3.8.3 — fix(codex): allowlist-based sanitization for gpt-5.5 Responses API * fix(deepseek-web): fix SSE parser, prompt format, error handling, and cache keys (diegosouzapw#2616) Integrated into release/v3.8.3 — fix(deepseek-web): SSE parser (APPEND + bare tokens), prompt builder, error handling, session cache cleanup * chore(config): ignore additional agent workflow command files Add newly introduced agent workflow and Claude command files to .gitignore so proprietary automation assets are not committed. * feat(docs): migrate /docs to Fumadocs MDX with nested routes (diegosouzapw#2614) Integrated into release/v3.8.3 — Fumadocs MDX migration with nested routes, search API, and 50+ URL redirects * fix(catalog): skip static PROVIDER_MODELS when synced models exist (diegosouzapw#2625) Integrated into release/v3.8.3 * fix(qoder): Cosy auth fallback for PAT tokens + vision support for qwen3-vl-plus (diegosouzapw#2629) Integrated into release/v3.8.3 * fix(cli): register tsx loader and add opencode config subcommand (diegosouzapw#2631) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2628) Integrated into release/v3.8.3 * fix(claude): improve Pi and OpenCode compatibility (diegosouzapw#2621) Integrated into release/v3.8.3 * fix: restore semantic passthrough system-role-only extraction instead of full normalization (diegosouzapw#2620) Integrated into release/v3.8.3 * fix(kiro): stabilize conversationId across prompt compression (diegosouzapw#2630) Integrated into release/v3.8.3 * fix(deepseek-web): SSE thinking/search routing and session lifecycle (diegosouzapw#2624) Integrated into release/v3.8.3 — DeepSeek Web SSE thinking/search routing overhaul * feat(dashboard): free-tier grouping with symbolic link in /providers (diegosouzapw#2632) Integrated into release/v3.8.3 * fix: close implementation gaps — t3-chat-web, stream_options, combo_strategy, batch config (diegosouzapw#2634) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2633) Integrated into release/v3.8.3 * fix(reasoning): extend reasoning_content injection to Kimi K2 and other replay models (diegosouzapw#2639) Integrated into release/v3.8.3 * fix(cli): Linux autostart via systemd user service (fixes diegosouzapw#2627) (diegosouzapw#2635) Integrated into release/v3.8.3 * Refactor/providers free tier (diegosouzapw#2640) Integrated into release/v3.8.3 * fix(tests): remove duplicate assertion in schema coercion & fix(cli): ignore system vars in env check * fix(combo): preserve omniModel tag in streaming output for round-trip context pinning (diegosouzapw#2646) Integrated into release/v3.8.3 * feat(dashboard): media providers pages + Web Fetch category (diegosouzapw#2645) Integrated into release/v3.8.3 * Feature provider adapta org com tutorial de conexão em modal (diegosouzapw#2643) Integrated into release/v3.8.3 * fix(rtk): skip content-based filter matching for non-shell tool results (diegosouzapw#2642) Integrated into release/v3.8.3 * fix(translator): enable Claude extended thinking for Copilot Responses-API requests (diegosouzapw#2647) Integrated into release/v3.8.3 * feat(dashboard): add search and filters to /dashboard/api-manager (diegosouzapw#2641) Integrated into release/v3.8.3 * feat(dashboard): risk notice modal for sensitive providers (diegosouzapw#2638) Integrated into release/v3.8.3 * feat(dashboard): mini-playground inline (Phase 4) (diegosouzapw#2648) Integrated into release/v3.8.3 * fix(settings): fix Require Login modal Cancel button text and dismissal (diegosouzapw#2649) Integrated into release/v3.8.3 * feat(combos): universal context handoff for cross-model conversation continuity (diegosouzapw#2653) Integrated into release/v3.8.3 * chore(release): bump to v3.8.3 — changelog, docs, version sync * feat(i18n): complete zh-CN translations for 1220 missing keys (diegosouzapw#2655) Integrated into release/v3.8.3 * chore(release): include electron package changes in v3.8.3 * docs(changelog): integrate PR diegosouzapw#2655 into v3.8.3 * feat(i18n): translate 377 additional zh-CN entries (81 new keys + 296 same-as-en) (diegosouzapw#2659) Integrated into release/v3.8.3 * feat(dashboard): add Cmd+K / Ctrl+K command palette for sidebar navigation (diegosouzapw#2656) Integrated into release/v3.8.3 * docs: update changelog for PR integrations under v3.8.3 * feat(cli): integrate native updates, autostart and headless CLI mode (diegosouzapw#2662) Integrated into release/v3.8.3 * fix(proxy): save dashboard custom proxies in registry (diegosouzapw#2661) Integrated into release/v3.8.3 * feat(dashboard): chat-first test slide-over (Option A) (diegosouzapw#2660) Integrated into release/v3.8.3 * docs: update changelog with Batch 2 PR merges for v3.8.3 * fix: add xhigh+max to effortLevel schema; add opencode-plugin publish job (diegosouzapw#2666) Integrated into release/v3.8.3 * docs: update changelog with Batch 3 PR diegosouzapw#2666 merge for v3.8.3 * feat(quota+providers): card-grid layout, provider group headers, Codex race fix (diegosouzapw#2667) Integrated into release/v3.8.3 * feat(dashboard): real-time live WebSocket monitoring (diegosouzapw#2668) Integrated into release/v3.8.3 * feat(copilot): AI assistant with CodeGraph + CLI + knowledge base (diegosouzapw#2669) Integrated into release/v3.8.3 * feat(pipeline): pre-request middleware hooks (diegosouzapw#2670) Integrated into release/v3.8.3 * feat(resilience): credential health check + adaptive circuit breaker (diegosouzapw#2671) Integrated into release/v3.8.3 * feat(playground): combo routing visual simulator (diegosouzapw#2672) Integrated into release/v3.8.3 * feat(auth): API key groups with model-level permissions (diegosouzapw#2673) Integrated into release/v3.8.3 * feat(pwa): enhanced manifest + push notification support (diegosouzapw#2674) Integrated into release/v3.8.3 * feat(proxy): serverless relay endpoints with rate limiting (diegosouzapw#2675) Integrated into release/v3.8.3 * docs(changelog): update changelog for PRs 2667-2675 & fix: resolve typescript compile-time errors * fix(db): remove transactions from migrations Remove explicit transaction wrappers from recent migrations and correct the API key groups migration metadata. Also fix codegraph path resolution for ESM environments and refresh generated fumadocs source output. --------- Co-authored-by: Ömer Vehbe <ovehbe@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Mr. Meowgi <mr@meowgi.dev> Co-authored-by: Hernan Javier Ardila Sanchez <hjasgr@gmail.com> Co-authored-by: amogus22877769 <y.lev357@gmail.com> Co-authored-by: Halil Tezcan KARABULUT <info@hlltzcnkb.com> Co-authored-by: Tentoxa <53821604+Tentoxa@users.noreply.github.com> Co-authored-by: HALDRO <121296348+HALDRO@users.noreply.github.com> Co-authored-by: Paijo <14921983+oyi77@users.noreply.github.com> Co-authored-by: janeza2 <49841619+janeza2@users.noreply.github.com> Co-authored-by: df4p <38404+df4p@users.noreply.github.com> Co-authored-by: ivan-mezentsev <ivan@mezentsev.me> Co-authored-by: Chewji <126886556+Chewji9875@users.noreply.github.com> Co-authored-by: L-aros <107354918+L-aros@users.noreply.github.com> Co-authored-by: M.M <mr.maatoug@gmail.com> Co-authored-by: Benson K B <bensonkbmca@gmail.com> Co-authored-by: terence71-glitch <mcdowellterence71@gmail.com>
Summary
Implements task
_tasks/features-v3.8.3/refactorpages/05-media-providers-and-webfetch.plan.md(Phase 3 of the v3.8.3 refactor).Adds the new Web Fetch category, the dedicated
/dashboard/media-providers/[kind]/[id]pages, and aserviceKindsmetadata field that surfaces what each provider can do. Three new web-fetch providers (Firecrawl, Jina Reader, Tavily Extract) ship with their own executors and Bearer-auth handling.Backend
POST /v1/web/fetch— CORS, Zod-validated request, optional auth, errors routed throughbuildErrorBody/sanitizeErrorMessage.firecrawl-fetch,jina-reader-fetch,tavily-fetch.Providers / chips
firecrawl(500/mo free),jina-reader(1M/mo free),byteplus.tavily-search,exa-search,serper-searchgain"webFetch"inserviceKinds.ServiceKindunion +serviceKinds?: ServiceKind[]inProviderSchema(Zod) and ProviderCard props.bg-orange-500) in the filter row + dedicated top-level section.KIND_LABELbadges (Chat/Embed/Image/TTS/STT/Search/Fetch/Video/Music).Dashboard /dashboard/media-providers
page.tsx→ redirect to/embedding(default kind).[kind]/page.tsx→ lists providers for the kind; invalid kinds 404.[kind]/[id]/page.tsx→ server validates kind ∋ providerId; client renders header + connections + "Playground inline — coming in Phase 4" placeholder.MediaProviderHeader,MediaProviderKindNav.i18n
20+ new keys in
en+pt-BR:providers.webFetch*,media.kinds.*,media.noProviders,media.addConnection,media.backToProviders,media.connections,media.noConnections,media.loading.Validations
npm run typecheck:core→ cleannpm run lint→ 0 errorsnode --import tsx/esm --test tests/unit/{web-fetch-handler,firecrawl-executor,jina-reader-executor}.test.ts→ 18/18 passTest plan
POST /v1/web/fetchwith{url, provider: "firecrawl"}returns extracted content (needs Firecrawl API key configured)/dashboard/providers→ "Web Fetch" chip appears with count/dashboard/media-providers/embedding/openai→ page renders/dashboard/media-providers/webFetch/firecrawl→ page renders/dashboard/media-providers/foo/bar→ 404/dashboard/media-providers/embedding/firecrawl(provider doesn't support embedding) → 404Out of scope (per plan §9)