Repository navigation
fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 - #866
Conversation
📝 WalkthroughWalkthroughRefactors image validation to use asynchronous background submission, introduces environment-driven validation timing and retry constants, preserves failed validation containers optionally, schedules delayed container cleanup, and expands shell resolution to return both Changes
Sequence Diagram(s)sequenceDiagram
participant Client
participant APIEndpoint as API:/images/validate
participant Registry
participant BGWorker as Background<br/>Task
participant TaskProcessor
participant DockerExec as Docker<br/>Executor
participant Shell as Shell CRD
Client->>APIEndpoint: POST /images/validate
APIEndpoint->>Registry: register validation task
APIEndpoint->>BGWorker: enqueue (asyncio.create_task)
APIEndpoint-->>Client: Immediate response {status:"submitted", validation_task_id}
BGWorker->>TaskProcessor: to_thread(process_tasks, [validation_task])
TaskProcessor->>DockerExec: execute validation task
DockerExec->>Shell: resolve shell info (shell_type, base_image)
DockerExec->>DockerExec: apply validation timeouts/retries
alt Container fails & VALIDATION_KEEP_FAILED_CONTAINER true
DockerExec-->>TaskProcessor: preserve container (no rm)
else
DockerExec->>DockerExec: cleanup container
end
Estimated code review effort🎯 4 (Complex) | ⏱️ ~45 minutes Poem
🚥 Pre-merge checks | ✅ 3✅ Passed checks (3 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Actionable comments posted: 5
🧹 Nitpick comments (3)
backend/app/services/execution/request_builder.py (2)
61-64: Remove dead_cached_shell_typevariable.
_cached_shell_typeis no longer used since_resolve_shell_typenow delegates to_resolve_shell_info, which uses_cached_shell_infoinstead.🧹 Proposed fix to remove dead code
self.db = db - # Cache shell_type to avoid repeated database queries - self._cached_shell_type: str | None = None # Cache shell info (shell_type + base_image) to avoid repeated database queries self._cached_shell_info: dict | None = None🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@backend/app/services/execution/request_builder.py` around lines 61 - 64, Remove the dead field _cached_shell_type from the RequestBuilder (or the class that defines it) because _resolve_shell_type now delegates to _resolve_shell_info and caching is handled by _cached_shell_info; delete the declaration "self._cached_shell_type: str | None = None" and any references to _cached_shell_type, leaving _cached_shell_info and _resolve_shell_info intact so caching logic is centralized.
693-707: Redundant variable initialization.The
shell = Noneon line 694 is immediately overwritten by the query result on lines 697-707.🧹 Proposed fix
shell_ref = bot_crd.spec.shellRef - shell = None # 1. Query user's private shell first shell = (🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@backend/app/services/execution/request_builder.py` around lines 693 - 707, Remove the redundant initialization "shell = None" before the DB query: the variable is immediately assigned by the result of self.db.query(Kind)...first() (referenced as shell_ref and the subsequent query on Kind), so delete the standalone "shell = None" line and keep the query-assignment as the single initialization; ensure no other code between uses shell before that query.executor_manager/routers/routers.py (1)
953-959: Consider using Redis to store validation task metadata for multi-worker deployments.The
_validation_task_registryis an in-memory dict that only works when/images/validateand/callbackrequests hit the same process. For single-worker deployments (current setup), this works fine. However, if the executor_manager scales to multiple worker processes or replicated instances, the callback handler may fail to locate the validation metadata. To future-proof the implementation for multi-worker deployments, migrate this correlation to Redis or another shared store. Redis is already configured in the environment (REDIS_URL).🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@executor_manager/routers/routers.py` around lines 953 - 959, The current implementation stores per-validation metadata in the in-memory dict _validation_task_registry keyed by validation_task_id, which will break when /images/validate and /callback requests land on different processes; move this correlation into Redis (using the existing REDIS_URL) by writing the same metadata (validation_id, shell_type, image, created_at) to a Redis key when you create the entry in the code path that sets _validation_task_registry (refer to _validation_task_registry and validation_task_id), and update the callback handler to read and delete that Redis key (instead of or in addition to _validation_task_registry) when processing the terminal callback so multi-worker instances can locate the metadata reliably.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Inline comments:
In `@backend/app/api/endpoints/adapter/shells.py`:
- Around line 996-997: The cleanup coroutine started with
asyncio.create_task(_cleanup_validation_container(request.executor_name)) is not
stored and may be garbage-collected before it runs; change this to create the
task and store a strong reference (e.g., add it to a lifecycle-managed set like
self._pending_cleanup_tasks) and register a done callback to remove it when
finished (use task.add_done_callback to pop from the set), doing the same for
the other places that spawn this cleanup (the similar block around the other
validation/cleanup calls). Ensure you reference the same task-handling pattern
used elsewhere (e.g., self._refresh_task) and keep the task referenced until
completion.
In `@backend/app/services/execution/request_builder.py`:
- Around line 676-678: The cache self._cached_shell_info is global across the
loop in _build_bot_config so multiple bots in the same team end up sharing the
first bot's shell_info; update the logic so shell_info is resolved
per-member—either make the cache keyed by the bot identity (e.g., bot.name +
bot.namespace) and use that key when reading/writing self._cached_shell_info, or
clear/avoid using the cached value inside the member iteration in
_build_bot_config (and any helper like _resolve_shell_info) so each bot gets its
own resolved shell_info; ensure all reads/writes reference the new per-bot key
or that caching is skipped during member processing.
In `@executor_manager/executors/docker/executor.py`:
- Around line 770-777: The cleanup call to self.subprocess.run(["docker", "rm",
"-f", executor_name], ...) currently swallows all failures; change the logic in
the cleanup routine (where the subprocess.run for docker rm -f is invoked) to
capture the CompletedProcess result or catch the exception and log an error
including executor_name and the stdout/stderr/exception details, and ensure
non-zero return codes are treated as failures (log and/or re-raise as
appropriate) instead of being silently ignored.
In `@executor_manager/routers/routers.py`:
- Around line 907-917: The current logic that trims "http(s)://" from
callback_host and then hardcodes "http://" for callback_url breaks HTTPS and
mangles IPv6; update the logic around callback_host/callback_port/callback_url
to parse the environment value with urllib.parse.urlparse (use get_host_ip() as
fallback), preserve the parsed.scheme if present (default to "http" only if no
scheme), use parsed.hostname (and parsed.port unless CALLBACK_PORT env
overrides) to avoid splitting on ":" (which breaks IPv6), and reconstruct
callback_url using the preserved scheme and properly bracketed IPv6 host and
final port; update references to callback_host, callback_port, and callback_url
accordingly.
- Around line 836-849: When process_tasks() fails in
_run_validation_task_in_background the code currently pops
_validation_task_registry and logs an error, leaving Redis stuck in "submitted";
change the except block to first write a terminal failed validation status (use
the existing _update_validation_status_from_callback or explicitly set status:
"failed", valid: false in Redis) before removing the registry entry, and apply
the same change to the other identical error-handling block referenced in the
review. Also address the other review notes: stop building callback URLs with
rsplit(":", 1) (use urllib.parse / yarl or proper URL/host handling to preserve
IPv6 addresses) and replace the process-local _validation_task_registry with
shared storage (Redis or DB) so request and callback correlation survives across
workers/replicas.
---
Nitpick comments:
In `@backend/app/services/execution/request_builder.py`:
- Around line 61-64: Remove the dead field _cached_shell_type from the
RequestBuilder (or the class that defines it) because _resolve_shell_type now
delegates to _resolve_shell_info and caching is handled by _cached_shell_info;
delete the declaration "self._cached_shell_type: str | None = None" and any
references to _cached_shell_type, leaving _cached_shell_info and
_resolve_shell_info intact so caching logic is centralized.
- Around line 693-707: Remove the redundant initialization "shell = None" before
the DB query: the variable is immediately assigned by the result of
self.db.query(Kind)...first() (referenced as shell_ref and the subsequent query
on Kind), so delete the standalone "shell = None" line and keep the
query-assignment as the single initialization; ensure no other code between uses
shell before that query.
In `@executor_manager/routers/routers.py`:
- Around line 953-959: The current implementation stores per-validation metadata
in the in-memory dict _validation_task_registry keyed by validation_task_id,
which will break when /images/validate and /callback requests land on different
processes; move this correlation into Redis (using the existing REDIS_URL) by
writing the same metadata (validation_id, shell_type, image, created_at) to a
Redis key when you create the entry in the code path that sets
_validation_task_registry (refer to _validation_task_registry and
validation_task_id), and update the callback handler to read and delete that
Redis key (instead of or in addition to _validation_task_registry) when
processing the terminal callback so multi-worker instances can locate the
metadata reliably.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: defaults
Review profile: CHILL
Plan: Pro
Run ID: 3528e097-43c9-4bec-9550-fea6dd648a13
📒 Files selected for processing (6)
backend/app/api/endpoints/adapter/shells.pybackend/app/services/execution/request_builder.pyexecutor_manager/executors/docker/executor.pyexecutor_manager/routers/routers.pyexecutor_manager/tests/executors/test_docker_executor.pyexecutor_manager/tests/routers/test_validate_image.py
| if request.executor_name and request.valid is True: | ||
| await _cleanup_validation_container(request.executor_name) | ||
| asyncio.create_task(_cleanup_validation_container(request.executor_name)) |
There was a problem hiding this comment.
🧩 Analysis chain
🏁 Script executed:
cat -n backend/app/api/endpoints/adapter/shells.py | sed -n '990,1035p'Repository: wecode-ai/Wegent
Length of output: 2093
🏁 Script executed:
# Get the full context around the flagged lines to understand the function and cleanup mechanism
head -n 1050 backend/app/api/endpoints/adapter/shells.py | tail -n +980Repository: wecode-ai/Wegent
Length of output: 2748
🏁 Script executed:
# Search for the _cleanup_validation_container function to understand its implementation
rg -n "_cleanup_validation_container" backend/app/api/endpoints/adapter/shells.py -A 15Repository: wecode-ai/Wegent
Length of output: 1108
🏁 Script executed:
# Search for VALIDATION_CONTAINER_CLEANUP_DELAY_SECONDS to understand how delays are configured
rg -n "VALIDATION_CONTAINER_CLEANUP_DELAY_SECONDS" backend/Repository: wecode-ai/Wegent
Length of output: 603
🏁 Script executed:
# Check if cleanup tasks are stored or tracked anywhere else in the file
rg -n "cleanup.*task\|pending.*task\|_cleanup" backend/app/api/endpoints/adapter/shells.pyRepository: wecode-ai/Wegent
Length of output: 42
🏁 Script executed:
# Check if there's any task tracking or background task management in this file
rg -n "background.*task\|task.*set\|pending.*task\|_cleanup" backend/app/api/endpoints/adapter/shells.py -B 2 -A 2Repository: wecode-ai/Wegent
Length of output: 42
🏁 Script executed:
# Check imports at top of file to understand what's available
head -n 50 backend/app/api/endpoints/adapter/shells.pyRepository: wecode-ai/Wegent
Length of output: 1529
🏁 Script executed:
# Search for similar fire-and-forget patterns in the codebase to see if this is a consistent pattern
rg "asyncio\.create_task" backend/ -n | head -20Repository: wecode-ai/Wegent
Length of output: 2112
Track the delayed cleanup task instead of dropping it.
This coroutine can spend time inside asyncio.sleep() with no strong reference. If the task is garbage collected or loses its reference, the cleanup will never execute and validation containers will remain on the executor. Keep pending cleanup tasks in a set or another lifecycle-managed runner, similar to patterns used elsewhere in the codebase like self._refresh_task = asyncio.create_task(...).
Also applies to lines 1022-1028.
🧰 Tools
🪛 Ruff (0.15.7)
[warning] 997-997: Store a reference to the return value of asyncio.create_task
(RUF006)
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.
In `@backend/app/api/endpoints/adapter/shells.py` around lines 996 - 997, The
cleanup coroutine started with
asyncio.create_task(_cleanup_validation_container(request.executor_name)) is not
stored and may be garbage-collected before it runs; change this to create the
task and store a strong reference (e.g., add it to a lifecycle-managed set like
self._pending_cleanup_tasks) and register a done callback to remove it when
finished (use task.add_done_callback to pop from the set), doing the same for
the other places that spawn this cleanup (the similar block around the other
validation/cleanup calls). Ensure you reference the same task-handling pattern
used elsewhere (e.g., self._refresh_task) and keep the task referenced until
completion.
| try: | ||
| self.subprocess.run( | ||
| ["docker", "rm", "-f", executor_name], | ||
| capture_output=True, | ||
| timeout=10, | ||
| ) | ||
| except Exception: | ||
| pass |
There was a problem hiding this comment.
Log failed cleanup of exited validation containers.
docker rm -f is invoked without checking the return code, and the except block suppresses every failure. A cleanup regression here will silently leave stale validation containers behind.
🧰 Tools
🪛 Ruff (0.15.7)
[error] 776-777: try-except-pass detected, consider logging the exception
(S110)
[warning] 776-776: Do not catch blind exception: Exception
(BLE001)
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.
In `@executor_manager/executors/docker/executor.py` around lines 770 - 777, The
cleanup call to self.subprocess.run(["docker", "rm", "-f", executor_name], ...)
currently swallows all failures; change the logic in the cleanup routine (where
the subprocess.run for docker rm -f is invoked) to capture the CompletedProcess
result or catch the exception and log an error including executor_name and the
stdout/stderr/exception details, and ensure non-zero return codes are treated as
failures (log and/or re-raise as appropriate) instead of being silently ignored.
| async def _run_validation_task_in_background( | ||
| validation_task: Dict[str, Any], validation_task_id: int, image: str | ||
| ) -> None: | ||
| """Run validation task submission in background to avoid blocking HTTP handlers.""" | ||
| try: | ||
| await asyncio.to_thread(task_processor.process_tasks, [validation_task]) | ||
| logger.info( | ||
| f"Validation task submitted: task_id={validation_task_id}, image={image}" | ||
| ) | ||
| except Exception as e: | ||
| # Clean up registry entry if background submission fails. | ||
| _validation_task_registry.pop(validation_task_id, None) | ||
| logger.error(f"Failed to submit validation task for {image}: {e}") | ||
|
|
There was a problem hiding this comment.
🧩 Analysis chain
🏁 Script executed:
# Check the file structure and examine the specific lines mentioned
cd /repo || exit 1
find . -name "routers.py" -path "*/executor_manager/*" -type f | head -5Repository: wecode-ai/Wegent
Length of output: 115
🏁 Script executed:
# Find and read the relevant file
find . -name "routers.py" -path "*executor_manager*routers*" -type fRepository: wecode-ai/Wegent
Length of output: 97
🏁 Script executed:
# Get file size and content around the specified lines
file_path=$(find . -name "routers.py" -path "*executor_manager*routers*" -type f | head -1)
if [ -n "$file_path" ]; then
echo "File: $file_path"
wc -l "$file_path"
echo "=== Lines 836-849 ==="
sed -n '836,849p' "$file_path"
echo "=== Lines 907-917 ==="
sed -n '907,917p' "$file_path"
echo "=== Lines 953-965 ==="
sed -n '953,965p' "$file_path"
fiRepository: wecode-ai/Wegent
Length of output: 1935
🏁 Script executed:
# Search for validation status updates and Redis interactions
rg "validation.*status|update.*status" ./executor_manager/routers/routers.py -A 3Repository: wecode-ai/Wegent
Length of output: 2041
🏁 Script executed:
# Look for _validation_task_registry usage
rg "_validation_task_registry" ./executor_manager/routers/routers.py -B 2 -A 2Repository: wecode-ai/Wegent
Length of output: 1680
🏁 Script executed:
# Find the callback endpoint handler
rg "executor-manager/callback|callback.*endpoint" ./executor_manager/routers/routers.py -A 10Repository: wecode-ai/Wegent
Length of output: 1226
🏁 Script executed:
# Search for Redis or status update operations related to validation
rg "redis.*validation|validation.*redis" ./executor_manager/routers/routers.py -B 2 -A 5Repository: wecode-ai/Wegent
Length of output: 42
🏁 Script executed:
# Find where validation status is initially created in Redis
rg "validation.*=.*submitted|status.*=.*submitted" ./executor_manager/routers/routers.py -B 3 -A 3Repository: wecode-ai/Wegent
Length of output: 42
🏁 Script executed:
# Look for any other places where validation status is updated outside the callback path
rg "update.*validation.*status|validation.*status.*update" ./executor_manager/routers/routers.py -B 2 -A 4Repository: wecode-ai/Wegent
Length of output: 1427
🏁 Script executed:
# Check if there's any mechanism to report failed validation outside of callback
rg "failed.*validation|validation.*failed" ./executor_manager/routers/routers.py -B 2 -A 2Repository: wecode-ai/Wegent
Length of output: 42
🏁 Script executed:
# Look for where validation status is first created when task is registered
rg "validation.*status|create.*validation" ./executor_manager/routers/routers.py -B 5 -A 5 | head -60Repository: wecode-ai/Wegent
Length of output: 2243
🏁 Script executed:
# Check the entire function that contains the registry population to see initial status
sed -n '890,975p' ./executor_manager/routers/routers.pyRepository: wecode-ai/Wegent
Length of output: 3483
Report failed validation when background submission fails.
If process_tasks() raises an exception, the registry entry is deleted immediately and only an error is logged. This leaves the backend validation status stuck at "submitted" since _update_validation_status_from_callback() is the only mechanism that updates Redis to a terminal state. Before deleting the registry entry, issue a failed validation status update (status: failed, valid: false) or keep the entry intact so the callback handler can report completion if the task was queued despite the exception.
Also applies to: 963-965
Additional concerns:
- Lines 907-917: The callback URL construction using
rsplit(":", 1)will break IPv6 addresses (e.g.,[::1]becomes[::after stripping the last segment). Use proper URL parsing. - Lines 953-959: Module-level registry
_validation_task_registryis process-local and breaks when request and callback land on different workers/replicas. Use shared storage (Redis/database) for validation correlation.
🧰 Tools
🪛 Ruff (0.15.7)
[warning] 845-845: Do not catch blind exception: Exception
(BLE001)
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.
In `@executor_manager/routers/routers.py` around lines 836 - 849, When
process_tasks() fails in _run_validation_task_in_background the code currently
pops _validation_task_registry and logs an error, leaving Redis stuck in
"submitted"; change the except block to first write a terminal failed validation
status (use the existing _update_validation_status_from_callback or explicitly
set status: "failed", valid: false in Redis) before removing the registry entry,
and apply the same change to the other identical error-handling block referenced
in the review. Also address the other review notes: stop building callback URLs
with rsplit(":", 1) (use urllib.parse / yarl or proper URL/host handling to
preserve IPv6 addresses) and replace the process-local _validation_task_registry
with shared storage (Redis or DB) so request and callback correlation survives
across workers/replicas.
There was a problem hiding this comment.
Actionable comments posted: 1
♻️ Duplicate comments (1)
executor_manager/routers/routers.py (1)
837-850:⚠️ Potential issue | 🟠 MajorFailed background submission leaves Redis validation status stuck at "submitted".
If
process_tasks()raises an exception, the registry entry is deleted but Redis validation status (initialized by the backend at "submitted") is never updated to a terminal state. Frontend polling will wait indefinitely.Before removing the registry entry, call the backend's validation-status endpoint to report failure:
🐛 Proposed fix
async def _run_validation_task_in_background( validation_task: Dict[str, Any], validation_task_id: int, image: str ) -> None: """Run validation task submission in background to avoid blocking HTTP handlers.""" try: await asyncio.to_thread(task_processor.process_tasks, [validation_task]) logger.info( f"Validation task submitted: task_id={validation_task_id}, image={image}" ) except Exception as e: - # Clean up registry entry if background submission fails. - _validation_task_registry.pop(validation_task_id, None) + # Clean up registry entry and report failure to backend. + validation_meta = _validation_task_registry.pop(validation_task_id, None) + if validation_meta and validation_meta.get("validation_id"): + try: + task_api_domain = os.getenv("TASK_API_DOMAIN", "http://localhost:8000") + update_url = ( + f"{task_api_domain}/api/shells/validation-status/" + f"{validation_meta['validation_id']}" + ) + async with traced_async_client(timeout=10.0) as client: + await client.post(update_url, json={ + "status": "completed", + "stage": "Submission failed", + "progress": 100, + "valid": False, + "errorMessage": f"Failed to submit validation task: {e}", + }) + except Exception as update_err: + logger.error(f"Failed to report validation failure: {update_err}") logger.error(f"Failed to submit validation task for {image}: {e}")🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@executor_manager/routers/routers.py` around lines 837 - 850, On exception in _run_validation_task_in_background, before popping _validation_task_registry, call the backend validation-status endpoint to mark the validation as terminal/failed (include validation_task_id and error details) so frontend polling stops; implement this by invoking the backend client/HTTP call from the exception handler (around task_processor.process_tasks), catch and log any errors from that backend call via logger.error, then finally remove the registry entry with _validation_task_registry.pop(validation_task_id, None) to ensure cleanup even if the status update fails.
🧹 Nitpick comments (1)
executor_manager/routers/routers.py (1)
964-967: Store the task reference to prevent potential garbage collection.Fire-and-forget
asyncio.create_task()without storing the reference can lead to the task being garbage-collected before completion in edge cases, and any unhandled exceptions are silently lost.♻️ Proposed fix
# Submit in background to keep this endpoint responsive. - asyncio.create_task( + # Store reference to prevent GC and enable exception logging + background_task = asyncio.create_task( _run_validation_task_in_background(validation_task, validation_task_id, image) ) + background_task.add_done_callback( + lambda t: t.exception() if not t.cancelled() and t.exception() else None + )🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed. In `@executor_manager/routers/routers.py` around lines 964 - 967, The fire-and-forget call to asyncio.create_task(...) that starts _run_validation_task_in_background(validation_task, validation_task_id, image) should keep a reference to the created Task to avoid GC and lost exceptions; change the call to store the returned Task (e.g., assign to a local variable or add it to a module-level set/list like background_tasks) and attach error handling (either wrap _run_validation_task_in_background with try/except or add a done callback that logs exceptions) so validation_task_id/image are available for context when logging failures.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Inline comments:
In `@executor_manager/routers/routers.py`:
- Around line 906-919: The current callback URL reconstruction (using
callback_host, callback_port, urlparse, callback_scheme, callback_hostname and
callback_effective_port) breaks for IPv6 literals because urlparse().hostname
strips the surrounding brackets; update the logic that builds callback_url to
detect when callback_hostname is an IPv6 address (contains ':'), wrap it in
square brackets when constructing the host portion, and then assemble the final
URL with callback_scheme and callback_effective_port; ensure values coming from
get_host_ip() or env CALLBACK_HOST are handled similarly so IPv6 addresses
become http://[::1]:8001/... instead of http://::1:8001/....
---
Duplicate comments:
In `@executor_manager/routers/routers.py`:
- Around line 837-850: On exception in _run_validation_task_in_background,
before popping _validation_task_registry, call the backend validation-status
endpoint to mark the validation as terminal/failed (include validation_task_id
and error details) so frontend polling stops; implement this by invoking the
backend client/HTTP call from the exception handler (around
task_processor.process_tasks), catch and log any errors from that backend call
via logger.error, then finally remove the registry entry with
_validation_task_registry.pop(validation_task_id, None) to ensure cleanup even
if the status update fails.
---
Nitpick comments:
In `@executor_manager/routers/routers.py`:
- Around line 964-967: The fire-and-forget call to asyncio.create_task(...) that
starts _run_validation_task_in_background(validation_task, validation_task_id,
image) should keep a reference to the created Task to avoid GC and lost
exceptions; change the call to store the returned Task (e.g., assign to a local
variable or add it to a module-level set/list like background_tasks) and attach
error handling (either wrap _run_validation_task_in_background with try/except
or add a done callback that logs exceptions) so validation_task_id/image are
available for context when logging failures.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: defaults
Review profile: CHILL
Plan: Pro
Run ID: 8dfb0f2e-5b32-499c-98c0-1722f9bff196
📒 Files selected for processing (4)
backend/app/services/execution/request_builder.pybackend/tests/services/execution/test_request_builder_user_mcp.pyexecutor_manager/routers/routers.pyexecutor_manager/tests/routers/test_validate_image.py
🚧 Files skipped from review as they are similar to previous changes (1)
- executor_manager/tests/routers/test_validate_image.py
| # Build validation task in OpenAI Responses API format (same as normal code tasks) | ||
| # Build callback URL from environment variables | ||
| callback_host = os.getenv("CALLBACK_HOST", get_host_ip()) | ||
| callback_port = os.getenv("CALLBACK_PORT", "8001") | ||
| parsed = urlparse( | ||
| callback_host if "://" in callback_host else f"http://{callback_host}" | ||
| ) | ||
| callback_scheme = parsed.scheme or "http" | ||
| callback_hostname = parsed.hostname or callback_host | ||
| callback_effective_port = parsed.port or callback_port | ||
| callback_url = ( | ||
| f"{callback_scheme}://{callback_hostname}:{callback_effective_port}" | ||
| f"/executor-manager/callback" | ||
| ) |
There was a problem hiding this comment.
IPv6 addresses produce malformed URLs.
urlparse().hostname strips brackets from IPv6 literals (e.g., [::1] → ::1), but the reconstruction doesn't add them back. This produces invalid URLs like http://::1:8001 instead of http://[::1]:8001.
🐛 Proposed fix to bracket IPv6 addresses
callback_host = os.getenv("CALLBACK_HOST", get_host_ip())
callback_port = os.getenv("CALLBACK_PORT", "8001")
parsed = urlparse(
callback_host if "://" in callback_host else f"http://{callback_host}"
)
callback_scheme = parsed.scheme or "http"
callback_hostname = parsed.hostname or callback_host
callback_effective_port = parsed.port or callback_port
+ # Bracket IPv6 addresses for valid URL format
+ if ":" in callback_hostname:
+ callback_hostname = f"[{callback_hostname}]"
callback_url = (
f"{callback_scheme}://{callback_hostname}:{callback_effective_port}"
f"/executor-manager/callback"
)🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.
In `@executor_manager/routers/routers.py` around lines 906 - 919, The current
callback URL reconstruction (using callback_host, callback_port, urlparse,
callback_scheme, callback_hostname and callback_effective_port) breaks for IPv6
literals because urlparse().hostname strips the surrounding brackets; update the
logic that builds callback_url to detect when callback_hostname is an IPv6
address (contains ':'), wrap it in square brackets when constructing the host
portion, and then assemble the final URL with callback_scheme and
callback_effective_port; ensure values coming from get_host_ip() or env
CALLBACK_HOST are handled similarly so IPv6 addresses become
http://[::1]:8001/... instead of http://::1:8001/....
* docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复无法使用自定义镜像 * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 * fix: 修复可能的bug --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com>
* docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复无法使用自定义镜像 * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 * fix: 修复可能的bug --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com>
* feat: add workspace archive and recovery for Pod deletion Implement Pod recovery feature that allows users to continue conversations after executor Pods are deleted: - Add ArchiveInfo schema to store archive metadata in Task.status.archive - Add workspace_archive service for MinIO presigned URL generation - Add archive/restore endpoints in executor and executor_manager - Add ExecutorRecoveryService for Pod recreation with workspace restoration - Add skip_git_clone support to prevent git clone conflicts during restore - Add Celery Beat scheduled task for expired archive cleanup (30-day retention) - Integrate archive workflow in executor_job before Pod deletion Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * fix(backend): add missing minio dependency Add minio package to backend dependencies for workspace archive storage. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * feat(admin): add created_at field to device monitor list (#846) - Add created_at field to AdminDeviceInfo schema in backend - Add created_at to AdminDeviceInfo TypeScript interface - Display creation time in device list UI - Add i18n translations for created_at column (zh-CN and en) Co-authored-by: yunpeng7 <yunpeng7@staff.weibo.com> Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com> * perf: use async heartbeat (#849) * fix(chat_shell): prevent orphaned tool call IDs in group chat history (#852) * fix(chat_shell): prevent tool call group splitting in group chat history truncation _truncate_history blindly sliced the flat message list, which could split assistant+tool_calls and their tool response messages across the truncation boundary. This produced orphaned function_call_output items without matching function_call entries in the OpenAI Responses API format, causing 'No tool call found for function call output' errors. Add _group_messages() to treat assistant+tool_calls+tool responses as atomic units, and modify _truncate_history() to truncate by groups instead of individual messages. * fix(chat_shell): ensure tool call group integrity across all compression paths Extract group_tool_call_messages() into shared messages/utils.py and apply atomic group handling to: - HistoryTruncationStrategy.compress(): adjust first/last boundaries to avoid splitting tool call groups, add post-removal orphan cleanup - _force_compression_to_target(): Step 2 removes middle groups instead of individual messages, Step 5 keeps first/last groups - Refactor loader.py to import shared utility instead of inline helper All 95 related tests pass. Comprehensive audit confirms no other code paths in chat_shell break tool call group integrity. * test(chat_shell): add tool-call group truncation regressions Add regression coverage for preserving assistant tool calls with their matching tool results across group-chat history truncation, history compression boundaries, and forced compression fallback paths. * fix: 在里面智能体的创建人和机器人的创建人不是一个人时会报错 (#853) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 在里面智能体的创建人和机器人的创建人不是一个人时会报错 * fix: 迁移其他的sql到kindReader --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fail fast on invalid tool call IDs across chat protocols (#854) * fix: 订阅任务执行间隔调整 & trace http接口的匹配规则调整 (#855) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: telemetry的匹配规则调整 * fix: 订阅任务执行间隔调整 * fix: 调整逻辑 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: sanitize PyInstaller LD_LIBRARY_PATH for child processes (#859) PyInstaller's bootloader prepends its extraction directory (/tmp/_MEIxxxxxx) to LD_LIBRARY_PATH, causing child processes (Claude Code, shell commands) to load wrong shared libraries (e.g., libtinfo.so.6). Extract `sanitize_ld_library_path()` into platform_compat and apply it in both local_mode_strategy (Claude SDK subprocess) and extension_handler (extension script subprocess) to restore the original library path. See: https://pyinstaller.org/en/stable/common-issues-and-pitfalls.html Co-authored-by: sifang <sifang@staff.weibo.com> * refactor(rag): move internal retrieve routing into backend (#847) * refactor(rag): move internal retrieve routing into backend * refactor(rag): move retrieve persistence into backend * refactor(rag): move kb head persistence into backend * fix(rag): tighten backend retrieve routing * refactor(rag): simplify token estimation fallback * refactor(rag): batch route token estimation * fix(rag): token estimator decimal * fix(rag): harden kb read persistence * frontend: show 'indexing' status for documents pending indexing (#858) * fix(frontend): show 'indexing' status for documents pending indexing When a document is uploaded, is_active is false while indexing is in progress. Previously, this showed 'index unavailable' which was misleading. Now documents with status='enabled' but is_active=false will show 'indexing' instead of 'index unavailable', matching the existing translation key. Changes: - Updated compact mode status indicator (line 247) - Updated normal mode status badge (line 461) Fixes: knowledge base document shows 'index unavailable' during indexing * fix(i18n): update Developer role description in Chinese locale * fix: 修复订阅器中脏数据导致的无法展示的问题 (#860) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复订阅器中脏数据导致的无法展示的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * feat(backend): add knowledge base RAG support to /v1/responses API (#844) * feat(backend): add knowledge base RAG support to /v1/responses API Implement knowledge base Q&A functionality for the OpenAI-compatible /v1/responses endpoint with the following changes: Schema Changes: - Add knowledge_base_names field to WegentTool schema - Support namespace#name format for KB specification New Services: - KnowledgeBaseNameResolver: resolves KB display names to IDs with permission checking via TaskKnowledgeBaseService - KnowledgeBaseContextCreator: creates SubtaskContext records for API-specified KBs to integrate with existing RAG pipeline Integration: - Extend parse_wegent_tools() to handle knowledge_base tool type - Add parse_knowledge_base_name() for namespace#name parsing - Modify build_execution_request() to accept knowledge_base_names - Add _create_kb_contexts_from_api_request() for KB context injection - Update openapi_responses.py endpoints to pass KB names parameter Testing: - Add comprehensive unit tests for KB name resolution - Add tests for KB context creation - Add tests for helper functions with KB support - All 32 new tests passing The implementation reuses the existing RAG flow through prepare_contexts_for_chat() and KnowledgeBaseTool, ensuring consistency with the web UI behavior. * refactor(kb_resolver): optimize database query complexity from O(n) to O(m) - Add batch_get_knowledge_base_by_names() to TaskKnowledgeBaseService for efficient batch queries - Extract _check_kb_access_permission() for unified permission checking logic - Update kb_resolver to use service methods instead of direct queries - Reduce DB queries from O(n) to O(m) where m is unique namespace count - Update tests to mock service methods instead of internal functions All 15 tests pass. * refactor(backend): optimize KB permission check in kb_resolver Simplify permission checking by using get_all_knowledge_bases_grouped() which already returns all KBs accessible to the user. Changes: - Replace _batch_query_kbs() and _check_kb_access_permission() with _get_accessible_kb_lookup() that builds a lookup dict from grouped results - Remove unused resolve_single() method and batch_get_knowledge_base_by_names() - Update tests to mock KnowledgeService.get_all_knowledge_bases_grouped() This reduces database queries and simplifies the permission check logic. * feat(backend): integrate knowledge base context creation into unified AI trigger - Add knowledge_base_names parameter to build_execution_request for OpenAPI v1/responses - Create _create_kb_contexts_from_api_request helper to process KB names from API requests - Integrate KB context processing into unified trigger flow - Add KnowledgeBaseContextCreator class for creating SubtaskContext records - Add comprehensive unit tests for KnowledgeBaseContextCreator This enables RAG functionality for OpenAPI v1/responses endpoint by creating SubtaskContext records that are processed by the existing context pipeline. * fix(chat): propagate HTTPException from KnowledgeBaseNameResolver in unified trigger - Add HTTPException import from fastapi - Catch and re-raise HTTPException explicitly in _create_kb_contexts_from_api_request - Keep generic exception handling for non-HTTP exceptions to preserve best-effort behavior - This ensures 403/404 errors from KB resolution are properly propagated to callers instead of being swallowed and logged as warnings * fix(chat_shell): use model_type for provider detection instead of model_id (#861) - Extract shared detect_provider() into models/providers.py with PROVIDER_ALIASES as single source of truth - model_type (env.model) is authoritative; raise ValueError on unknown - Remove _PROVIDER_ID_PATTERNS model_id prefix fallback (same model_id can serve multiple protocols) - Unify truncation notice logic for all providers (no system-role notice in middle of messages, preventing Anthropic non-consecutive system message errors) - Pass model_type from model_config through MessageCompressor to TokenCounter for accurate provider detection - Remove duplicate provider constants from factory.py and token_counter.py Co-authored-by: wenbo17 <wenbo17@staff.weibo.com> * ix: claude的子代理模式不可用修复 (#862) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: claude的子代理模式不可用修复 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * feat(inbox): implement work queue and message forwarding system (#851) * feat(inbox): implement work queue and message forwarding system Add a comprehensive message forwarding and work queue system that enables users to forward conversation messages to other users. Recipients can manage received messages through work queues and optionally configure AI agents for automatic processing. Backend changes: - Add QueueMessage and RecentContact database models - Add WorkQueue CRD schema stored in kinds table - Implement work queue services for CRUD operations - Implement message forwarding service with queue selection - Add WebSocket events for real-time notifications - Add API endpoints for work queue management - Add ForbiddenException to core exceptions Frontend changes: - Add inbox page with queue sidebar and message list - Implement ForwardMessageDialog for recipient selection - Add queue edit/create dialog with auto-processing config - Add message detail dialog with content preview - Add i18n translations (zh-CN and en) - Register inbox route and navigation * fix: resolve lint errors in inbox feature - Remove unused imports (RefreshCw, Settings, Menu, Button, Input, Clock) - Format Python files with Black * fix: resolve TypeScript errors in inbox feature - Add 'flow' and 'inbox' to TopNavigation activePage type - Replace Badge variant 'outline' with 'info' (outline not supported) * fix: address CodeRabbit review comments for work queue feature - Fix status parameter shadowing fastapi status module in work_queue.py - Fix NamespaceMember.namespace to use group_name column reference - Replace func.json_set with Python-level update for PostgreSQL compatibility - Fix refreshQueues dependency loop using functional state update - Remove Chinese text from inbox page comment - Add NaN validation for schedule interval input - Replace clickable Badge with accessible button for recent contacts --------- Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> * Wegent/work queue and message forwarding (#863) * feat(inbox): implement work queue and message forwarding system Add a comprehensive message forwarding and work queue system that enables users to forward conversation messages to other users. Recipients can manage received messages through work queues and optionally configure AI agents for automatic processing. Backend changes: - Add QueueMessage and RecentContact database models - Add WorkQueue CRD schema stored in kinds table - Implement work queue services for CRUD operations - Implement message forwarding service with queue selection - Add WebSocket events for real-time notifications - Add API endpoints for work queue management - Add ForbiddenException to core exceptions Frontend changes: - Add inbox page with queue sidebar and message list - Implement ForwardMessageDialog for recipient selection - Add queue edit/create dialog with auto-processing config - Add message detail dialog with content preview - Add i18n translations (zh-CN and en) - Register inbox route and navigation * fix: resolve lint errors in inbox feature - Remove unused imports (RefreshCw, Settings, Menu, Button, Input, Clock) - Format Python files with Black * fix: resolve TypeScript errors in inbox feature - Add 'flow' and 'inbox' to TopNavigation activePage type - Replace Badge variant 'outline' with 'info' (outline not supported) * fix: address CodeRabbit review comments for work queue feature - Fix status parameter shadowing fastapi status module in work_queue.py - Fix NamespaceMember.namespace to use group_name column reference - Replace func.json_set with Python-level update for PostgreSQL compatibility - Fix refreshQueues dependency loop using functional state update - Remove Chinese text from inbox page comment - Add NaN validation for schedule interval input - Replace clickable Badge with accessible button for recent contacts * feat: update work queue --------- Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> * fix: fix column default value * fix: fix forward message click * feat: remove unused area * feat: add inbox default message * fix: 修复脏数据导致的订阅任务无法执行的问题 (#865) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复脏数据导致的订阅任务无法执行的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix(browser): harden browser-tool linux recovery (#867) Co-authored-by: sifang <sifang@staff.weibo.com> * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 (#866) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复无法使用自定义镜像 * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 * fix: 修复可能的bug --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fix welcome timezone (#868) * docs: update inbox docs (#869) * fix: 修复单测 (#870) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复单测 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fix page error (#871) * fix: data-roleid="api-key-create-button" not in html attr (#873) * fix: 修复停止按钮偶发变成发送的问题 & 修复失败的消息会丢失的问题 (#876) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复停止按钮偶发变成发送的问题 * fix: 修复失败的消息会丢失的问题 * fix: 修复类型报错 * fix: 修复前端复制按钮内容错误的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: 修复“skill not found” (#877) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 技能错乱 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * chore(executor): upgrade claude-agent-sdk from 0.1.31 to 0.1.51 (#880) Co-authored-by: sifang <sifang@staff.weibo.com> * feat(frontend): add HTML attachment preview and share link generation (#872) - Add HtmlPreview component for previewing HTML files with iframe and source view modes - Update FilePreview to support HTML file type detection and rendering - Add createAttachmentShareLink API for generating public share links - Add share button to FilePreviewDialog and FilePreviewPage (visible for owners only) - Add Web Page type label and icon for HTML attachments in AttachmentCard - Fix preview page height to fill viewport using h-screen and h-full - Update AttachmentPreview to support HTML file preview button Fixes share link browsing and download for table-type attachments * fix(knowledge): harden document indexing state (#875) * fix(knowledge): harden document indexing state * fix(knowledge): harden indexing state transitions * fix(knowledge): tighten reindex review followups * fix(rag): KNOWLEDGE_INDEX_LOCK_MAX_RETRIES=1 * fix(knowledge): store index status without db enum * fix(alembic): correct migration revision metadata * docs: update contributors list (zh) (#879) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * docs: update contributors list (#878) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * feat: 支持skill认证 (#882) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * docs: add skill http identity design and plan * feat(skill): add http identity token flow * feat: 修改样式 * feat: 修改样式 * feat: 移除计划 * feat: 调整为带有认证的接口 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> # Conflicts: # executor_manager/services/sandbox/manager.py * Feature/knowledge document read (#888) * docs(backend): add knowledge document read spec and plan * feat(backend): add orchestrated knowledge document reads * fix(backend): tighten knowledge document read handling * refactor(web-scraper): add configuration for specific sites that require special handling (#884) * refactor(web-scraper): extract site-specific config to scraper_config.py - Add scraper_config.py for site-specific crawling configurations * fix(web_scraper): load WEB_SCRAPER_SITE_CONFIG from Pydantic settings instead of os.environ - Add WEB_SCRAPER_SITE_CONFIG to Settings class in config.py - Refactor scraper_config.py to use settings.WEB_SCRAPER_SITE_CONFIG with proper logging - Replace module-level config loading with cached get_site_config() function - Update scraper_service.py to use new get_site_config() function - Add detailed logging for site config matching and application - Fix remove_overlay_elements duplicate key in CrawlerRunConfig This ensures the configuration is properly loaded from .env file via Pydantic settings." * refactor(backend): improve scraper_config security and type safety - Remove sensitive config value from INFO level logging - Add return type annotations to _load_site_config and get_site_config - Replace broad Exception catch with specific exception types (AttributeError, KeyError, TypeError, ValueError) - Import Dict and Any from typing module * refactor(backend): replace auto-cleanup with archive expiration check Remove automatic MinIO archive cleanup (Celery Beat task) and instead block task execution when workspace archive has expired (>30 days). Users will receive a clear error message and must create a new task. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: 添加恢复行为测试和脚本路径修正 * fix: 使用 timezone.utc 替换 UTC 以确保时区正确 * test(backend): fix workspace recovery test patches --------- Co-authored-by: yunpeng7 <yunpeng7@staff.weibo.com> Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com> Co-authored-by: axb <qindi@staff.weibo.com> Co-authored-by: moqimoqidea <39821951+moqimoqidea@users.noreply.github.com> Co-authored-by: MicroLee <yudexiaozhou@gmail.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> Co-authored-by: icycrystal4 <icycrystal4@gmail.com> Co-authored-by: sifang <sifang@staff.weibo.com> Co-authored-by: Yanhe <yanhe1@staff.weibo.com> Co-authored-by: parabala <chenyong1@staff.weibo.com> Co-authored-by: wenbo17 <wenbo17@staff.weibo.com> Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> Co-authored-by: 李枨煊 <chengxuan@staff.weibo.com> Co-authored-by: johnny0120 <jiangyang7@staff.weibo.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* feat: add workspace archive and recovery for Pod deletion Implement Pod recovery feature that allows users to continue conversations after executor Pods are deleted: - Add ArchiveInfo schema to store archive metadata in Task.status.archive - Add workspace_archive service for MinIO presigned URL generation - Add archive/restore endpoints in executor and executor_manager - Add ExecutorRecoveryService for Pod recreation with workspace restoration - Add skip_git_clone support to prevent git clone conflicts during restore - Add Celery Beat scheduled task for expired archive cleanup (30-day retention) - Integrate archive workflow in executor_job before Pod deletion Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * fix(backend): add missing minio dependency Add minio package to backend dependencies for workspace archive storage. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> * feat(admin): add created_at field to device monitor list (#846) - Add created_at field to AdminDeviceInfo schema in backend - Add created_at to AdminDeviceInfo TypeScript interface - Display creation time in device list UI - Add i18n translations for created_at column (zh-CN and en) Co-authored-by: yunpeng7 <yunpeng7@staff.weibo.com> Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com> * perf: use async heartbeat (#849) * fix(chat_shell): prevent orphaned tool call IDs in group chat history (#852) * fix(chat_shell): prevent tool call group splitting in group chat history truncation _truncate_history blindly sliced the flat message list, which could split assistant+tool_calls and their tool response messages across the truncation boundary. This produced orphaned function_call_output items without matching function_call entries in the OpenAI Responses API format, causing 'No tool call found for function call output' errors. Add _group_messages() to treat assistant+tool_calls+tool responses as atomic units, and modify _truncate_history() to truncate by groups instead of individual messages. * fix(chat_shell): ensure tool call group integrity across all compression paths Extract group_tool_call_messages() into shared messages/utils.py and apply atomic group handling to: - HistoryTruncationStrategy.compress(): adjust first/last boundaries to avoid splitting tool call groups, add post-removal orphan cleanup - _force_compression_to_target(): Step 2 removes middle groups instead of individual messages, Step 5 keeps first/last groups - Refactor loader.py to import shared utility instead of inline helper All 95 related tests pass. Comprehensive audit confirms no other code paths in chat_shell break tool call group integrity. * test(chat_shell): add tool-call group truncation regressions Add regression coverage for preserving assistant tool calls with their matching tool results across group-chat history truncation, history compression boundaries, and forced compression fallback paths. * fix: 在里面智能体的创建人和机器人的创建人不是一个人时会报错 (#853) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 在里面智能体的创建人和机器人的创建人不是一个人时会报错 * fix: 迁移其他的sql到kindReader --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fail fast on invalid tool call IDs across chat protocols (#854) * fix: 订阅任务执行间隔调整 & trace http接口的匹配规则调整 (#855) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: telemetry的匹配规则调整 * fix: 订阅任务执行间隔调整 * fix: 调整逻辑 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: sanitize PyInstaller LD_LIBRARY_PATH for child processes (#859) PyInstaller's bootloader prepends its extraction directory (/tmp/_MEIxxxxxx) to LD_LIBRARY_PATH, causing child processes (Claude Code, shell commands) to load wrong shared libraries (e.g., libtinfo.so.6). Extract `sanitize_ld_library_path()` into platform_compat and apply it in both local_mode_strategy (Claude SDK subprocess) and extension_handler (extension script subprocess) to restore the original library path. See: https://pyinstaller.org/en/stable/common-issues-and-pitfalls.html Co-authored-by: sifang <sifang@staff.weibo.com> * refactor(rag): move internal retrieve routing into backend (#847) * refactor(rag): move internal retrieve routing into backend * refactor(rag): move retrieve persistence into backend * refactor(rag): move kb head persistence into backend * fix(rag): tighten backend retrieve routing * refactor(rag): simplify token estimation fallback * refactor(rag): batch route token estimation * fix(rag): token estimator decimal * fix(rag): harden kb read persistence * frontend: show 'indexing' status for documents pending indexing (#858) * fix(frontend): show 'indexing' status for documents pending indexing When a document is uploaded, is_active is false while indexing is in progress. Previously, this showed 'index unavailable' which was misleading. Now documents with status='enabled' but is_active=false will show 'indexing' instead of 'index unavailable', matching the existing translation key. Changes: - Updated compact mode status indicator (line 247) - Updated normal mode status badge (line 461) Fixes: knowledge base document shows 'index unavailable' during indexing * fix(i18n): update Developer role description in Chinese locale * fix: 修复订阅器中脏数据导致的无法展示的问题 (#860) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复订阅器中脏数据导致的无法展示的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * feat(backend): add knowledge base RAG support to /v1/responses API (#844) * feat(backend): add knowledge base RAG support to /v1/responses API Implement knowledge base Q&A functionality for the OpenAI-compatible /v1/responses endpoint with the following changes: Schema Changes: - Add knowledge_base_names field to WegentTool schema - Support namespace#name format for KB specification New Services: - KnowledgeBaseNameResolver: resolves KB display names to IDs with permission checking via TaskKnowledgeBaseService - KnowledgeBaseContextCreator: creates SubtaskContext records for API-specified KBs to integrate with existing RAG pipeline Integration: - Extend parse_wegent_tools() to handle knowledge_base tool type - Add parse_knowledge_base_name() for namespace#name parsing - Modify build_execution_request() to accept knowledge_base_names - Add _create_kb_contexts_from_api_request() for KB context injection - Update openapi_responses.py endpoints to pass KB names parameter Testing: - Add comprehensive unit tests for KB name resolution - Add tests for KB context creation - Add tests for helper functions with KB support - All 32 new tests passing The implementation reuses the existing RAG flow through prepare_contexts_for_chat() and KnowledgeBaseTool, ensuring consistency with the web UI behavior. * refactor(kb_resolver): optimize database query complexity from O(n) to O(m) - Add batch_get_knowledge_base_by_names() to TaskKnowledgeBaseService for efficient batch queries - Extract _check_kb_access_permission() for unified permission checking logic - Update kb_resolver to use service methods instead of direct queries - Reduce DB queries from O(n) to O(m) where m is unique namespace count - Update tests to mock service methods instead of internal functions All 15 tests pass. * refactor(backend): optimize KB permission check in kb_resolver Simplify permission checking by using get_all_knowledge_bases_grouped() which already returns all KBs accessible to the user. Changes: - Replace _batch_query_kbs() and _check_kb_access_permission() with _get_accessible_kb_lookup() that builds a lookup dict from grouped results - Remove unused resolve_single() method and batch_get_knowledge_base_by_names() - Update tests to mock KnowledgeService.get_all_knowledge_bases_grouped() This reduces database queries and simplifies the permission check logic. * feat(backend): integrate knowledge base context creation into unified AI trigger - Add knowledge_base_names parameter to build_execution_request for OpenAPI v1/responses - Create _create_kb_contexts_from_api_request helper to process KB names from API requests - Integrate KB context processing into unified trigger flow - Add KnowledgeBaseContextCreator class for creating SubtaskContext records - Add comprehensive unit tests for KnowledgeBaseContextCreator This enables RAG functionality for OpenAPI v1/responses endpoint by creating SubtaskContext records that are processed by the existing context pipeline. * fix(chat): propagate HTTPException from KnowledgeBaseNameResolver in unified trigger - Add HTTPException import from fastapi - Catch and re-raise HTTPException explicitly in _create_kb_contexts_from_api_request - Keep generic exception handling for non-HTTP exceptions to preserve best-effort behavior - This ensures 403/404 errors from KB resolution are properly propagated to callers instead of being swallowed and logged as warnings * fix(chat_shell): use model_type for provider detection instead of model_id (#861) - Extract shared detect_provider() into models/providers.py with PROVIDER_ALIASES as single source of truth - model_type (env.model) is authoritative; raise ValueError on unknown - Remove _PROVIDER_ID_PATTERNS model_id prefix fallback (same model_id can serve multiple protocols) - Unify truncation notice logic for all providers (no system-role notice in middle of messages, preventing Anthropic non-consecutive system message errors) - Pass model_type from model_config through MessageCompressor to TokenCounter for accurate provider detection - Remove duplicate provider constants from factory.py and token_counter.py Co-authored-by: wenbo17 <wenbo17@staff.weibo.com> * ix: claude的子代理模式不可用修复 (#862) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: claude的子代理模式不可用修复 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * feat(inbox): implement work queue and message forwarding system (#851) * feat(inbox): implement work queue and message forwarding system Add a comprehensive message forwarding and work queue system that enables users to forward conversation messages to other users. Recipients can manage received messages through work queues and optionally configure AI agents for automatic processing. Backend changes: - Add QueueMessage and RecentContact database models - Add WorkQueue CRD schema stored in kinds table - Implement work queue services for CRUD operations - Implement message forwarding service with queue selection - Add WebSocket events for real-time notifications - Add API endpoints for work queue management - Add ForbiddenException to core exceptions Frontend changes: - Add inbox page with queue sidebar and message list - Implement ForwardMessageDialog for recipient selection - Add queue edit/create dialog with auto-processing config - Add message detail dialog with content preview - Add i18n translations (zh-CN and en) - Register inbox route and navigation * fix: resolve lint errors in inbox feature - Remove unused imports (RefreshCw, Settings, Menu, Button, Input, Clock) - Format Python files with Black * fix: resolve TypeScript errors in inbox feature - Add 'flow' and 'inbox' to TopNavigation activePage type - Replace Badge variant 'outline' with 'info' (outline not supported) * fix: address CodeRabbit review comments for work queue feature - Fix status parameter shadowing fastapi status module in work_queue.py - Fix NamespaceMember.namespace to use group_name column reference - Replace func.json_set with Python-level update for PostgreSQL compatibility - Fix refreshQueues dependency loop using functional state update - Remove Chinese text from inbox page comment - Add NaN validation for schedule interval input - Replace clickable Badge with accessible button for recent contacts --------- Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> * Wegent/work queue and message forwarding (#863) * feat(inbox): implement work queue and message forwarding system Add a comprehensive message forwarding and work queue system that enables users to forward conversation messages to other users. Recipients can manage received messages through work queues and optionally configure AI agents for automatic processing. Backend changes: - Add QueueMessage and RecentContact database models - Add WorkQueue CRD schema stored in kinds table - Implement work queue services for CRUD operations - Implement message forwarding service with queue selection - Add WebSocket events for real-time notifications - Add API endpoints for work queue management - Add ForbiddenException to core exceptions Frontend changes: - Add inbox page with queue sidebar and message list - Implement ForwardMessageDialog for recipient selection - Add queue edit/create dialog with auto-processing config - Add message detail dialog with content preview - Add i18n translations (zh-CN and en) - Register inbox route and navigation * fix: resolve lint errors in inbox feature - Remove unused imports (RefreshCw, Settings, Menu, Button, Input, Clock) - Format Python files with Black * fix: resolve TypeScript errors in inbox feature - Add 'flow' and 'inbox' to TopNavigation activePage type - Replace Badge variant 'outline' with 'info' (outline not supported) * fix: address CodeRabbit review comments for work queue feature - Fix status parameter shadowing fastapi status module in work_queue.py - Fix NamespaceMember.namespace to use group_name column reference - Replace func.json_set with Python-level update for PostgreSQL compatibility - Fix refreshQueues dependency loop using functional state update - Remove Chinese text from inbox page comment - Add NaN validation for schedule interval input - Replace clickable Badge with accessible button for recent contacts * feat: update work queue --------- Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> * fix: fix column default value * fix: fix forward message click * feat: remove unused area * feat: add inbox default message * fix: 修复脏数据导致的订阅任务无法执行的问题 (#865) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复脏数据导致的订阅任务无法执行的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix(browser): harden browser-tool linux recovery (#867) Co-authored-by: sifang <sifang@staff.weibo.com> * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 (#866) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复无法使用自定义镜像 * fix: 修复无法使用自定义镜像以及自定义镜像无法校验的问题 * fix: 修复可能的bug --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fix welcome timezone (#868) * docs: update inbox docs (#869) * fix: 修复单测 (#870) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复单测 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: fix page error (#871) * fix: data-roleid="api-key-create-button" not in html attr (#873) * fix: 修复停止按钮偶发变成发送的问题 & 修复失败的消息会丢失的问题 (#876) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 修复停止按钮偶发变成发送的问题 * fix: 修复失败的消息会丢失的问题 * fix: 修复类型报错 * fix: 修复前端复制按钮内容错误的问题 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * fix: 修复“skill not found” (#877) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * fix: 技能错乱 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> * chore(executor): upgrade claude-agent-sdk from 0.1.31 to 0.1.51 (#880) Co-authored-by: sifang <sifang@staff.weibo.com> * feat(frontend): add HTML attachment preview and share link generation (#872) - Add HtmlPreview component for previewing HTML files with iframe and source view modes - Update FilePreview to support HTML file type detection and rendering - Add createAttachmentShareLink API for generating public share links - Add share button to FilePreviewDialog and FilePreviewPage (visible for owners only) - Add Web Page type label and icon for HTML attachments in AttachmentCard - Fix preview page height to fill viewport using h-screen and h-full - Update AttachmentPreview to support HTML file preview button Fixes share link browsing and download for table-type attachments * fix(knowledge): harden document indexing state (#875) * fix(knowledge): harden document indexing state * fix(knowledge): harden indexing state transitions * fix(knowledge): tighten reindex review followups * fix(rag): KNOWLEDGE_INDEX_LOCK_MAX_RETRIES=1 * fix(knowledge): store index status without db enum * fix(alembic): correct migration revision metadata * docs: update contributors list (zh) (#879) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * docs: update contributors list (#878) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * feat: 支持skill认证 (#882) * docs: update contributors list * docs: update contributors list (zh) * docs: update contributors list * docs: update contributors list (zh) * docs: add skill http identity design and plan * feat(skill): add http identity token flow * feat: 修改样式 * feat: 修改样式 * feat: 移除计划 * feat: 调整为带有认证的接口 --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> # Conflicts: # executor_manager/services/sandbox/manager.py * Feature/knowledge document read (#888) * docs(backend): add knowledge document read spec and plan * feat(backend): add orchestrated knowledge document reads * fix(backend): tighten knowledge document read handling * refactor(web-scraper): add configuration for specific sites that require special handling (#884) * refactor(web-scraper): extract site-specific config to scraper_config.py - Add scraper_config.py for site-specific crawling configurations * fix(web_scraper): load WEB_SCRAPER_SITE_CONFIG from Pydantic settings instead of os.environ - Add WEB_SCRAPER_SITE_CONFIG to Settings class in config.py - Refactor scraper_config.py to use settings.WEB_SCRAPER_SITE_CONFIG with proper logging - Replace module-level config loading with cached get_site_config() function - Update scraper_service.py to use new get_site_config() function - Add detailed logging for site config matching and application - Fix remove_overlay_elements duplicate key in CrawlerRunConfig This ensures the configuration is properly loaded from .env file via Pydantic settings." * refactor(backend): improve scraper_config security and type safety - Remove sensitive config value from INFO level logging - Add return type annotations to _load_site_config and get_site_config - Replace broad Exception catch with specific exception types (AttributeError, KeyError, TypeError, ValueError) - Import Dict and Any from typing module * refactor(backend): replace auto-cleanup with archive expiration check Remove automatic MinIO archive cleanup (Celery Beat task) and instead block task execution when workspace archive has expired (>30 days). Users will receive a clear error message and must create a new task. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat: 添加恢复行为测试和脚本路径修正 * fix: 使用 timezone.utc 替换 UTC 以确保时区正确 * test(backend): fix workspace recovery test patches * feat: 添加工作区归档配置测试与默认值 * feat: 添加工作区归档时区配置及测试 --------- Co-authored-by: yunpeng7 <yunpeng7@staff.weibo.com> Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com> Co-authored-by: axb <qindi@staff.weibo.com> Co-authored-by: moqimoqidea <39821951+moqimoqidea@users.noreply.github.com> Co-authored-by: MicroLee <yudexiaozhou@gmail.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: hongyu9 <hongyu9@staff.weibo.com> Co-authored-by: icycrystal4 <icycrystal4@gmail.com> Co-authored-by: sifang <sifang@staff.weibo.com> Co-authored-by: Yanhe <yanhe1@staff.weibo.com> Co-authored-by: parabala <chenyong1@staff.weibo.com> Co-authored-by: wenbo17 <wenbo17@staff.weibo.com> Co-authored-by: qdaxb <4157870+qdaxb@users.noreply.github.com> Co-authored-by: 李枨煊 <chengxuan@staff.weibo.com> Co-authored-by: johnny0120 <jiangyang7@staff.weibo.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
chore: update docker-compose.yml to version 1.1.0 (wecode-ai#866) See merge request weibo_rd/common/wecode/wegent!1059
Summary by CodeRabbit
New Features
Bug Fixes
Tests