Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
9d4e7ef
feat(deepagents): extract sampled frames from video reads
Jun 19, 2026
da5069f
test(deepagents): cover video read_file dispatch and snapshots
Jun 19, 2026
508c0a6
build(deepagents): add [video] extra and document it
Jun 19, 2026
ba9e923
fix(sdk): address video read review findings
actions-user Jun 19, 2026
adefabd
fix(sdk): address video read feedback
actions-user Jun 19, 2026
a032baa
fix(sdk): wrap lazy video decode errors
actions-user Jun 19, 2026
358e892
fix(sdk): drop agent-input limit clamp on video read_file
actions-user Jun 20, 2026
e28555a
refactor(sdk): tighten video read_file review findings
Jun 20, 2026
17075e9
fix(sdk): tighten video read bounds and schema
Jun 22, 2026
b2b972d
fix(sdk): bound video extra dependencies
Jun 22, 2026
08bfe73
fix(sdk): move video frames out of tool output
Jun 23, 2026
acef9e5
docs(sdk): remove video readme update
Jun 23, 2026
3bc6b7f
fix(sdk): keep video reads out of tool output
Jun 23, 2026
d21beb3
fix(sdk): sync `read_file` prompt snapshot wording
Jun 23, 2026
da025df
fix(sdk): preserve native video pass-through
Jun 23, 2026
ead192f
fix(sdk): raise video input cap and downscale frames
Jun 23, 2026
9c2d5d1
fix(code): install video extra for CLI reads
Jun 23, 2026
b5b2c22
fix(talon): enable video extra in WhatsApp image
Jun 23, 2026
54c755d
fix(sdk): simplify video read handling
Jun 23, 2026
646d361
fix(code): make video extra opt-in
Jun 23, 2026
f776237
fix(sdk): resolve video read CI failures
Jun 23, 2026
9782635
fix(talon): align video extra SDK range
Jun 26, 2026
977523d
Merge branch 'main' into jk/video-frame-extraction-read-file-v2
mdrxy Jul 2, 2026
8d03fb5
cr
mdrxy Jul 2, 2026
bac6884
nit
mdrxy Jul 2, 2026
1a6d323
cr
mdrxy Jul 2, 2026
51e292d
cr
mdrxy Jul 2, 2026
c59bd1a
Merge branch 'main' into jk/video-frame-extraction-read-file-v2
mdrxy Jul 2, 2026
9d5fc28
cr
mdrxy Jul 2, 2026
00eeb22
safely remove annotations
mdrxy Jul 2, 2026
80a92e1
fix false pos
mdrxy Jul 2, 2026
e15895b
cr
mdrxy Jul 2, 2026
9a0b861
gate on dep presence
mdrxy Jul 2, 2026
c452870
perf
mdrxy Jul 2, 2026
1a58061
fix(talon): collapse media extras
Jul 2, 2026
e0638b5
fix(talon): sync media extra dependencies
Jul 2, 2026
f223213
chore(evals): update lockfile for media extra
Jul 2, 2026
e2c4867
fix(code): classify media extra
Jul 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion examples/async-subagent-server/uv.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 5 additions & 1 deletion examples/llm-wiki/uv.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion examples/talon/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ RUN mkdir -p /opt/whatsapp-bridge && \
cd /opt/whatsapp-bridge && \
npm install --omit=dev

RUN cd libs/talon && uv sync --frozen --extra speech
RUN cd libs/talon && uv sync --frozen --extra media

WORKDIR /workspace

Expand Down
4 changes: 2 additions & 2 deletions examples/talon/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ Uncomment the Telegram env vars in `.env` and set `DEEPAGENTS_TALON_TELEGRAM_BOT

## Voice Transcription

Voice transcription is enabled by default in `.env.example`. The Docker example installs `ffmpeg` plus the Talon `speech` extra, so inbound voice notes are transcribed locally with NVIDIA Parakeet through Transformers before reaching the agent. The first voice message can be slow because the ASR model is downloaded lazily. Set `DEEPAGENTS_TALON_VOICE_TRANSCRIPTION_DEVICE=cuda` when running on a GPU-enabled host.
Voice transcription is enabled by default in `.env.example`. The Docker example installs `ffmpeg` plus the Talon `media` extra, so inbound voice notes are transcribed locally with NVIDIA Parakeet through Transformers before reaching the agent. The first voice message can be slow because the ASR model is downloaded lazily. Set `DEEPAGENTS_TALON_VOICE_TRANSCRIPTION_DEVICE=cuda` when running on a GPU-enabled host.

Cron records, downloaded inbound media, and channel session state persist under `~/talon-workspace/.deepagents/`. The agent's default working directory is `/workspace`, so files it creates are written into `~/talon-workspace/` on the host.

Expand All @@ -43,7 +43,7 @@ cd ../../libs/talon/deepagents_talon/channels/whatsapp_bridge
npm install

cd ../../../..
uv sync --directory libs/talon --extra speech
uv sync --directory libs/talon --extra media
cp examples/talon/AGENTS.md ~/.deepagents/talon-local/agent/AGENTS.md
export DEEPAGENTS_TALON_WORKSPACE=~/talon-workspace
uv run --directory libs/talon deepagents-talon --whatsapp
Expand Down
9 changes: 5 additions & 4 deletions libs/code/deepagents_code/extras_info.py
Original file line number Diff line number Diff line change
Expand Up @@ -204,11 +204,12 @@ class ExtrasIntrospectionError(RuntimeError):
)
"""Optional extras that add sandbox integrations."""

STANDALONE_EXTRAS: frozenset[str] = frozenset({"quickjs"})
"""Compatibility extras that don't fit the provider/sandbox taxonomy.
STANDALONE_EXTRAS: frozenset[str] = frozenset({"media", "quickjs"})
"""Optional extras that don't fit the provider/sandbox taxonomy.

`quickjs` is a core dependency now, but the empty extra remains installable so
older `deepagents-code[quickjs]` and `/install quickjs` workflows stay harmless.
`quickjs` is a core dependency as of 0.1.24, but the empty extra remains
installable so older `deepagents-code[quickjs]` and `/install quickjs` workflows
stay harmless.
"""

KNOWN_EXTRAS: frozenset[str] = (
Expand Down
4 changes: 3 additions & 1 deletion libs/code/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -122,7 +122,9 @@ all-sandboxes = [
"deepagents-code[agentcore,daytona,modal,runloop,vercel]",
]

# Standalone integrations (kept for backwards-compatible install commands)
# Standalone integrations
media = ["av>=17.0.0,<18.0.0", "pillow>=12.2.0,<13.0.0"]

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why no reuse?

Comment thread
robin-agent[bot] marked this conversation as resolved.
Resolved
# (quickjs kept for backwards-compatible install commands)
quickjs = []


Expand Down
Loading