Skip to content

feat(voice): add TTS MCP bridge and expression registry - #1116

Merged
POWERFULMOVES merged 1 commit into
mainfrom
codex/tts-mcp-bridge
Mar 27, 2026
Merged

POWERFULMOVES merged 1 commit into
mainfrom
codex/tts-mcp-bridge

Conversation

@POWERFULMOVES

Copy link
Copy Markdown
Owner

feat(voice): add TTS MCP bridge and expression registry

Summary

  • add expressive TTS intent registry for engine and modifier selection
  • add /tts:express command definition
  • add FastAPI SSE MCP bridge for Flute-Gateway TTS access
  • add direct Gradio diagnostic helpers for Higgs and Fish S2 load/synthesis/unload paths

Validation

  • python -m py_compile pmoves/services/flute-gateway/mcp_bridge.py pmoves/tools/_check_higgs_params.py pmoves/tools/_test_fish_s2_direct.py pmoves/tools/_test_higgs_defaults.py pmoves/tools/_test_higgs_direct.py pmoves/tools/_test_higgs_filled.py pmoves/tools/_unload_engine.py
  • YAML parse check for pmoves/configs/tts-engine-expressions.yaml

Notes

  • This branch intentionally stays separate from the Pinokio/networking docs branch and from unrelated dirty root-checkout changes.
  • No live Gradio/TTS server execution was performed in this branch during extraction.

@coderabbitai

coderabbitai Bot commented Mar 26, 2026

Copy link
Copy Markdown
Contributor

Warning

Rate limit exceeded

@POWERFULMOVES has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 20 minutes and 21 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 22d0db3b-b5ff-4202-a03c-891970913ff5

📥 Commits

Reviewing files that changed from the base of the PR and between 3995b98 and 7ba89e2.

📒 Files selected for processing (9)
  • .claude/commands/tts/express.md
  • pmoves/configs/tts-engine-expressions.yaml
  • pmoves/services/flute-gateway/mcp_bridge.py
  • pmoves/tools/_check_higgs_params.py
  • pmoves/tools/_test_fish_s2_direct.py
  • pmoves/tools/_test_higgs_defaults.py
  • pmoves/tools/_test_higgs_direct.py
  • pmoves/tools/_test_higgs_filled.py
  • pmoves/tools/_unload_engine.py
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/tts-mcp-bridge

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7ba89e2c3a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +310 to +311
f"{provider.base_url}/api{load_ep}",
json={"data": []},

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Switch engine load calls to Gradio event API

This posts engine load/unload requests to .../api/..., but the flute gateway’s Ultimate-TTS integration uses Gradio’s event transport (/gradio_api/call/...) and no longer relies on /api endpoints; on current Gradio setups this path returns failures, so MCP tts_load_engine/tts_unload_engine won’t actually change engine VRAM state. Use the same event-based call flow (submit + poll event_id) already used by providers/ultimate_tts.py.

Useful? React with 👍 / 👎.

"modifier": modifier,
"text_length": len(text),
"audio_bytes": len(audio_bytes),
"audio_base64": audio_b64[:100] + "..." if len(audio_b64) > 100 else audio_b64,

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Return complete audio payload from tts_synthesize

The synthesis response truncates audio_base64 to the first 100 characters plus ..., which makes it invalid audio data for any MCP client trying to decode/play the result. In real calls this means successful synthesis still cannot be consumed downstream; return the full base64 string (or a retrievable URL) instead of a preview snippet.

Useful? React with 👍 / 👎.

Comment on lines +469 to +472
def create_mcp_router(
get_provider: Any,
get_nats_client: Any,
) -> APIRouter:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Mount the new MCP router on the FastAPI app

This commit introduces the MCP router factory, but there is no wiring path that registers it with the flute-gateway FastAPI application; a repo-wide search for create_mcp_router only returns this definition. Without app inclusion, /sse and /messages are never exposed, so the bridge added in this commit is unreachable at runtime.

Useful? React with 👍 / 👎.

@POWERFULMOVES
POWERFULMOVES enabled auto-merge (squash) March 26, 2026 21:11
@POWERFULMOVES
POWERFULMOVES merged commit c3274df into main Mar 27, 2026
8 checks passed
POWERFULMOVES added a commit that referenced this pull request Mar 27, 2026
…ity hardening

Fleet Networking & RustDesk:
- KVM2 self-hosted RustDesk relay (hbbs+hbbr, systemd, UFW-locked)
- Scripts: fix-kvm2-rustdesk-relay.sh, restart-jetson-rustdesk.sh
  (env var driven — HOSTINGER_KVM2_IP, RUSTDESK_RELAY_KEY, JETSON_IPS)
- RUSTDESK_SELF_HOSTED.md deployment guide (sanitized, no secrets)
- QR code generation instructions for mobile enrollment

Security Hardening:
- Network hardening: localhost defaults for all service bindings
- 4090 laptop host hardening script
- SSH key-only auth across 8 nodes (password disabled)
- Gitignore: rustdesk QR images excluded from repo

Infrastructure:
- DeepResearch Dockerfile: add pmoves.chit COPY for CGP_SPEC_VERSION
  (Python files only, secrets manifests excluded from image layers)
- TOPOLOGY.md: KVM2 RustDesk ports, updated node hostnames, Jetson status
- AGNOTE4482 ACK: Z890-CLAUDE fleet networking claim signed

Also includes merged PR content:
- Hi-RAG embedding defaults aligned to Qwen3 2560d (#1122)
- Pinokio Codex plugin + Agent Zero launcher (#1121)
- Publishing approval handoff state (#1120)
- TTS MCP bridge + expression registry (#1116)
- Damage-control hooks Windows compat (#1123)
- AGNOTE4482 fleet claim docs (#1127)
- Dependency bumps (#1111, #1113, #1128)
- Bootstrap SUPERSEDED_VALUES (#1112)
- Various docs updates (#1115, #1117, #1119, #1124, #1125)
- Publisher RPC idempotent guards (#1126)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
POWERFULMOVES added a commit that referenced this pull request Mar 27, 2026
…ity hardening

Fleet Networking & RustDesk:
- KVM2 self-hosted RustDesk relay (hbbs+hbbr, systemd, UFW-locked)
- Scripts: fix-kvm2-rustdesk-relay.sh, restart-jetson-rustdesk.sh
  (env var driven — HOSTINGER_KVM2_IP, RUSTDESK_RELAY_KEY, JETSON_IPS)
- RUSTDESK_SELF_HOSTED.md deployment guide (sanitized, no secrets)
- QR code generation instructions for mobile enrollment

Security Hardening:
- Network hardening: localhost defaults for all service bindings
- 4090 laptop host hardening script
- SSH key-only auth across 8 nodes (password disabled)
- Idempotent authorized_keys injection (grep+append, never truncate)
- Gitignore: rustdesk QR images excluded from repo

Infrastructure:
- DeepResearch Dockerfile: add pmoves.chit COPY for CGP_SPEC_VERSION
  (Python files only, secrets manifests excluded from image layers)
- TOPOLOGY.md: KVM2 RustDesk ports, updated node hostnames, Jetson status
- AGNOTE4482 ACK: Z890-CLAUDE fleet networking claim signed
- setup-glances.sh: prefer uv over pip per CLAUDE.md

Also includes merged PR content:
- Hi-RAG embedding defaults aligned to Qwen3 2560d (#1122)
- Pinokio Codex plugin + Agent Zero launcher (#1121)
- Publishing approval handoff state (#1120)
- TTS MCP bridge + expression registry (#1116)
- Damage-control hooks Windows compat (#1123)
- Various docs, deps, bootstrap updates (#1111-#1128)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@POWERFULMOVES
POWERFULMOVES deleted the codex/tts-mcp-bridge branch April 21, 2026 13:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants