Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
91 changes: 91 additions & 0 deletions docs/AGENT_OPS_ROADMAP.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,91 @@
# Tutti Agent Operations Roadmap (Execution Plan)

## Goal
Position Tutti as the agent operations layer (not just a coding assistant) by closing reliability, governance, observability, and adoption gaps.

## Priorities

### P0 — Foundation (must ship first)
1. **Identity + Auth + RBAC**
- User/org/workspace identities
- API keys and role-based permissions
- Audit trail for sensitive actions

2. **Production Control Plane Hardening**
- Stable API contracts
- Durable event stream semantics
- Idempotency for mutating endpoints
- Queryable run/event history

3. **Reliability Primitives**
- Retry policies + backoff
- Checkpoint/resume guarantees
- Dead-letter handling for failed actions
- Circuit breakers / provider failover

4. **Approval and Guardrail Workflows**
- Human approval gates for risky actions
- Policy-as-code enforcement
- Exception handling with traceability

5. **Operator Observability**
- Per-run timeline and failure stages
- Root cause attribution (routing/tool/model/policy)
- SLO dashboards and alerting hooks

### P1 — Scale and Governance
6. **Cost Governance**
- Workspace/agent budgets
- Forecasting and anomaly detection
- Hard-stop + escalation behavior

7. **Deployment and Operations Story**
- Managed and self-hosted deployment paths
- Secrets/backup/migration tooling
- Upgrade safety and rollback docs

8. **Ecosystem + Templates**
- Connector starter set (CRM, ticketing, docs, messaging)
- Template arrangements/workflows by use case
- <30 min time-to-first-value path

9. **Trust and Compliance Pack**
- Security posture docs
- Data retention/export controls
- Auditability and incident response basics

10. **Positioning + Onboarding Narrative**
- Replace generic “agent framework” messaging
- “Run reliable agent operations in one day” onboarding flow
- Product-led proof of value in first session

## Telemetry Plan (parallel to all milestones)

### North Star
- **Activation rate:** installs that reach first successful workflow run within 24h

### Event instrumentation
- Install: `tutti_install_started`, `tutti_install_completed`
- Activation: `first_workspace_created`, `first_up_success`, `first_send`, `first_workflow_run`
- Habit: DAW (daily active workspaces), returning workspace cohorts (D1/D7/D30), runs per workspace
- Outcome: run success/failure, failure type (`routing/tool/model/policy`), time-to-success
- Commercial: conversion funnel install → first up → first successful run → D7 return
Comment thread
coderabbitai[bot] marked this conversation as resolved.
Resolved

### Telemetry deliverables
- Event schema + versioning
- Redaction/privacy defaults
- Dashboard for activation, reliability, retention
- Alerting on activation regression and failure spikes

## Suggested sequencing (8-week sketch)
- **Weeks 1-2:** P0.1 + P0.2 + telemetry schema foundation
- **Weeks 3-4:** P0.3 + P0.4 + failure attribution dashboards
- **Weeks 5-6:** P0.5 + P1.6 (observability + cost governance)
- **Weeks 7-8:** P1.7 + P1.8 + onboarding narrative improvements
- Ongoing: P1.9 + P1.10 hardening and GTM tuning

## Success criteria
- Activation >= target baseline and trending up
Comment thread
coderabbitai[bot] marked this conversation as resolved.
Resolved
- Reduced run failure rate and faster MTTR
- Clear operator trust: approval/audit/cost controls usable in production
- Repeatable adoption via templates + onboarding story
Loading