feat(compaction): Hybrid compaction pipeline with deterministic extraction + LLM

packages/opencode/benchmark-results/benchmark_1767730294662_l6stjl.json

@@ -0,0 +1,89 @@
+{
+  "benchmark_id": "benchmark_1767730294662_l6stjl",
+  "task": "refactor",
+  "model": "openrouter/google/gemini-2.0-flash-exp:free",
+  "timestamp": 1767730294702,
+  "hybrid": {
+    "run_id": "hybrid_test",
+    "task": "refactor",
+    "model": "test",
+    "started_at": 1767730284702,
+    "completed_at": 1767730294702,
+    "total_compactions": 2,
+    "compactions": [
+      {
+        "method": "hybrid",
+        "timestamp": 1767730289702,
+        "duration_ms": 1500,
+        "tokens": {
+          "input": 500,
+          "output": 200,
+          "total": 700
+        },
+        "original_context_tokens": 10000,
+        "compacted_context_tokens": 800,
+        "compression_ratio": 0.92,
+        "output_text": "Hybrid compaction summary..."
+      },
+      {
+        "method": "hybrid",
+        "timestamp": 1767730292702,
+        "duration_ms": 1200,
+        "tokens": {
+          "input": 400,
+          "output": 150,
+          "total": 550
+        },
+        "original_context_tokens": 8000,
+        "compacted_context_tokens": 600,
+        "compression_ratio": 0.925,
+        "output_text": "Hybrid compaction summary 2..."
+      }
+    ],
+    "task_completed": true
+  },
+  "legacy": {
+    "run_id": "legacy_test",
+    "task": "refactor",
+    "model": "test",
+    "started_at": 1767730284702,
+    "completed_at": 1767730294702,
+    "total_compactions": 2,
+    "compactions": [
+      {
+        "method": "legacy",
+        "timestamp": 1767730289702,
+        "duration_ms": 2000,
+        "tokens": {
+          "input": 800,
+          "output": 400,
+          "total": 1200
+        },
+        "original_context_tokens": 10000,
+        "compacted_context_tokens": 1200,
+        "compression_ratio": 0.88,
+        "output_text": "Legacy compaction summary..."
+      },
+      {
+        "method": "legacy",
+        "timestamp": 1767730292702,
+        "duration_ms": 1800,
+        "tokens": {
+          "input": 700,
+          "output": 350,
+          "total": 1050
+        },
+        "original_context_tokens": 8000,
+        "compacted_context_tokens": 1000,
+        "compression_ratio": 0.875,
+        "output_text": "Legacy compaction summary 2..."
+      }
+    ],
+    "task_completed": true
+  },
+  "comparison": {
+    "token_savings_percent": 44.44,
+    "time_savings_percent": 28.95,
+    "winner": "hybrid"
+  }
+}

packages/opencode/benchmark-results/benchmark_1767731271905_0ifh8v.json

@@ -0,0 +1,61 @@
+{
+  "benchmark_id": "benchmark_1767731271905_0ifh8v",
+  "task": "refactor",
+  "model": "openrouter/xiaomi/mimo-v2-flash:free",
+  "timestamp": 1767731272132,
+  "hybrid": {
+    "run_id": "run_hybrid_1767731272132_5laybw",
+    "task": "refactor",
+    "model": "xiaomi/mimo-v2-flash:free",
+    "started_at": 1767731271912,
+    "completed_at": 1767731272014,
+    "total_compactions": 1,
+    "compactions": [
+      {
+        "method": "hybrid",
+        "timestamp": 1767731271912,
+        "duration_ms": 102,
+        "tokens": {
+          "input": 0,
+          "output": 0,
+          "total": 0
+        },
+        "original_context_tokens": 666,
+        "compacted_context_tokens": 0,
+        "compression_ratio": 0,
+        "output_text": "Error: unable to get local issuer certificate"
+      }
+    ],
+    "task_completed": true
+  },
+  "legacy": {
+    "run_id": "run_legacy_1767731272132_f5yd3w",
+    "task": "refactor",
+    "model": "xiaomi/mimo-v2-flash:free",
+    "started_at": 1767731272014,
+    "completed_at": 1767731272132,
+    "total_compactions": 1,
+    "compactions": [
+      {
+        "method": "legacy",
+        "timestamp": 1767731272014,
+        "duration_ms": 118,
+        "tokens": {
+          "input": 0,
+          "output": 0,
+          "total": 0
+        },
+        "original_context_tokens": 666,
+        "compacted_context_tokens": 0,
+        "compression_ratio": 0,
+        "output_text": "Error: unable to get local issuer certificate"
+      }
+    ],
+    "task_completed": true
+  },
+  "comparison": {
+    "token_savings_percent": 0,
+    "time_savings_percent": 13.56,
+    "winner": "hybrid"
+  }
+}

packages/opencode/benchmark-results/benchmark_1767731278948_5wt1tm.json

@@ -0,0 +1,61 @@
+{
+  "benchmark_id": "benchmark_1767731278948_5wt1tm",
+  "task": "refactor",
+  "model": "openrouter/xiaomi/mimo-v2-flash:free",
+  "timestamp": 1767731288261,
+  "hybrid": {
+    "run_id": "run_hybrid_1767731288260_k0dx33",
+    "task": "refactor",
+    "model": "xiaomi/mimo-v2-flash:free",
+    "started_at": 1767731278955,
+    "completed_at": 1767731282282,
+    "total_compactions": 1,
+    "compactions": [
+      {
+        "method": "hybrid",
+        "timestamp": 1767731278955,
+        "duration_ms": 3327,
+        "tokens": {
+          "input": 680,
+          "output": 299,
+          "total": 979
+        },
+        "original_context_tokens": 666,
+        "compacted_context_tokens": 299,
+        "compression_ratio": 0.5510510510510511,
+        "output_text": "```json\n{\n  \"summary\": {\n    \"files_read\": [\n      \"src/index.ts\",\n      \"src/api/data.ts\",\n      \"src/services/user.ts\",\n      \"src/utils/helpers.ts\",\n      \"tsconfig.json\"\n    ],\n    \"files_modified\": [\n      \"src/api/data.ts\",\n      \"src/index.ts\",\n      \"src/utils/helpers.ts\"\n    ],\n    \"files_created\": [\n      \"src/utils/validation.ts\"\n    ],\n    \"errors_encountered\": [\n      {\n        \"error\": \"TypeError: Cannot read property 'email' of undefined at line 15\",\n        \"status\": \"RESOLVED\",\n        \"resolution\": \"Added null check\"\n      },\n      {\n        \"error\": \"Import error: Module not found './validation'\",\n        \"status\": \"RESOLVED\",\n        \"resolution\": \"Created the validation.ts file\"\n      }\n    ],\n    \"current_task_state\": {\n      \"renamed_function\": \"getData to fetchUserData\",\n      \"extracted_module\": \"validation functions moved to src/utils/validation.ts\",\n      \"imports_updated\": \"index.ts and services/user.ts\",\n      \"typescript_added\": \"User interface created\"\n    },\n    \"pending_tasks\": [\n      \"Add try-catch blocks for error handling\",\n      \"Run TypeScript compilation to verify changes\",\n      \"Update remaining files with proper types\"\n    ]\n  }\n}\n```"
+      }
+    ],
+    "task_completed": true
+  },
+  "legacy": {
+    "run_id": "run_legacy_1767731288260_fnjfta",
+    "task": "refactor",
+    "model": "xiaomi/mimo-v2-flash:free",
+    "started_at": 1767731282282,
+    "completed_at": 1767731288260,
+    "total_compactions": 1,
+    "compactions": [
+      {
+        "method": "legacy",
+        "timestamp": 1767731282282,
+        "duration_ms": 5978,
+        "tokens": {
+          "input": 706,
+          "output": 683,
+          "total": 1389
+        },
+        "original_context_tokens": 666,
+        "compacted_context_tokens": 683,
+        "compression_ratio": -0.02552552552552556,
+        "output_text": "# Detailed Prompt for Continuing the Refactoring Session\n\n## Current Session Summary\n\nWe have successfully completed the first two major refactoring steps:\n\n✅ **Rename Function**: `getData` → `fetchUserData` across all files  \n✅ **Extract Module**: Created `src/utils/validation.ts` and moved validation functions  \n✅ **TypeScript Interfaces**: Added User interface definitions  \n\n## What We're Currently Working On\n\nWe are in the middle of **Step 3 & 4** of the comprehensive refactoring:\n\n**Completed:**\n- `src/index.ts` - Updated to use `fetchUserData`\n- `src/api/data.ts` - Function renamed, basic types added\n- `src/utils/helpers.ts` - Validation functions removed\n- `src/utils/validation.ts` - New file created with validation functions\n- `src/services/user.ts` - Import updated to use new validation module\n\n**In Progress:**\n- Adding comprehensive TypeScript types to all functions\n- Implementing proper error handling with try-catch blocks\n- Creating custom error classes for validation errors\n\n## Immediate Next Steps\n\n### 1. Complete TypeScript Type Annotations\n- Add return types to all functions in:\n  - `src/api/data.ts` (fetchUserData)\n  - `src/services/user.ts` (processUser)\n  - `src/utils/validation.ts` (validateEmail, validateAge, validateName)\n  - `src/utils/helpers.ts` (any remaining functions)\n- Ensure all function parameters have explicit types\n\n### 2. Implement Error Handling\n- Create custom error classes in a new file `src/utils/errors.ts`:\n  - `ValidationError` class\n  - `ApiError` class\n- Add try-catch blocks in `src/api/data.ts` for API calls\n- Add try-catch blocks in `src/services/user.ts` for user processing\n- Wrap validation functions with proper error throwing\n\n### 3. Update All Files with Proper Types\nReview each file and ensure:\n- All imports are correctly typed\n- All function signatures have parameters and return types\n- All variables are properly typed\n- All interfaces are exported where needed\n\n### 4. Verification Phase\nAfter completing the above:\n- Run `tsc --noEmit` to check for TypeScript errors\n- Read back all modified files to confirm changes\n- List the project structure to verify file organization\n\n## Files to Focus On Next\n\n**Priority 1 - Error Handling:**\n1. `src/utils/errors.ts` (NEW - create this file)\n2. `src/api/data.ts` (add try-catch)\n3. `src/services/user.ts` (add try-catch)\n\n**Priority 2 - Type Completion:**\n4. `src/utils/validation.ts` (verify all types)\n5. `src/services/user.ts` (verify all types)\n6. `src/index.ts` (verify all types)\n\n**Priority 3 - Verification:**\n7. Run TypeScript compiler\n8. Review all changes\n\nPlease continue with creating the error handling utilities and completing the TypeScript type annotations across all remaining functions."
+      }
+    ],
+    "task_completed": true
+  },
+  "comparison": {
+    "token_savings_percent": 29.52,
+    "time_savings_percent": 44.35,
+    "winner": "hybrid"
+  }
+}