feat: align LCM with Codex continuity and whitepaper control flow

[codejeet]

Summary

• add lossless opaque Codex reasoning and native-compaction continuity without exposing capsules through FTS, summaries, inspection, or expansion
• add explicit soft/hard compaction, deterministic convergence, file lineage, and persistent llm_map / agentic_map operators
• make concurrent SQLite ownership and lock recovery durable, and bound restart reconciliation over large externalized-output archives

Why

Long-running concurrent gateway sessions exposed two production failures: restart reconciliation repeatedly scanned a 12,799-file, roughly 540 MB archive, and cloned engines could contend over independently owned SQLite helpers. The first failure pushed a 590K-token resume beyond the 30-second host timeout. The bounded lookup and per-pass identity cache reduce that reconciliation to roughly 2 seconds while preserving every source row and externalized payload.

Validation

• Focused validation: 483 passed
• Default validation:
  • pytest tests/test_lcm_core.py tests/test_lcm_engine.py tests/test_packaging_install.py -q
  • pytest -q: 2,846 passed, 1 skipped
  • low-FD pytest at ulimit -n 1024: 2,846 passed, 1 skipped
  • scripts/validate_release.sh --full --keep-going: all gates passed
  • benchmark smoke, stress smoke, and release stress tier: zero failures
  • git diff checks for origin/main...HEAD, working tree, and staged tree
  • Python compileall, script py_compile, and shell syntax checks
• Workflow validation not applicable: workflow files are unchanged

Notes

• Scope is broad because the storage, compaction, provider-state, and operator invariants share one schema and lifecycle boundary; the commit keeps the existing plugin name, engine name, and database path compatible.
• Background compaction remains opt-in.
• The separate Hermes gateway-core teardown patch is intentionally excluded from this plugin PR.
• Validation started and ended with a clean git status.