Introduce Server Stats

[NolanTrem]

Protected route that gives statistics around the server where R2R is deployed.

{"results":{"start_time":"2024-08-01T23:32:01.591093+00:00","uptime_seconds":36.691362,"cpu_usage":17.0,"memory_usage":76.0}}

---

🚀	This description was created by Ellipsis for commit bf43688

Summary:

Introduced server statistics route, replaced JSON with TOML configuration, refactored providers, and updated ingestion pipeline with chunking.

Key points:

• Added /server_stats route in r2r/main/api/routes/management/base.py to provide server statistics.
• Replaced JSON configuration files with TOML in Dockerfile, compose.yaml, and various other files.
• Updated R2RConfig class in r2r/main/assembly/config.py to handle TOML files.
• Refactored LLMProvider to CompletionProvider across multiple files.
• Added ChunkingProvider and ParsingProvider in r2r/base/providers.
• Updated ingestion pipeline in r2r/pipelines/ingestion_pipeline.py to include chunking.
• Added new tests in tests/test_cli.py, tests/test_config.py, tests/test_end_to_end.py, and tests/test_llms.py.

---

Generated with ❤️ by ellipsis.dev

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to bf43688 in 1 minute and 49 seconds

More details

• Looked at 5548 lines of code in 91 files
• Skipped 1 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. r2r/main/api/routes/management/base.py:28

• Draft comment:
  The implementation of the server stats endpoint looks correct and well-secured. It properly checks for superuser status before providing sensitive server statistics, which is crucial for maintaining security.
• Reason this comment was not posted:
  Confidence changes required: 10%
  The PR introduces a new feature for server statistics, which seems to be implemented correctly based on the provided code snippets. The server stats endpoint is protected and only accessible by superusers, which is a good security practice. The stats include uptime, CPU usage, and memory usage, which are typical and useful metrics for monitoring server health. The implementation uses the psutil library to gather system information, which is a standard choice for such tasks. The PR also includes changes to Docker and compose configurations, which are necessary for deploying the new feature. Overall, the PR appears to be well-implemented with attention to security and performance.

Workflow ID: wflow_cpBJLzP98dfa5YfJ

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.