feat: add support for querying available backend devices

[qnixsynapse]

This change introduces a new get_devices method to the llamacpp_extension engine that allows the frontend to query and display a list of available devices (e.g., Vulkan, CUDA, SYCL) from the compiled llama-server binary.

• Added DeviceList interface to represent GPU/device metadata.

• Implemented getDevices(): Promise<DeviceList[]> method.

  • Splits version/backend, ensures backend is ready.
  • Invokes the new Tauri command get_devices.

• Introduced a new get_devices Tauri command.

• Parses llama-server --list-devices output to extract available devices with memory info.

• Introduced DeviceInfo struct (id, name, mem, free) and exposed it via serialization.

• Robust parsing logic using string processing (non-regex) to locate memory stats.

• Registered the new command in the tauri::Builder in lib.rs.

• Fixed logic to correctly parse multiple devices from the llama-server output.

• Handles common failure modes: binary not found, malformed memory info, etc.

This sets the foundation for device selection, memory-aware model loading, and improved diagnostics in Jan AI engine setup flows.

---

Important

Adds support for querying available backend devices in llamacpp extension via new Tauri command and parsing logic.

• Behavior:
  • Adds getDevices() method in index.ts to query available devices (Vulkan, CUDA, SYCL) from llama-server.
  • Introduces get_devices Tauri command in server.rs to parse llama-server --list-devices output.
  • Handles errors like binary not found and malformed memory info.
• Models:
  • Adds DeviceList interface in index.ts and DeviceInfo struct in server.rs for device metadata.
• Misc:
  • Registers get_devices command in lib.rs.

^{This description was created by for 0b9354f. You can customize this summary. It will automatically update as commits are pushed.}

[ellipsis-dev]

Caution

Changes requested ❌

Reviewed everything up to 0b9354f in 2 minutes and 31 seconds. Click for details.

• Reviewed 342 lines of code in 3 files
• Skipped 0 files when reviewing.
• Skipped posting 2 draft comments. View those below.
• Modify your settings and rules to customize what types of comments Ellipsis leaves. And don't forget to react with 👍 or 👎 to teach Ellipsis.

1. src-tauri/src/core/utils/extensions/inference_llamacpp_extension/server.rs:148

• Draft comment:
  The Windows branch uses a raw string literal in trim_start_matches (e.g. r"\?") which may not compile as expected (raw strings cannot end with a backslash). Consider using an escaped standard string (e.g. "\\?\") or an alternative approach.
• Reason this comment was not posted:
  Comment was not on a location in the diff, so it can't be submitted as a review comment.

2. src-tauri/src/core/utils/extensions/inference_llamacpp_extension/server.rs:414

• Draft comment:
  Typographical issue: The raw string literal r"\\?\" appears to be incorrectly terminated. In Rust, a raw string that contains a quote needs to use a different delimiter (e.g., r#"\\?\"#) or proper escaping. Please review and correct this to ensure the intended UNC prefix is properly trimmed.
• Reason this comment was not posted:
  Comment looked like it was already resolved.

Workflow ID: wflow_oHv2xuCgSimu3Y0L

^{You can customize by changing your verbosity settings, reacting with 👍 or 👎, replying to comments, or adding code review rules.}

[github-actions]

Barecheck - Code coverage report

Total: 36.95%

Your code coverage diff: 0.01% ▴

✅ All code changes are covered