Skip to content

Commit

Permalink
lmstudio: Support missing quantization in model metadata (#24054)
Browse files Browse the repository at this point in the history
- Closes #23764

Certain models do not include `quantization` parameter from lm studio rest API.
  • Loading branch information
notpeter committed Jan 31, 2025
1 parent a1bfec3 commit 7d90fd3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion crates/lmstudio/src/lmstudio.rs
Original file line number Diff line number Diff line change
Expand Up @@ -192,7 +192,7 @@ pub struct ModelEntry {
pub publisher: String,
pub arch: Option<String>,
pub compatibility_type: CompatibilityType,
pub quantization: String,
pub quantization: Option<String>,
pub state: ModelState,
pub max_context_length: Option<u32>,
pub loaded_context_length: Option<u32>,
Expand Down

0 comments on commit 7d90fd3

Please sign in to comment.