Skip to content

FoundryLocal CLI preview encountered a problem #779

Description

@goxia

The old foundrylocal has already been uninstalled through winget.

PS C:\Users\sufan\Downloads> foundry chat qwen3.5-4b
■ Chatting model (qwen3.5-4b)
■ note: Type /help to see chat commands, /exit to quit.
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
❯ hello

● error: IPC error 'op_handler_failed': Error from chat_completions command: Error:
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: WebGPU validation failed. [Buffer (unlabeled)] usage
(Storage(read-write)|Storage(read-only)) includes writable usage and another usage in the same synchronization scope.

  • While validating compute pass usage.

  • While finishing [CommandEncoder (unlabeled)].

    at Microsoft.ML.OnnxRuntimeGenAI.Result.VerifySuccess(IntPtr) + 0x47
    at Microsoft.ML.OnnxRuntimeGenAI.Generator.AppendTokenSequences(Sequences) + 0x1f
    at Microsoft.Neutron.OpenAI.Provider.OnnxChatGenerator..ctor(OnnxLoadedModel, GeneratorParams, ILogger, Sequences,
    NamedTensors) + 0x94
    at Microsoft.Neutron.OpenAI.Provider.OnnxChatGenerator.CreateOnnxChatGenerator(ChatCompletionCreateRequestExtended,
    OnnxLoadedModel, AzureFoundryLocalModel, ITelemetry, ILogger) + 0xa94
    at Microsoft.AI.Foundry.Local.ChatClient.<>c__DisplayClass8_0.b__0(CancellationToken) +
    0x2a
    at Microsoft.Neutron.OpenAI.Provider.ChatCompletions.d__3.MoveNext() + 0x234
    --- End of stack trace from previous location ---
    at Microsoft.AI.Foundry.Local.ChatClient.d__8.MoveNext() + 0x2cb
    --- End of stack trace from previous location ---
    at Microsoft.AI.Foundry.Local.ChatClient.d__8.MoveNext() + 0x446
    --- End of stack trace from previous location ---
    at
    Microsoft.AI.Foundry.Local.NativeInterop.<>c__DisplayClass13_0.<b__2>d.MoveNext() +
    0x467
    --- End of stack trace from previous location ---
    at
    Microsoft.AI.Foundry.Local.NativeInterop.<>c__DisplayClass13_0.<b__2>d.MoveNext() +
    0x7d9
    --- End of stack trace from previous location ---
    at Microsoft.AI.Foundry.Local.NativeInterop.d__9.MoveNext() + 0xb8
    Hint: Try 'foundry server stop' then 'foundry server start'.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions