Skip to content

METAL: The library on iOS, Swift code, fails when running a transcription in background #1670

@lelinolino

Description

@lelinolino

Hi,
running the transcription with the app in foreground, when passing to background I immediately got an exception in whisper.cpp.
I am using whisper.cpp with METAL, so I'm running on GPU.
I suppose that this is the problem: https://developer.apple.com/documentation/metal/gpu_devices_and_work_submission/preparing_your_metal_app_to_run_in_the_background

I'm using the latest commit available, 940de9d, and the problem occurs here, in file ggml-metal:

Screenshot 2023-12-21 alle 13 43 22

What are the possible strategies to not going in error or to pause the inference and get back to the transcription progress when the app came back to foreground ?

Thank you so much for your work!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions