Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/1.5.0 #132

Merged
merged 9 commits into from
Nov 25, 2023
Merged

Release/1.5.0 #132

merged 9 commits into from
Nov 25, 2023

Conversation

sandrohanea
Copy link
Owner

@sandrohanea sandrohanea commented Nov 18, 2023

  • Upgraded to Whisper.cpp 1.5.1

  • Improved cancellation using CancellationToken provided => it's using the onabort handler in native library to cancel the processing faster
    => addressing concerns from AccessViolation when try to cancel ProcessAsync() #23

  • Logging improvements: not logging to stderr by default anymore, but events can be registered (see LogProvider)
    => Added optional logging in simple samples + CoreML sample
    => Logging is now suppressed by default: Is there a way to suppress Console logging? #129

  • Added useGpu on WhisperFactory creation so that GPU usage can be disabled on specific runtimes (e.g. Cublas, CoreML, etc)

  • Upgraded dotnet targets to dotnet 8

  • Added support for whisper large v3 (including downloader + coreml model)
    => Old model Large in downloader should be renamed to LargeV2 see GgmlType

  • Added linux-x64 support for Whisper.net.Runtime.Cublas

  • Added support for distil-whisper Adding Distil-Whisper - distilled version of Whisper that is 6 times faster, 49% smaller  #126
    => No downloader added, you'll need to load the model yourself
    => How to build the model: https://github.com/ggerganov/whisper.cpp/tree/master/models#distilled-models

  • Added automated builds for all runtimes using Github Actions

  • Unified runtime builds with make for linux, macos, ios, tvos, wasm and powershell scripts for windows

  • Added Blazor with InteractivityAuto, InteractivityServer and InteractivityWebAssemly support
    => sample with new dotnet 8 Blazor template added.

  • Unified Whisper.net.Runtime.Wasm with Whisper.net.Runtime
    => If previously you were using Whisper.net.Runtime.Wasm, just replace it with Whisper.net.Runtime

  • Added metal support for arm-based apple platforms (both Whisper.net.Runtime + Whisper.net.Runtime.CoreML)

@sandrohanea
Copy link
Owner Author

Blocked by: ggerganov/whisper.cpp#1519

@Alumniminium
Copy link

Concerningly, no mention of #128

@sandrohanea
Copy link
Owner Author

Concerningly, no mention of #128

Will be addressed in this release as well (at least for Whisper.net.Runtime.Cublas)

 - Improved cancellation using CancellationToken provided => it's using the onabort handler in native library to cancel the processing faster
    => addressing concerns from #23

  - Logging improvements: not logging to stderr by default anymore, but events can be registered (see [LogProvider](https://github.com/sandrohanea/whisper.net/tree/main/Whisper.net/Logger/LogProvider))
     => Added optional logging in simple samples + CoreML sample
     => Logging is now suppressed by default: #129

   - Added `useGpu` on WhisperFactory creation so that GPU usage can be disabled on specific runtimes (e.g. Cublas, CoreML, etc)

   - Upgraded dotnet targets to dotnet 8

   - Added support for whisper large v3 (including downloader + coreml model)
       => Old model Large in downloader should be renamed to LargeV2 see [GgmlType](https://github.com/sandrohanea/whisper.net/blob/main/Whisper.net/Ggml/GgmlType.cs)

   - Added linux-x64 support for Whisper.net.Runtime.Cublas

   - Added support for distil-whisper #126
       => No downloader added, you'll need to load the model yourself
       => How to build the model: https://github.com/ggerganov/whisper.cpp/tree/master/models#distilled-models

   - **Added automated builds for all runtimes using Github Actions**

   - Unified runtime builds with make for linux, macos, ios, tvos, wasm and powershell scripts for windows

   - Added Blazor with InteractivityAuto, InteractivityServer and InteractivityWebAssemly sample with Blazor updated in dotnet 8.

   - Unified Whisper.net.Runtime.Wasm with Whisper.net.Runtime
       => If previously you were using Whisper.net.Runtime.Wasm, just replace it with Whisper.net.Runtime

   - Added metal support for arm-based apple platforms (both Whisper.net.Runtime + Whisper.net.Runtime.CoreML)
@sandrohanea sandrohanea merged commit 8711b1b into main Nov 25, 2023
@sandrohanea sandrohanea deleted the release/1.5.0 branch November 25, 2023 16:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants