Skip to content

Updated port qvac-lib-inference-addon-cpp to v0.1.3#4

Merged
vigan-abd merged 2 commits into
tetherto:mainfrom
jpgaribotti:main
Apr 10, 2025
Merged

Updated port qvac-lib-inference-addon-cpp to v0.1.3#4
vigan-abd merged 2 commits into
tetherto:mainfrom
jpgaribotti:main

Conversation

@jpgaribotti

Copy link
Copy Markdown
Contributor

No description provided.

@jpgaribotti

Copy link
Copy Markdown
Contributor Author

@jpgaribotti

Copy link
Copy Markdown
Contributor Author

@ignaciolarranaga @hamlingreen @chetasr @vigan-abd please help merge

@jpgaribotti

Copy link
Copy Markdown
Contributor Author

@olyasir @Sero1000 @GustavoA1604 @jesusmb1995 @hamlingreen please review again, added version 0.1.4 which has already been merged.

@vigan-abd vigan-abd merged commit bed8456 into tetherto:main Apr 10, 2025
GustavoA1604 added a commit that referenced this pull request May 20, 2026
…roid dynamic backends) (#159)

* ggml-speech: bump to port-version 4 (PR #10 iOS Metal NULL-safety)

Picks up the iOS Metal NULL-safety hardening from
tetherto/qvac-ext-ggml#10 (PR-10's 3 commits f21ff9a0 + b7dc01c7 +
0f54d9f7) now merged into the `speech` branch as PR-10 merge
08d39f0c.

Android backend stack unchanged: GGML_CPU_ALL_VARIANTS=ON +
GGML_CPU_REPACK=ON shape introduced in port-version 3 stays. Only
the Apple Metal init path changes -- transient
`MTLCreateSystemDefaultDevice` / `ggml_metal_library_init` / buffer-
alloc failures now surface as a clean
`ggml_backend_metal_init: error: Metal device init failed - falling
back to CPU` log line + NULL return, instead of crashing inside
AGXMetalG17P.bundle with EXC_BAD_ACCESS (observed on iPhone 16 /
iOS 26.4 warm relaunches).

Co-authored-by: Cursor <cursoragent@cursor.com>

* tts-cpp: bump to 2026-05-20 + tighten ggml-speech to #4

Pulls in the Android dynamic-backend selection landed on
tetherto/qvac-ext-lib-whisper.cpp@master via PR #29 (merge 60dc1504,
content commit 907f3151): registry-only `init_gpu_backend()`
(Adreno 700+ -> OpenCL, every other GPU -> Vulkan / Metal / CUDA),
new EngineOptions::backends_dir / opencl_cache_dir fields wired
through to `tts_cpp::detail::set_backends_directory` /
`tts_cpp::detail::set_opencl_cache_dir`, and the GGML_BACKEND_DL=ON
Android CMake defaults so `ggml_backend_load_all_from_path()`
discovers per-arch CPU + Vulkan + OpenCL .so files installed
alongside the bare module.

Also tightens the ggml-speech dependency to `version>=: 2026-04-09#4`
so consumers without an explicit constraint of their own pull
ggml-speech port-version 4 (PR-10 iOS Metal NULL-safety) instead of
the registry baseline #1. tts-cpp's new `init_gpu_backend()` walks
the registry blindly and a NULL-from-Metal-init is now handled
cleanly thanks to PR-10, so #4 is the lowest version this port is
safe against.

Co-authored-by: Cursor <cursoragent@cursor.com>

---------

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants