Repository navigation
openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off #24503
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 126 commits
4bc1eb1
c49ec28
76eb69e
7e6caef
d306b0b
01088c2
126d758
32f9cb7
f812f78
865f121
ca3a176
a73a6dc
bfa4c53
9c922b1
59f0e3c
c8e9ce4
9f355ed
dc5ed75
e2ce59c
130ef39
13ddbf3
7597773
a1baa1a
dad8acd
760e86d
5a39967
d289bbd
e0caf43
8c83092
a08546f
0d0fb42
c064e87
d44fa9c
6afe652
d2279ae
e6a7a9e
418c5e5
c6efcb6
eafd08e
89858ec
e25ed8f
996f0c7
12863b8
404d6b3
41c35a3
03e835c
08438be
904c608
d2ca0f8
2aa3b2d
59e3d64
4472ce0
4bbb85f
3032423
c4bd20f
2c2541c
d11e198
c4f2ec7
46bddb1
bb38483
645df27
08b4fd6
d2c7549
e05da27
c3c4dba
a32aeb5
a0155c4
b1f6fb4
603c7dc
21bab71
f49b026
65ec35a
292b156
c832153
af2a8e1
a16cfb4
36c5cd5
6df01a7
2ab4121
6b1c5aa
d194391
f1a5340
88f22fd
ccb1b23
df50c52
b397e94
41ce1c7
7baa213
5fa8e5e
b9cba9d
e8324ac
10a2cfd
38e9d59
9c0ca74
bbc4319
e3bdd6b
bc11c32
d551f5b
2e33f25
699fd7d
d05ce54
b32c04e
1d9fa46
71ba113
1c64362
f7bbe7c
efbc565
34b2bee
b3f21ea
e68a103
65e2ecc
8ea91dd
341b615
4c878bd
971816c
835121d
3365e31
906a48d
dd5c58d
a9045e0
fb924cb
ba6c06d
1d3035b
90ae917
383d163
00e80a9
65d4041
ce52f0a
3481530
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,24 @@ | ||
| name: "Windows - Setup OpenVINO Toolkit" | ||
| description: "Setup OpenVINO Toolkit for Windows" | ||
| inputs: | ||
| path: | ||
| description: "Installation path" | ||
| required: true | ||
| version_major: | ||
| description: "OpenVINO major version (e.g., 2026.2)" | ||
| required: true | ||
| version_full: | ||
| description: "OpenVINO full version" | ||
| required: true | ||
|
|
||
| runs: | ||
| using: "composite" | ||
| steps: | ||
| - name: Download and extract OpenVINO Runtime | ||
| shell: powershell | ||
| run: | | ||
| $url = "https://storage.openvinotoolkit.org/repositories/openvino/packages/${{ inputs.version_major }}/windows/openvino_toolkit_windows_${{ inputs.version_full }}_x86_64.zip" | ||
| $out = "openvino.zip" | ||
| Invoke-WebRequest -Uri $url -OutFile $out | ||
| Expand-Archive -Path $out -DestinationPath ${{ inputs.path }} -Force | ||
| Remove-Item $out |
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
|
|
@@ -37,14 +37,10 @@ jobs: | |||||
| ubuntu-24-openvino: | ||||||
| runs-on: [self-hosted, Linux, Intel, OpenVINO] | ||||||
|
|
||||||
| concurrency: | ||||||
| group: openvino-gpu-${{ github.head_ref || github.ref }} | ||||||
| cancel-in-progress: false | ||||||
|
|
||||||
| env: | ||||||
| # Sync versions in build-openvino.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile | ||||||
| OPENVINO_VERSION_MAJOR: "2026.0" | ||||||
| OPENVINO_VERSION_FULL: "2026.0.0.20965.c6d6a13a886" | ||||||
| OPENVINO_VERSION_MAJOR: "2026.2" | ||||||
| OPENVINO_VERSION_FULL: "2026.2.0.21903.52ddc073857" | ||||||
|
|
||||||
| steps: | ||||||
| - name: Clone | ||||||
|
|
@@ -78,7 +74,7 @@ jobs: | |||||
| cmake -B build/ReleaseOV -G Ninja \ | ||||||
| -DCMAKE_BUILD_TYPE=Release \ | ||||||
| -DGGML_OPENVINO=ON | ||||||
| time cmake --build build/ReleaseOV --config Release -j $(nproc) | ||||||
| time cmake --build build/ReleaseOV --config Release --parallel | ||||||
|
|
||||||
| - name: Test (CPU) | ||||||
| id: cmake_test_cpu | ||||||
|
|
@@ -93,4 +89,81 @@ jobs: | |||||
| run: | | ||||||
| cd ${{ github.workspace }} | ||||||
| export GGML_OPENVINO_DEVICE=GPU | ||||||
| ctest --test-dir build/ReleaseOV -L main -E "test-llama-archs" --verbose --timeout 2000 | ||||||
| ctest --test-dir build/ReleaseOV -L main -E "test-llama-archs" --verbose --timeout 3000 | ||||||
|
|
||||||
| windows-2022-openvino: | ||||||
| runs-on: windows-2022 | ||||||
|
|
||||||
| env: | ||||||
| # Sync versions in build-openvino.yml, build-self-hosted.yml, release.yml, build-cache.yml, .devops/openvino.Dockerfile | ||||||
| OPENVINO_VERSION_MAJOR: "2026.2" | ||||||
| OPENVINO_VERSION_FULL: "2026.2.0.21903.52ddc073857" | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. How long does this build take? Can it be offloaded to self-hosted runners?
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The recent time for windows-2022-openvino: succeeded 5 days ago in 13m 14s I will check internally and try to move to self-hosted runner. Will follow up with another PR. |
||||||
|
|
||||||
| steps: | ||||||
| - name: Clone | ||||||
| id: checkout | ||||||
| uses: actions/checkout@v6 | ||||||
|
|
||||||
| - name: ccache | ||||||
| uses: ggml-org/ccache-action@v1.2.21 | ||||||
| with: | ||||||
| key: windows-2022-openvino | ||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. For consistency:
Suggested change
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Done |
||||||
| variant: ccache | ||||||
| evict-old-files: 1d | ||||||
| save: ${{ github.event_name == 'push' && github.ref == 'refs/heads/master' }} | ||||||
|
|
||||||
| - name: Setup Cache | ||||||
| uses: actions/cache@v5 | ||||||
| id: cache-openvino | ||||||
| with: | ||||||
| path: ./openvino_toolkit | ||||||
| key: cache-gha-openvino-toolkit-v${{ env.OPENVINO_VERSION_FULL }}-${{ runner.os }} | ||||||
|
|
||||||
| - name: Setup OpenVINO Toolkit | ||||||
| if: steps.cache-openvino.outputs.cache-hit != 'true' | ||||||
| uses: ./.github/actions/windows-setup-openvino | ||||||
| with: | ||||||
| path: ./openvino_toolkit | ||||||
| version_major: ${{ env.OPENVINO_VERSION_MAJOR }} | ||||||
| version_full: ${{ env.OPENVINO_VERSION_FULL }} | ||||||
|
|
||||||
| - name: Install OpenCL using vcpkg | ||||||
| shell: powershell | ||||||
| run: | | ||||||
| git clone https://github.com/microsoft/vcpkg C:\vcpkg | ||||||
| C:\vcpkg\bootstrap-vcpkg.bat | ||||||
| C:\vcpkg\vcpkg install opencl | ||||||
|
|
||||||
| - name: Build | ||||||
| id: cmake_build | ||||||
| shell: cmd | ||||||
| run: | | ||||||
| REM Find extracted OpenVINO folder dynamically | ||||||
| for /d %%i in (openvino_toolkit\*) do set OPENVINO_ROOT=%%i | ||||||
|
|
||||||
| if not exist "%OPENVINO_ROOT%\runtime\cmake\OpenVINOConfig.cmake" ( | ||||||
| echo ERROR: OpenVINOConfig.cmake not found | ||||||
| exit /b 1 | ||||||
| ) | ||||||
|
|
||||||
| call "%OPENVINO_ROOT%\setupvars.bat" | ||||||
|
|
||||||
| cmake -B build\ReleaseOV -G "Visual Studio 17 2022" ^ | ||||||
| -A x64 ^ | ||||||
| -DCMAKE_BUILD_TYPE=Release ^ | ||||||
| -DGGML_OPENVINO=ON ^ | ||||||
| -DCMAKE_TOOLCHAIN_FILE=C:\vcpkg\scripts\buildsystems\vcpkg.cmake | ||||||
|
|
||||||
| cmake --build build\ReleaseOV --config Release -- /m | ||||||
|
|
||||||
| - name: Test (CPU) | ||||||
| id: cmake_test_cpu | ||||||
| shell: cmd | ||||||
| # TODO: fix and re-enable the `test-llama-archs` test below | ||||||
| run: | | ||||||
| REM Find extracted OpenVINO folder dynamically | ||||||
| for /d %%i in (openvino_toolkit\*) do set OPENVINO_ROOT=%%i | ||||||
| call "%OPENVINO_ROOT%\setupvars.bat" | ||||||
|
|
||||||
| cd build | ||||||
| ctest --test-dir ReleaseOV -L main -E "test-llama-archs" -C Release --verbose --timeout 3000 | ||||||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How big is this cache?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The cache-gha-openvino-toolkit-v2026.2.0.21903.52ddc073857-Windows: 180 MB