Skip to content

ci: add Linux cross-compile build #12428

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mtmcp merged 27 commits into from
Apr 4, 2025
Merged

ci: add Linux cross-compile build #12428

Show file tree
Hide file tree
Changes from 26 commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
b437b30
Add build-linux-cross to CI
mtmcp Mar 17, 2025
6a447e1
Install mesa drivers before vulkan sdk
mtmcp Mar 17, 2025
ddd7b2f
Install vulkan drivers before vulkan sdk
mtmcp Mar 17, 2025
d14edbb
Only install glslang-tools (not full vulkan sdk)
mtmcp Mar 17, 2025
10edb6e
Search for GLSLC program outside find-root-path
mtmcp Mar 17, 2025
344bda5
Merge branch 'master' into ci-build-cross
mtmcp Mar 17, 2025
ce5285a
Do not specify Vulkan components
mtmcp Mar 17, 2025
ce6e549
Install shaderc
mtmcp Mar 17, 2025
b52bb4d
Set project name for vulkan-shaders-gen
mtmcp Mar 17, 2025
829bca0
Set minimum cmake project ver.
mtmcp Mar 17, 2025
d2ac204
Use ubuntu latest
mtmcp Mar 17, 2025
d8d3ba5
Add cpu-only build
mtmcp Mar 17, 2025
7e276bc
Use Noble glslc instead of LunarG
mtmcp Mar 17, 2025
ef7376e
Revert change to ggml/src/ggml-vulkan/CMakeLists.txt
mtmcp Mar 17, 2025
05bfb76
Merge branch 'master' into ci-build-cross
mtmcp Mar 21, 2025
2ec6ef0
Temp. applied patch from #12272 to test compile fix
mtmcp Mar 27, 2025
bb93531
Fix indent
mtmcp Mar 27, 2025
6140bc0
Merge branch 'master' into ci-build-cross
mtmcp Mar 27, 2025
16aef52
Add arm64 build
mtmcp Mar 27, 2025
ee51858
Revert temp. applied patch from #12272 to test compile fix
mtmcp Mar 28, 2025
f92353d
Merge branch 'master' into ci-build-cross
mtmcp Mar 28, 2025
9c4cef4
Merge branch 'master' into ci-build-cross
mtmcp Mar 31, 2025
5ad6133
Re-Activate RISCV builds
mtmcp Mar 31, 2025
610dda1
Use gcc/g++ 14 instead of default in crossbuild-essentials
mtmcp Apr 3, 2025
ed65c64
Use gcc/g++ 14 instead of crossbuild-essential
mtmcp Apr 3, 2025
67dde0b
Update build-linux-cross.yml
mtmcp Apr 3, 2025
78fa6a5
Use cmake switch for position-independent code
mtmcp Apr 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
124 changes: 124 additions & 0 deletions .github/workflows/build-linux-cross.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,124 @@
name: Build on Linux using cross-compiler
on:
workflow_dispatch:
workflow_call:

jobs:
ubuntu-latest-riscv64-cpu-cross:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
- name: Setup Riscv
run: |
sudo dpkg --add-architecture riscv64
sudo sed -i 's|http://azure.archive.ubuntu.com/ubuntu|http://ports.ubuntu.com/ubuntu-ports|g' \
/etc/apt/sources.list /etc/apt/apt-mirrors.txt
sudo apt-get clean
sudo apt-get update
sudo apt-get install -y --no-install-recommends \
build-essential \
gcc-14-riscv64-linux-gnu \
g++-14-riscv64-linux-gnu

- name: Build
run: |
cmake -B build -DCMAKE_BUILD_TYPE=Release \
-DGGML_OPENMP=OFF \
-DLLAMA_BUILD_EXAMPLES=ON \
-DLLAMA_BUILD_TESTS=OFF \
-DCMAKE_SYSTEM_NAME=Linux \
-DCMAKE_SYSTEM_PROCESSOR=riscv64 \
-DCMAKE_C_COMPILER=riscv64-linux-gnu-gcc-14 \
-DCMAKE_CXX_COMPILER=riscv64-linux-gnu-g++-14 \
-DCMAKE_C_FLAGS_INIT='-fPIC' \
-DCMAKE_CXX_FLAGS_INIT='-fPIC' \
Comment thread
slaren marked this conversation as resolved.
Outdated
-DCMAKE_FIND_ROOT_PATH=/usr/lib/riscv64-linux-gnu \
-DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=NEVER \
-DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY \
-DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=BOTH

cmake --build build --config Release -j $(nproc)

ubuntu-latest-riscv64-vulkan-cross:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0

- name: Setup Riscv
run: |
sudo dpkg --add-architecture riscv64
sudo sed -i 's|http://azure.archive.ubuntu.com/ubuntu|http://ports.ubuntu.com/ubuntu-ports|g' \
/etc/apt/sources.list /etc/apt/apt-mirrors.txt
sudo apt-get clean
sudo apt-get update
sudo apt-get install -y --no-install-recommends \
build-essential \
glslc \
gcc-14-riscv64-linux-gnu \
g++-14-riscv64-linux-gnu \
libvulkan-dev:riscv64

- name: Build
run: |
cmake -B build -DCMAKE_BUILD_TYPE=Release \
-DGGML_VULKAN=ON \
-DGGML_OPENMP=OFF \
-DLLAMA_BUILD_EXAMPLES=ON \
-DLLAMA_BUILD_TESTS=OFF \
-DCMAKE_SYSTEM_NAME=Linux \
-DCMAKE_SYSTEM_PROCESSOR=riscv64 \
-DCMAKE_C_COMPILER=riscv64-linux-gnu-gcc-14 \
-DCMAKE_CXX_COMPILER=riscv64-linux-gnu-g++-14 \
-DCMAKE_C_FLAGS_INIT='-fPIC' \
-DCMAKE_CXX_FLAGS_INIT='-fPIC' \
-DCMAKE_FIND_ROOT_PATH=/usr/lib/riscv64-linux-gnu \
-DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=NEVER \
-DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY \
-DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=BOTH

cmake --build build --config Release -j $(nproc)

ubuntu-latest-arm64-vulkan-cross:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0

- name: Setup Arm64
run: |
sudo dpkg --add-architecture arm64
sudo sed -i 's|http://azure.archive.ubuntu.com/ubuntu|http://ports.ubuntu.com/ubuntu-ports|g' \
/etc/apt/sources.list /etc/apt/apt-mirrors.txt
sudo apt-get clean
sudo apt-get update
sudo apt-get install -y --no-install-recommends \
build-essential \
glslc \
crossbuild-essential-arm64 \
libvulkan-dev:arm64

- name: Build
run: |
cmake -B build -DCMAKE_BUILD_TYPE=Release \
-DGGML_VULKAN=ON \
-DGGML_OPENMP=OFF \
-DLLAMA_BUILD_EXAMPLES=ON \
-DLLAMA_BUILD_TESTS=OFF \
-DCMAKE_SYSTEM_NAME=Linux \
-DCMAKE_SYSTEM_PROCESSOR=aarch64 \
-DCMAKE_C_COMPILER=aarch64-linux-gnu-gcc \
-DCMAKE_CXX_COMPILER=aarch64-linux-gnu-g++ \
-DCMAKE_C_FLAGS_INIT='-fPIC' \
-DCMAKE_CXX_FLAGS_INIT='-fPIC' \
-DCMAKE_FIND_ROOT_PATH=/usr/lib/aarch64-linux-gnu \
-DCMAKE_FIND_ROOT_PATH_MODE_PROGRAM=NEVER \
-DCMAKE_FIND_ROOT_PATH_MODE_LIBRARY=ONLY \
-DCMAKE_FIND_ROOT_PATH_MODE_INCLUDE=BOTH

cmake --build build --config Release -j $(nproc)
5 changes: 4 additions & 1 deletion .github/workflows/build.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ on:
push:
branches:
- master
paths: ['.github/workflows/build.yml', '**/CMakeLists.txt', '**/Makefile', '**/*.h', '**/*.hpp', '**/*.c', '**/*.cpp', '**/*.cu', '**/*.cuh', '**/*.swift', '**/*.m', '**/*.metal', '**/*.comp']
paths: ['.github/workflows/build.yml', '.github/workflows/build-linux-cross.yml', '**/CMakeLists.txt', '**/Makefile', '**/*.h', '**/*.hpp', '**/*.c', '**/*.cpp', '**/*.cu', '**/*.cuh', '**/*.swift', '**/*.m', '**/*.metal', '**/*.comp']
pull_request:
types: [opened, synchronize, reopened]
paths: ['.github/workflows/build.yml', '**/CMakeLists.txt', '**/Makefile', '**/*.h', '**/*.hpp', '**/*.c', '**/*.cpp', '**/*.cu', '**/*.cuh', '**/*.swift', '**/*.m', '**/*.metal', '**/*.comp']
Expand Down Expand Up @@ -606,6 +606,9 @@ jobs:
-DGGML_SYCL_F16=ON
cmake --build build --config Release -j $(nproc)

build-linux-cross:
uses: ./.github/workflows/build-linux-cross.yml

macOS-latest-cmake-ios:
runs-on: macos-latest

Expand Down