Skip to content

Enable PGO for Linux x86-64 ty releases #4213

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
charliermarsh merged 11 commits into from
Aug 11, 2026
Merged

Enable PGO for Linux x86-64 ty releases #4213

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
fb1726d
Enable profile-guided optimization for Linux x86_64 ty builds
charliermarsh Aug 7, 2026
3cf0552
Include incremental language-server workloads in ty PGO
charliermarsh Aug 7, 2026
bc34f62
Harden ty PGO training across native platforms
charliermarsh Aug 7, 2026
afb9536
Expand ty PGO corpus with real applications
charliermarsh Aug 10, 2026
6502ca6
Explain the ty PGO corpus methodology
charliermarsh Aug 10, 2026
5259f0c
Clarify the ty PGO corpus selection
charliermarsh Aug 10, 2026
8dea756
Standardize ty PGO training settings
charliermarsh Aug 10, 2026
24c7f2a
Align ty PGO hotness with size optimization
charliermarsh Aug 10, 2026
7e64bad
Install project dependencies during PGO training
charliermarsh Aug 11, 2026
58f75f6
Use project Python versions for PGO training
charliermarsh Aug 11, 2026
7ce2ea4
Benchmark eight-core Linux x86-64 PGO builds
charliermarsh Aug 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 23 additions & 1 deletion .github/workflows/build-binaries.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ on:
- pyproject.toml
# And when we change this workflow itself...
- .github/workflows/build-binaries.yml
- scripts/build_ty_pgo.py

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
Expand Down Expand Up @@ -227,7 +228,7 @@ jobs:

linux:
if: ${{ !contains(github.event.pull_request.labels.*.name, 'no-build') }}
runs-on: depot-ubuntu-24.04-4
runs-on: ${{ matrix.target == 'x86_64-unknown-linux-gnu' && 'depot-ubuntu-24.04-8' || 'depot-ubuntu-24.04-4' }}
strategy:
matrix:
target:
Expand All @@ -242,13 +243,34 @@ jobs:
with:
python-version: ${{ env.PYTHON_VERSION }}
architecture: x64
- name: "Install uv for PGO training"
if: ${{ matrix.target == 'x86_64-unknown-linux-gnu' }}
uses: astral-sh/setup-uv@c771a70e6277c0a99b617c7a806ffedaca235ff9 # v9.0.0
- name: "Install LLVM profiling tools"
id: pgo-toolchain
if: ${{ matrix.target == 'x86_64-unknown-linux-gnu' }}
working-directory: ruff
run: |
rustup component add llvm-tools-preview
echo "toolchain=$(rustc --version | cut -d ' ' -f2)" >> "$GITHUB_OUTPUT"
- name: "Train PGO ty"
if: ${{ matrix.target == 'x86_64-unknown-linux-gnu' }}
run: |
python scripts/build_ty_pgo.py \
--target "${{ matrix.target }}" \
--target-dir "${{ github.workspace }}/ruff/target/ty-pgo" \
--train-only

PROFILE_HOT_COUNT="$(cat "${{ github.workspace }}/ruff/target/ty-pgo/ty.profile-hot-count")"
echo "RUSTFLAGS=${RUSTFLAGS:+${RUSTFLAGS} }-Cprofile-use=${{ github.workspace }}/ruff/target/ty-pgo/ty.profdata -Cllvm-args=--profile-summary-hot-count=$PROFILE_HOT_COUNT" >> "$GITHUB_ENV"
- name: "Prep README.md"
run: python scripts/transform_readme.py
- name: "Build wheels"
uses: PyO3/maturin-action@e83996d129638aa358a18fbd1dfb82f0b0fb5d3b # v1.51.0
with:
maturin-version: v1.14.1
target: ${{ matrix.target }}
rust-toolchain: ${{ steps.pgo-toolchain.outputs.toolchain }}
manylinux: 2_17
args: --release --locked --out dist --compatibility pypi
- name: "Test wheel"
Expand Down
Loading