Use the `sccache-dist` build cluster in CI - #479

Merged

trxcllnt merged 102 commits into

rapidsai:branch-25.10from

trxcllnt:fea/use-sccache-build-cluster

Aug 11, 2025

Commits on Apr 12, 2025

Add scripts to configure sccache-dist and use the build cluster in CI
trxcllnt
committed
631d3f5

Commits on Apr 14, 2025

Merge branch 'branch-25.06' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
b87e1e7

Commits on Apr 16, 2025

Merge branch 'branch-25.06' into fea/use-sccache-build-cluster
trxcllnt
authored
a72407d
remove -DCMAKE_POLICY_VERSION_MINIMUM=3.5
trxcllnt
committed
3932245
temporarily use my cuspatial fork
trxcllnt
committed
1de075e

Commits on Apr 17, 2025

Commits on Apr 21, 2025

cleanup
trxcllnt
committed
5978e0d

Commits on Apr 22, 2025

Commits on Apr 23, 2025

Merge branch 'branch-25.06' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
622a5af

Commits on Apr 30, 2025

switch back to shared-workflows@branch-25.06
trxcllnt
committed
31436cf

Commits on May 1, 2025

revert cuspatial chnage in manifest.yaml
trxcllnt
committed
b126fd1
pass -q option to `git branch --remotes -d`
trxcllnt
committed
3cf4f74

Commits on May 3, 2025

log output
trxcllnt
committed
9285ac5
be safer when constructing command args
trxcllnt
committed
471307c
don't background rapids-generate-scripts
trxcllnt
committed
92d25ad
fix typo
trxcllnt
committed
a34964f

Commits on May 6, 2025

Commits on May 7, 2025

Merge branch 'branch-25.06' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
c8659ac

Commits on May 8, 2025

default -j with no value to hard nofile limit in configure and build scripts
trxcllnt
committed
bd8d712

Commits on May 10, 2025

enable sccache keepalive
trxcllnt
committed
04001cc

Commits on May 13, 2025

Merge branch 'branch-25.06' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
2eb515f

Commits on May 23, 2025

Commits on Jun 11, 2025

Commits on Jun 26, 2025

Merge branch 'branch-25.08' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
2774d6f

Commits on Jun 30, 2025

enable and configure sccache-dist by default
trxcllnt
committed
abd6d4f
set RMM's default branch to main, fix devcontainer-utils tests
trxcllnt
committed
825192e

Commits on Jul 1, 2025

use cpu4 runners
trxcllnt
committed
a7a960c
cpu4 -> cpu8
trxcllnt
committed
84ba6a3
remove SCCACHE_S3_KEY_PREFIX
trxcllnt
committed
9b00a04

Commits on Jul 2, 2025

default to rapidsai/sccache
trxcllnt
committed
e1adb33
switch back to rapidsai/shared-workflows@branch-25.08
trxcllnt
committed
2d5e5c7
switch back to cp -n
trxcllnt
committed
2aa0507
use ninja v1.12.1
trxcllnt
committed
b21ad62

Commits on Jul 3, 2025

Commits on Jul 5, 2025

fix build-all-{cpp,python}
trxcllnt
committed
63adf3a
recache
trxcllnt
committed
551e947
Revert "recache"
trxcllnt
committed
745b501

Commits on Jul 6, 2025

remove --compress-mode and -static-global-template-stub from clangd args
trxcllnt
committed
af6851c

Commits on Jul 7, 2025

Commits on Jul 8, 2025

copy common scripts
trxcllnt
committed
4c64bbf
measure CI build times on 8-core runners with sccache and sccache-dist
trxcllnt
committed
aae691b

Commits on Jul 11, 2025

Commits on Jul 16, 2025

remove dead code
trxcllnt
committed
4dcff98
support repo dependency_keys in manifest.yaml
trxcllnt
committed
91f03d2

Commits on Jul 18, 2025

Commits on Jul 19, 2025

-j128
trxcllnt
committed
29a6b8a
lower nofile ulimits
trxcllnt
committed
4fe00e5

Commits on Jul 21, 2025

background rapids-merge-compile-commands-json call
trxcllnt
committed
d15e6e0
fix typo
trxcllnt
committed
78c5254
set process nofile ulimit again
trxcllnt
committed
e94b573
Merge branch 'branch-25.08' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
d075ae6
bump devcontainer feature version
trxcllnt
committed
b315758
test always uploading sccache client logs
trxcllnt
committed
ad09243
print memory usage every 1s
trxcllnt
committed
9acb5dd

Commits on Jul 22, 2025

Fix bash race conditions in rapids-make-{conda,pip}-dependencies
trxcllnt
committed
04eb45b
Merge branch 'fix/rapids-make-env-races' into fea/use-sccache-build-cluster
trxcllnt
committed
4b0e12f
update devcontainer feature version
trxcllnt
committed
723f2ee
increase nofile ulimit to 500k
trxcllnt
committed
de87de9
Merge branch 'branch-25.08' of github.com:rapidsai/devcontainers into fea/use-sccache-build-cluster
trxcllnt
committed
0ab78bd
Revert "print memory usage every 1s"
trxcllnt
committed
3f1df88
use the connection pool
trxcllnt
committed
fc2a498

Commits on Jul 23, 2025

fix rapids-make-pip-dependencies with -r flag
trxcllnt
committed
f1bb107
use files again instead of a fifo
trxcllnt
committed
9e7512f

Commits on Jul 30, 2025

don't use connection pooling
trxcllnt
committed
d443366
persist the preprocessor cache across runs
trxcllnt
committed
b4ae283

Commits on Jul 31, 2025

Commits on Aug 1, 2025

Revert "recache"
trxcllnt
committed
5b41354

Commits on Aug 5, 2025

Commits on Aug 7, 2025

Commits on Aug 8, 2025

Revert "fix shell init script for nvhpc25.7"
trxcllnt
committed
f215b07

Commits on Aug 9, 2025

Commits on Aug 11, 2025

switch back to shared-workflows branch-25.10
trxcllnt
committed
77fe8c1
tee build times out to /var/log
trxcllnt
committed
dccfebc
print build times at the end
trxcllnt
committed
e1b8de2
remove SCCACHE_S3_KEY_PREFIX
trxcllnt
committed
768745b