Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
315 commits
Select commit Hold shift + click to select a range
97a6f36
fix: SyntaxError: Unexpected number
strophy May 10, 2023
afc4760
ci: add s3 layer cache backend and test cache mount
strophy May 10, 2023
bef52ba
chore: bump wasm-bindgen-cli version
strophy May 10, 2023
db69397
chore: debug ci
strophy May 10, 2023
a243789
build: bulild javascript inside docker container
lklimek May 10, 2023
f5ced00
build(Docker): remove drive-abci env vars from Dockerfie
lklimek May 10, 2023
06fff00
chore(rs-drive-abci): rustfmt
lklimek May 10, 2023
53088e4
Merge branch 'feat/ci-cd-caching' into feat/faster-ci
strophy May 11, 2023
09d3d35
ci: implement cache mount action
strophy May 11, 2023
dccd4a0
chore: try to use s5cmd to sync cache mount on s3
strophy May 11, 2023
4c0015f
ci: install s5cmd manually
strophy May 11, 2023
6123956
ci: install s5cmd as root
strophy May 11, 2023
a6b26a9
build: unified Dockerfile for all services
lklimek May 5, 2023
850bf20
doc: Describe Dockerfile caching
lklimek May 8, 2023
563c6d8
build(github): use new unified Dockerifle
lklimek May 8, 2023
85615e8
build(dashmate): set SCCACHE build args
lklimek May 8, 2023
1436764
build(github): set drive-abci docker timeout to 3h
lklimek May 8, 2023
2a80c2b
build: rename CARGO_BUILD_PROFILE `debug` with `dev`
lklimek May 8, 2023
8afbb21
build(github): build drive-abci docker on self-hosted runner
lklimek May 8, 2023
e6af398
build(github): rs-drive-abci uses s3 cache
lklimek May 8, 2023
5e58995
build(Dockerfile): run node.js as non-privileged user
lklimek May 8, 2023
0d5941d
build(Docker): only delete rust sources starting with rs-
lklimek May 8, 2023
fd08417
build(dashmate): entrypoint: create user only when run as root
lklimek May 8, 2023
c30de7e
feat(drive-abci): add drive-abci status command (mock for now)
lklimek May 9, 2023
6805a30
chore: minor cleanup of Dockerfile
lklimek May 9, 2023
a7b7f8b
build: bulild javascript inside docker container
lklimek May 10, 2023
89e3330
build(Docker): remove drive-abci env vars from Dockerfie
lklimek May 10, 2023
9131e8f
chore(rs-drive-abci): rustfmt
lklimek May 10, 2023
081d929
build(github): docker cache mode max
lklimek May 11, 2023
353daa7
build(wasm-dpp): use --profile instead of --release
lklimek May 11, 2023
bbcf8d4
chore(docker): self-review
lklimek May 11, 2023
54c7b8c
build(wasm-dpp): autodetect wasm-bindgen-cli version
lklimek May 11, 2023
de2053f
Merge branch 'feat/ci-cd-caching' into feat/faster-ci
strophy May 12, 2023
8e17012
debug: ci after s5cmd
strophy May 12, 2023
6f2cb9c
chore: disable gha cache
strophy May 12, 2023
de2d8b5
chore: bust cache
strophy May 12, 2023
d7ff5bb
build: unified Dockerfile for all services
lklimek May 5, 2023
fe6873c
doc: Describe Dockerfile caching
lklimek May 8, 2023
24a6ca8
build(github): use new unified Dockerifle
lklimek May 8, 2023
a0a9cea
build(dashmate): set SCCACHE build args
lklimek May 8, 2023
9af4b43
build(github): set drive-abci docker timeout to 3h
lklimek May 8, 2023
15ce460
build: rename CARGO_BUILD_PROFILE `debug` with `dev`
lklimek May 8, 2023
232297c
build(github): build drive-abci docker on self-hosted runner
lklimek May 8, 2023
ed7fd70
build(github): rs-drive-abci uses s3 cache
lklimek May 8, 2023
4a22fe7
build(Dockerfile): run node.js as non-privileged user
lklimek May 8, 2023
7a34aa2
build(Docker): only delete rust sources starting with rs-
lklimek May 8, 2023
59f815a
build(dashmate): entrypoint: create user only when run as root
lklimek May 8, 2023
e77e930
ci: build amd64 only
strophy May 12, 2023
29fa1e7
chore: show value of CARGO_HOME
strophy May 12, 2023
bb477c2
chore: minor cleanup of Dockerfile
lklimek May 9, 2023
7dd2f14
build: bulild javascript inside docker container
lklimek May 10, 2023
85e83d9
build(Docker): remove drive-abci env vars from Dockerfie
lklimek May 10, 2023
b6e1e00
build(github): docker cache mode max
lklimek May 11, 2023
a5e9dd2
build(wasm-dpp): use --profile instead of --release
lklimek May 11, 2023
ad438cc
chore(docker): self-review
lklimek May 11, 2023
bc8c283
build(wasm-dpp): autodetect wasm-bindgen-cli version
lklimek May 11, 2023
9b6f8e6
build(github): list all targets available in Dockerfile
lklimek May 12, 2023
15f17ab
chore: peer review feedback
lklimek May 12, 2023
29f0bf1
revert: downgrade bingden to create separate PR
lklimek May 12, 2023
19c3368
Revert "build(wasm-dpp): autodetect wasm-bindgen-cli version"
lklimek May 12, 2023
d3ed462
chore: peer review
lklimek May 12, 2023
377b44b
chore: switch to custom action
strophy May 12, 2023
98a1253
chore: mount absolute paths
strophy May 12, 2023
6eef7e7
fix: typo
strophy May 12, 2023
421473a
chore: bust cache
strophy May 12, 2023
7c913eb
build(dashmate): optimize list of packages transferred to the final i…
lklimek May 12, 2023
293645c
build(dapi): optimize packages transferred to final image
lklimek May 12, 2023
a01b00f
chore(Dockerfile): remove commented code
lklimek May 12, 2023
93e1d33
chore(Dockerfile): remove outdated doc comment
lklimek May 12, 2023
afa7466
chore: check if enabling rust cache speeds up yarn build
strophy May 13, 2023
e5c66f2
chore: remove s3 autocache for now
strophy May 13, 2023
bb6a05f
chore: build deps only
strophy May 13, 2023
1dc790c
chore: inspect cache mounts
strophy May 13, 2023
1b1c2c0
chore: inspect cache after build
strophy May 13, 2023
c695835
ci: try to bust cache
strophy May 15, 2023
5b17389
ci: re-enable cache
strophy May 15, 2023
ff12c34
chore: bust layer cache
strophy May 15, 2023
7ec3448
chore: enable tmate to inspect build environment
strophy May 15, 2023
2f5d64a
chore: debug username
strophy May 15, 2023
b66b2d4
chore: try to bust cache again
strophy May 15, 2023
347d013
chore: bust layer cache
strophy May 15, 2023
065fa87
chore: bust layer cache
strophy May 15, 2023
0b8db61
doc: add brew install protobuf to dependency docs
lklimek May 15, 2023
74c8839
chore(dashmate): remove unused SCCACHE_GHA_ENABLED code
lklimek May 15, 2023
f762983
build(test-suite): copy only required files
lklimek May 15, 2023
09e4898
Merge remote-tracking branch 'origin/v0.25-dev' into feat/ci-cd-caching
lklimek May 15, 2023
2f74694
Merge branch 'feat/ci-cd-caching' into feat/faster-ci
strophy May 15, 2023
5c8f9fa
chore: manually fix outstanding merge issues
strophy May 16, 2023
0b7b666
fix: action sometimes fails with curl exit code 35
strophy May 16, 2023
97a6669
fix: build sometimes fails with curl exit code 35
strophy May 16, 2023
d0cbda2
chore: bust cache
strophy May 16, 2023
c7222e9
chore: add cache mount ids
strophy May 16, 2023
02a3ee0
chore: bust cache
strophy May 16, 2023
f340d5a
Merge branch 'v0.25-dev' into feat/faster-ci
strophy May 16, 2023
06a27f1
chore: bust cache
strophy May 16, 2023
3b13e1f
chore: show debug for cargo install
strophy May 16, 2023
65462c4
chore: bust cache
strophy May 16, 2023
5fda034
chore: bust cache
strophy May 16, 2023
3e77787
chore: bust cache
strophy May 17, 2023
a1e9997
chore: bust cache
strophy May 17, 2023
6926094
chore: bust cache
strophy May 17, 2023
8c91e58
chore: bust cache
strophy May 17, 2023
e67ef2b
chore: disable debug output
strophy May 17, 2023
2906fbd
chore: bust cache
strophy May 17, 2023
cb1c929
chore: bust cache
strophy May 17, 2023
f496f5d
chore: try to build drive
strophy May 17, 2023
6894585
Merge branch 'v0.25-dev' into feat/faster-ci
strophy May 18, 2023
0f17932
chore: try deps-only build again
strophy May 18, 2023
bf3755a
chore: try to build two stages without cache mount ids
strophy May 18, 2023
e6e3f92
chore: bust cache
strophy May 18, 2023
ee25de3
chore: build drive-abci
strophy May 18, 2023
b85616a
chore: bust cache
strophy May 18, 2023
a4419bf
chore: restore mount cache id and bust cache
strophy May 18, 2023
2cb99b0
chore: bust cache
strophy May 18, 2023
e8f6055
ci: disable tmate
strophy May 18, 2023
af4e1f8
Merge branch 'v0.25-dev' into feat/faster-ci
strophy May 19, 2023
26f1fbd
chore: bust cache
strophy May 19, 2023
4707a5a
chore: bust cache
strophy May 19, 2023
8a0f2b9
chore: try locked cache mounts
strophy May 19, 2023
1bf2519
chore: bust second cache only
strophy May 19, 2023
fdb52ca
build(dapi-grpc): commit generated rust code to avoid ci/cd issues
lklimek May 19, 2023
a161ac9
chore: single cache mount across stages
strophy May 19, 2023
5bf1422
chore: bust cache
strophy May 19, 2023
3999832
chore: remove debug output
strophy May 19, 2023
e3c4e7b
chore: separate namespace for target mounts
strophy May 20, 2023
8f01a13
Merge branch 'v0.25-dev' into feat/faster-ci
strophy May 20, 2023
509232b
chore: bust cache
strophy May 20, 2023
49f20ea
chore: bust drive cache only
strophy May 20, 2023
65c4312
chore: show debug
strophy May 20, 2023
e9a7751
chore: restore shared cache
strophy May 20, 2023
6340662
chore: cache in max mode
strophy May 20, 2023
547a1ed
chore: enable rust cache fingerprint trace
strophy May 20, 2023
e130b65
chore: don't show platform contents
strophy May 20, 2023
350918d
chore: bust cache
strophy May 20, 2023
3482518
chore: disable s5cmd installation on runner
strophy May 21, 2023
d203d5e
chore: disable s5cmd push
strophy May 21, 2023
714503c
chore: bust cache
strophy May 21, 2023
b4acc2c
chore: bust cache
strophy May 21, 2023
900ce09
chore: bust cache
strophy May 21, 2023
9069138
chore: access each file before cargo accesses it
strophy May 22, 2023
074d375
chore: sleep before build
strophy May 22, 2023
be87566
chore: try locked cache
strophy May 22, 2023
0485cdf
chore: more cache busting and build cleanup
strophy May 22, 2023
a488d67
chore: enable yarn cache
strophy May 22, 2023
7bc2ec0
chore: inspect timestamps before build
strophy May 22, 2023
e0e6603
chore: bust cache
strophy May 22, 2023
df12495
chore: separate cache layers for registry
strophy May 22, 2023
f084ff8
chore: bust cache
strophy May 22, 2023
d363f80
chore: try again with db in separate dir
strophy May 22, 2023
2367b14
chore: try to touch all cache files to make them new
strophy May 23, 2023
07c804e
chore: escape command correctly
strophy May 23, 2023
34ebc18
fix: find syntax
strophy May 23, 2023
fbfe93a
chore: make cache older, not newer
strophy May 23, 2023
8a8e368
chore: move touch command to action
strophy May 23, 2023
dde90f9
chore: bust cache
strophy May 23, 2023
47cfb55
chore: bust cache
strophy May 23, 2023
0bb31c1
chore: remove debug
strophy May 23, 2023
738880e
chore: bust cache
strophy May 23, 2023
d14147e
Revert "chore: remove debug"
strophy May 24, 2023
effe9a3
chore: bust cache
strophy May 24, 2023
e85f58e
chore: remove debug
strophy May 24, 2023
d3c0b42
chore: try shared cache
strophy May 24, 2023
9f2696e
chore: try to find drive_target
strophy May 24, 2023
c75baba
chore: try to debug how docker sees the cache
strophy May 24, 2023
27c8eea
chore: install tree
strophy May 24, 2023
4d40915
chore: bust cache
strophy May 24, 2023
33f09f4
chore: inspect platform dir without cache mount
strophy May 24, 2023
31f273f
chore: inspect dir properly
strophy May 24, 2023
b3b5611
chore: debug target dir again
strophy May 24, 2023
e78f8fb
chore: configure docker gc
strophy May 26, 2023
0498a17
chore: increase cache keep duration to match s3
strophy May 26, 2023
523a7e2
chore: bust cache
strophy May 26, 2023
88ee38d
chore: remove debug
strophy May 26, 2023
79ac634
Merge branch 'v0.25-dev' into feat/faster-ci
strophy May 30, 2023
5749e52
chore: single platform dir
strophy May 31, 2023
916d7ca
chore: bust cache
strophy May 31, 2023
3387c56
chore: bust wasm-bindgen only
strophy May 31, 2023
5d1593d
chore: restore fingerprint debug
strophy May 31, 2023
cc4720d
chore: disable git cli
strophy May 31, 2023
095c357
fix: syntax
strophy May 31, 2023
07139c8
chore: bust drive cache
strophy May 31, 2023
fd2be3f
chore: bust deps only
strophy May 31, 2023
f3023a3
chore: try dynamic linking
strophy Jun 1, 2023
f65c732
fix: syntax
strophy Jun 1, 2023
77184cf
fix: bad syntax
strophy Jun 1, 2023
ddc78ac
chore: bust wasm
strophy Jun 1, 2023
651ca0d
chore: bust drive
strophy Jun 1, 2023
b9cec9c
chore: bust both
strophy Jun 1, 2023
58729a0
chore: bust drive
strophy Jun 2, 2023
7b06d40
chore: bust wasm
strophy Jun 2, 2023
60a5a8e
chore: bust both
strophy Jun 2, 2023
71d4e54
chore: remove debug
strophy Jun 2, 2023
75c18c4
chore: try to cache dapi build and unplugged dir
strophy Jun 2, 2023
60f79fa
chore: enable dapi build
strophy Jun 2, 2023
ff95780
fix: tag input missing
strophy Jun 2, 2023
328ac7c
chore: rename unplugged cache mount
strophy Jun 2, 2023
e45f879
chore: try to release all docker stages
strophy Jun 2, 2023
b966757
chore: disable arm builds
strophy Jun 2, 2023
01ed638
chore: remove cache mount restore from envoy build
strophy Jun 2, 2023
ef4dcda
chore: disable s3 cache for envoy
strophy Jun 2, 2023
24649f2
chore: disable envoy build
strophy Jun 2, 2023
d20b519
chore: debug dapi build on fail
strophy Jun 2, 2023
332e468
Merge branch 'v0.25-dev' into feat/faster-ci
strophy Jun 2, 2023
a15be58
chore: check if updating ssh2 helps
strophy Jun 3, 2023
69d62ff
chore: disable tmate
strophy Jun 3, 2023
d23760d
Revert "chore: disable tmate"
strophy Jun 5, 2023
2636551
Revert "chore: check if updating ssh2 helps"
strophy Jun 5, 2023
447ee44
chore: cache .yarn/cache dir
strophy Jun 5, 2023
a93dcfc
chore: disable tmate
strophy Jun 5, 2023
8de3dee
Revert "chore: cache .yarn/cache dir"
strophy Jun 6, 2023
f412fc5
chore: disable test suite build
strophy Jun 6, 2023
0e6af2b
chore: debug unplugged dir
strophy Jun 6, 2023
e8ee4df
chore: try to lock unplugged mount
strophy Jun 6, 2023
beaa4cd
chore: try to use yarn 3.6.0
strophy Jun 6, 2023
031489e
Merge branch 'v0.25-dev' into feat/faster-ci
strophy Jun 8, 2023
cc667bc
build: provide `node-gyp` deps for ssh2 build
shumkov Jun 8, 2023
62d895d
Merge remote-tracking branch 'origin/feat/faster-ci' into feat/faster-ci
shumkov Jun 8, 2023
001e007
build: fix cache mount for yarn unplugged
shumkov Jun 8, 2023
b426c0e
chore: include install-state.gz in cache mount
strophy Jun 9, 2023
b3578d3
Merge branch 'v0.25-dev' into feat/faster-ci
strophy Jun 9, 2023
fbbcd57
chore: install wasm-bindgen generated artifacts and intermediate file…
strophy Jun 9, 2023
632637d
chore: try to inspect and use $workspace_root
strophy Jun 9, 2023
b8f36ed
chore: replace tree with ls command
strophy Jun 9, 2023
6cea887
chore: disable drive build
strophy Jun 9, 2023
880f072
fix: syntax
strophy Jun 9, 2023
2332925
chore: remove broken ls commands
strophy Jun 9, 2023
0d5e72a
chore: bump deps in base image
strophy Jun 9, 2023
c18d244
chore: remove debug
strophy Jun 9, 2023
62218e9
chore: remove target-dir
strophy Jun 9, 2023
db2cf55
chore: revert to yarn 3.3.0
strophy Jun 9, 2023
8b3a929
chore: revert retry
strophy Jun 9, 2023
da006e6
chore: revert npm
strophy Jun 9, 2023
5c6bb3c
fix: unnecessary newline
strophy Jun 9, 2023
af5c6f5
chore: remove sccache from release workflows
strophy Jun 9, 2023
4f80c19
chore: remove debug
strophy Jun 9, 2023
0420ed8
chore: enable layer cache for dashmate-helper
strophy Jun 9, 2023
a02767b
chore: enable test suite and drive builds
strophy Jun 9, 2023
a654b5f
chore: disable non-dapi runs
strophy Jun 13, 2023
2bce90b
chore: try s3 cache backend
strophy Jun 13, 2023
04935fd
fix: A mapping was not expected
strophy Jun 13, 2023
fd23027
chore: try manual s3 command
strophy Jun 13, 2023
f148fc4
chore: handle install-state.gz
strophy Jun 13, 2023
33b5a3d
chore: remove old stuff
strophy Jun 13, 2023
58b1a6e
chore: cache cargo stuff in non-docker build
strophy Jun 13, 2023
d053084
chore: debug
strophy Jun 13, 2023
f1cb309
chore: remove debug
strophy Jun 13, 2023
aeb8dc8
chore: use absolute dirs because CARGO_HOME is not set
strophy Jun 13, 2023
e90c8b4
chore: move cache shuffle after yarn build
strophy Jun 13, 2023
58b7c27
chore: try opendal cache only
strophy Jun 13, 2023
2f42ce1
chore: get credentials from role
strophy Jun 13, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/actions/rust/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ runs:
- name: Set sccache Rust variables
shell: bash
run: |
echo SCCACHE_GHA_ENABLED=true >> $GITHUB_ENV
echo SCCACHE_BUCKET=platform-runner-cache >> $GITHUB_ENV
echo RUSTC_WRAPPER=sccache >> $GITHUB_ENV

- name: Rust cache
Expand Down
31 changes: 19 additions & 12 deletions .github/workflows/all-packages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -65,11 +65,13 @@ jobs:
test-suite:
name: Run Platform Test Suite
runs-on: self-hosted
if: false
timeout-minutes: 30
env:
SCCACHE_GHA_ENABLED: "true"
SCCACHE_BUCKET: "platform-runner-cache"
RUSTC_WRAPPER: "sccache"
CARGO_INCREMENTAL: "false"
SCCACHE_GHA_ENABLED: "false"
steps:
- name: Check out repo
uses: actions/checkout@v3
Expand All @@ -91,18 +93,18 @@ jobs:
toolchain: stable
target: wasm32-unknown-unknown

- name: Setup Cargo cache
uses: Swatinem/rust-cache@v2
with:
# Don't cache ./target, as it takes tons of space, use sccache instead.
cache-targets: false
# We set a shared key, as our cache is reusable between jobs
shared-key: rust-cargo
# - name: Setup Cargo cache
# uses: Swatinem/rust-cache@v2
# with:
# # Don't cache ./target, as it takes tons of space, use sccache instead.
# cache-targets: false
# # We set a shared key, as our cache is reusable between jobs
# shared-key: rust-cargo

- name: Setup Rust compilation cache
uses: mozilla-actions/sccache-action@v0.0.3
with:
version: "v0.4.1"
# - name: Setup Rust compilation cache
# uses: mozilla-actions/sccache-action@v0.0.3
# with:
# version: "v0.4.1"

- name: Enable corepack
run: corepack enable
Expand All @@ -127,6 +129,10 @@ jobs:
- name: Set up Docker BuildX
id: buildx
uses: docker/setup-buildx-action@v2
with:
install: true
driver-opts: |
image=moby/buildkit:master

- name: Enable docker cache mount
uses: actions/cache@v3
Expand Down Expand Up @@ -159,6 +165,7 @@ jobs:
test-suite-browsers:
name: Run Platform Test Suite in Browsers
runs-on: self-hosted
if: false
timeout-minutes: 30
env:
SCCACHE_GHA_ENABLED: "true"
Expand Down
3 changes: 2 additions & 1 deletion .github/workflows/js-checks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ jobs:
lint:
name: Linting
runs-on: self-hosted
if: false
timeout-minutes: 15
env:
SCCACHE_GHA_ENABLED: "true"
Expand Down Expand Up @@ -93,7 +94,7 @@ jobs:
name: Tests
runs-on: self-hosted
timeout-minutes: 30
if: ${{ !inputs.skip-tests }}
if: false
env:
SCCACHE_GHA_ENABLED: "true"
RUSTC_WRAPPER: "sccache"
Expand Down
Loading