Skip to content

chore: fallback to building barretenberg targets sequentially when RAM constrained #5426

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ludamad merged 4 commits into from
Mar 26, 2024
Merged

chore: fallback to building barretenberg targets sequentially when RAM constrained #5426

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
7590526
chore(ci): fallback to building barretenberg targets sequentially whe…
TomAFrench Mar 25, 2024
89443ff
Update barretenberg/cpp/bootstrap.sh
TomAFrench Mar 25, 2024
f603947
Merge branch 'master' into tf/sequential-bootstrap
TomAFrench Mar 25, 2024
d028900
Merge branch 'master' into tf/sequential-bootstrap
TomAFrench Mar 26, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 19 additions & 6 deletions barretenberg/cpp/bootstrap.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -77,13 +77,26 @@ b="\033[34m" # Blue
p="\033[35m" # Purple
r="\033[0m" # Reset

(build_native > >(awk -v g="$g" -v r="$r" '{print g "native: " r $0}')) &
(build_wasm > >(awk -v b="$b" -v r="$r" '{print b "wasm: " r $0}')) &
(build_wasm_threads > >(awk -v p="$p" -v r="$r" '{print p "wasm_threads: "r $0}')) &

for job in $(jobs -p); do
wait $job || exit 1
done
AVAILABLE_MEMORY=$(awk '/MemFree/ { printf $2 }' /proc/meminfo)
# This value may be too low.
# If builds fail with an amount of free memory greater than this value then it should be increased.
MIN_PARALLEL_BUILD_MEMORY=32000000

if [[ AVAILABLE_MEMORY -lt MIN_PARALLEL_BUILD_MEMORY ]]; then
echo "System does not have enough memory for parallel builds, falling back to sequential"
build_native
build_wasm
build_wasm_threads
else
(build_native > >(awk -v g="$g" -v r="$r" '{print g "native: " r $0}')) &
(build_wasm > >(awk -v b="$b" -v r="$r" '{print b "wasm: " r $0}')) &
(build_wasm_threads > >(awk -v p="$p" -v r="$r" '{print p "wasm_threads: "r $0}')) &

for job in $(jobs -p); do
wait $job || exit 1
done
fi

if [ ! -d ./srs_db/grumpkin ]; then
# The Grumpkin SRS is generated manually at the moment, only up to a large enough size for tests
Expand Down