Skip to content

Commit d08cf37

Browse files
authored
fix(cli): update run command shmsize (#246)
Because - better local model run performance This commit - update run command shmsize
1 parent 444b210 commit d08cf37

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

instill/helpers/cli.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -289,6 +289,7 @@ def run(args):
289289
"run",
290290
"--rm",
291291
"-d",
292+
"--shm-size=4gb",
292293
"--name",
293294
str(name),
294295
f"{args.name}:{args.tag}",
@@ -301,7 +302,7 @@ def run(args):
301302
)
302303
else:
303304
subprocess.run(
304-
f"docker run --rm -d --name {str(name)} --gpus all {args.name}:{args.tag} /bin/bash -c \
305+
f"docker run --rm -d --shm-size=4gb --name {str(name)} --gpus all {args.name}:{args.tag} /bin/bash -c \
305306
\"serve build _model:entrypoint -o serve.yaml && \
306307
sed -i 's/app1/default/' serve.yaml && \
307308
sed -i 's/num_cpus: 0.0/num_gpus: 1.0/' serve.yaml && \

0 commit comments

Comments
 (0)