Skip to content

Commit bac8459

Browse files
biswapandannshah1
authored andcommitted
fix: hello world yaml and messages (#2634)
Signed-off-by: nnshah1 <[email protected]>
1 parent 3f67f0e commit bac8459

File tree

2 files changed

+4
-3
lines changed

2 files changed

+4
-3
lines changed

examples/runtime/hello_world/client.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ async def worker(runtime: DistributedRuntime):
4040
try:
4141
# Issue request and process the stream
4242
idx += 1
43-
stream = await client.generate(f"Query[{idx}] Hello world")
43+
stream = await client.generate("world,sun,moon,star")
4444
async for response in stream:
4545
print(response.data())
4646
# Reset backoff on successful iteration

examples/runtime/hello_world/deploy/hello_world.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,7 @@ kind: DynamoGraphDeployment
66
metadata:
77
name: hello-world
88
spec:
9+
backendFramework: vllm
910
services:
1011
Frontend:
1112
livenessProbe:
@@ -60,7 +61,7 @@ spec:
6061
command:
6162
- /bin/sh
6263
- -c
63-
- 'grep "Serving endpoint" /tmp/hello_world.log'
64+
- "exit 0"
6465
initialDelaySeconds: 60
6566
periodSeconds: 60
6667
timeoutSeconds: 30
@@ -83,4 +84,4 @@ spec:
8384
- /bin/sh
8485
- -c
8586
args:
86-
- python3 hello_world.py 2>&1 | tee /tmp/hello_world.log
87+
- python3 hello_world.py

0 commit comments

Comments
 (0)