Skip to content

feat: dynamo deploy hello world example to k8s - #205

Merged
biswapanda merged 59 commits into
mainfrom
bis/dynamo-api-store
Mar 28, 2025
Merged

biswapanda merged 59 commits into
mainfrom
bis/dynamo-api-store

Conversation

@biswapanda

@biswapanda biswapanda commented Mar 17, 2025 •

Copy link
Copy Markdown
Contributor

Overview:

Features:

  1. onboard hello world dynamo deployment in k8s cluster
  2. separate storage api server deployment to handle dynamo storage in S3 compatible object storage
  3. ubuntu based image to run hello world example
  4. fixes to helm chart, operator and api-servers to get k8s deployment fully functional
 # Step.1: Login to  dynamo server
  export DYNAMO_SEREVR=https://ci-ephemeral-bis.dev.aire.nvidia.com
  dynamo server login --api-token TEST-TOKEN --endpoint $DYNAMO_SEREVR   

 # Step.2:  use a framework-less base image and build a dynamo nim
  export DYNAMO_IMAGE=nvcr.io/nvidian/nim-llm-dev/dynamo-base:097fb745a43e85b8c9e5ad0cf217e03290c865e8
  cd /workspace/examples/hello_world
  DYNAMO_TAG=$(dynamo build hello_world:Frontend | grep "Successfully built" | awk -F"\"" '{ print $2 }')

 # Step.3: Deploy!  
  echo $DYNAMO_TAG
  dynamo deployment create $DYNAMO_TAG --no-wait -n ci-hw

Details:

Where should the reviewer start?

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

@biswapanda biswapanda self-assigned this Mar 17, 2025
@biswapanda
biswapanda marked this pull request as draft March 17, 2025 04:35
@biswapanda biswapanda changed the title Bis/dynamo api store [feat] add python api server to handle dynamo storage related apis Mar 17, 2025
@biswapanda
biswapanda force-pushed the bis/dynamo-api-store branch from b5e5180 to 6635e39 Compare March 17, 2025 04:42
@biswapanda
biswapanda force-pushed the bis/dynamo-api-store branch from c774d14 to f616c2e Compare March 17, 2025 05:22
@biswapanda
biswapanda force-pushed the bis/dynamo-api-store branch from 642db7e to 4a05d29 Compare March 19, 2025 18:57
@copy-pr-bot

copy-pr-bot Bot commented Mar 19, 2025

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@biswapanda biswapanda changed the title [feat] add python api server to handle dynamo storage related apis [feat] add python api server and e2e CI pipeline Mar 20, 2025
@saturley-hall

Copy link
Copy Markdown
Member

/ok to test

Comment thread deploy/dynamo/api-store/README.md Outdated
Comment thread deploy/dynamo/tests/test_deployment.sh
Comment thread deploy/dynamo/operator/api/v1alpha1/dynamoinimdeployment_types.go
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Comment thread deploy/dynamo/api-server/.env Outdated
Comment thread deploy/dynamo/api-store/.env Outdated
Comment thread deploy/dynamo/api-store/ai_dynamo_store/.env Outdated
Comment thread deploy/dynamo/api-store/docker-compose.yaml Outdated

@julienmancuso julienmancuso left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@tanmayv25 tanmayv25 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving to unblock.

This branch was previously deployed

1 inactive deployment
GITLAB — 0c00da5e Deployed Mar 28, 2025 by copy-pr-bot[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants