Skip to content
Merged
Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
76fe56c
first commit
praateekmahajan Feb 24, 2026
04f02b3
verbose handling; cleaner serve.stop
praateekmahajan Feb 26, 2026
051dac2
improve restart and tests
praateekmahajan Feb 27, 2026
32e0291
update pyproject.toml
praateekmahajan Feb 27, 2026
d66a849
add serve,llm to cuda12
praateekmahajan Feb 27, 2026
8dd7d98
switch model server to singleton
praateekmahajan Mar 3, 2026
28019fb
remove logging
praateekmahajan Mar 4, 2026
1b5f8eb
update uv.lock + pr review comments
praateekmahajan Mar 6, 2026
45df4f4
remove logging from start too and add TODO
praateekmahajan Mar 6, 2026
be55a1f
Rename to InferenceModelConfig and InferenceServer and remove tests t…
praateekmahajan Mar 9, 2026
e304ee4
add boto3 comment in pyproject.toml
praateekmahajan Mar 9, 2026
2677415
Merge branch 'main' into praateek/ray-serve
praateekmahajan Mar 9, 2026
a56ee1b
greptile reviews
praateekmahajan Mar 9, 2026
c539e75
Merge branch 'praateek/ray-serve' of github.com:praateekmahajan/Curat…
praateekmahajan Mar 9, 2026
834e367
Add handling for ray.init() and ray.shutdown()
praateekmahajan Mar 10, 2026
a66aa1d
resolve uv lock conflict
praateekmahajan Mar 10, 2026
450a8a3
move to a separate pyproject.toml group
praateekmahajan Mar 10, 2026
60cd857
add boto3 also in inference_server group
praateekmahajan Mar 10, 2026
69d07b4
Update tutorial and benchmark
praateekmahajan Mar 10, 2026
4f8fcbe
That's not a secret
praateekmahajan Mar 10, 2026
ef72ea8
greptile reviews
praateekmahajan Mar 10, 2026
761339b
not a secret and let ruff respect that
praateekmahajan Mar 10, 2026
51c9678
PR Reviews
praateekmahajan Mar 10, 2026
8be76d3
Merge remote-tracking branch 'upstream/main' into praateek/ray-serve
praateekmahajan Mar 10, 2026
3a8eba8
Merge branch 'main' into praateek/ray-serve
praateekmahajan Mar 11, 2026
a8b3b57
PR Reviews + Move inference_server to sdg_cuda12
praateekmahajan Mar 11, 2026
17fcac1
update pyproject.toml for pip
praateekmahajan Mar 11, 2026
b3fe641
remove sdg_cuda12 due to slow pip
praateekmahajan Mar 11, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions .github/workflows/install-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -235,7 +235,7 @@ jobs:
run: |
set -o pipefail
INSTALLER="${{ matrix.installer }}"
GPU_EXTRAS=("cuda12" "deduplication_cuda12" "audio_cuda12" "image_cuda12" "text_cuda12")
GPU_EXTRAS=("cuda12" "deduplication_cuda12" "audio_cuda12" "image_cuda12" "text_cuda12" "inference_server")
RESULTS=""
FAILED=0

Expand Down Expand Up @@ -517,4 +517,3 @@ jobs:
else
echo "❌ Core installation tests failed"; exit 1
fi

3 changes: 3 additions & 0 deletions nemo_curator/core/constants.py
Original file line number Diff line number Diff line change
Expand Up @@ -25,3 +25,6 @@
DEFAULT_RAY_MIN_WORKER_PORT = 10002
DEFAULT_RAY_MAX_WORKER_PORT = 19999
RAY_CLUSTER_START_VERIFICATION_TIMEOUT = 300

DEFAULT_SERVE_PORT = 8000
DEFAULT_SERVE_HEALTH_TIMEOUT_S = 300
Loading
Loading