Skip to content

Add SSL Cert Functionality#224

Merged
hnyls2002 merged 6 commits intosgl-project:mainfrom
nivibilla:main
Mar 3, 2024
Merged

Add SSL Cert Functionality#224
hnyls2002 merged 6 commits intosgl-project:mainfrom
nivibilla:main

Conversation

@nivibilla
Copy link
Copy Markdown
Contributor

Adds a verify parameter to the RuntimeEndpoint and modifies utils.py.

can be used like

runtime = sgl.RuntimeEndpoint(url, verify='./ca_bundle.crt')

This doesn't modify any of the openai python interactions since we can just do this instead

import httpx
import openai
client = openai.Client(
    base_url=url + "/v1",
    http_client = httpx.Client(verify='./ca_bundle.crt'),
    api_key='none'
    )

# Chat completion
response = client.chat.completions.create(
    model="default",
    messages=[
        {"role": "system", "content": "You are a helpful AI assistant"},
        {"role": "user", "content": "List 3 countries and their capitals."},
    ],
    temperature=0,
    max_tokens=64,
)
print(response)

@nivibilla nivibilla mentioned this pull request Feb 23, 2024
@hnyls2002 hnyls2002 merged commit 01b07ea into sgl-project:main Mar 3, 2024
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
vschandramourya pushed a commit to vschandramourya/sglang that referenced this pull request Feb 3, 2026
lujangus pushed a commit to tails-mpt/sglang that referenced this pull request Mar 31, 2026
…ect#224)

* support deepseek-v2-lite online train and support yarn rope

* Update run_deepseek_v2_lite_eagle3_online.sh

* Update llama3_eagle.py

* fix fmt
EdwardXuy pushed a commit to shun8686/sglang that referenced this pull request Apr 6, 2026
update memory_and_scheduling & optimization_debug_options & runtime_options testcases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants