Skip to content

Remove gaie#145

Merged
kalantar merged 5 commits into
llm-d-incubation:mainfrom
kalantar:remove-gaie
Oct 31, 2025
Merged

Remove gaie#145
kalantar merged 5 commits into
llm-d-incubation:mainfrom
kalantar:remove-gaie

Conversation

@kalantar

@kalantar kalantar commented Oct 21, 2025

Copy link
Copy Markdown
Collaborator

Remove gaie components (epp/inferencepool). None of the llm-d guides use ms for deploying gaie. There is an upstream chart defined here: https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/config/charts/inferencepool (released versions at oci://registry.k8s.io/gateway-api-inference-extension/charts/inferencepool) that we would basically be copying if we maintained these pieces.

Also removes creation of HTTPRoute but documents how to do this. HTTPRoutes are really between the gateway and gaie components. There are many ways to create them. We find that except for the simplest cases, users redefine them. An extraObject can be used to include them if desired.

Fixes #135.

This is a breaking change.

Signed-off-by: Michael Kalantar <kalantar@us.ibm.com>
Signed-off-by: Michael Kalantar <kalantar@us.ibm.com>
@kalantar kalantar requested a review from jgchn October 21, 2025 14:39
@kalantar

Copy link
Copy Markdown
Collaborator Author

This should also fix #121.

@jgchn jgchn left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also update chart minor version

Comment thread README.md Outdated
Comment thread examples/README.md
Comment thread examples/README.md Outdated
Comment thread examples/README.md Outdated
Comment thread examples/README.md Outdated
Comment thread examples/README.md
Signed-off-by: Michael Kalantar <kalantar@us.ibm.com>
Signed-off-by: Michael Kalantar <kalantar@us.ibm.com>
Comment thread examples/README.md
Comment thread README.md

@jgchn jgchn left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yankay

yankay commented Oct 28, 2025

Copy link
Copy Markdown
Collaborator

/lgtm

@github-actions github-actions Bot added the lgtm Looks good to me, indicates that a PR is ready to be merged. label Oct 28, 2025
@kalantar kalantar merged commit e7dfb0b into llm-d-incubation:main Oct 31, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

breaking change lgtm Looks good to me, indicates that a PR is ready to be merged.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove/deprecate gaie components

3 participants