Skip to content

Conversation

@nirrozenbaum
Copy link
Contributor

@nirrozenbaum nirrozenbaum commented Jun 12, 2025

fix comment on e2e test target in makefile. GPUs are no longer required to run the tests.

@netlify
Copy link

netlify bot commented Jun 12, 2025

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit abea094
🔍 Latest deploy log https://app.netlify.com/projects/gateway-api-inference-extension/deploys/684e6591c28b370008495042
😎 Deploy Preview https://deploy-preview-976--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jun 12, 2025
@k8s-ci-robot k8s-ci-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Jun 12, 2025
@nirrozenbaum nirrozenbaum changed the title e2e makefile [WIP] e2e makefile Jun 12, 2025
@k8s-ci-robot k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Jun 12, 2025
@kfswain
Copy link
Collaborator

kfswain commented Jun 13, 2025

Do we still need this?

@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 15, 2025
@nirrozenbaum nirrozenbaum changed the title [WIP] e2e makefile e2e makefile comment fix Jun 15, 2025
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 15, 2025
@nirrozenbaum
Copy link
Contributor Author

Do we still need this?

used it to fix the makefile comment on e2e tests (doesn't require GPUs anymore).

@ahg-g
Copy link
Contributor

ahg-g commented Jun 15, 2025

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 15, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, nirrozenbaum

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 15, 2025
@k8s-ci-robot k8s-ci-robot merged commit 0650da7 into kubernetes-sigs:main Jun 15, 2025
9 checks passed
@nirrozenbaum nirrozenbaum deleted the e2e-makefile branch June 16, 2025 05:31
shmuelk pushed a commit to shmuelk/gateway-api-inference-extension that referenced this pull request Jun 17, 2025
k8s-ci-robot pushed a commit that referenced this pull request Jun 18, 2025
…e it easier to add plugins (#881)

* configuration implementation (after rebase...)

Signed-off-by: Shmuel Kallner <[email protected]>

* Moved plugin registry back to pkg/epp/plugins

Signed-off-by: Shmuel Kallner <[email protected]>

* Removed unneeded 'forced imports' of scorers

Signed-off-by: Shmuel Kallner <[email protected]>

* Changed 'profilepicker' to 'profilehandler' in new and old code

Signed-off-by: Shmuel Kallner <[email protected]>

* Pass the configured SchedulingProfiles to LoadSchedulerConfig

Signed-off-by: Shmuel Kallner <[email protected]>

* Ensure that both the configText and configFile flags are not specified

Signed-off-by: Shmuel Kallner <[email protected]>

* Load RequestControl plugins from the configuration

Signed-off-by: Shmuel Kallner <[email protected]>

* Register all plugin factories

Signed-off-by: Shmuel Kallner <[email protected]>

* Review fixes

Signed-off-by: Shmuel Kallner <[email protected]>

* Reverted unneeded change

Signed-off-by: Shmuel Kallner <[email protected]>

* Updates from review comments

Signed-off-by: Shmuel Kallner <[email protected]>

* Added a stub interface for plugins to get data from the EPP

Signed-off-by: Shmuel Kallner <[email protected]>

* Added a temporary implementation of plugins.Handle

Signed-off-by: Shmuel Kallner <[email protected]>

* Added pluginName and plugins.Handle to plugin factory interface

Signed-off-by: Shmuel Kallner <[email protected]>

* Updated plugin factory signatures to reflect new API

Signed-off-by: Shmuel Kallner <[email protected]>

* Updated plugin instantiation to reflect new API

Signed-off-by: Shmuel Kallner <[email protected]>

* Updated plugin instantiation to reflect new API

Signed-off-by: Shmuel Kallner <[email protected]>

* Updated tests to reflect new API

Signed-off-by: Shmuel Kallner <[email protected]>

* Do not rename the imported package

Signed-off-by: Shmuel Kallner <[email protected]>

* Only upper layer of code should log errors

Signed-off-by: Shmuel Kallner <[email protected]>

* Only pass what is needed to instantiate the plugins

Signed-off-by: Shmuel Kallner <[email protected]>

* Review updates

Signed-off-by: Shmuel Kallner <[email protected]>

* Review update

Signed-off-by: Shmuel Kallner <[email protected]>

* Review update. Make more clear that the code only checks for already defined names

Signed-off-by: Shmuel Kallner <[email protected]>

* fixed e2e doc in makefile (does not require GPUs) (#976)

Signed-off-by: Nir Rozenbaum <[email protected]>

* API: Adds 5xx Status Code for Invalid ExtRef (#991)

Signed-off-by: Daneyon Hansen <[email protected]>

* feat(conformance): Add test for invalid EPP service reference (#959)

* fix boilerplate header

* add tests for InferencePoolInvalidEPPService

* change to expect error on httproute refcond

* moved the creation of the context to main.go. (#995)

this is useful when writing a different main like llm-d, allowing to propogate the same context to the whole system.

Signed-off-by: Nir Rozenbaum <[email protected]>

* fix dead links (#989)

* feat: add health check for epp cluster (#966)

* feat: add health check for epp cluster

Signed-off-by: zhengkezhou1 <[email protected]>

* remove tls

Signed-off-by: zhengkezhou1 <[email protected]>

* don't use tls

Signed-off-by: zhengkezhou1 <[email protected]>

* health checking flag

Signed-off-by: zhengkezhou1 <[email protected]>

* fix import

Signed-off-by: zhengkezhou1 <[email protected]>

* add tls options

Signed-off-by: zhengkezhou1 <[email protected]>

---------

Signed-off-by: zhengkezhou1 <[email protected]>

* Server unit test and utility to help with such tests (#820)

Signed-off-by: Ira <[email protected]>

* Update dynamic-lora-sidecar to expose metrics to track loaded adapters (#980)

* Add a metrics to track loaded adapters

* Update the sample manifests

* Add explanation of metrics from dyanmic LoRA adapter sidecar

* Add explanation of metrics from dyanmic LoRA adapter sidecar (take 2)

* Update metrics.md based on feedback

* refactor: Replace prefix cache structure with golang-lru (#928)

* refactor: Replace prefix cache structure with golang-lru

Signed-off-by: Kfir Toledo <[email protected]>
Co-authored-by: Maroon Ayoub <[email protected]>

* fix: rename prefix scorer parameters and convert test to benchmark test

Signed-off-by: Kfir Toledo <[email protected]>

* feat: Add per server LRU capacity

Signed-off-by: Kfir Toledo <[email protected]>

* fix: Fix typos and error handle

Signed-off-by: Kfir Toledo <[email protected]>

* fix: add safety check for LRUCapacityPerServer

Signed-off-by: Kfir Toledo <[email protected]>

---------

Signed-off-by: Kfir Toledo <[email protected]>
Co-authored-by: Maroon Ayoub <[email protected]>

* feat(conformance): Add HTTPRouteMultipleRulesDifferentPools test (#834)

* copy of accepted inference pool test to start from.

* add yaml file for the test

* update time out

* update the yaml file to add port 9002

* read timeout config from local repo

* remove excess comments

* correct spelling for scenarios

* check route condition on RouteConditionResolvedRefs

* remove empty lines in yaml

* set optional/defaulted fields as unspecified

* fix timeout

* fix boilerplate header

* change varialbe names to use primary secondary consistently.

* remove extra comments

* factor out common code

* Add actual http traffic validation using echo-basic

* remove extra comments from manifest

* remove modifiedTimeoutConfig.HTTPRouteMustHaveCondition per review comment.

* intermediate update

* fix the test run

* factor out common code

* move epp def to shared manifest

* remove extra comments

* revert back to two epps

* add to do for epp image

* switch to GeneralMustHaveConditionTimeout

* undo gateway version changes

* remove unused HTTPRouteMustHaveConditions

* update doc string for GetPod

* update docstring

* Remove resource type from names in manifests.

* remove type from name

* remove health check

* add todo for combining getpod methods

* configuration implementation (after rebase...)

Signed-off-by: Shmuel Kallner <[email protected]>

* After review, made code more obvious

Signed-off-by: Shmuel Kallner <[email protected]>

* Fixed merge issues

Signed-off-by: Shmuel Kallner <[email protected]>

---------

Signed-off-by: Shmuel Kallner <[email protected]>
Signed-off-by: Nir Rozenbaum <[email protected]>
Signed-off-by: Daneyon Hansen <[email protected]>
Signed-off-by: zhengkezhou1 <[email protected]>
Signed-off-by: Ira <[email protected]>
Signed-off-by: Kfir Toledo <[email protected]>
Co-authored-by: Nir Rozenbaum <[email protected]>
Co-authored-by: Daneyon Hansen <[email protected]>
Co-authored-by: sina chavoshi <[email protected]>
Co-authored-by: Xudong Wang <[email protected]>
Co-authored-by: Zhengke Zhou <[email protected]>
Co-authored-by: Ira Rosen <[email protected]>
Co-authored-by: Shotaro Kohama <[email protected]>
Co-authored-by: Kfir Toledo <[email protected]>
Co-authored-by: Maroon Ayoub <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants