feat(llm): carry KServe requested outputs on tensor requests

[yinggeh]

Summary

• Add RequestedOutput and NvCreateTensorRequest.outputs so a tensor request can name which model outputs to return and carry per-output parameters.
• Convert KServe ModelInferRequest.outputs (including parameters such as classification) in the gRPC tensor frontend. An empty list still means every model output.

Validation

• Unit tests in lib/llm/src/grpc/service/tensor.rs: parameters are preserved, empty outputs are omitted from JSON, and a valueless parameter is rejected as InvalidArgument.
• rustfmt --edition 2024 on the two touched files.

Summary by CodeRabbit

• New Features

  • Tensor requests can now specify requested output names and optional parameters.
  • Omitting requested outputs continues to represent requesting all model outputs.
  • Output parameters are preserved when tensor requests are processed.

• Bug Fixes

  • Empty output lists are omitted during JSON serialization.
  • Invalid output parameters without values are rejected.

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[yinggeh]

/ok_to_test 6f2fe42

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 18369f8d-3421-4168-becc-24add1ae2baa

📥 Commits

Reviewing files that changed from the base of the PR and between 061385a and c6cfaba.

📒 Files selected for processing (2)

• lib/llm/src/grpc/service/tensor.rs
• lib/llm/src/protocols/tensor.rs

Included review availability: Your plan provides up to 12 included reviews per hour; 11 remain after this review.

---

Walkthrough

Changes

Tensor request output handling

Layer / File(s)	Summary
Requested output contract lib/llm/src/protocols/tensor.rs	Adds RequestedOutput with a name and parameters. Adds outputs to NvCreateTensorRequest. Empty output lists are omitted during serialization.
Output conversion and validation lib/llm/src/grpc/service/tensor.rs	Converts KServe requested outputs into Dynamo values, preserves parameters, and rejects valueless parameters. Tests cover conversion and JSON serialization.

Estimated code review effort: 3 (Moderate) | ~20 minutes

Merge Risk: ⚪ Minimal · up to c6cfa

This change propagates requested output names and parameters while preserving all-output behavior and rejecting invalid valueless parameters. No merge-blocking risk remains.

🚥 Pre-merge checks | ✅ 3 | ❌ 2

❌ Failed checks (2 warnings)

Check name	Status	Explanation	Resolution
Description check	⚠️ Warning	The description explains the implementation and validation, but it omits the required Related Issues section and does not identify where the reviewer should start.	Add the required Related Issues section and select either the linked issue option with issue number(s) or the confirmation that no related issue exists. Also identify the files or areas where the reviewer should start.
Docstring Coverage	⚠️ Warning	Docstring coverage is 30.00% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff. Analyzed 10 functions across 2 files.	Write docstrings for the functions missing them to satisfy the coverage threshold.

✅ Passed checks (3 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly identifies the main change: carrying KServe requested outputs through tensor requests.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

🤖 Coding task started

---

_{Comment @coderabbitai help to get the list of available commands.}

[coderabbitai]

⚠️ Coding task failed

The task could not be completed. Open the task for details or retry.

[yinggeh]

/ok to test cbcc5aa

[yinggeh]

/ok to test d786503