Skip to content

[RFC] RFC 006: Multi-Component Reward Signals - #624

Closed
adithya-s-k wants to merge 1 commit into
huggingface:mainfrom
adithya-s-k:rfc-006-multi-component-rewards
Closed

[RFC] RFC 006: Multi-Component Reward Signals#624
adithya-s-k wants to merge 1 commit into
huggingface:mainfrom
adithya-s-k:rfc-006-multi-component-rewards

Conversation

@adithya-s-k

Copy link
Copy Markdown
Collaborator

Summary

This PR proposes RFC 006 for a standardized multi-component reward representation that remains fully backward compatible with existing scalar reward pipelines.

Scope

  • Adds rfcs/006-multi-component-rewards.md
  • Design-only RFC PR (no runtime behavior changes)

Why

  • Improve reward observability and debugging in complex agentic tasks
  • Keep scalar optimization contract unchanged
  • Standardize component-level reward schema across environments

Compatibility

  • observation.reward remains unchanged
  • Component payload is additive in metadata only

Related

Closes #623

@greptile-apps

greptile-apps Bot commented Apr 29, 2026

Copy link
Copy Markdown
Contributor

PR title or description contains an excluded keyword.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Apr 29, 2026
@adithya-s-k

Copy link
Copy Markdown
Collaborator Author

Closing without merging. The RFC never got ratified and I'm no longer proposing multi-component rewards as an OpenEnv-core change (see #623 for the full reasoning) — the component/weighting need is being met on the training-framework reward contract instead. Leaving the RFC unmerged so rfcs/ reflects only ratified designs. Happy to re-open a scoped version later if OpenEnv needs its own schema.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot. RFC size: medium Medium pull request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

RFC 006 proposal: standard multi-component rewards with scalar compatibility

2 participants