Skip to content

Edit prediction: add some typescript evals, fix a teacher model failure mode - #50141

Merged
maxbrunsfeld merged 2 commits into
mainfrom
edit-prediction-evals
Feb 25, 2026
Merged

Edit prediction: add some typescript evals, fix a teacher model failure mode#50141
maxbrunsfeld merged 2 commits into
mainfrom
edit-prediction-evals

Conversation

@maxbrunsfeld

Copy link
Copy Markdown
Collaborator

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
format_related_files_within_budget, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.

Release Notes:

  • N/A

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
`format_related_files_within_budget`, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.
@cla-bot cla-bot Bot added the cla-signed The user has signed the Contributor License Agreement label Feb 25, 2026
@zed-community-bot zed-community-bot Bot added the staff Pull requests authored by a current member of Zed staff label Feb 25, 2026
@maxbrunsfeld maxbrunsfeld changed the title Edit prediction: add some typescript evals, fix an teacher model failure mode Edit prediction: add some typescript evals, fix a teacher model failure mode Feb 25, 2026
@maxbrunsfeld
maxbrunsfeld merged commit 3da9adc into main Feb 25, 2026
38 checks passed
@maxbrunsfeld
maxbrunsfeld deleted the edit-prediction-evals branch February 25, 2026 23:47
rtfeldman pushed a commit that referenced this pull request Feb 27, 2026
…re mode (#50141)

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
`format_related_files_within_budget`, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.

Release Notes:

- N/A
tahayvr pushed a commit to tahayvr/zed that referenced this pull request Mar 4, 2026
…re mode (zed-industries#50141)

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
`format_related_files_within_budget`, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.

Release Notes:

- N/A
jonx pushed a commit to jonx/zed-aros that referenced this pull request Jul 17, 2026
…re mode (zed-industries#50141)

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
`format_related_files_within_budget`, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.

Release Notes:

- N/A
jolutz pushed a commit to jolutz/zed that referenced this pull request Aug 8, 2026
…re mode (zed-industries#50141)

In some evals, the teacher produced hallucinations, seemingly due to
context rot. This makes the zeta prompt crate's budgeted rendering
usable by the teacher, so that it can truncate the list of excerpts.

I've also cleaned up the implementation of zeta_prompt's
`format_related_files_within_budget`, and changed the behavior so that
it filters the the excerpts by priority but renders the files in their
original order.

Release Notes:

- N/A
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed The user has signed the Contributor License Agreement staff Pull requests authored by a current member of Zed staff

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant