Skip to content

fix(autoCombo): normalize -free suffix in task fitness lookups (fixes #8603) - #8636

Merged
diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.49from
Dingding-leo:fix/task-fitness-free-suffix-normalization
Jul 27, 2026
Merged

diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.49from
Dingding-leo:fix/task-fitness-free-suffix-normalization

Conversation

@Dingding-leo

Copy link
Copy Markdown
Contributor

Summary

Fixes #8603.

When model names end with the -free suffix (e.g. claude-sonnet-free), task fitness calculations fell through to wildcard/default fallback scores because lookupStaticFitnessTable and getModelsDevTierFitness did not normalize the -free suffix before looking up entries.

Changes

  • Updated lookupStaticFitnessTable in open-sse/services/autoCombo/taskFitness.ts to check the base model name without -free if the initial lookup yields null.
  • Updated getModelsDevTierFitness to check the base model name without -free if the initial lookup yields null.
  • Added unit test in open-sse/services/autoCombo/__tests__/autoCombo.test.ts verifying -free model suffix normalization.

…r fitness lookups (fixes #8603)

When looking up model task fitness in lookupStaticFitnessTable and getModelsDevTierFitness, normalized model names ending in '-free' were failing to match base model entries in static tables and capability mappings. Normalize '-free' to base model name as fallback in static lookup and models dev tier calculation, and add unit test.
Copilot AI review requested due to automatic review settings July 26, 2026 06:37

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@diegosouzapw

Copy link
Copy Markdown
Collaborator

Validated in local merge-train /tmp/train1d-20260727-090022-suite.log on .113 @ 029cdf4215cf465f0e1716ac9f84a84692b1e881 (full unit suite green on CI-equivalent host)

@diegosouzapw
diegosouzapw merged commit 96c3b94 into cheaper-inference:release/v3.8.49 Jul 27, 2026
5 checks passed
@diegosouzapw diegosouzapw mentioned this pull request Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fix(backend): static fitness table substring match returns wrong row for longer model ids (gpt-4o-mini scores as gpt-4o)

3 participants