Skip to content

Commit

Permalink
fix typo in website/blog/2023-05-18-GPT-adaptive-humaneval/index.mdx (#…
Browse files Browse the repository at this point in the history
…299)

Co-authored-by: Qingyun Wu <[email protected]>
  • Loading branch information
Surav Shrestha and qingyun-wu authored Oct 19, 2023
1 parent 8d4afe4 commit 1983575
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion website/blog/2023-05-18-GPT-adaptive-humaneval/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ In this blog post, we will explore a creative, adaptive way of using GPT models

## Observations

* GPT-3.5-Turbo can alrady solve 40%-50% tasks. For these tasks if we never use GPT-4, we can save nearly 40-50% cost.
* GPT-3.5-Turbo can already solve 40%-50% tasks. For these tasks if we never use GPT-4, we can save nearly 40-50% cost.
* If we use the saved cost to generate more responses with GPT-4 for the remaining unsolved tasks, it is possible to solve some more of them while keeping the amortized cost down.

The obstacle of leveraging these observations is that we do not know *a priori* which tasks can be solved by the cheaper model, which tasks can be solved by the expensive model, and which tasks can be solved by paying even more to the expensive model.
Expand Down

0 comments on commit 1983575

Please sign in to comment.