Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generate benchmarks for release #5263

Closed
charliermarsh opened this issue Jul 21, 2024 · 1 comment · Fixed by #5531
Closed

Generate benchmarks for release #5263

charliermarsh opened this issue Jul 21, 2024 · 1 comment · Fixed by #5531
Assignees
@charliermarsh
Labels
benchmarks Related to benchmarking documentation Improvements or additions to documentation

Comments

@charliermarsh
Copy link
Member

We're going to want a new round of benchmarks with some new comparisons.
@charliermarsh charliermarsh self-assigned this Jul 21, 2024
@charliermarsh charliermarsh added documentation Improvements or additions to documentation benchmarks Related to benchmarking labels Jul 21, 2024
@charliermarsh
Copy link
Member Author

For projects:

  • Cold resolve without lockfile
  • Warm resolve without lockfile
  • Cold resolve with lockfile
  • Warm resolve with lockfile
  • Incremental resolve (add an entry to pyproject.toml)

For tools:

  • Cold run
  • Warm run
  • Already-installed run

@charliermarsh charliermarsh mentioned this issue Jul 28, 2024
Merged
charliermarsh added a commit that referenced this issue Jul 28, 2024
@charliermarsh
Add support for benchmarking uv sync and uv lock (#5524)
efbc9fb 
## Summary

This PR adds support for `uv lock` and `uv sync` in the standardized
benchmarks script.

Part of: #5263.

## Test Plan

For example:

```sh
python scripts/bench/__main__.py --uv-project --benchmark resolve-cold ./scripts/requirements/trio.in --verbose
```
@charliermarsh charliermarsh mentioned this issue Jul 28, 2024
Merged
charliermarsh added a commit that referenced this issue Jul 28, 2024
@charliermarsh
Enable benchmarking of uv tool and pipx (#5531)
3626d08 
## Summary

Closes #5263.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@charliermarsh charliermarsh

Labels
benchmarks Related to benchmarking documentation Improvements or additions to documentation
Projects
No open projects
uv: release-ready
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Enable benchmarking of uv tool and pipx astral-sh/uv
1 participant
@charliermarsh