Add Pyodide support #12731

hoodmane · 2025-04-07T21:59:48Z

This includes some initial work on adding Pyodide support (issue #12729). It is enough to get

uv pip compile -p /path/to/pyodide --extra-index-url file:/path/to/simple-index

to work which should already be quite useful.

Test Plan

added a unit test for pyodide_platform
integration tested manually with:

cargo run pip install \
-p /home/rchatham/Documents/programming/tmp/pyodide-venv-test/.pyodide-xbuildenv-0.29.3/0.27.4/xbuildenv/pyodide-root/dist/python \
--extra-index-url file:/home/rchatham/Documents/programming/tmp/pyodide-venv-test/.pyodide-xbuildenv-0.29.3/0.27.4/xbuildenv/pyodide-root/package_index \
--index-strategy unsafe-best-match --target blah --no-build \
numpy pydantic

This includes some initial work to add Pyodide support. It is enough to get ``` uv pip compile -p /path/to/pyodide --extra-index-url file:/path/to/simple-index ``` to work which should already be quite useful.

codspeed-hq · 2025-04-08T08:40:52Z

CodSpeed Instrumentation Performance Report

Merging #12731 will not alter performance

_{Comparing hoodmane:pyodide-support (e9e37be) with main (37e22e4)}

Summary

✅ 12 untouched benchmarks

hoodmane · 2025-04-08T08:58:45Z

Uh oh tests are failing because of a pypi outage.

konstin · 2025-04-10T09:26:38Z

The micro-benchmark regression is probably a fluke but is fine otherwise too, as long as the resolver benchmarks don't change

hoodmane · 2025-04-10T10:26:53Z

Thanks @konstin. I'll add an integration test and then mark this ready for review.

zanieb · 2025-04-10T16:00:43Z

We keep seeing that microbenchmark false positive. I don't know what's up with it.

hoodmane · 2025-05-08T22:12:03Z

Okay I added an integration test and it is working:
https://github.com/astral-sh/uv/actions/runs/14916812495/job/41904275552?pr=12731

So this is ready for review.

konstin · 2025-05-09T09:36:24Z

Where does the 2024 in pyodide 2024 come from? I couldn't find it in the docs or the GitHub page.

.github/workflows/ci.yml

crates/uv-configuration/src/target_triple.rs

crates/uv-python/python/get_interpreter_info.py

crates/uv-configuration/src/target_triple.rs

hoodmane · 2025-05-16T03:12:10Z

Thanks for the review @konstin !

Co-authored-by: konsti <[email protected]>

hoodmane · 2025-05-17T16:06:41Z

Where does the 2024 in pyodide 2024 come from? I couldn't find it in the docs or the GitHub page.

It's vaguely documented here:
https://pyodide.org/en/stable/development/abi.html#pyodide-2024-0

Also the Pyodide packaging pep:
https://peps.python.org/pep-0783/

konstin

Thanks!

hoodmane · 2025-06-03T15:37:45Z

@zanieb would appreciate review on this when you have a chance.

zanieb · 2025-06-03T16:39:50Z

🤦‍♀️ thanks for the poke

hoodmane · 2025-06-03T18:54:38Z

Thanks @zanieb and @konstin!

This MR contains the following updates: | Package | Update | Change | |---|---|---| | [astral-sh/uv](https://github.com/astral-sh/uv) | patch | `0.7.7` -> `0.7.13` | MR created with the help of [el-capitano/tools/renovate-bot](https://gitlab.com/el-capitano/tools/renovate-bot). **Proposed changes to behavior should be submitted there as MRs.** --- ### Release Notes <details> <summary>astral-sh/uv (astral-sh/uv)</summary> ### [`v0.7.13`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#0713) [Compare Source](astral-sh/uv@0.7.12...0.7.13) ##### Python - Add Python 3.14.0b2 - Add Python 3.13.5 - Fix stability of `uuid.getnode` on 3.13 See the [`python-build-standalone` release notes](https://github.com/astral-sh/python-build-standalone/releases/tag/20250612) for more details. ##### Enhancements - Download versions in `uv python pin` if not found ([#13946](astral-sh/uv#13946)) - Use TTY detection to determine if SIGINT forwarding is enabled ([#13925](astral-sh/uv#13925)) - Avoid fetching an exact, cached Git commit, even if it isn't locked ([#13748](astral-sh/uv#13748)) - Add `zstd` and `deflate` to `Accept-Encoding` ([#13982](astral-sh/uv#13982)) - Build binaries for riscv64 ([#12688](astral-sh/uv#12688)) ##### Bug fixes - Check if relative URL is valid directory before treating as index ([#13917](astral-sh/uv#13917)) - Ignore Python discovery errors during `uv python pin` ([#13944](astral-sh/uv#13944)) - Do not allow `uv add --group ... --script` ([#13997](astral-sh/uv#13997)) ##### Preview changes - Build backend: Support namespace packages ([#13833](astral-sh/uv#13833)) ##### Documentation - Add 3.14 to the supported platform reference ([#13990](astral-sh/uv#13990)) - Add an `llms.txt` to uv ([#13929](astral-sh/uv#13929)) - Add supported macOS version to the platform reference ([#13993](astral-sh/uv#13993)) - Update platform support reference to include Python implementation list ([#13991](astral-sh/uv#13991)) - Update pytorch.md ([#13899](astral-sh/uv#13899)) - Update the CLI help and reference to include references to the Python bin directory ([#13978](astral-sh/uv#13978)) ### [`v0.7.12`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#0712) [Compare Source](astral-sh/uv@0.7.11...0.7.12) ##### Enhancements - Add `uv python pin --rm` to remove `.python-version` pins ([#13860](astral-sh/uv#13860)) - Don't hint at versions removed by `excluded-newer` ([#13884](astral-sh/uv#13884)) - Add hint to use `tool.uv.environments` on resolution error ([#13455](astral-sh/uv#13455)) - Add hint to use `tool.uv.required-environments` on resolution error ([#13575](astral-sh/uv#13575)) - Improve `python pin` error messages ([#13862](astral-sh/uv#13862)) ##### Bug fixes - Lock environments during `uv sync`, `uv add` and `uv remove` to prevent race conditions ([#13869](astral-sh/uv#13869)) - Add `--no-editable` to `uv export` for `pylock.toml` ([#13852](astral-sh/uv#13852)) ##### Documentation - List `.gitignore` in project init files ([#13855](astral-sh/uv#13855)) - Move the pip interface documentation into the concepts section ([#13841](astral-sh/uv#13841)) - Remove the configuration section in favor of concepts / reference ([#13842](astral-sh/uv#13842)) - Update Git and GitHub Actions docs to mention `gh auth login` ([#13850](astral-sh/uv#13850)) ##### Preview - Fix directory glob traversal fallback preventing exclusion of all files ([#13882](astral-sh/uv#13882)) ### [`v0.7.11`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#0711) [Compare Source](astral-sh/uv@0.7.10...0.7.11) ##### Python - Add Python 3.14.0b1 - Add Python 3.13.4 - Add Python 3.12.11 - Add Python 3.11.13 - Add Python 3.10.18 - Add Python 3.9.23 ##### Enhancements - Add Pyodide support ([#12731](astral-sh/uv#12731)) - Better error message for version specifier with missing operator ([#13803](astral-sh/uv#13803)) ##### Bug fixes - Downgrade `reqwest` and `hyper-util` to resolve connection reset errors over IPv6 ([#13835](astral-sh/uv#13835)) - Prefer `uv`'s binary's version when checking if it's up to date ([#13840](astral-sh/uv#13840)) ##### Documentation - Use "terminal driver" instead of "shell" in `SIGINT` docs ([#13787](astral-sh/uv#13787)) ### [`v0.7.10`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#0710) [Compare Source](astral-sh/uv@0.7.9...0.7.10) ##### Enhancements - Add `--show-extras` to `uv tool list` ([#13783](astral-sh/uv#13783)) - Add dynamically generated sysconfig replacement mappings ([#13441](astral-sh/uv#13441)) - Add data locations to install wheel logs ([#13797](astral-sh/uv#13797)) ##### Bug fixes - Avoid redaction of placeholder `git` username when using SSH authentication ([#13799](astral-sh/uv#13799)) - Propagate credentials to files on devpi indexes ending in `/+simple` ([#13743](astral-sh/uv#13743)) - Restore retention of credentials for direct URLs in `uv export` ([#13809](astral-sh/uv#13809)) ### [`v0.7.9`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#079) [Compare Source](astral-sh/uv@0.7.8...0.7.9) ##### Python The changes reverted in [0.7.8](#078) have been restored. See the [`python-build-standalone` release notes](https://github.com/astral-sh/python-build-standalone/releases/tag/20250529) for more details. ##### Enhancements - Improve obfuscation of credentials in URLs ([#13560](astral-sh/uv#13560)) - Allow running non-default Python implementations via `uvx` ([#13583](astral-sh/uv#13583)) - Add `uvw` as alias for `uv` without console window on Windows ([#11786](astral-sh/uv#11786)) - Allow discovery of x86-64 managed Python builds on macOS ([#13722](astral-sh/uv#13722)) - Differentiate between implicit vs explicit architecture requests ([#13723](astral-sh/uv#13723)) - Implement ordering for Python architectures to prefer native installations ([#13709](astral-sh/uv#13709)) - Only show the first match per platform (and architecture) by default in `uv python list` ([#13721](astral-sh/uv#13721)) - Write the path of the parent environment to an `extends-environment` key in the `pyvenv.cfg` file of an ephemeral environment ([#13598](astral-sh/uv#13598)) - Improve the error message when libc cannot be found, e.g., when using the distroless containers ([#13549](astral-sh/uv#13549)) ##### Performance - Avoid rendering info log level ([#13642](astral-sh/uv#13642)) - Improve performance of `uv-python` crate's manylinux submodule ([#11131](astral-sh/uv#11131)) - Optimize `Version` display ([#13643](astral-sh/uv#13643)) - Reduce number of reference-checks for `uv cache clean` ([#13669](astral-sh/uv#13669)) ##### Bug fixes - Avoid reinstalling dependency group members with `--all-packages` ([#13678](astral-sh/uv#13678)) - Don't fail direct URL hash checking with dependency metadata ([#13736](astral-sh/uv#13736)) - Exit early on `self update` if global `--offline` is set ([#13663](astral-sh/uv#13663)) - Fix cases where the uv lock is incorrectly marked as out of date ([#13635](astral-sh/uv#13635)) - Include pre-release versions in `uv python install --reinstall` ([#13645](astral-sh/uv#13645)) - Set `LC_ALL=C` for git when checking git worktree ([#13637](astral-sh/uv#13637)) - Avoid rejecting Windows paths for remote Python download JSON targets ([#13625](astral-sh/uv#13625)) ##### Preview - Add `uv add --bounds` to configure version constraints ([#12946](astral-sh/uv#12946)) ##### Documentation - Add documentation about Python versions to Tools concept page ([#7673](astral-sh/uv#7673)) - Add example of enabling Dependabot ([#13692](astral-sh/uv#13692)) - Fix `exclude-newer` date format for persistent configuration files ([#13706](astral-sh/uv#13706)) - Quote versions variables in GitLab documentation ([#13679](astral-sh/uv#13679)) - Update Dependabot support status ([#13690](astral-sh/uv#13690)) - Explicitly specify to add a new repo entry to the repos list item in the `.pre-commit-config.yaml` ([#10243](astral-sh/uv#10243)) - Add integration with marimo guide ([#13691](astral-sh/uv#13691)) - Add pronunciation to README ([#5336](astral-sh/uv#5336)) ### [`v0.7.8`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#078) [Compare Source](astral-sh/uv@0.7.7...0.7.8) ##### Python We are reverting most of our Python changes from `uv 0.7.6` and `uv 0.7.7` due to a miscompilation that makes the Python interpreter behave incorrectly, resulting in spurious type-errors involving str. This issue seems to be isolated to x86\_64 Linux, and affected at least Python 3.12, 3.13, and 3.14. The following changes that were introduced in those versions of uv are temporarily being reverted while we test and deploy a proper fix for the miscompilation: - Add Python 3.14 on musl - free-threaded Python on musl - Add Python 3.14.0a7 - Statically link `libpython` into the interpreter on Linux for a significant performance boost See [the issue for details](astral-sh/uv#13610). ##### Documentation - Remove misleading line in pin documentation ([#13611](astral-sh/uv#13611)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever MR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this MR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this MR, check this box --- This MR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).

charliermarsh · 2025-06-24T00:54:47Z

crates/uv-platform-tags/src/platform_tag.rs

            Self::Haiku { release_arch } => write!(f, "haiku_{release_arch}"),
            Self::Illumos { release_arch } => write!(f, "illumos_{release_arch}"),
            Self::Solaris { release_arch } => write!(f, "solaris_{release_arch}_64bit"),
+            Self::Pyodide { major, minor } => write!(f, "pyodide_{major}_{minor}_wasm32"),


@hoodmane -- Should this not be emscripten_3_1_58_wasm32, for pyodide_2024_0?

I put up a PR here, I may be mistaken though: #14226

Ah okay, I'm seeing that the wheels in pyodide config get package_index do use this pyodide tag. Should we support both?

…#15027) Addresses this outstanding item from a previous review #13724 (comment) I'm interested in this now for consolidating some logic in #12731

hoodmane added 3 commits April 7, 2025 23:58

Add Pyodide support

122703e

This includes some initial work to add Pyodide support. It is enough to get ``` uv pip compile -p /path/to/pyodide --extra-index-url file:/path/to/simple-index ``` to work which should already be quite useful.

Fix lints

8342b02

Update cli.md

6537e2f

hoodmane added 2 commits April 8, 2025 10:53

Add a platform_tag unit test

6302a6e

Simplify get_interpreter_info

cefb169

hoodmane added 2 commits April 8, 2025 11:10

trigger ci

f35d54c

Trigger CI

af7a8e2

hoodmane mentioned this pull request Apr 8, 2025

Pyodide support? #12729

Open

zanieb requested a review from konstin April 8, 2025 17:41

konstin added the enhancement New feature or improvement to existing functionality label Apr 10, 2025

hoodmane added 2 commits May 8, 2025 17:29

Add pyodide integration test

b7ea789

Install pip in native venv

315f03e

hoodmane marked this pull request as ready for review May 8, 2025 22:11

konstin reviewed May 9, 2025

View reviewed changes

hoodmane and others added 6 commits May 17, 2025 11:30

Pin pyodide-build and use pyodide config get interpreter

92d4de4

Update crates/uv-configuration/src/target_triple.rs

9528f9f

Co-authored-by: konsti <[email protected]>

Add comment on uname version

26b2983

Add comment about Emscripten compiler version

4e0218c

Add a link

08aa62d

Add custom error message for emscripten-not-python

f5c6b05

Merge branch 'main' into pyodide-support

9c29572

hoodmane and others added 3 commits May 17, 2025 14:38

Update schema

364c659

Update cli.md

e45f18e

Update GHA versions

2774ed4

konstin approved these changes May 19, 2025

View reviewed changes

Update generated schema

f4db3b8

zanieb approved these changes Jun 3, 2025

View reviewed changes

Merge branch 'main' into pyodide-support

e9e37be

zanieb merged commit f9d3f24 into astral-sh:main Jun 3, 2025
86 checks passed

hoodmane deleted the pyodide-support branch June 3, 2025 18:54

BrewTestBot mentioned this pull request Jun 4, 2025

uv 0.7.11 Homebrew/homebrew-core#225777

Merged

charliermarsh reviewed Jun 24, 2025

View reviewed changes

charliermarsh mentioned this pull request Jun 24, 2025

Use emscripten platform tags for Pyodide #14226

Closed

zanieb mentioned this pull request Aug 2, 2025

Refactor os, arch, and libc information into a shared Platform type #15027

Merged

Add Pyodide support #12731

Add Pyodide support #12731

Uh oh!

Conversation

hoodmane commented Apr 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Plan

Uh oh!

codspeed-hq bot commented Apr 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CodSpeed Instrumentation Performance Report

Merging #12731 will not alter performance

Summary

Uh oh!

hoodmane commented Apr 8, 2025

Uh oh!

konstin commented Apr 10, 2025

Uh oh!

hoodmane commented Apr 10, 2025

Uh oh!

zanieb commented Apr 10, 2025

Uh oh!

hoodmane commented May 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

konstin commented May 9, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

hoodmane commented May 16, 2025

Uh oh!

hoodmane commented May 17, 2025

Uh oh!

konstin left a comment

Choose a reason for hiding this comment

Uh oh!

hoodmane commented Jun 3, 2025

Uh oh!

zanieb commented Jun 3, 2025

Uh oh!

Uh oh!

hoodmane commented Jun 3, 2025

Uh oh!

charliermarsh Jun 24, 2025

Choose a reason for hiding this comment

Uh oh!

charliermarsh Jun 24, 2025

Choose a reason for hiding this comment

Uh oh!

charliermarsh Jun 24, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

hoodmane commented Apr 7, 2025 •

edited

Loading

codspeed-hq bot commented Apr 8, 2025 •

edited

Loading

hoodmane commented May 8, 2025 •

edited

Loading