Further compact cached distribution metadata

[charliermarsh]

Summary

Follow-up to #20463 that further compacts the cached Simple API representation:

• We now store registry files in a cache-local CachedFile, eliding filenames recoverable from their URLs, normalizing false-yanked entries, packing optional size/upload-time fields, and retaining fallbacks for renamed files and uncommon hashes;
• We now store a single canonical MD5, SHA-256, BLAKE2b-256, SHA-384, or SHA-512 digest in binary form; the two larger digests are boxed so the common SHA-256/BLAKE2b layout stays compact;
• We now niche-box optional resolution metadata and reorder VersionSmall to reduce the archived version/metadatum layouts;
• we now sort by reconstructed filenames to preserve deterministic wheel/sdist ordering, bump the Simple cache bucket to simple-v24, and update cutoff/publish consumers.

Performance

For the exact 1,750 common entries, the Simple cache falls from 222,371,536 B to 146,852,744 B (-33.96%).

workload	wall before	wall after	change	CPU before	CPU after	change
jupyter (97 packages)	99.8 ms	97.6 ms	-2.28%	53.8 ms	51.2 ms	-4.99%
boto3 (7 packages, backtracking)	162.0 ms	162.1 ms	+0.05%	222.8 ms	247.1 ms	+10.90%
airflow (559 packages)	239.8 ms	234.8 ms	-2.07%	368.4 ms	348.0 ms	-5.55%
large-index (26 large Simple pages, no deps)	100.6 ms	97.3 ms	-3.36%	57.8 ms	50.9 ms	-11.90%

[codspeed-hq]

Merging this PR will improve performance by 11.12%

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
✅ 17 untouched benchmarks
⏩ 6 skipped benchmarks¹

Performance Changes

	Mode	Benchmark	BASE	HEAD	Efficiency
⚡	Simulation	resolve_warm_jupyter	34.4 ms	29.4 ms	+16.9%
⚡	Simulation	resolve_warm_airflow	342.8 ms	303.7 ms	+12.88%
⚡	WallTime	resolve_warm_jupyter	20.6 ms	18.6 ms	+11.11%
⚡	WallTime	resolve_warm_jupyter_universal	95.6 ms	91.9 ms	+4.01%

Tip

Curious why this is faster? Use the CodSpeed MCP and ask your agent.

---

_{Comparing charlie/codex-compact-cache-followups (d70c062) with main (eadaf43)}

Footnotes

1. 6 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[astral-sh-bot]

uv test inventory changes

This PR changes the tests when compared with the main base revision.

• Added tests: 1
• Removed tests: 0
• Changed suites: 1

uv-distribution-types: +1 / -0

Added:

• uv-distribution-types::file::tests::raw_filename

Removed: none

[zanieb]

I can't tell if this wall-time win is actually particularly compelling and the size difference for this particular data in the cache seems insignificant. The codspeed benchmarks look nice though!

[zanieb]

At least it doesn't look too complicated code-wise

[charliermarsh]

Personally think it's worth it given that it's fairly contained. Gonna give it a shot!