v0.5.22

What's Changed 🚀

💥 Breaking Changes

• refactor!: use struct datatype as daft representation of tuples @universalmind303 (#5030)

✨ Features

• feat: Add uv.lock to git @desmondcheongzx (#5065)
• feat: Add Hash Function Support for Decimal128, Time, Timestamp, Timestamptz Datatypes @Zyiqin-Miranda (#5026)
• feat: pushdown for lance scan @Jay-ju (#4710)
• feat: add lance merge_column task @Jay-ju (#5008)
• feat: Make the max parallel of scan tasks configurable for Native Runner @plotor (#5018)
• feat: basic generator udf @kevinzwang (#5036)
• feat: implements an openai provider with embed_text @rchowell (#4997)
• feat: daft.File object store support @universalmind303 (#5002)

🐛 Bug Fixes

• fix: Fix venv command for windows build @colin-ho (#5073)
• fix: add setuptools_scm to build wheel requirements @colin-ho (#5072)
• fix: Use cachebusting and range request fallback for HTTP requests to Hugging Face CDNs @desmondcheongzx (#5061)
• fix: Use async for starting and calling udf actors in flotilla @colin-ho (#5000)
• fix: Always refresh tqdm when updating total @colin-ho (#5033)
• fix: Fix docs build @desmondcheongzx (#5066)
• fix: require uv as prerequisite for development setup @ykdojo (#5059)
• fix: Add missing source command in Makefile install-docs-deps target @ykdojo (#5060)
• fix: Mermaid syntax error when enable explain analyze for Native Runner @plotor (#5052)
• fix: clean notebook output before running tests & tweak doc proc notebook @malcolmgreaves (#5055)
• fix: correct Modin query optimizer value in comparison tables @ykdojo (#4983)
• fix: skip credentialed tests if not from main @rchowell (#5048)
• fix: subprocess UDF inherits current process env @rchowell (#5047)
• fix: sql/spark read_iceberg and read_deltalake @kevinzwang (#5035)
• fix(blc): Disabled pipefail @rohitkulshreshtha (#5031)

♻️ Refactor

• refactor!: use struct datatype as daft representation of tuples @universalmind303 (#5030)

📖 Documentation

• docs: Make overview page legible for light mode @desmondcheongzx (#5067)
• docs: Move custom python code higher up in docs @desmondcheongzx (#5064)
• docs: Add better description in overview page @jaychia (#5063)
• docs: remove core_concepts.md and broken anchor link references @ykdojo (#5062)
• docs: fix formatting @rchowell (#4994)
• docs: remove runllm widget @ccmao1130 (#5056)
• docs: add reo script to docs @ccmao1130 (#5049)
• docs: fix broken UDF link due to core_concepts.md redirect @ykdojo (#5022)
• docs: fix typo "Github" --> "GitHub" @metonym (#5025)
• docs: fix df.limit link in quickstart.md @rockokw (#5013)

👷 CI

• ci: Don't run pr test suite on non-code changes fr @desmondcheongzx (#5057)

🔧 Maintenance

• chore: Remove deprecated APIs for 0.6 @colin-ho (#5050)
• chore: disable hugging face library progress bars @kevinzwang (#5040)
• chore: relax assertion in flaky sharding distribution test @Jay-ju (#5053)
• chore(dev): use pyproject.toml to manage the dev dependencies @xy-xin (#4849)
• chore: random the counter during creating DistributedActorPoolProject… @stayrascal (#5039)

⏪ Reverts

• revert: Temporarily revert "Remove deprecated APIs for 0.6" @desmondcheongzx (#5068)

Full Changelog: v0.5.21...v0.5.22