chore(deps): Upgrade pyarrow to 18.1.0

[phillipleblanc]

SUMMARY

Upgrade pyarrow to 18.1.0, to support the StringView arrow type.

TESTING INSTRUCTIONS

Start Superset and verify that the SQL Lab queries are still working.

ADDITIONAL INFORMATION

• Has associated issue: Fixes Update PyArrow dependency to support StringView type #31475
• Required feature flags:
• Changes UI
• Includes DB Migration (follow approval process in SIP-59)
  • Migration is atomic, supports rollback & is backwards-compatible
  • Confirm DB migration upgrade and downgrade tested
  • Runtime estimates and downtime expectations provided
• Introduces new feature or API
• Removes existing feature or API

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 84.65%. Comparing base (76d897e) to head (d451881).
Report is 1815 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #31476       +/-   ##
===========================================
+ Coverage   60.48%   84.65%   +24.16%     
===========================================
  Files        1931      556     -1375     
  Lines       76236    50426    -25810     
  Branches     8568        0     -8568     
===========================================
- Hits        46114    42688     -3426     
+ Misses      28017     7738    -20279     
+ Partials     2105        0     -2105     

Flag	Coverage Δ
hive	48.73% <ø> (-0.43%)	⬇️
javascript	?
mysql	76.87% <ø> (?)
postgres	76.91% <ø> (?)
presto	53.64% <ø> (-0.16%)	⬇️
python	84.65% <ø> (+21.14%)	⬆️
sqlite	76.40% <ø> (?)
unit	62.57% <ø> (+4.94%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[villebro]

LGTM. This is a biiiig bump, fingers crossed this doesn't break anything. But I assume we should have adequate coverage to protect against these types of upgrade regressions.

[villebro]

Changing to "Request changes" to update the dependency bounds.

[phillipleblanc]

@villebro I've updated the dependency bounds

[rusackas]

Running CI 🤞

[villebro]

You need to update requirements/development.txt, too, as that is pinning pyarrow==14.0.2. Optimally, you should run the uv commands for this.

[phillipleblanc]

Thanks, I've run the uv command to update both requirements/base.txt and requirements/development.txt.

[villebro]

LGTM - it appears the docker build step is failing, but I believe it's unrelated. I'll try to restart CI, but it may well be that something needs to be fixed on master before we can get this working..

[rusackas]

Closing/reopening to kick start CI again. Hopefully we can get this merged.

[rusackas]

Everything passed! Merged! Hopefully we don't see any unintended side effects 🤞