Skip to content

Fixed bug where pyarrow conversions were causing string accessor to fail in search#718

Merged
charles-turner-1 merged 1 commit intomainfrom
fix-pyarrow-search
May 8, 2025
Merged

Fixed bug where pyarrow conversions were causing string accessor to fail in search#718
charles-turner-1 merged 1 commit intomainfrom
fix-pyarrow-search

Conversation

@charles-turner-1
Copy link
Collaborator

@charles-turner-1 charles-turner-1 commented May 8, 2025

Change Summary

  • Added a try/except for a case where pyarrow conversions (polars <=> pandas stuff) were causing the search functionality to fail on columns with iterables.
  • Added test with relevant data.

Not exactly sure why this only happens with this specific case, nor why other tests didn't catch but given I'm planning on rewriting the search functionality using polars soon anyway (#711) I'm not too worried. I'm guessing probably something to do with the compression since none of test catalogues relating to columns_with_iterables are gzipped.

No apparent other related issues I can find.

Related issue number

N/A

Checklist

  • Unit tests for the changes exist
  • Tests pass on CI
  • Documentation reflects the changes where applicable N/A

@charles-turner-1 charles-turner-1 marked this pull request as ready for review May 8, 2025 05:53
@charles-turner-1 charles-turner-1 requested a review from mgrover1 as a code owner May 8, 2025 05:53
@charles-turner-1 charles-turner-1 merged commit bf1810f into main May 8, 2025
10 checks passed
@charles-turner-1 charles-turner-1 deleted the fix-pyarrow-search branch May 8, 2025 06:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant