Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

csvsort Sorting big files #338

Closed
djstrong opened this issue Sep 19, 2014 · 4 comments
Closed

csvsort Sorting big files #338

djstrong opened this issue Sep 19, 2014 · 4 comments

Comments

@djstrong
Copy link

External sorting would be helpful.

@onyxfish
Copy link
Collaborator

I'm not sure what you mean by "external sorting"?

@onyxfish
Copy link
Collaborator

Ah, I've Googled it. This isn't possible with the current data architecture which requires converting the table into a typed in-memory representation. Not doing this would mean forgoing on the data typing, which seems like much too large an inconvenience for the rare large dataset. Erring on the prior principle of "big data is the edge case" and closing this out.

@djstrong
Copy link
Author

Thanks for considering!

@jpmckinney
Copy link
Member

Related #457

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants