New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] fast search #194

Closed

vince62s opened this issue Jan 13, 2023 · 1 comment

vince62s commented Jan 13, 2023

Hello,
I am beginning with this API. My use case is as follow:

In a large file, made of 100 millions of lines, I would like to get rid of all lines that have a Jaccard > 0.7 (for instance)
I looped once with MinHask.bulk to store the hashes.
Then I double loop to compare line by line => very slow.
same question with File1 compared to File2.

Is there a faster way to accomplish this ?

Thanks

Author

vince62s commented Jan 13, 2023

sorry seems like the same as #188

vince62s closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment