Add Papyrus 3 Million data point pchembl for 7k protein #340
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add all papyrus dataset that have pchembl only from: https://doi.org/10.4121/16896406.v3 To understand columns means in details look at README inside reference link. Data was cleaned and upload into Hugging face as original data are difficult to upload for a normal computer link: https://huggingface.co/datasets/phalem/awesome_chem_clean_data/resolve/main/pchembl_papyrus.csv.gz size : 105 MB Please note: I fill na of the field rather than pchembl with unknown. Please look other field if possible.
|
Hi @phalem thank you for looking into the Papyrus data, this looks very interesting! For this dataset you used the data from https://data.4tu.nl/file/ca10bf7d-f508-4d54-9c9a-5a9e9c1adef9/36feebfc-4703-4290-90f2-f3e41261f0c4 right? PS: I just merged with the latest main and applied the pre-commit hooks. |
|
Ok, I'm currently trying to get the data from the direct source but the data is very big and the transform.py script needs a lot of RAM. Let's see how this works out. Depending on that we can discuss how we best approach that. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add all papyrus dataset that have pchembl only from: https://doi.org/10.4121/16896406.v3 To understand columns means in details look at README inside reference link. Data was cleaned and upload into Hugging face as original data are difficult to upload for a normal computer link: https://huggingface.co/datasets/phalem/awesome_chem_clean_data/resolve/main/pchembl_papyrus.csv.gz size : 105 MB
Please note: I fill na of the field rather than pchembl with unknown. Please look other field if possible and revise the columns as well.
Example include:
What is the this mention at?
what is the of the or on ?
what <activity_type> of the reported on ? Ka for example.
Please, if possible it need some enhancement ,
@MicPie Can you help me in this ?
Data was large. Hugging face raise a problem when loading using
load_dataset.For
60 Million datapointWe will need to check each compound either active or not as I found compound that doesn't have pchembl is inactive. However I didn't search on all data and other data. I will see away to do that.Thank you.