Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minor improvements for custom database annotation #67

Merged
merged 7 commits into from
Oct 5, 2022

Conversation

lam-c
Copy link
Contributor

@lam-c lam-c commented Sep 28, 2022

Some bugs happened when using custom databases for annotation, so I simply modified codes to solve them. Changes are roughly about:

  • Make Blast DB when executing blastn for annotating custom database, to resolve errors lacking index file for nucleotide db;
  • Strip spaces in Shiny markdown for properly generating links to custom database reports.

There still exist bugs in custom database reports. Some of the report html file are empty when assigning multiple custom databases, while the annotation files (.summary.txt, .gff, both not empty) successfully completed. I'm not sure if this problem are caused by modification above.

Thank you soooo much for your patience, and this awesome tool!

Blast database throw error for no alias or index file found for
nucleotide database, when using blastn. Thus, make blast database
before execute blastn to custom database on genome.
Whitespace occurs when generated links for custom database report in
Shiny markdown. Specify seperate string to emtpy string to fix this.
@fmalmeida fmalmeida self-requested a review September 28, 2022 10:14
@fmalmeida fmalmeida added the bug Something isn't working label Sep 28, 2022
@fmalmeida
Copy link
Owner

Hi @lam-c,
Thanks for using the pipelines and thanks more for helping improving it. Appreciate it 😄

I will take a look at the changes later today to review the changes. I'll also let the example datasets running so we can make sure all works.

If all goes good, we can may have all merged whithin this week.

🚀 👍🏼

@fmalmeida
Copy link
Owner

Execution was successful for example dataset, now I just need to assess the changes on the shiny app.

@fmalmeida
Copy link
Owner

fmalmeida commented Sep 29, 2022

I am not sure about this comment:

Some of the report html file are empty when assigning multiple custom

Is it possible for you to send the logs for the report executions? Also, have you tested if your changes fixed this?

I guess it may be just an adjusment on the 'loop' on the custom annotation results when running the REPORTS module. But, to be sure, would be nice to take a look at the loggings, and files, erros, etc.

😄

@fmalmeida
Copy link
Owner

fmalmeida commented Sep 29, 2022

I think I just ran into the error you mentioned. The error is basically that, even though the summary files are not empty, the tables in the reports are empty, right?

I will take a look on that.

Can you open an issue for that? I will link to this PR.

@lam-c
Copy link
Contributor Author

lam-c commented Sep 30, 2022

I think I just ran into the error you mentioned. The error is basically that, even though the summary files are not empty, the tables in the reports are empty, right?

I will take a look on that.

Can you open an issue for that? I will link to this PR.

Exactly! I've opened an issue as you advised just now. The commond logs show that everything goes fine, I guess may be some bugs in report_custom_blast.Rmd.

Sorry for not replying sooner. MUCH lots of THANKS for prompt replies and active debugging!

@fmalmeida fmalmeida linked an issue Sep 30, 2022 that may be closed by this pull request
@fmalmeida
Copy link
Owner

Hi @lam-c,
Since this PR you've opened seems to bring no problem to the PR but actually allowed you to run your analysis and get the html report files properly generated, I will merge this changes in the develop branch and close this PR. So you can use the pipeline from there.

Then, I will start to work on the issue you've opened which is not related to the workflow itself but to the shiny app which means I have to debug the shiny app code and this, should be tackled in another PR.

Many thanks for the contributions.

😄

@fmalmeida fmalmeida changed the base branch from master to develop October 5, 2022 16:56
@fmalmeida fmalmeida merged commit 04388cb into fmalmeida:develop Oct 5, 2022
@fmalmeida fmalmeida mentioned this pull request Nov 10, 2022
fmalmeida added a commit that referenced this pull request Dec 19, 2022
* update hmmer to working version with PGAP

* update hmmer to working version with PGAP (#59) (#60)

* Adding option for using `bakta` (#58)

* first bakta addition test

* Fixing error when phigaro output was empty (#55) (#56)

* adding checkIfExists rules to input loading

* Update build.sh

* fixed report if else statement

* updated version and changelog

* fix example samplesheet url

* Create nf-core-bacannot-compare_logo_dark.png

* Update phigaro.nf

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update .gitignore

* Update bacannot.nf

* workflow runs from top to bottom

* workflow correctly working

* changing version manifest

* explaining how to use bakta

* adding variables to generic annotation

* adding victors backup db

* report_general understands bakta

* report_resistance understands bakta

* update hmmer to working version with PGAP

* update hmmer to working version with PGAP (#59)

* update hmmer to working version with PGAP (#59) (#60)

* Update resfinder2gff.py

* Update addBedtoolsIntersect.R

* Update addBedtoolsIntersect.R

* Update addBedtoolsIntersect.R

* Update addBedtoolsIntersect.R

* Update docker.config

* download db if not available

* Update merge_annotations.nf

* Update merge_annotations.nf

* update process label

* Update merge_annotations.nf

* fix docker file ownerships

* added retry label for bakta

* update changelog

* changing to new version

* add falmeida-py scripts to docker

* Create generate_dockers.sh

* Minor improvements for custom database annotation (#67)

* Add step making Blast DB when annotating custom db

Blast database throw error for no alias or index file found for
nucleotide database, when using blastn. Thus, make blast database
before execute blastn to custom database on genome.

* Remove space when generate link in Shiny markdown

Whitespace occurs when generated links for custom database report in
Shiny markdown. Specify seperate string to emtpy string to fix this.

* fix: script was calling an out of bounds value

* handle exceptions and missing values

* increment test profile

* also build for proteins

* Use correct version of customdb_gffs in REPORTS module

Co-authored-by: fmalmeida <[email protected]>

* fixed docker images

* resfinder now uses conda env

* rgi does not have --exclude_nudge anymore

* add circos conf files

* fix indentation

* add circos sub-workflow calling

* add circos tool

* added karyotype and gc_skew modules

* fix indentation

* modules now have a channel suitable for summary generation

* include summary generation module

* update docker image

* add aro index tsv

* add amrfinder2tsv module

* add bacannot json summary generation

* update docker images

* add new modules

* added binaries for circos plot

* update docker files

* add label to module

* finalise modules preparing data for circos

* include whole circos 'pathway' in workflow

* add circos module

* circos plot currently functional

* re-organised circos outputs

* ameliorate default version of circos plot

* fixed docker image

* fixed custom annotation problem in server

* added circos plot with easy_circos

* circos plot properly being generated

* update changelog

* update readme

* update documentation

* fix tool name

* fix dir

* update indentation

* fixed schema

* add pipefail

* fix docker image

Co-authored-by: Cy <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Custom database report file bugs
2 participants