Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use IntelDeflaterFactory from the GKL #1964

Merged
merged 1 commit into from
Jul 1, 2016
Merged

Conversation

akiezun
Copy link
Contributor

@akiezun akiezun commented Jul 1, 2016

fixes #1903

also updated the system properties in build.gradle and gatk-launch

@@ -128,6 +129,13 @@ public Object instanceMainPostParseArgs() {
System.setProperty("java.io.tmpdir", f.getAbsolutePath()); // in loop so that last one takes effect
}

//Set defaults (note: setting them here means they are not controllable by the user)
BlockCompressedOutputStream.setDefaultDeflaterFactory(new IntelDeflaterFactory());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a command-line arg to CommandLineProgram that allows the user to opt-out of using the IntelDeflater

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@coveralls
Copy link
Collaborator

coveralls commented Jul 1, 2016

Coverage Status

Coverage increased (+0.002%) to 81.694% when pulling 1222cd4 on ak_use_intelDeflaterFactory into 0cebc03 on master.

@akiezun akiezun assigned akiezun and unassigned lbergelson and gspowley Jul 1, 2016
@akiezun
Copy link
Contributor Author

akiezun commented Jul 1, 2016

i'll grab it

@akiezun
Copy link
Contributor Author

akiezun commented Jul 1, 2016

note: This PR does not reinstate the IntelDeflater for Spark. It's now a bit tricky because you need to call BlockCompressedOutputStream.setDefaultDeflaterFactory(new IntelDeflaterFactory()); on every executor or on every writer factory. Maybe a solution would be to use IntelDeflaterFactory directly in Hadoop-BAM. @droazen wdyt? I entered HadoopGenomics/Hadoop-BAM#109

@akiezun akiezun force-pushed the ak_use_intelDeflaterFactory branch from 1222cd4 to 0aa6f36 Compare July 1, 2016 17:56
@gspowley
Copy link
Collaborator

gspowley commented Jul 1, 2016

GKL 0.1.1 release in Maven Central resolves Intel-HLS/GKL#8 (not the Spark issue)

@coveralls
Copy link
Collaborator

coveralls commented Jul 1, 2016

Coverage Status

Coverage increased (+0.003%) to 81.701% when pulling 0aa6f36 on ak_use_intelDeflaterFactory into bbd028b on master.

@akiezun akiezun force-pushed the ak_use_intelDeflaterFactory branch from 0aa6f36 to 7b821e4 Compare July 1, 2016 18:25
@akiezun
Copy link
Contributor Author

akiezun commented Jul 1, 2016

thanks @gspowley - using 0.1.1 now and the issue is fixed

@coveralls
Copy link
Collaborator

coveralls commented Jul 1, 2016

Coverage Status

Coverage increased (+0.003%) to 81.7% when pulling 7b821e4 on ak_use_intelDeflaterFactory into bbd028b on master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Load inteldeflater from intel-gkl, hook up to new htsjdk interface
5 participants