Skip to content

[not-for-merge] Thread compiler xvector example and few optimizations#2303

Closed
gorinars wants to merge 6 commits intokaldi-asr:masterfrom
gorinars:thread_compiler_test
Closed

[not-for-merge] Thread compiler xvector example and few optimizations#2303
gorinars wants to merge 6 commits intokaldi-asr:masterfrom
gorinars:thread_compiler_test

Conversation

@gorinars
Copy link
Contributor

Example of running xvector extractor in multiple threads (includes e4da298 that makes it safe)

Some features include:

  • --num-threads
  • extra argument cache_rxfilename that allows to store cache and re-use it in extractor
  • --chunk-sampling-rate - dummy implementation of frame rounding to make segments less diferse and make code spend less time on compilation (not tested properly - better use default)

@danpovey
Copy link
Contributor

This is related to #2288.

@gorinars, would you mind fixing the conflicts?

As previously discussed, I will close this PR but I wanted it on github for discoverability, since this might come in useful in future.

@gorinars
Copy link
Contributor Author

I was not sure if it was better to keep your commit e4da298 in this PR. Basically without it the thing will not work properly, so I guess it is better to keep it and later when you merge your part the diff will be not so huge

@gorinars gorinars changed the title [not-for-merge] Thread compiler example and few optimizations [not-for-merge] Thread compiler xvector example and few optimizations Mar 22, 2018
@danpovey
Copy link
Contributor

closing but please keep that branch up for reference.

@danpovey danpovey closed this Mar 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants