Merge master#85

Merged

danpovey merged 682 commits intodanpovey:pybind11from

naxingyu:merge-master

Dec 17, 2019

This pull request is big! We're only showing the most recent 250 commits

Commits on May 12, 2019

[egs] New chime-5 recipe (#2893)

vimalmanohar
authored and
danpovey
committed

Commits on May 13, 2019

[scripts,egs] Made changes to the augmentation script to make it work for ASR and speaker ID (#3119)

phanisankar-nidadavolu
authored and
danpovey
committed
[egs] updated local/musan.sh to steps/data/make_musan.sh in speaker id scripts (#3320)

phanisankar-nidadavolu
authored and
danpovey
committed

Commits on May 14, 2019

[src] Fix sample rounding errors in extract-segments (#3321)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[src,scripts]Store frame_shift, utt2{dur,num_frames}, .conf with features (#3316)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 15, 2019

[build] Initial version of Docker images for (CPU and GPU versions) (#3322)

mdoulaty
authored and
danpovey
committed
[scripts] fix typo/bug in make_musan.py (#3327)

Wonkyum
authored and
danpovey
committed
[scripts] Fixed misnamed variable in data/make_musan.py (#3324)

phanisankar-nidadavolu
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on May 16, 2019

[scripts] Trust frame_shift and utt2num_frames if found (#3313)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[scripts] typo fix in augmentation script (#3329)

Wonkyum
authored and
danpovey
committed
[scripts] handle frame_shit and utt2num_frames in utils/ (#3323)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 17, 2019

[scripts] Extend combine_ali_dirs.sh to combine alignment lattices (#3315)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[src] Fix rare case when segment end rounding overshoots file end in extract-segments (#3331)

alumae
authored and
danpovey
committed

Commits on May 20, 2019

Commits on May 22, 2019

[scripts,minor] Fix typo in comment (#3338)

Shujian2015
authored and
danpovey
committed

Commits on May 23, 2019

[src,egs] Add option for applying SVD on trained models (#3272)

saikiranvalluri
authored and
danpovey
committed
[src] Add interfaces to nnet-batch-compute that expects device input. (#3311)

luitjens
authored and
danpovey
committed

Commits on May 27, 2019

[build] Update GCC support check for CUDA toolkit 10.1 (#3345)

entn-at
authored and
danpovey
committed
[egs] Fix to aishell1 v1 download script (#3344)

naxingyu
authored and
danpovey
committed

Commits on May 28, 2019

[scripts] Support utf-8 files in some scripts (#3346)

vimalmanohar
authored and
danpovey
committed
[src] Fix potential underflow bug in MFCC, RE energy floor, thx: Zoltan Tobler (#3347)

huangruizhe
authored and
danpovey
committed
[scripts]: add warning to nnet3/chain/train.py about ineffective options (#3341)

bringtree
authored and
danpovey
committed

Commits on May 29, 2019

[scripts] Fix regarding UTF handling in cleanup script (#3352)

vimalmanohar
authored and
danpovey
committed

Commits on Jun 1, 2019

[scripts] Change encoding to utf-8 in data augmentation scripts (#3360)

hhadian
authored and
danpovey
committed

Commits on Jun 3, 2019

[src] Add CUDA accelerated MFCC computation. (#3348)

luitjens
authored and
danpovey
committed
[src] Optimizations for batch nnet3. The issue fixed here is that (#3351)

luitjens
authored and
danpovey
committed
[scripts,minor] Remove outdated comment (#3361)

Shujian2015
authored and
danpovey
committed

Commits on Jun 4, 2019

Commits on Jun 5, 2019

[egs] Modify split_scp.pl usage to match its updated code (#3371)
danpovey
authored

Commits on Jun 6, 2019

Commits on Jun 7, 2019

[build] Widen cuda guard in cudafeat makefile. (#3379)

langep
authored and
danpovey
committed

Commits on Jun 10, 2019

[scripts] nnet1: updating the scripts to support 'online-cmvn', (#3383)

KarelVesely84
authored and
danpovey
committed

Commits on Jun 11, 2019

Commits on Jun 12, 2019

[egs] Fixed file path RE augmentation, in aspire recipe (#3388)

Shujian2015
authored and
danpovey
committed

Commits on Jun 13, 2019

[scripts] Update taint_ctm_edits.py, RE utf-8 encoding (#3392)

vimalmanohar
authored and
danpovey
committed

Commits on Jun 14, 2019

[src] Change nnet3-am-copy to allow more manipulations (#3393)
danpovey
authored

Commits on Jun 15, 2019

[egs] Remove confusing setting of overridden num_epochs variable in aspire (#3394)

Shujian2015
authored and
danpovey
committed

Commits on Jun 17, 2019

[build] Add a missing dependency for "decoder" in Makefile (#3397)

hhadian
authored and
danpovey
committed

Commits on Jun 19, 2019

Commits on Jun 20, 2019

[egs] Fix cleanup-after-partial-download bug in aishell (#3404)

naxingyu
authored and
danpovey
committed
[src] Change functions like AppiyLog() to all work out-of-place (#3185)

YiwenShaoStephen
authored and
danpovey
committed

Commits on Jun 21, 2019

[src] Make stack trace display more user friendly (#3406)

rosun82
authored and
danpovey
committed

Commits on Jun 22, 2019

Commits on Jun 23, 2019

[src] online2-tcp, add option to display start/end times (#3399)

KarelVesely84
authored and
danpovey
committed

Commits on Jun 24, 2019

Commits on Jun 25, 2019

[src] Added error string to CUDA allocation errors. (#3413)

luitjens
authored and
danpovey
committed
[src] Fix CUDA_VSERION number in preprocessor checks (#3414)

LvHang
authored and
danpovey
committed

Commits on Jun 26, 2019

Commits on Jun 27, 2019

Commits on Jun 28, 2019

Commits on Jun 29, 2019

Commits on Jun 30, 2019

[build] Fix the cross-compiling issue for Android under MacOS (#3435)

rayworks
authored and
danpovey
committed

Commits on Jul 2, 2019

[src] Marking operator as __host__ __device__ to avoid build issues (#3441)

luitjens
authored and
danpovey
committed
[egs] Fix perl encoding bug (was causing crashes) (#3442)

naxingyu
authored and
danpovey
committed

Commits on Jul 3, 2019

Commits on Jul 4, 2019

[src,scripts] Various typo fixes and stylistic fixes (#3153)

csukuangfj
authored and
danpovey
committed

Commits on Jul 7, 2019

[scripts] Scripts for VB (variational bayes) resegmentation for Callhome diarization (#3305)

HuangZiliAndy
authored and
danpovey
committed

Commits on Jul 8, 2019

[scripts] Extend utils/data/subsegment_data_dir.sh to copy reco2dur (#3452)

yonatankahana
authored and
danpovey
committed

Commits on Jul 9, 2019

Commits on Jul 10, 2019

[scripts] Fix to steps/nnet/train.sh (nnet1) w.r.t. incorrect bash test expressions (#3456)

xiaominfc
authored and
danpovey
committed

Commits on Jul 17, 2019

[egs] fixed bug in egs/gale_arabic/s5c/local/prepare_dict_subword.sh that it may delete words matching '<*>' (#3465)

DongjiGao
authored and
danpovey
committed

Commits on Jul 19, 2019

[src,build] Small fixes (#3472)

aka-rider
authored and
danpovey
committed
[egs] Add MGB-2 Arabic recipe (#3333)

vimalmanohar
authored and
danpovey
committed

Commits on Jul 20, 2019

[scripts] Check/fix utt2num_frames when fixing data dir. (#3482)

hhadian
authored and
danpovey
committed

Commits on Jul 23, 2019

Commits on Jul 27, 2019

Commits on Jul 28, 2019

[src] Fix for nnet3 bug encountered when implementing deltas. (#3495)
danpovey
authored

Commits on Aug 2, 2019

[scripts,egs] Replace LDA layer with delta and delta-delta features (#3490)

desh2608
authored and
danpovey
committed

Commits on Aug 3, 2019

[egs] Add updated tdnn recipe for AMI (#3497)

aarora8
authored and
danpovey
committed
[egs] Create MALACH recipe based on s5b for AMI (#3496)

picheny
authored and
danpovey
committed

Commits on Aug 4, 2019

[scripts] add --phone-symbol-table to prepare_lang_subword.sh (#3485)

DongjiGao
authored and
danpovey
committed

Commits on Aug 6, 2019

[scripts] Fixed issue that leads to empty segment file (#3510)

Shujian2015
authored and
danpovey
committed

Commits on Aug 8, 2019

[egs] Fix bug in AMI s5b RE overlapping segments that causes Fixed overlap segment bug (#3503)

desh2608
authored and
danpovey
committed

Commits on Aug 12, 2019

[egs] Small cosmetic change in extend_vocab_demo.sh (#3516)

QIU-Shuo
authored and
danpovey
committed

Commits on Aug 15, 2019

Commits on Aug 19, 2019

[src] Hopefully make it possible to use empty FST in grammar-fst (#3523)
danpovey
authored

Commits on Aug 20, 2019

[src] Add option to convert pdf-posteriors to phones (#3526)
danpovey
authored

Commits on Aug 22, 2019

[src] Fix GetDeltaWeights for long-running online decoding (#3528)

nshmyrev
authored and
danpovey
committed

Commits on Aug 24, 2019

[src] Small fix to post-to-phone-post.cc (problem introduced in from #3526) (#3534)

Iek-Heng Chu
authored and
danpovey
committed
[src]: adding Dan's fix to a bug in nnet-computation-graph (#3531)

david-ryan-snyder
authored and
danpovey
committed
[egs] Replace prep_test_aspire_segmentation.sh (#2943) (#3530)

Shujian2015
authored and
danpovey
committed
[egs] OCR: Decomposition for CASIA and YOMDLE_ZH datasets (#3527)

ChunChiehChang
authored and
danpovey
committed

Commits on Aug 26, 2019

Commits on Aug 27, 2019

[egs,scripts] Adding possibility to have 'online-cmn' on input of 'nnet3' models (#3498)

KarelVesely84
authored and
danpovey
committed

Commits on Aug 28, 2019

Commits on Aug 30, 2019

[scripts] fix utils/lang/extend_lang.sh to add nonterm symbols in align_lexicon.txt (#3556)

lucas-jo
authored and
danpovey
committed

Commits on Sep 1, 2019

[scripts] Fix to bug in steps/data/data_dir_manipulation_lib.py (#3174)
danpovey
committed

Commits on Sep 3, 2019

Commits on Sep 6, 2019

[scripts] Fix to data cleanup script RE utf-8 support in uttearnce

sih4sing5hong5
authored and
danpovey
committed

Commits on Sep 7, 2019

[src,scripts,egs] online-cmvn for online2 with chain models, (#3560)

KarelVesely84
authored and
danpovey
committed

Commits on Sep 10, 2019

[build,src] Change to error message; update kaldi_lm install script (and kaldi_lm) to fix compile issue (#3581)
danpovey
authored

Commits on Sep 14, 2019

[src] Clarify something in plda.h (cosmetic change) (#3588)
danpovey
authored

Commits on Sep 16, 2019

Commits on Sep 17, 2019

[src] Remove duplicate `num_done++` in apply-cmvn-online.cc (#3597)

ferb2015
authored and
danpovey
committed

Commits on Sep 18, 2019

[src] Fix to CMVN with CUDA (#3593)

LeviBarnes
authored and
danpovey
committed

Commits on Sep 19, 2019

[src] Fix two bugs in batched-wav-nnet3-cuda binary. (#3600)

luitjens
authored and
danpovey
committed
[scripts] propagated bad whitespace fix to validate_dict_dir.pl (cosmetic change) (#3601)

pskrunner14
authored and
danpovey
committed

Commits on Sep 20, 2019

[scripts] bug-fix on subset_data_dir.sh with --per-spk option (#3567) (#3572)

schaltung
authored and
danpovey
committed

Commits on Sep 22, 2019

[src] Code changes to support GCC9 + OpenFST1.7.3 + C++2a (namespace issues) (#3570)

jtrmal
authored and
danpovey
committed

Commits on Sep 25, 2019

[scripts] Training ivector-extractor: make online-cmvn per speaker. (#3615)

KarelVesely84
authored and
danpovey
committed
[src] cached compiler I/O for nnet3-xvector-compute (#3197)

stanleyguan
authored and
danpovey
committed

Commits on Sep 29, 2019

Commits on Oct 2, 2019

[egs] Fix to run_ivector_common.sh in swbd (crash when running from stage 3) (#3631)

sih4sing5hong5
authored and
danpovey
committed

Commits on Oct 3, 2019

[scripts] Make data augmentation work with UTF-8 utterance ids/filenames (#3633)

sih4sing5hong5
authored and
danpovey
committed
[src] fix a bug in src/online/online-faster-decoder.cc (prevent segfault with some models) (#3634)

freewym
authored and
danpovey
committed
[scripts] Make extend_lang.sh support lexiconp_silprob.txt (#3339) (#3632)

DongjiGao
authored and
danpovey
committed

Commits on Oct 4, 2019

[scripts] Fix typo in analyze_alignments.sh (#3635)

mgoldey
authored and
danpovey
committed
[scripts] Change the GPU policy of align.sh to wait instead of yes (#3636)

frankz-ai
authored and
danpovey
committed
[egs] Added tri3b and chain training for Aurora4 (#3638)

desh2608
authored and
danpovey
committed

Commits on Oct 5, 2019

[build] fixed broken Docker builds by adding gfortran package (#3640)

mdoulaty
authored and
danpovey
committed
[src] Fix bug in resampling checks for online features (#3639)

entn-at
authored and
danpovey
committed

Commits on Oct 8, 2019

[build] Bump OpenBLAS version to 0.3.7 and enable locking (#3642)

sayint-ai
authored and
danpovey
committed

Commits on Oct 9, 2019

[scripts] Update nnet3_to_dot.py to ignore Scale descriptors (#3644)

rouseabout
authored and
danpovey
committed
[src] Speed optimization for decoders (call templates properly) (#3637)

Bar-BY
authored and
danpovey
committed

Commits on Oct 10, 2019

[doc] update FAQ page to include some FAQ candidates from Kaldi mailing lists (#3646)

qindazhu
authored and
danpovey
committed

Commits on Oct 11, 2019

[egs] Small fix: duplicate xent settings from examples (#3649)

sih4sing5hong5
authored and
danpovey
committed
[doc] Fix typo (#3648)

sih4sing5hong5
authored and
danpovey
committed
[egs] Fix a bug in Tedlium run_ivector_common.sh (#3647)

jerrykuo7727
authored and
danpovey
committed

Commits on Oct 12, 2019

[src] Fix to matrix-lib-test to ignore small difference (#3650)
danpovey
authored

Commits on Oct 14, 2019

[doc] update FAQ page: (#3651)

qindazhu
authored and
danpovey
committed

Commits on Oct 15, 2019

[scripts] Modify split_data.sh to split data evenly when utt2dur exists (#3653)

RuABraun
authored and
danpovey
committed
[doc] update FAQ page: added section for free dataset, python wrapper, etc. (#3652)

qindazhu
authored and
danpovey
committed

Commits on Oct 17, 2019

[src] Some CUDA i-vector fixes (#3660)

luitjens
authored and
danpovey
committed
[src] CUDA batched decoder pipeline fixes (#3659)

luitjens
authored and
danpovey
committed

Commits on Oct 18, 2019

[egs] Small fix to aspire example: pass in num_data_reps (#3665)

Shujian2015
authored and
danpovey
committed
[doc] Update FAQ page (#3663)

qindazhu
authored and
danpovey
committed

Commits on Oct 19, 2019

Commits on Oct 20, 2019

[egs] Fix sox command in multi-Updated sox command (#3667)

Shaheen A Kader
authored and
danpovey
committed

Commits on Oct 21, 2019

[src] Change data-type for hash in lattice alignment (avoid debugger complaints) (#3672)

jiedanzhu2307
authored and
danpovey
committed

Commits on Oct 23, 2019

[egs] Two fixes to multi_en setup (#3676)

Shaheen A Kader
authored and
danpovey
committed
[scripts] Fix misspelled variable in reverb script (#3678)

Alicegaz
authored and
danpovey
committed

Commits on Oct 24, 2019

Commits on Oct 26, 2019

[egs] Make librispeech run_tdnn_discriminative.sh more efficient with disk (#3685)

jiangj-dc
authored and
danpovey
committed

Commits on Oct 28, 2019

[egs] Remove pitch from multi_cn nnet3 recipe (#3686)

naxingyu
authored and
danpovey
committed
[egs] multi_cn: clarify metric is CER (#3687)

naxingyu
authored and
danpovey
committed

Commits on Oct 29, 2019

[src,minor] Fix typo in comment in kaldi-holder.h (#3691)

zh794390558
authored and
danpovey
committed
[egs] update run_tdnn_discriminative.sh in librispeech recipe (#3689)

jiangj-dc
authored and
danpovey
committed

Commits on Oct 31, 2019

[egs] Aspire recipe: fixed typo in utterance and speaker prefix (#3696)

skolachi
authored and
danpovey
committed

Commits on Nov 1, 2019

[src] cuda batched decoder, fix memory bugs (#3697)

luitjens
authored and
danpovey
committed

Commits on Nov 7, 2019

[scripts] Change make_rttm.py to read/write files with UTF-8 encoding (#3705)

entn-at
authored and
danpovey
committed

Commits on Nov 9, 2019

[src] Removing non-compiling paranoid asserts in nnet-computation-graph. (#3709)

RuABraun
authored and
danpovey
committed
[build] Fix gfortran package name for centos (#3708)

rezame
authored and
danpovey
committed

Commits on Nov 11, 2019

[scripts] Change the Python diagnostic scripts to accept non-ASCII UTF-8 phone set (#3711)

vdp
authored and
danpovey
committed

Commits on Nov 12, 2019

[scripts] Fix some issues in #3653 in split_scp.pl (#3710)

RuABraun
authored and
danpovey
committed
[scripts] Fix 2 issues in nnet2->nnet3 model conversion script (#886)(#3713)

jfainberg
authored and
danpovey
committed

Commits on Nov 14, 2019

Removing changes to split_scp.pl (#3717)
danpovey
authored

Commits on Nov 15, 2019

[scripts] Improve how combine_ali_dirs.sh gets job-specific filenames (#3720)

KimJeongSun
authored and
danpovey
committed

Commits on Nov 16, 2019

[src] Add --debug-level=N configure option to control assertions (#3690) (#3700)

iskunk
authored and
danpovey
committed

Commits on Nov 28, 2019

[src] Fix NVCC compilation errors on Windows (#3741)

cloudhan
authored and
danpovey
committed
[build] Add CMake Build System as alternative to current Makefile-based build (#3580)

cloudhan
authored and
danpovey
committed

Commits on Nov 30, 2019

[scripts] Modify split_data_dir.sh and split_scp.pl to use utt2dur if present, to balance splits

desh2608
authored and
danpovey
committed
[scripts] fix slurm.pl error (#3745)

naxingyu
authored and
danpovey
committed

Commits on Dec 1, 2019

Revert "[scripts] Modify split_data_dir.sh and split_scp.pl to use utt2dur if present, to balance splits" (#3746)
danpovey
authored

Commits on Dec 2, 2019

Commits on Dec 3, 2019

[scripts] Add scripts to create combine fmllr-tranform dirs(#3752)

marvin-nj
authored and
danpovey
committed

Commits on Dec 5, 2019

[src] CUDA decoder: fix invalid-lattice error that happens in corner cases (#3756)

hugovbraun
authored and
danpovey
committed
[egs] Add Chime 6 baseline system (#3755)

aarora8
authored and
danpovey
committed
[scripts] Fix issue in copy_lat_dir.sh affecting combine_lat_dirs.sh (missing phones.txt) (#3757)

marvin-nj
authored and
danpovey
committed

Commits on Dec 6, 2019

[src] Add missing #include, needed for CUDA decoder compilation on some platforms (#3759)

luitjens
authored and
danpovey
committed

Commits on Dec 8, 2019

[scripts] fix bug in steps/data/reverberate_data_dir.py (#3762)

HuangZiliAndy
authored and
danpovey
committed

Commits on Dec 11, 2019

Commits on Dec 12, 2019

[src] CUDA decoder: fix bug in NumPendingTasks() (#3769)

luitjens
authored and
danpovey
committed
[src] Add options to select specific gpu, reuse cuda context (#3750)

hugovbraun
authored and
danpovey
committed

Commits on Dec 13, 2019

[src] Move CheckAndFix to config struct (#3749)

hugovbraun
authored and
danpovey
committed

Commits on Dec 14, 2019

[egs,scripts] Add recipes for CN-Celeb (#3758)

Lantian Li
authored and
danpovey
committed
[src] CUDA decoder: remove unecessary sync that was added for debugging (#3770)

luitjens
authored and
danpovey
committed