[TTS] fixed wrong pronunciations for r1.11. #4677

XuesongYang · 2022-08-04T19:47:03Z

What does this PR do ?

Mirror the bugfix from #4669

Collection: [Note which collection this PR will affect]

Changelog

Add specific line by line info of high level changes in this PR.

Usage

You can potentially add a usage example below

# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

Make sure you read and followed Contributor guidelines
Did you write any new necessary tests?
Did you add or update any necessary documentation?
Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
- Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

New Feature
Bugfix
Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed.
Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

Related to # (issue)

Signed-off-by: Xuesong Yang <[email protected]>

@blisc

* [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]>

@blisc

* [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: David Mosallanezhad <[email protected]>

@blisc

* [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]>

@blisc

* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (#4699) Signed-off-by: nithinraok <[email protected]> * Fix notebook for buffered inference (#4703) Signed-off-by: smajumdar <[email protected]> * Prompt Learning Notebook Bug Fix (#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <[email protected]> * updated argument name for build dataset Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * add psutils to mock imports (#4728) Signed-off-by: ericharper <[email protected]> Signed-off-by: ericharper <[email protected]> * Update Aligner model and tutorial to add NGC checkpoint loading (#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <[email protected]> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <[email protected]> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] bugfix for missing configs. (#4725) Signed-off-by: Xuesong Yang <[email protected]> * docs typo fix Signed-off-by: Oleksii Kuchaiev <[email protected]> * Fix pynini install in TTS tutorials (#4729) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> * Fix ASR notebooks (#4738) Signed-off-by: smajumdar <[email protected]> Signed-off-by: smajumdar <[email protected]> * Multilingual VAD model (#4734) * add ngc link Signed-off-by: fayejf <[email protected]> * add tuned VAD config on ASR data Signed-off-by: fayejf <[email protected]> * yaml note Signed-off-by: fayejf <[email protected]> * update vad asr notebook with mVAD Signed-off-by: fayejf <[email protected]> * update vad infer config comment Signed-off-by: fayejf <[email protected]> * fix Signed-off-by: fayejf <[email protected]> * mvad sd config for ch109 Signed-off-by: fayejf <[email protected]> * update sd readme Signed-off-by: fayejf <[email protected]> * add new mVAD model to doc Signed-off-by: fayejf <[email protected]> * style fix Signed-off-by: fayejf <[email protected]> * update sd tutorial with mVAD Signed-off-by: fayejf <[email protected]> * typo fix Signed-off-by: fayejf <[email protected]> Signed-off-by: fayejf <[email protected]> * publish pretrained itn t5 model for English (#4748) Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> * Updated docs and doc paths (#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <[email protected]> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * fix bug relating to ddp strategy in joint intent slot classification tutorial (#4762) * [TTS] updated config with a German IPA phoneme tokenizer (#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <[email protected]> * Update r1.11 to new heteronyms list (#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (#4763) Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (#4770) Signed-off-by: Xuesong Yang <[email protected]> * Update CMUdict with more recent 0.7b entries (#4768) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * Install pynini in docker container (#4733) Signed-off-by: Vladimir Bataev <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Fix tutorial formatting (#4778) Signed-off-by: Jocelyn Huang <[email protected]> * [TTS] deprecated old scripts for ljspeech. (#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and requirements Signed-off-by: ericharper <[email protected]> * update container Signed-off-by: ericharper <[email protected]> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Oleksii Kuchaiev <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: nithinraok <[email protected]> Signed-off-by: smajumdar <[email protected]> Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: fayejf <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Somshubra Majumdar <[email protected]> Co-authored-by: Virginia Adams <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: fayejf <[email protected]> Co-authored-by: bene-ges <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> Co-authored-by: Zhilin Wang <[email protected]> Co-authored-by: Vladimir Bataev <[email protected]>

@blisc

* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <[email protected]> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <[email protected]> * updated argument name for build dataset Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <[email protected]> Signed-off-by: ericharper <[email protected]> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <[email protected]> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <[email protected]> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <[email protected]> * docs typo fix Signed-off-by: Oleksii Kuchaiev <[email protected]> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <[email protected]> Signed-off-by: smajumdar <[email protected]> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <[email protected]> * add tuned VAD config on ASR data Signed-off-by: fayejf <[email protected]> * yaml note Signed-off-by: fayejf <[email protected]> * update vad asr notebook with mVAD Signed-off-by: fayejf <[email protected]> * update vad infer config comment Signed-off-by: fayejf <[email protected]> * fix Signed-off-by: fayejf <[email protected]> * mvad sd config for ch109 Signed-off-by: fayejf <[email protected]> * update sd readme Signed-off-by: fayejf <[email protected]> * add new mVAD model to doc Signed-off-by: fayejf <[email protected]> * style fix Signed-off-by: fayejf <[email protected]> * update sd tutorial with mVAD Signed-off-by: fayejf <[email protected]> * typo fix Signed-off-by: fayejf <[email protected]> Signed-off-by: fayejf <[email protected]> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <[email protected]> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <[email protected]> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <[email protected]> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <[email protected]> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and requirements Signed-off-by: ericharper <[email protected]> * update container Signed-off-by: ericharper <[email protected]> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Oleksii Kuchaiev <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: nithinraok <[email protected]> Signed-off-by: smajumdar <[email protected]> Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: fayejf <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Somshubra Majumdar <[email protected]> Co-authored-by: Virginia Adams <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: fayejf <[email protected]> Co-authored-by: bene-ges <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> Co-authored-by: Zhilin Wang <[email protected]> Co-authored-by: Vladimir Bataev <[email protected]> Signed-off-by: Anas Abou Allaban <[email protected]>

@blisc

* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <[email protected]> * Syle Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (#4699) Signed-off-by: nithinraok <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix rpe check Signed-off-by: MaximumEntropy <[email protected]> * Revert to main Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Revert more files Signed-off-by: MaximumEntropy <[email protected]> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Update Signed-off-by: MaximumEntropy <[email protected]> * Fix cross attention sync check Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix zero init Signed-off-by: MaximumEntropy <[email protected]> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <[email protected]> * Add worker changes Signed-off-by: MaximumEntropy <[email protected]> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <[email protected]> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Revert workers change Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: nithinraok <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Hoo Chang Shin <[email protected]> Co-authored-by: khcs <[email protected]>

@blisc

* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <[email protected]> * Syle Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (#4699) Signed-off-by: nithinraok <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix rpe check Signed-off-by: MaximumEntropy <[email protected]> * Revert to main Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Revert more files Signed-off-by: MaximumEntropy <[email protected]> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Update Signed-off-by: MaximumEntropy <[email protected]> * Fix cross attention sync check Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix zero init Signed-off-by: MaximumEntropy <[email protected]> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <[email protected]> * Add worker changes Signed-off-by: MaximumEntropy <[email protected]> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <[email protected]> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Revert workers change Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: nithinraok <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Hoo Chang Shin <[email protected]> Co-authored-by: khcs <[email protected]>

@blisc

* [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]>

@blisc

* [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]>

@blisc

* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <[email protected]> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <[email protected]> * updated argument name for build dataset Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <[email protected]> Signed-off-by: ericharper <[email protected]> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <[email protected]> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <[email protected]> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <[email protected]> * docs typo fix Signed-off-by: Oleksii Kuchaiev <[email protected]> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <[email protected]> Signed-off-by: smajumdar <[email protected]> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <[email protected]> * add tuned VAD config on ASR data Signed-off-by: fayejf <[email protected]> * yaml note Signed-off-by: fayejf <[email protected]> * update vad asr notebook with mVAD Signed-off-by: fayejf <[email protected]> * update vad infer config comment Signed-off-by: fayejf <[email protected]> * fix Signed-off-by: fayejf <[email protected]> * mvad sd config for ch109 Signed-off-by: fayejf <[email protected]> * update sd readme Signed-off-by: fayejf <[email protected]> * add new mVAD model to doc Signed-off-by: fayejf <[email protected]> * style fix Signed-off-by: fayejf <[email protected]> * update sd tutorial with mVAD Signed-off-by: fayejf <[email protected]> * typo fix Signed-off-by: fayejf <[email protected]> Signed-off-by: fayejf <[email protected]> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <[email protected]> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <[email protected]> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <[email protected]> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <[email protected]> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and requirements Signed-off-by: ericharper <[email protected]> * update container Signed-off-by: ericharper <[email protected]> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Oleksii Kuchaiev <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: nithinraok <[email protected]> Signed-off-by: smajumdar <[email protected]> Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: fayejf <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Somshubra Majumdar <[email protected]> Co-authored-by: Virginia Adams <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: fayejf <[email protected]> Co-authored-by: bene-ges <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> Co-authored-by: Zhilin Wang <[email protected]> Co-authored-by: Vladimir Bataev <[email protected]> Signed-off-by: Matvei Novikov <[email protected]>

@blisc

* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <[email protected]> * Syle Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix rpe check Signed-off-by: MaximumEntropy <[email protected]> * Revert to main Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Revert more files Signed-off-by: MaximumEntropy <[email protected]> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Update Signed-off-by: MaximumEntropy <[email protected]> * Fix cross attention sync check Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix zero init Signed-off-by: MaximumEntropy <[email protected]> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <[email protected]> * Add worker changes Signed-off-by: MaximumEntropy <[email protected]> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <[email protected]> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Revert workers change Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: nithinraok <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Hoo Chang Shin <[email protected]> Co-authored-by: khcs <[email protected]> Signed-off-by: Matvei Novikov <[email protected]>

@blisc

* update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Initial Signed-off-by: MaximumEntropy <[email protected]> * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Make megatron legacy configurable Signed-off-by: MaximumEntropy <[email protected]> * Enc-Dec checksum matching Signed-off-by: MaximumEntropy <[email protected]> * Add conversion script Signed-off-by: MaximumEntropy <[email protected]> * Reset files Signed-off-by: MaximumEntropy <[email protected]> * Reset docker and jenkinsfile Signed-off-by: MaximumEntropy <[email protected]> * Reset README Signed-off-by: MaximumEntropy <[email protected]> * Remove tts scripts files Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update finetuning script Signed-off-by: MaximumEntropy <[email protected]> * add cloning Signed-off-by: Abhinav Khattar <[email protected]> * map to cpu Signed-off-by: Abhinav Khattar <[email protected]> * Fix TP change for HF exported models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update conversion script and style Signed-off-by: MaximumEntropy <[email protected]> * Add base config Signed-off-by: MaximumEntropy <[email protected]> * Add arg Signed-off-by: MaximumEntropy <[email protected]> * Change partition comment update Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Minor fix for prompt learning Signed-off-by: MaximumEntropy <[email protected]> * style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix default Signed-off-by: MaximumEntropy <[email protected]> * Fix to latest ptl Signed-off-by: MaximumEntropy <[email protected]> * Add arg to perceiver Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Temporarily add Signed-off-by: MaximumEntropy <[email protected]> * Restore Signed-off-by: MaximumEntropy <[email protected]> * Move tokens head bias to cfg population Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Empty Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fixes to get decode to work. Signed-off-by: MaximumEntropy <[email protected]> * More changes Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Test Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update config to 0 dropout Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Reset file Signed-off-by: MaximumEntropy <[email protected]> * Remove scheduler Signed-off-by: MaximumEntropy <[email protected]> * Changes Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Support generic bos id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Minor changes Signed-off-by: MaximumEntropy <[email protected]> * Add embedding dropout Signed-off-by: MaximumEntropy <[email protected]> * Changes for ul2 Signed-off-by: MaximumEntropy <[email protected]> * Fix for pad id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update models that can be converted Signed-off-by: MaximumEntropy <[email protected]> * Fix inference Signed-off-by: MaximumEntropy <[email protected]> * Remove ipdb Signed-off-by: MaximumEntropy <[email protected]> * Fix typo Signed-off-by: MaximumEntropy <[email protected]> * Load ul2 in bf16 Signed-off-by: MaximumEntropy <[email protected]> * Add amp o2 arg Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Tmp Signed-off-by: MaximumEntropy <[email protected]> * Fix rmsnorm Signed-off-by: MaximumEntropy <[email protected]> * Reset config Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix eval for converted models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update predict step for adapters Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: Abhinav Khattar <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Abhinav Khattar <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

@blisc

) * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Initial Signed-off-by: MaximumEntropy <[email protected]> * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Make megatron legacy configurable Signed-off-by: MaximumEntropy <[email protected]> * Enc-Dec checksum matching Signed-off-by: MaximumEntropy <[email protected]> * Add conversion script Signed-off-by: MaximumEntropy <[email protected]> * Reset files Signed-off-by: MaximumEntropy <[email protected]> * Reset docker and jenkinsfile Signed-off-by: MaximumEntropy <[email protected]> * Reset README Signed-off-by: MaximumEntropy <[email protected]> * Remove tts scripts files Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update finetuning script Signed-off-by: MaximumEntropy <[email protected]> * add cloning Signed-off-by: Abhinav Khattar <[email protected]> * map to cpu Signed-off-by: Abhinav Khattar <[email protected]> * Fix TP change for HF exported models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update conversion script and style Signed-off-by: MaximumEntropy <[email protected]> * Add base config Signed-off-by: MaximumEntropy <[email protected]> * Add arg Signed-off-by: MaximumEntropy <[email protected]> * Change partition comment update Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Minor fix for prompt learning Signed-off-by: MaximumEntropy <[email protected]> * style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix default Signed-off-by: MaximumEntropy <[email protected]> * Fix to latest ptl Signed-off-by: MaximumEntropy <[email protected]> * Add arg to perceiver Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Temporarily add Signed-off-by: MaximumEntropy <[email protected]> * Restore Signed-off-by: MaximumEntropy <[email protected]> * Move tokens head bias to cfg population Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Empty Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fixes to get decode to work. Signed-off-by: MaximumEntropy <[email protected]> * More changes Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Test Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update config to 0 dropout Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Reset file Signed-off-by: MaximumEntropy <[email protected]> * Remove scheduler Signed-off-by: MaximumEntropy <[email protected]> * Changes Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Support generic bos id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Minor changes Signed-off-by: MaximumEntropy <[email protected]> * Add embedding dropout Signed-off-by: MaximumEntropy <[email protected]> * Changes for ul2 Signed-off-by: MaximumEntropy <[email protected]> * Fix for pad id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update models that can be converted Signed-off-by: MaximumEntropy <[email protected]> * Fix inference Signed-off-by: MaximumEntropy <[email protected]> * Remove ipdb Signed-off-by: MaximumEntropy <[email protected]> * Fix typo Signed-off-by: MaximumEntropy <[email protected]> * Load ul2 in bf16 Signed-off-by: MaximumEntropy <[email protected]> * Add amp o2 arg Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Tmp Signed-off-by: MaximumEntropy <[email protected]> * Fix rmsnorm Signed-off-by: MaximumEntropy <[email protected]> * Reset config Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix eval for converted models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update predict step for adapters Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: Abhinav Khattar <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Abhinav Khattar <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: 1-800-bad-code <[email protected]>

@blisc

* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <[email protected]> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <[email protected]> * updated argument name for build dataset Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <[email protected]> Signed-off-by: ericharper <[email protected]> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <[email protected]> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <[email protected]> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <[email protected]> * docs typo fix Signed-off-by: Oleksii Kuchaiev <[email protected]> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <[email protected]> Signed-off-by: smajumdar <[email protected]> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <[email protected]> * add tuned VAD config on ASR data Signed-off-by: fayejf <[email protected]> * yaml note Signed-off-by: fayejf <[email protected]> * update vad asr notebook with mVAD Signed-off-by: fayejf <[email protected]> * update vad infer config comment Signed-off-by: fayejf <[email protected]> * fix Signed-off-by: fayejf <[email protected]> * mvad sd config for ch109 Signed-off-by: fayejf <[email protected]> * update sd readme Signed-off-by: fayejf <[email protected]> * add new mVAD model to doc Signed-off-by: fayejf <[email protected]> * style fix Signed-off-by: fayejf <[email protected]> * update sd tutorial with mVAD Signed-off-by: fayejf <[email protected]> * typo fix Signed-off-by: fayejf <[email protected]> Signed-off-by: fayejf <[email protected]> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <[email protected]> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <[email protected]> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <[email protected]> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <[email protected]> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and requirements Signed-off-by: ericharper <[email protected]> * update container Signed-off-by: ericharper <[email protected]> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Oleksii Kuchaiev <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: nithinraok <[email protected]> Signed-off-by: smajumdar <[email protected]> Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: fayejf <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Somshubra Majumdar <[email protected]> Co-authored-by: Virginia Adams <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: fayejf <[email protected]> Co-authored-by: bene-ges <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> Co-authored-by: Zhilin Wang <[email protected]> Co-authored-by: Vladimir Bataev <[email protected]> Signed-off-by: Hainan Xu <[email protected]>

@blisc

* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <[email protected]> * Syle Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix rpe check Signed-off-by: MaximumEntropy <[email protected]> * Revert to main Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Revert more files Signed-off-by: MaximumEntropy <[email protected]> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Update Signed-off-by: MaximumEntropy <[email protected]> * Fix cross attention sync check Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix zero init Signed-off-by: MaximumEntropy <[email protected]> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <[email protected]> * Add worker changes Signed-off-by: MaximumEntropy <[email protected]> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <[email protected]> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Revert workers change Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: nithinraok <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Hoo Chang Shin <[email protected]> Co-authored-by: khcs <[email protected]> Signed-off-by: Hainan Xu <[email protected]>

@blisc

) * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Initial Signed-off-by: MaximumEntropy <[email protected]> * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Make megatron legacy configurable Signed-off-by: MaximumEntropy <[email protected]> * Enc-Dec checksum matching Signed-off-by: MaximumEntropy <[email protected]> * Add conversion script Signed-off-by: MaximumEntropy <[email protected]> * Reset files Signed-off-by: MaximumEntropy <[email protected]> * Reset docker and jenkinsfile Signed-off-by: MaximumEntropy <[email protected]> * Reset README Signed-off-by: MaximumEntropy <[email protected]> * Remove tts scripts files Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update finetuning script Signed-off-by: MaximumEntropy <[email protected]> * add cloning Signed-off-by: Abhinav Khattar <[email protected]> * map to cpu Signed-off-by: Abhinav Khattar <[email protected]> * Fix TP change for HF exported models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update conversion script and style Signed-off-by: MaximumEntropy <[email protected]> * Add base config Signed-off-by: MaximumEntropy <[email protected]> * Add arg Signed-off-by: MaximumEntropy <[email protected]> * Change partition comment update Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Minor fix for prompt learning Signed-off-by: MaximumEntropy <[email protected]> * style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix default Signed-off-by: MaximumEntropy <[email protected]> * Fix to latest ptl Signed-off-by: MaximumEntropy <[email protected]> * Add arg to perceiver Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Temporarily add Signed-off-by: MaximumEntropy <[email protected]> * Restore Signed-off-by: MaximumEntropy <[email protected]> * Move tokens head bias to cfg population Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Empty Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fixes to get decode to work. Signed-off-by: MaximumEntropy <[email protected]> * More changes Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Test Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update config to 0 dropout Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Reset file Signed-off-by: MaximumEntropy <[email protected]> * Remove scheduler Signed-off-by: MaximumEntropy <[email protected]> * Changes Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Support generic bos id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Minor changes Signed-off-by: MaximumEntropy <[email protected]> * Add embedding dropout Signed-off-by: MaximumEntropy <[email protected]> * Changes for ul2 Signed-off-by: MaximumEntropy <[email protected]> * Fix for pad id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update models that can be converted Signed-off-by: MaximumEntropy <[email protected]> * Fix inference Signed-off-by: MaximumEntropy <[email protected]> * Remove ipdb Signed-off-by: MaximumEntropy <[email protected]> * Fix typo Signed-off-by: MaximumEntropy <[email protected]> * Load ul2 in bf16 Signed-off-by: MaximumEntropy <[email protected]> * Add amp o2 arg Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Tmp Signed-off-by: MaximumEntropy <[email protected]> * Fix rmsnorm Signed-off-by: MaximumEntropy <[email protected]> * Reset config Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix eval for converted models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update predict step for adapters Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: Abhinav Khattar <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Abhinav Khattar <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: Hainan Xu <[email protected]>

@blisc

* NeMo Megatron doc updates Signed-off-by: Oleksii Kuchaiev <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix notebook for buffered inference (NVIDIA#4703) Signed-off-by: smajumdar <[email protected]> * Prompt Learning Notebook Bug Fix (NVIDIA#4689) * Added back dataset class list of dict input for generation in tutorial notebook Signed-off-by: Virginia Adams <[email protected]> * updated argument name for build dataset Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * add psutils to mock imports (NVIDIA#4728) Signed-off-by: ericharper <[email protected]> Signed-off-by: ericharper <[email protected]> * Update Aligner model and tutorial to add NGC checkpoint loading (NVIDIA#4714) * Update Aligner model and tutorial to add NGC checkpoint loading Signed-off-by: Jocelyn Huang <[email protected]> * Fix pynini install for Aligner notebook, minor formatting fix for model Signed-off-by: Jocelyn Huang <[email protected]> * Aligner notebook formatting consistency Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] bugfix for missing configs. (NVIDIA#4725) Signed-off-by: Xuesong Yang <[email protected]> * docs typo fix Signed-off-by: Oleksii Kuchaiev <[email protected]> * Fix pynini install in TTS tutorials (NVIDIA#4729) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> * Fix ASR notebooks (NVIDIA#4738) Signed-off-by: smajumdar <[email protected]> Signed-off-by: smajumdar <[email protected]> * Multilingual VAD model (NVIDIA#4734) * add ngc link Signed-off-by: fayejf <[email protected]> * add tuned VAD config on ASR data Signed-off-by: fayejf <[email protected]> * yaml note Signed-off-by: fayejf <[email protected]> * update vad asr notebook with mVAD Signed-off-by: fayejf <[email protected]> * update vad infer config comment Signed-off-by: fayejf <[email protected]> * fix Signed-off-by: fayejf <[email protected]> * mvad sd config for ch109 Signed-off-by: fayejf <[email protected]> * update sd readme Signed-off-by: fayejf <[email protected]> * add new mVAD model to doc Signed-off-by: fayejf <[email protected]> * style fix Signed-off-by: fayejf <[email protected]> * update sd tutorial with mVAD Signed-off-by: fayejf <[email protected]> * typo fix Signed-off-by: fayejf <[email protected]> Signed-off-by: fayejf <[email protected]> * publish pretrained itn t5 model for English (NVIDIA#4748) Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> * Updated docs and doc paths (NVIDIA#4754) * Updated docs and doc paths Signed-off-by: Virginia Adams <[email protected]> * Update Multitask_Prompt_and_PTuning.ipynb * Update README.rst * Changed branch name to use single quotes Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Virginia Adams <[email protected]> * fix bug relating to ddp strategy in joint intent slot classification tutorial (NVIDIA#4762) * [TTS] updated config with a German IPA phoneme tokenizer (NVIDIA#4756) * [TTS] added a German IPA phoneme tokenizer * [TTS][ASR] enabled customized arguments for trimming the leading and trailing silence. * [TTS] disabled spline interpolation for beta-binomial distribution. Let it generate align prior and save to disks. Use a new phoneme tokenizer. * [TTS] use consistent spline interpolation with fastpitch checkpoint when generating mel-spectrograms for hifigan finetune. Signed-off-by: Xuesong Yang <[email protected]> * Update r1.11 to new heteronyms list (NVIDIA#4745) * Update configs to new heteronyms list * Remove old heteronyms list, add alt 'merchandise' pron to CMUdict * Update remaining references to old heteronyms list Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * [TTS] Add multi-speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4763) Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> * [TTS] Add single male speaker German FastPitch and HiFiGAN NGC checkpoints (NVIDIA#4770) Signed-off-by: Xuesong Yang <[email protected]> * Update CMUdict with more recent 0.7b entries (NVIDIA#4768) Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> * Install pynini in docker container (NVIDIA#4733) Signed-off-by: Vladimir Bataev <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Fix tutorial formatting (NVIDIA#4778) Signed-off-by: Jocelyn Huang <[email protected]> * [TTS] deprecated old scripts for ljspeech. (NVIDIA#4780) * deprecated old scripts for ljspeech. * removed relevent function calls in TTS docs. Signed-off-by: Xuesong Yang <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and requirements Signed-off-by: ericharper <[email protected]> * update container Signed-off-by: ericharper <[email protected]> * Update stragglers to new cmudict and heteronyms paths Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: Oleksii Kuchaiev <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: nithinraok <[email protected]> Signed-off-by: smajumdar <[email protected]> Signed-off-by: Virginia Adams <[email protected]> Signed-off-by: Jocelyn Huang <[email protected]> Signed-off-by: fayejf <[email protected]> Signed-off-by: Alexandra Antonova <[email protected]> Signed-off-by: Vladimir Bataev <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Sandeep Subramanian <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Somshubra Majumdar <[email protected]> Co-authored-by: Virginia Adams <[email protected]> Co-authored-by: Jocelyn <[email protected]> Co-authored-by: fayejf <[email protected]> Co-authored-by: bene-ges <[email protected]> Co-authored-by: Alexandra Antonova <[email protected]> Co-authored-by: Zhilin Wang <[email protected]> Co-authored-by: Vladimir Bataev <[email protected]> Signed-off-by: Hainan Xu <[email protected]>

@blisc

* Enc-Dec RPE PP > 2 Signed-off-by: MaximumEntropy <[email protected]> * Syle Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * [TTS] incremented the version number to 22.08 in tutorials. (NVIDIA#4684) * [TTS] incremented the version number to 22.08 in tutorials. Signed-off-by: Xuesong Yang <[email protected]> * Megatron encode function with RPE fix (NVIDIA#4692) * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * fix to fetch config file (NVIDIA#4699) Signed-off-by: nithinraok <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix rpe check Signed-off-by: MaximumEntropy <[email protected]> * Revert to main Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Revert more files Signed-off-by: MaximumEntropy <[email protected]> * Additional changes to make PP>2 with RPE work. * Fixes for O2 Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Update Signed-off-by: MaximumEntropy <[email protected]> * Fix cross attention sync check Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix zero init Signed-off-by: MaximumEntropy <[email protected]> * Modify .data instead of the weight Signed-off-by: MaximumEntropy <[email protected]> * Add worker changes Signed-off-by: MaximumEntropy <[email protected]> * Set workers to 0 for validation and test Signed-off-by: MaximumEntropy <[email protected]> * Remove unused imports and allreduce func Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Revert workers change Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: nithinraok <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Nithin Rao <[email protected]> Co-authored-by: Hoo Chang Shin <[email protected]> Co-authored-by: khcs <[email protected]> Signed-off-by: Hainan Xu <[email protected]>

@blisc

) * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Initial Signed-off-by: MaximumEntropy <[email protected]> * Fix for RPE Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * update branch Signed-off-by: ericharper <[email protected]> * update package info and dockerfile Signed-off-by: ericharper <[email protected]> * fix fastpitch export (NVIDIA#4676) Signed-off-by: Jason <[email protected]> * [TTS] fixed wrong pronunciations for r1.11. (NVIDIA#4677) * [TTS] fixed wrong pronunciations. Signed-off-by: Xuesong Yang <[email protected]> * incremented the version number to 22.08 as @blisc suggested. Signed-off-by: Xuesong Yang <[email protected]> * correct cmudict versions in world-wide places. Signed-off-by: Xuesong Yang <[email protected]> * Fix for incorrect batch size issue while decoding (NVIDIA#4675) Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Eric Harper <[email protected]> * Make megatron legacy configurable Signed-off-by: MaximumEntropy <[email protected]> * Enc-Dec checksum matching Signed-off-by: MaximumEntropy <[email protected]> * Add conversion script Signed-off-by: MaximumEntropy <[email protected]> * Reset files Signed-off-by: MaximumEntropy <[email protected]> * Reset docker and jenkinsfile Signed-off-by: MaximumEntropy <[email protected]> * Reset README Signed-off-by: MaximumEntropy <[email protected]> * Remove tts scripts files Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update finetuning script Signed-off-by: MaximumEntropy <[email protected]> * add cloning Signed-off-by: Abhinav Khattar <[email protected]> * map to cpu Signed-off-by: Abhinav Khattar <[email protected]> * Fix TP change for HF exported models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update conversion script and style Signed-off-by: MaximumEntropy <[email protected]> * Add base config Signed-off-by: MaximumEntropy <[email protected]> * Add arg Signed-off-by: MaximumEntropy <[email protected]> * Change partition comment update Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Minor fix for prompt learning Signed-off-by: MaximumEntropy <[email protected]> * style Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix default Signed-off-by: MaximumEntropy <[email protected]> * Fix to latest ptl Signed-off-by: MaximumEntropy <[email protected]> * Add arg to perceiver Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Temporarily add Signed-off-by: MaximumEntropy <[email protected]> * Restore Signed-off-by: MaximumEntropy <[email protected]> * Move tokens head bias to cfg population Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Empty Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fixes to get decode to work. Signed-off-by: MaximumEntropy <[email protected]> * More changes Signed-off-by: MaximumEntropy <[email protected]> * Update base config Signed-off-by: MaximumEntropy <[email protected]> * Test Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update config to 0 dropout Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Reset file Signed-off-by: MaximumEntropy <[email protected]> * Remove scheduler Signed-off-by: MaximumEntropy <[email protected]> * Changes Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Support generic bos id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * Minor changes Signed-off-by: MaximumEntropy <[email protected]> * Add embedding dropout Signed-off-by: MaximumEntropy <[email protected]> * Changes for ul2 Signed-off-by: MaximumEntropy <[email protected]> * Fix for pad id Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Update models that can be converted Signed-off-by: MaximumEntropy <[email protected]> * Fix inference Signed-off-by: MaximumEntropy <[email protected]> * Remove ipdb Signed-off-by: MaximumEntropy <[email protected]> * Fix typo Signed-off-by: MaximumEntropy <[email protected]> * Load ul2 in bf16 Signed-off-by: MaximumEntropy <[email protected]> * Add amp o2 arg Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Tmp Signed-off-by: MaximumEntropy <[email protected]> * Fix rmsnorm Signed-off-by: MaximumEntropy <[email protected]> * Reset config Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix eval for converted models Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Fix Signed-off-by: MaximumEntropy <[email protected]> * Style Signed-off-by: MaximumEntropy <[email protected]> * Update predict step for adapters Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Minor Signed-off-by: MaximumEntropy <[email protected]> * Fixes Signed-off-by: MaximumEntropy <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: ericharper <[email protected]> Signed-off-by: Jason <[email protected]> Signed-off-by: Xuesong Yang <[email protected]> Signed-off-by: MaximumEntropy <[email protected]> Signed-off-by: Abhinav Khattar <[email protected]> Co-authored-by: ericharper <[email protected]> Co-authored-by: Jason <[email protected]> Co-authored-by: Xuesong Yang <[email protected]> Co-authored-by: Rajesh Ilango <[email protected]> Co-authored-by: Micha Livne <[email protected]> Co-authored-by: Abhinav Khattar <[email protected]> Co-authored-by: Oleksii Kuchaiev <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: Hainan Xu <[email protected]>

XuesongYang added 4 commits August 4, 2022 09:59

[TTS] fixed wrong pronunciations.

68a181a

Signed-off-by: Xuesong Yang <[email protected]>

incremented the version number to 22.08 as @blisc suggested.

824a18e

Signed-off-by: Xuesong Yang <[email protected]>

correct cmudict versions in world-wide places.

a616c7c

Signed-off-by: Xuesong Yang <[email protected]>

Merge branch 'main' into fix-pron

c8021b4

XuesongYang requested review from blisc and redoctopus August 4, 2022 19:47

XuesongYang changed the title ~~[TTS] fixed wrong pronunciations.~~ [TTS] fixed wrong pronunciations for r1.11. Aug 4, 2022

XuesongYang added the fix label Aug 4, 2022

blisc approved these changes Aug 4, 2022

View reviewed changes

Merge branch 'r1.11.0' into fix-pron

d1d4fc2

blisc merged commit 02b1518 into r1.11.0 Aug 4, 2022

blisc mentioned this pull request Aug 4, 2022

[TTS] fixed wrong pronunciations. #4669

Closed

8 tasks

blisc deleted the fix-pron branch August 4, 2022 20:49

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[TTS] fixed wrong pronunciations for r1.11. #4677

[TTS] fixed wrong pronunciations for r1.11. #4677

XuesongYang commented Aug 4, 2022

[TTS] fixed wrong pronunciations for r1.11. #4677

[TTS] fixed wrong pronunciations for r1.11. #4677

Conversation

XuesongYang commented Aug 4, 2022

What does this PR do ?

Changelog

Usage

Before your PR is "Ready for review"

Who can review?

Additional Information