Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

VITS HiFiTTS doc #6288

Merged
merged 19 commits into from
Apr 6, 2023
Merged

VITS HiFiTTS doc #6288

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
591d74a
storing
treacker Dec 13, 2022
1f2cd6e
Merge branch 'main' of https://github.com/NVIDIA/NeMo into main
treacker Feb 10, 2023
8374ae3
Added VITS documentation
treacker Feb 10, 2023
178c69a
Added VITS documentation
treacker Feb 10, 2023
82c1563
Cleaned stuff
treacker Feb 10, 2023
843e74d
Cleaned stuff
treacker Feb 10, 2023
323e791
cleaning
treacker Feb 11, 2023
6ff867e
Typos
treacker Feb 11, 2023
aa65b42
Added experimental note
treacker Feb 11, 2023
9ca84b5
Merge branch 'main' of https://github.com/NVIDIA/NeMo into main
treacker Mar 13, 2023
1c70344
Merge branch 'main' of https://github.com/NVIDIA/NeMo into main
Mar 23, 2023
e402f7a
Merge branch 'main' into vits_doc
Mar 24, 2023
22b398a
updated for 44kHz version
Mar 24, 2023
75d2fd4
added table
Mar 24, 2023
16dd374
Updated tutorial
Mar 25, 2023
825ed44
Added spectrogram visualization
Mar 29, 2023
38d6324
Merge remote-tracking branch 'origin/main' into vits_doc
Mar 31, 2023
dc05669
Updated ipa_cmudict version
Apr 5, 2023
5c3f7ec
Merge branch 'main' into vits_doc
XuesongYang Apr 5, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/source/tts/data/ngc_models_e2e.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
Locale,Model Name,Dataset,Sampling Rate,#Spk,Phoneme Unit,Model Class,Overview,Checkpoint
en-US,tts_en_lj_vits,LJSpeech,22050Hz,1,IPA,nemo.collections.tts.models.vits.VitsModel,`tts_en_lj_vits <https://ngc.nvidia.com/catalog/models/nvidia:nemo:tts_en_lj_vits>`_,``https://api.ngc.nvidia.com/v2/models/nvidia/nemo/tts_en_lj_vits/versions/1.13.0/files/vits_ljspeech_fp16_full.nemo``
en-US,tts_en_lj_vits,LJSpeech,22050Hz,1,IPA,nemo.collections.tts.models.vits.VitsModel,`tts_en_lj_vits <https://ngc.nvidia.com/catalog/models/nvidia:nemo:tts_en_lj_vits>`_,``https://api.ngc.nvidia.com/v2/models/nvidia/nemo/tts_en_lj_vits/versions/1.13.0/files/vits_ljspeech_fp16_full.nemo``
en-US,tts_en_hifitts_vits,HiFiTTS,44100Hz,10,IPA,nemo.collections.tts.models.vits.VitsModel,`tts_en_hifitts_vits <https://ngc.nvidia.com/catalog/models/nvidia:nemo:tts_en_hifitts_vits>`_,``https://api.ngc.nvidia.com/v2/models/nvidia/nemo/tts_en_hifitts_vits/versions/r1.15.0/files/vits_en_hifitts.nemo``
3 changes: 1 addition & 2 deletions examples/tts/vits.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,6 @@

import pytorch_lightning as pl

from nemo.collections.common.callbacks import LogEpochTimeCallback
from nemo.collections.tts.models.vits import VitsModel
from nemo.core.config import hydra_runner
from nemo.utils.exp_manager import exp_manager
Expand All @@ -26,7 +25,7 @@ def main(cfg):
exp_manager(trainer, cfg.get("exp_manager", None))
model = VitsModel(cfg=cfg.model, trainer=trainer)

trainer.callbacks.extend([pl.callbacks.LearningRateMonitor(), LogEpochTimeCallback()])
trainer.callbacks.extend([pl.callbacks.LearningRateMonitor()])
trainer.fit(model)


Expand Down
7 changes: 7 additions & 0 deletions nemo/collections/tts/models/vits.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -394,6 +394,13 @@ def list_available_models(cls) -> 'List[PretrainedModelInfo]':
class_=cls,
)
list_of_models.append(model)
model = PretrainedModelInfo(
pretrained_model_name="tts_en_hifitts_vits",
location="https://api.ngc.nvidia.com/v2/models/nvidia/nemo/tts_en_hifitts_vits/versions/r1.15.0/files/vits_en_hifitts.nemo",
description="This model is trained on HiFITTS sampled at 44100Hz with and can be used to generate male and female English voices with an American accent.",
class_=cls,
)
list_of_models.append(model)
return list_of_models

@typecheck(
Expand Down
Loading