Code

Merge main to asr_normalize#7084

Code

Merged

KunalDhawan merged 123 commits intoasr_normalizeNVIDIA/NeMo:asr_normalizefrom mainNVIDIA/NeMo:mainCopy head branch name to clipboardJul 20, 2023

+28,556-3,914

Commits

Commits on Jun 1, 2023

• peft eval directly from ckpt (#6785)

  Show description for 89cbf1d
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  89cbf1d

  Copy full SHA for 89cbf1d

• Add Frame-VAD examples and utils (#6463)

  Show description for 23f1c42
  

  3 peopleauthored
  23f1c42

  Copy full SHA for 23f1c42

Commits on Jun 2, 2023

• [TTS][zh] refine hardcoded lowercase for ASCII letters. (#6781)

  Show description for cfbe092
  XuesongYang

  authored
  cfbe092

  Copy full SHA for cfbe092

• Spellchecking ASR customization model (#6179)

  Show description for 5428a97
  

  3 peopleauthored
  5428a97

  Copy full SHA for 5428a97

• [TTS] Implement new vocoder dataset (#6670)

  Show description for a420f90
  rlangman

  authored
  a420f90

  Copy full SHA for a420f90

• GPT inference long context (#6687)

  Show description for 9827c9b
  

  ekmb

  and

  pre-commit-ci[bot]

  authored
  9827c9b

  Copy full SHA for 9827c9b

• TDT model pull request (#6536)

  Show description for d5819e9
  

  3 peopleauthored
  d5819e9

  Copy full SHA for d5819e9

• Fix get_parameters when using main params optimizer (#6764) (#6787)

  Show description for ef74006
  

  github-actions[bot]

  and

  ericharper

  authored
  ef74006

  Copy full SHA for ef74006

• Lddl bert (#6761) (#6790)

  Show description for 19a8d2f
  

  4 peopleauthored
  19a8d2f

  Copy full SHA for 19a8d2f

• Fix check (#6798) (#6800)

  Show description for a7403c2
  

  github-actions[bot]

  and

  MaximumEntropy

  authored
  a7403c2

  Copy full SHA for a7403c2

• Fix validation with drop_last=False (#6704)

  Show description for d984333
  

  mikolajblaz

  and

  ericharper

  authored
  d984333

  Copy full SHA for d984333

Commits on Jun 3, 2023

• SDE unt lvl comparison (#6669)

  Show description for 8f26d83
  

  Jorjeous

  and

  pre-commit-ci[bot]

  authored
  8f26d83

  Copy full SHA for 8f26d83

Commits on Jun 4, 2023

• Debug Transformer Engine FP8 support with Megatron-core infrastructure (#6791)

  Show description for 5c3ed94
  

  github-actions[bot]

  and

  timmoon10

  authored
  5c3ed94

  Copy full SHA for 5c3ed94

Commits on Jun 5, 2023

• Lora/PEFT training script CI test (#6664)

  Show description for ae00414
  arendu

  authored
  ae00414

  Copy full SHA for ae00414

• change branch to main, small fix (#6803)

  Show description for 76fc488
  bene-ges

  authored
  76fc488

  Copy full SHA for 76fc488

• add call to p2p overlap (#6779) (#6786)

  Show description for aa1986f
  

  3 peopleauthored
  aa1986f

  Copy full SHA for aa1986f

• fixed decor to show messages only when the wrapped object is called. (#6793)

  Show description for aa21e8a
  XuesongYang

  authored
  aa21e8a

  Copy full SHA for aa21e8a

• Bug fix for reset_sequence_parallel_args (#6802) (#6805)

  Show description for f9bb1b0
  

  github-actions[bot]

  and

  markelsanz14

  authored
  f9bb1b0

  Copy full SHA for f9bb1b0

Commits on Jun 6, 2023

• text_generation_utils memory reduction if no logprob needed (#6773)

  Show description for 3063e32
  

  4 peopleauthored
  3063e32

  Copy full SHA for 3063e32

• Fixed bug in MaskedSpecAug that overestimates samples. (#6775)

  Show description for 010a0e6
  tbartley94

  authored
  010a0e6

  Copy full SHA for 010a0e6

• update core version (#6817) (#6819)

  Show description for 8c26464
  

  github-actions[bot]

  and

  aklife97

  authored
  8c26464

  Copy full SHA for 8c26464

• lora pp2 (#6818)

  Show description for acf50f4
  arendu

  authored
  acf50f4

  Copy full SHA for acf50f4

• Add optional index mapping dir in mmap text datasets (#6683)

  Show description for 04628ca
  gheinrich

  authored
  04628ca

  Copy full SHA for 04628ca

• Add inference kv cache support for transformer TE path (#6627)

  Show description for bf27079
  

  5 peopleauthored
  bf27079

  Copy full SHA for bf27079

Commits on Jun 7, 2023

• Support large inputs to Conformer and Fast Conformer (#6556)

  Show description for 336372c
  

  bmwshop

  and

  pre-commit-ci[bot]

  authored
  336372c

  Copy full SHA for 336372c

• sharded_manifests updated docs (#6833)

  Show description for ebfcef7
  bmwshop

  authored
  ebfcef7

  Copy full SHA for ebfcef7

Commits on Jun 8, 2023

• added fc-xl, xxl and titanet-s models (#6832)

  Show description for 52e23e0
  nithinraok

  authored
  52e23e0

  Copy full SHA for 52e23e0

• add reference to our paper (#6821)

  Show description for 6903d9b
  bene-ges

  authored
  6903d9b

  Copy full SHA for 6903d9b

• Upperbound Numpy to < 1.24 (#6829)

  Show description for 9cca92b
  

  titu1994

  and

  ericharper

  authored
  9cca92b

  Copy full SHA for 9cca92b

• Multi-lookahead cache-aware streaming models (#6711)

  Show description for b67d410
  

  VahidooX

  and

  pre-commit-ci[bot]

  authored
  b67d410

  Copy full SHA for b67d410

• added changes to ramp up bs (#6799)

  Show description for 3ed3c4e
  

  dimapihtar

  and

  ericharper

  authored
  3ed3c4e

  Copy full SHA for 3ed3c4e

• Fix typo in core.rst (#6838)

  Show description for 7538a08
  Dounx

  authored
  7538a08

  Copy full SHA for 7538a08

• add back ptuning pp2 test (#6394)

  Show description for 014fa02
  arendu

  authored
  014fa02

  Copy full SHA for 014fa02

• t5 lora tuning (#6612)

  Show description for 29ceec0
  

  3 peopleauthored
  29ceec0

  Copy full SHA for 29ceec0

Commits on Jun 9, 2023

• NFA updates (#6695)

  Show description for 72faf55
  

  erastorgueva-nv

  and

  pre-commit-ci[bot]

  authored
  72faf55

  Copy full SHA for 72faf55

Commits on Jun 10, 2023

• Added rouge monitoring support for T5 (#6737)

  Show description for 2db352a
  

  jubick1337

  and

  pre-commit-ci[bot]

  authored
  2db352a

  Copy full SHA for 2db352a

Commits on Jun 12, 2023

• GPT extrapolatable position embedding (xpos/sandwich/alibi/kerple) and Flash Attention (#6666)

  Show description for a87702a
  

  53 peopleauthored
  a87702a

  Copy full SHA for a87702a

Commits on Jun 13, 2023

• fix (#6842) (#6843)

  Show description for b54e7fd
  

  github-actions[bot]

  and

  yidong72

  authored
  b54e7fd

  Copy full SHA for b54e7fd

• Add Frame-VAD to ASR+VAD pipeline (#6464)

  Show description for 02c3068
  

  stevehuang52

  and

  fayejf

  authored
  02c3068

  Copy full SHA for 02c3068

Commits on Jun 14, 2023

• Add API docs for NeMo Megatron (#6850) (#6864)

  Show description for 1e4845c
  

  github-actions[bot]

  and

  ericharper

  authored
  1e4845c

  Copy full SHA for 1e4845c

Commits on Jun 15, 2023

• Update transcribe_utils.py (#6865)

  Show description for 72132a2
  stevehuang52

  authored
  72132a2

  Copy full SHA for 72132a2

Commits on Jun 17, 2023

• Import Enum for chatbot component (#6877)

  Show description for a6c8cce
  

  ericharper

  and

  pre-commit-ci[bot]

  authored
  a6c8cce

  Copy full SHA for a6c8cce

• [bugfix] avoid the random shuffle of phoneme and tone tokens. (#6855)

  Show description for 6f2035b
  XuesongYang

  authored
  6f2035b

  Copy full SHA for 6f2035b

Commits on Jun 18, 2023

• update mcore version (#6875) (#6876)

  Show description for 990c764
  

  github-actions[bot]

  and

  ericharper

  authored
  990c764

  Copy full SHA for 990c764

• Add trainer.validate example for GPT (#6794) (#6822)

  Show description for 3aac795
  

  github-actions[bot]

  and

  ericharper

  authored
  3aac795

  Copy full SHA for 3aac795

Commits on Jun 19, 2023

• typo fix from #6666 (#6882)

  Show description for fc84071
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  fc84071

  Copy full SHA for fc84071

Commits on Jun 20, 2023

• Fix k2 build topo helper (#6887)

  Show description for e418f71
  artbataev

  authored
  e418f71

  Copy full SHA for e418f71

• Update container for import action (#6883)

  Show description for 63d9b2c
  ericharper

  authored
  63d9b2c

  Copy full SHA for 63d9b2c

Commits on Jun 21, 2023

• removed unnecessary print (#6884)

  Show description for 24837af
  dimapihtar

  authored
  24837af

  Copy full SHA for 24837af

• Fix destructor for delayed mmap dataset case (#6703)

  Show description for 328bbbb
  

  mikolajblaz

  and

  ericharper

  authored
  328bbbb

  Copy full SHA for 328bbbb

• removed some tests (#6900)

  Show description for 07ea971
  arendu

  authored
  07ea971

  Copy full SHA for 07ea971

• Fix transcribe_utils.py for hybrid models in partial transcribe mode (#6899)

  Show description for 0b94ef8
  

  stevehuang52

  and

  fayejf

  authored
  0b94ef8

  Copy full SHA for 0b94ef8

Commits on Jun 22, 2023

• hot fix SDE (#6897)

  Show description for 29015df
  

  3 peopleauthored
  29015df

  Copy full SHA for 29015df

• fix ptuning residuals bug (#6866)

  Show description for a8609ab
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  a8609ab

  Copy full SHA for a8609ab

• Add hybrid model support to transcribe_speech_parallel.py (#6906)

  Show description for 698a5f7
  

  stevehuang52

  and

  pre-commit-ci[bot]

  authored
  698a5f7

  Copy full SHA for 698a5f7

• Make Gradio library optional (#6904)

  Show description for d870644
  yidong72

  authored
  d870644

  Copy full SHA for d870644

• Update Frame-VAD doc (#6902)

  Show description for 4726650
  

  stevehuang52

  and

  fayejf

  authored
  4726650

  Copy full SHA for 4726650

Commits on Jun 23, 2023

• Update container info in README.rst (#6913)

  Show description for 722e77c
  fayejf

  authored
  722e77c

  Copy full SHA for 722e77c

• Fix fast-glu activation in change partitions (#6909)

  Show description for 74cbbb2
  hsiehjackson

  authored
  74cbbb2

  Copy full SHA for 74cbbb2

Commits on Jun 25, 2023

• Documentation for ONNX export of Megatron Models (#6914)

  Show description for c4e677a
  

  3 peopleauthored
  c4e677a

  Copy full SHA for c4e677a

Commits on Jun 26, 2023

• FixTextMemMapDataset index file creation in multi-node setup (#6768)

  Show description for f344fdb
  

  3 peopleauthored
  f344fdb

  Copy full SHA for f344fdb

• Move model change out of if-branch (#6908)

  Show description for ef56c97
  erastorgueva-nv

  authored
  ef56c97

  Copy full SHA for ef56c97

• Update fvad doc (#6920)

  Show description for e736c86
  

  stevehuang52

  and

  fayejf

  authored
  e736c86

  Copy full SHA for e736c86

• Fix flash-attention (#6901)

  Show description for 8204483
  

  hsiehjackson

  and

  pre-commit-ci[bot]

  authored
  8204483

  Copy full SHA for 8204483

Commits on Jun 27, 2023

• ptuning oom fix (#6916)

  Show description for 7e3739b
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  7e3739b

  Copy full SHA for 7e3739b

• add rampup bs assertion (#6927)

  Show description for 350b2a2
  

  dimapihtar

  and

  pre-commit-ci[bot]

  authored
  350b2a2

  Copy full SHA for 350b2a2

• Online Code Switching Dataset for ASR (#6579)

  Show description for 92c4a2a
  

  trias702

  and

  pre-commit-ci[bot]

  authored
  92c4a2a

  Copy full SHA for 92c4a2a

Commits on Jun 28, 2023

• Removed optional optimize_for_inference (#6933)

  Show description for e9b0b11
  borisfom

  authored
  e9b0b11

  Copy full SHA for e9b0b11

• Apply garbage collection interval to validation steps (#6870) (#6872)

  Show description for 7e20750
  

  4 peopleauthored
  7e20750

  Copy full SHA for 7e20750

• Enable rpe methods in bert-like models (#6898)

  Show description for 3b4f37a
  sararb

  authored
  3b4f37a

  Copy full SHA for 3b4f37a

• Fix AN4 dataset links (#6926)

  Show description for 69747d8
  artbataev

  authored
  69747d8

  Copy full SHA for 69747d8

• Update core commit for CI (#6939)

  Show description for 295e88f
  aklife97

  authored
  295e88f

  Copy full SHA for 295e88f

• Tensor-parallel communication overlap with userbuffer backend (#6792)

  Show description for 29b9b8a
  

  5 peopleauthored
  29b9b8a

  Copy full SHA for 29b9b8a

• lora inference ci (#6931)

  Show description for 5260c9c
  

  arendu

  and

  aklife97

  authored
  5260c9c

  Copy full SHA for 5260c9c

Commits on Jun 29, 2023

• support value attribution condition (#6934)

  Show description for a27ba52
  

  yidong72

  and

  pre-commit-ci[bot]

  authored
  a27ba52

  Copy full SHA for a27ba52

• Fix confidence ensembles RNNT logprobs selection logic for exclude_blank scenario (#6937)

  Show description for 47c9d74
  

  KunalDhawan

  and

  pre-commit-ci[bot]

  authored
  47c9d74

  Copy full SHA for 47c9d74

• Add ub communicator initialization to validation step (#6814)

  Show description for 7e6e04a
  

  3 peopleauthored
  7e6e04a

  Copy full SHA for 7e6e04a

• Add missing save restore connector to eval scripts (#6935)

  Show description for 89225e4
  

  titu1994

  and

  ericharper

  authored
  89225e4

  Copy full SHA for 89225e4

• added cache-aware checkpoints. (#6940)

  Show description for 0dee17b
  VahidooX

  authored
  0dee17b

  Copy full SHA for 0dee17b

• Merge release r1.19.0 into main (#6948)

  Show description for 85e3e15
  

  3 peopleauthored
  85e3e15

  Copy full SHA for 85e3e15

Commits on Jun 30, 2023

• upgrade base container (#6938)

  Show description for e5706a0
  ericharper

  authored
  e5706a0

  Copy full SHA for e5706a0

Commits on Jul 1, 2023

• Fix requirements for pydantic + inflect (#6956)

  Show description for b0e5bf3
  

  titu1994

  and

  pre-commit-ci[bot]

  authored
  b0e5bf3

  Copy full SHA for b0e5bf3

Commits on Jul 3, 2023

• Update distopt API for coalesced NCCL calls (#6886)

  Show description for 0b6e4e6
  

  timmoon10

  and

  pre-commit-ci[bot]

  authored
  0b6e4e6

  Copy full SHA for 0b6e4e6

Commits on Jul 5, 2023

• Remove compute_on_step from metrics (#6979) (#6981)

  Show description for 1744718
  

  3 peopleauthored
  1744718

  Copy full SHA for 1744718

Commits on Jul 7, 2023

• Fix require_grad typos (#6930)

  Show description for 153c307
  kit1980

  authored
  153c307

  Copy full SHA for 153c307

• fix the mpt chatbot (#6957) (#6968)

  Show description for 19449a9
  

  github-actions[bot]

  and

  yidong72

  authored
  19449a9

  Copy full SHA for 19449a9

• add support for max_total_length=4096 for 43b (#6763)

  Show description for ff430e4
  

  Zhilin123

  and

  pre-commit-ci[bot]

  authored
  ff430e4

  Copy full SHA for ff430e4

• rnnt_greedy_decoding.py: typos? auto-repressively -> auto-regressively (#6989)

  Show description for b22a21f
  vadimkantorov

  authored
  b22a21f

  Copy full SHA for b22a21f

• Cache handling without input tensors mutation (#6980) (#6996)

  Show description for 07b79d2
  

  3 peopleauthored
  07b79d2

  Copy full SHA for 07b79d2

• Hybrid conformer export (#6983) (#6995)

  Show description for 94e1efa
  

  github-actions[bot]

  and

  borisfom

  authored
  94e1efa

  Copy full SHA for 94e1efa

Commits on Jul 10, 2023

• Fixing an issue with confidence ensembles (#6987) (#7004)

  Show description for 112c806
  

  github-actions[bot]

  and

  Kipok

  authored
  112c806

  Copy full SHA for 112c806

Commits on Jul 11, 2023

• [TTS] Add cosine distance option to TTS aligner (#6806)

  Show description for 68b4d1f
  rlangman

  authored
  68b4d1f

  Copy full SHA for 68b4d1f

• Minor MPT-7B fixes and creation script update (#6982)

  Show description for 0f79a9f
  

  trias702

  and

  pre-commit-ci[bot]

  authored
  0f79a9f

  Copy full SHA for 0f79a9f

• Change Jenkins timeout (#6997)

  Show description for 0cca300
  ericharper

  authored
  0cca300

  Copy full SHA for 0cca300

• remove hard coded input and output fields (#7008)

  Show description for 9e75050
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  9e75050

  Copy full SHA for 9e75050

• RoPE length extrapolation with interpolation (#7005)

  Show description for 41d8477
  

  3 peopleauthored
  41d8477

  Copy full SHA for 41d8477

Commits on Jul 12, 2023

• add async + distopt to sft (#7018)

  Show description for e87985d
  MaximumEntropy

  authored
  e87985d

  Copy full SHA for e87985d

• Adding tutorial for confidence ensembles (#6932)

  Show description for 77c666f
  Kipok

  authored
  77c666f

  Copy full SHA for 77c666f

• Add support for Numba FP16 RNNT Loss (#6991)

  Show description for 40c1ccc
  

  71 peopleauthored
  40c1ccc

  Copy full SHA for 40c1ccc

• ptuning inference table bug fix (#7015)

  Show description for a69f0f4
  arendu

  authored
  a69f0f4

  Copy full SHA for a69f0f4

• [TTS] Add tutorial for TTS data prep scripts (#6922)

  Show description for 728403d
  rlangman

  authored
  728403d

  Copy full SHA for 728403d

Commits on Jul 13, 2023

• Fix missing import (#7026)

  Show description for 36adc7e
  MaximumEntropy

  authored
  36adc7e

  Copy full SHA for 36adc7e

• fix install_beamsearch_decoders (#7011)

  Show description for 5e02346
  karpnv

  authored
  5e02346

  Copy full SHA for 5e02346

• Update SDP docs page with a new documentation link (#7029)

  Show description for caddb8d
  Kipok

  authored
  caddb8d

  Copy full SHA for caddb8d

• [TTS] Append pretrained FastPitch & SpectrogamEnhancer pair to available models (#7012) (#7013)

  Show description for 7ccc2cf
  github-actions[bot]

  authored
  7ccc2cf

  Copy full SHA for 7ccc2cf

• Add ASR with TTS Tutorial. Fix enhancer usage. (#6955) (#7023)

  Show description for d44127e
  

  github-actions[bot]

  and

  artbataev

  authored
  d44127e

  Copy full SHA for d44127e

• Add end_strings to SamplingParams (#6986)

  Show description for f7e33fc
  

  17 peopleauthored
  f7e33fc

  Copy full SHA for f7e33fc

• Fix race condition when executing with multi-node where some ranks does not wait for setup (#7016)

  Show description for 5733975
  findkim

  authored
  5733975

  Copy full SHA for 5733975

Commits on Jul 14, 2023

• Added bool types to neural_types export (#7032)

  Show description for 470f178
  tbartley94

  authored
  470f178

  Copy full SHA for 470f178

• rnnt and char utils (#6971)

  Show description for e859e43
  

  3 peopleauthored
  e859e43

  Copy full SHA for e859e43

• fix tab text gen (#7022) (#7031)

  Show description for 18f283e
  

  github-actions[bot]

  and

  yidong72

  authored
  18f283e

  Copy full SHA for 18f283e

Commits on Jul 15, 2023

• ASR Confidence update and tutorial (#6810)

  Show description for 33100e0
  

  GNroy

  and

  pre-commit-ci[bot]

  authored
  33100e0

  Copy full SHA for 33100e0

Commits on Jul 17, 2023

• install_bs (#7019) (#7028)

  Show description for 2ef544f
  

  github-actions[bot]

  and

  karpnv

  authored
  2ef544f

  Copy full SHA for 2ef544f

Commits on Jul 18, 2023

• fixes for spellmapper (#6994) (#7000)

  Show description for 8b4b382
  

  3 peopleauthored
  8b4b382

  Copy full SHA for 8b4b382

• added back the retro documents (#7033)

  Show description for 9051440
  yidong72

  authored
  9051440

  Copy full SHA for 9051440

• Remove pyyaml (#7052) (#7054)

  Show description for 84ae944
  

  github-actions[bot]

  and

  titu1994

  authored
  84ae944

  Copy full SHA for 84ae944

• st standalone model (#6969)

  Show description for 47e782a
  

  AlexGrinch

  and

  pre-commit-ci[bot]

  authored
  47e782a

  Copy full SHA for 47e782a

Commits on Jul 19, 2023

• remove pos emb from state dict for old models (#7068)

  Show description for ea9d3fd
  

  ekmb

  and

  pre-commit-ci[bot]

  authored
  ea9d3fd

  Copy full SHA for ea9d3fd

• Fix typo in ASR-TTS tutorial (#7049)

  Show description for b1aa4c2
  artbataev

  authored
  b1aa4c2

  Copy full SHA for b1aa4c2

• Fixed tutorial's name (#7047)

  Show description for 1dde267
  

  vsl9

  and

  artbataev

  authored
  1dde267

  Copy full SHA for 1dde267

• Fix documentation for Numba (#7065) (#7077)

  Show description for 6704a79
  

  3 peopleauthored
  6704a79

  Copy full SHA for 6704a79

• Update Frame-VAD doc and fix onnx export (#7076)

  Show description for 39aff5c
  

  stevehuang52

  and

  fayejf

  authored
  39aff5c

  Copy full SHA for 39aff5c

Commits on Jul 20, 2023

• memmap worker arg (#7062)

  Show description for d300a3a
  

  arendu

  and

  pre-commit-ci[bot]

  authored
  d300a3a

  Copy full SHA for d300a3a