Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create per.py #7538

Merged
merged 153 commits into from
Oct 7, 2023
Merged

Create per.py #7538

merged 153 commits into from
Oct 7, 2023

Commits on Oct 5, 2023

  1. Move model precision copy (NVIDIA#7336) 

    * move cfg precision set to megatron base model

Signed-off-by: Maanu Grover <[email protected]>

* remove copy from other models

Signed-off-by: Maanu Grover <[email protected]>

* modify attribute not arg

Signed-off-by: Maanu Grover <[email protected]>

* fix gpt model test for ptl 2.0

Signed-off-by: Maanu Grover <[email protected]>

* rename function and add docstring

Signed-off-by: Maanu Grover <[email protected]>

* replace precision to dtype conditionals with func call

Signed-off-by: Maanu Grover <[email protected]>

* unnecessary function and cfg reset

Signed-off-by: Maanu Grover <[email protected]>

* set default value

Signed-off-by: Maanu Grover <[email protected]>

* fix precision lookup in a few more places

Signed-off-by: Maanu Grover <[email protected]>

* rename mapping function

Signed-off-by: Maanu Grover <[email protected]>

* ununsed import

Signed-off-by: Maanu Grover <[email protected]>

* save torch datatype to model

Signed-off-by: Maanu Grover <[email protected]>

* set weights precision wrt amp o2

Signed-off-by: Maanu Grover <[email protected]>

* Revert "set weights precision wrt amp o2"

This reverts commit 313a4bf.

Signed-off-by: Maanu Grover <[email protected]>

* revert half precision at inference attempt

Signed-off-by: Maanu Grover <[email protected]>

* move autocast dtype to base model

Signed-off-by: Maanu Grover <[email protected]>

* move params dtype to base model, enable fp16 O2 inf

Signed-off-by: Maanu Grover <[email protected]>

* unused imports

Signed-off-by: Maanu Grover <[email protected]>

---------

Signed-off-by: Maanu Grover <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @maanug-nv @ssh-meister
    maanug-nv authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9c461ea View commit details
    Browse the repository at this point in the history

  2. Fix PEFT checkpoint loading (NVIDIA#7388) 

    * Fix PEFT checkpoint loading

Signed-off-by: Jason Wang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Jason Wang <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @blahBlahhhJ @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    59802b1 View commit details
    Browse the repository at this point in the history

  3. Use distributed optimizer support for multiple dtypes (NVIDIA#7359) 

    * Update distopt wrapper with multiple dtype support

Remove manual handling of separate FP32 optimizer.

Signed-off-by: Tim Moon <[email protected]>

* Use distopt support for contiguous buffers with multiple dtypes

Signed-off-by: Tim Moon <[email protected]>

* Fix typo

Signed-off-by: Tim Moon <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Separate distopt buckets for first GPT layer and non-overlapped params

Signed-off-by: Tim Moon <[email protected]>

* Add distopt logic for int dtypes

Signed-off-by: Tim Moon <[email protected]>

* Update Apex commit

Signed-off-by: Tim Moon <[email protected]>

* Remove unused variables

Signed-off-by: Tim Moon <[email protected]>

* Update Apex commit in README and Jenkensfile

Signed-off-by: Tim Moon <[email protected]>

* Debug Dockerfile and Jenkinsfile

Signed-off-by: Tim Moon <[email protected]>

---------

Signed-off-by: Tim Moon <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Eric Harper <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @timmoon10 @pre-commit-ci
    @ericharper @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0d97b6c View commit details
    Browse the repository at this point in the history

  4. minor fix for llama ckpt conversion script (NVIDIA#7387) 

    * minor fix for llama ckpt conversion script

Signed-off-by: Jason Wang <[email protected]>

* Update Jenkinsfile

Signed-off-by: Jason Wang <[email protected]>

* remove fast_swiglu configuration

Signed-off-by: Jason Wang <[email protected]>

---------

Signed-off-by: Jason Wang <[email protected]>
Co-authored-by: Eric Harper <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @blahBlahhhJ @ericharper @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    201cccc View commit details
    Browse the repository at this point in the history

  5. Fix wrong calling of librosa.get_duration() in notebook (NVIDIA#7376) 

    Signed-off-by: Robin Dong <[email protected]>
Co-authored-by: Somshubra Majumdar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @titu1994 @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    869240d View commit details
    Browse the repository at this point in the history

  6. [PATCH] PEFT import mcore (NVIDIA#7393) 

    * [PATCH] PEFT import mcore

Signed-off-by: Jason Wang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Jason Wang <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @blahBlahhhJ @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    230146f View commit details
    Browse the repository at this point in the history

  7. Create per.py 

    Script for calculation Punctuation Error Rate and related rates (correct rate, deletions rate, etc.)

Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c2c7d41 View commit details
    Browse the repository at this point in the history

  8. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c7ba7ca View commit details
    Browse the repository at this point in the history

  9. [TTS] Added a callback for logging initial data (NVIDIA#7384) 

    Signed-off-by: Ante Jukić <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @anteju @ssh-meister
    anteju authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6723bda View commit details
    Browse the repository at this point in the history

  10. Update Core Commit (NVIDIA#7402) 

    * Update Core Commit

Signed-off-by: Abhinav Khattar <[email protected]>

* update commit

Signed-off-by: Abhinav Khattar <[email protected]>

---------

Signed-off-by: Abhinav Khattar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @aklife97 @ssh-meister
    aklife97 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0fffeef View commit details
    Browse the repository at this point in the history

  11. Use cfg attribute in bert (NVIDIA#7394) 

    * use cfg attribute instead of arg

Signed-off-by: Maanu Grover <[email protected]>

* use torch_dtype in place of cfg.precision

Signed-off-by: Maanu Grover <[email protected]>

* move precision copy before super constructor

Signed-off-by: Maanu Grover <[email protected]>

* use trainer arg

Signed-off-by: Maanu Grover <[email protected]>

---------

Signed-off-by: Maanu Grover <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @maanug-nv @ssh-meister
    maanug-nv authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3eb95a4 View commit details
    Browse the repository at this point in the history

  12. Add support for bias conversion in Swiglu models (NVIDIA#7386) 

    * Add support for bias conversion in Swiglu models

Signed-off-by: smajumdar <[email protected]>

* Add support for auto extracting tokenizer model

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add support for auto extracting tokenizer model

Signed-off-by: smajumdar <[email protected]>

* Fix issue with missing tokenizer

Signed-off-by: smajumdar <[email protected]>

* Refactor

Signed-off-by: smajumdar <[email protected]>

* Refactor

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: smajumdar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @titu1994 @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    834a5c7 View commit details
    Browse the repository at this point in the history

  13. Update save_to and restore_from for dist checkpointing (NVIDIA#7343) 

    * add dist ckpt to save to, in progress

Signed-off-by: eharper <[email protected]>

* move dist ckpt

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update restore from, need to figure out how to initialize distributed

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* launch distrib if needed when restoring dist ckpt

Signed-off-by: eharper <[email protected]>

* when using mcore we can change tp pp on the fly

Signed-off-by: eharper <[email protected]>

* add load_from_checkpoint support for dist ckpt

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update llama convert script to save dist .nemo

Signed-off-by: eharper <[email protected]>

* fix load dist ckpt

Signed-off-by: jasonwan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* setup TE TP groups if needed

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* setup te tp groups if needed

Signed-off-by: eharper <[email protected]>

* remove import

Signed-off-by: eharper <[email protected]>

---------

Signed-off-by: eharper <[email protected]>
Signed-off-by: jasonwan <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: jasonwan <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ericharper @pre-commit-ci
    @blahBlahhhJ @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c871147 View commit details
    Browse the repository at this point in the history

  14. fix forward for with mcore=false (NVIDIA#7403) 

    Signed-off-by: Jimmy Zhang <[email protected]>
Co-authored-by: Jimmy Zhang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @JimmyZhang12 @jiemingz @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3eed031 View commit details
    Browse the repository at this point in the history

  15. Fix logging to remove 's/it' from progress bar in Megatron models and… 

    … add train_step_timing (NVIDIA#7374)

* Add CustomProgressBar class to exp_manager and trainer callbacks

Signed-off-by: Abhishree <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix the progress bar to reflect total microbatch cnt

Signed-off-by: Abhishree <[email protected]>

* Modify CustomProgressBar class

1) Modify CustomProgressBar class to update progress bar per global_step instead of per microbatch
2) Add the callback to other megatron training/finetuning files that are not using MegatronTrainerBuilder

Signed-off-by: Abhishree <[email protected]>

* Add CustomProgressBar callback to tuning files

Signed-off-by: Abhishree <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @athitten @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6093209 View commit details
    Browse the repository at this point in the history

  16. Set Activation Checkpointing Defaults (NVIDIA#7404) 

    * Set Activation Checkpointing Defaults

Signed-off-by: Abhinav Khattar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* check for None

Signed-off-by: Abhinav Khattar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Abhinav Khattar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @aklife97 @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    592282f View commit details
    Browse the repository at this point in the history

  17. make loss mask default to false (NVIDIA#7407) 

    Signed-off-by: eharper <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ericharper @ssh-meister
    ericharper authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    00246c9 View commit details
    Browse the repository at this point in the history

  18. Add dummy userbuffer config files (NVIDIA#7408) 

    Signed-off-by: Sangkug Lym <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @erhoo82 @ssh-meister
    erhoo82 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0dac83d View commit details
    Browse the repository at this point in the history

  19. add missing ubconf files (NVIDIA#7412) 

    Signed-off-by: Abhinav Khattar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @aklife97 @ssh-meister
    aklife97 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    bb7cd82 View commit details
    Browse the repository at this point in the history

  20. New tutorial on Speech Data Explorer (NVIDIA#7405) 

    * Added Google Colab based tutorial on Speech Data Explorer

Signed-off-by: George Zelenfroynd <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @Jorjeous @ssh-meister
    Jorjeous authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    b92cc7c View commit details
    Browse the repository at this point in the history

  21. Update ptl training ckpt conversion script to work with dist ckpt (NV… 

    …IDIA#7416)

* update ptl convert script

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* don't break legacy

Signed-off-by: eharper <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: eharper <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @ericharper @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    e157cd0 View commit details
    Browse the repository at this point in the history

  22. Allow disabling sanity checking when num_sanity_val_steps=0 (NVIDIA#7413 

    )

* Allow disabling sanity checking when num_sanity_val_steps=0

Signed-off-by: Abhishree <[email protected]>

* Update num_sanity_val_steps to be a multiple of num_microbatches

Signed-off-by: Abhishree Thittenamane <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Abhishree <[email protected]>
Signed-off-by: Abhishree Thittenamane <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @athitten @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1f28287 View commit details
    Browse the repository at this point in the history

  23. Add comprehensive error messages (NVIDIA#7261) 

    Signed-off-by: Anton Peganov <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @PeganovAnton @ssh-meister
    PeganovAnton authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    41e664e View commit details
    Browse the repository at this point in the history

  24. check NEMO_PATH (NVIDIA#7418) 

    Signed-off-by: Nikolay Karpov <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @karpnv @ssh-meister
    karpnv authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    f6fc39a View commit details
    Browse the repository at this point in the history

  25. layer selection for ia3 (NVIDIA#7417) 

    * layer selection for ia3

Signed-off-by: arendu <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: arendu <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @arendu @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    2147faa View commit details
    Browse the repository at this point in the history

  26. Fix missing pip package 'einops' (NVIDIA#7397) 

    Signed-off-by: Robin Dong <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @ssh-meister
    RobinDong authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    749164a View commit details
    Browse the repository at this point in the history

  27. Fix failure of pyaudio in Google Colab (NVIDIA#7396) 

    Signed-off-by: Robin Dong <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @ssh-meister
    RobinDong authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    952b2a4 View commit details
    Browse the repository at this point in the history

  28. Update README.md: output_path --> output_manifest_filepath (NVIDIA#7442) 

    Signed-off-by: Samuele Cornell <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @popcornell @ssh-meister
    popcornell authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    14ba7f8 View commit details
    Browse the repository at this point in the history

  29. Add rope dynamic linear scaling (NVIDIA#7437) 

    * Add dynamic linear scaling

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

---------

Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Yang Zhang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @hsiehjackson @pre-commit-ci
    @yzhang123 @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    32dc1d0 View commit details
    Browse the repository at this point in the history

  30. Fix None dataloader issue in PTL2.0 (NVIDIA#7455) 

    * Fix None dataloader issue in PTL2.0

Signed-off-by: KunalDhawan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updating values of self._validation_dl and self._test_dl as well

Signed-off-by: KunalDhawan <[email protected]>

* updating values of self._validation_dl and self._test_dl as well

Signed-off-by: KunalDhawan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: KunalDhawan <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @KunalDhawan @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    48c25be View commit details
    Browse the repository at this point in the history

  31. [ASR] Confidence measure -> method renames (NVIDIA#7434) 

    * measure -> method

Signed-off-by: Aleksandr Laptev <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Aleksandr Laptev <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @GNroy @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    bafbdc6 View commit details
    Browse the repository at this point in the history

  32. Add steps for document of getting dataset 'SF Bilingual Speech' (NVID… 

    …IA#7378)

* Add steps for document of getting dataset 'SF Bilingual Speech'

Signed-off-by: Robin Dong <[email protected]>

* Update datasets.rst

added a link from a tutorial demonstrating detailed data prep steps.

Signed-off-by: Xuesong Yang <[email protected]>

---------

Signed-off-by: Robin Dong <[email protected]>
Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @XuesongYang @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1660781 View commit details
    Browse the repository at this point in the history

  33. RNN-T confidence and alignment bugfix (NVIDIA#7381) 

    * new frame_confidence and alignments lists are now always created after the while loop

Signed-off-by: Aleksandr Laptev <[email protected]>

* tests added

Signed-off-by: Aleksandr Laptev <[email protected]>

---------

Signed-off-by: Aleksandr Laptev <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @GNroy @ssh-meister
    GNroy authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    cffe476 View commit details
    Browse the repository at this point in the history

  34. Fix resume from checkpoint in exp_manager (NVIDIA#7424) (NVIDIA#7426) 

    Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Co-authored-by: Eric Harper <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten
    @ericharper @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    f634e0c View commit details
    Browse the repository at this point in the history

  35. Fix checking of cuda/cpu device for inputs of Decoder (NVIDIA#7444) 

    * Fix checking of cuda/cpu device for inputs of Decoder

Signed-off-by: Robin Dong <[email protected]>

* Update tacotron2.py

Signed-off-by: Jason <[email protected]>

---------

Signed-off-by: Robin Dong <[email protected]>
Signed-off-by: Jason <[email protected]>
Co-authored-by: Jason <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @blisc @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    569dabc View commit details
    Browse the repository at this point in the history

  36. Fix failure of ljspeech's get_data.py (NVIDIA#7430) 

    * Fix failure of ljspeech's get_data.py

Signed-off-by: Robin Dong <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Robin Dong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    edb95cd View commit details
    Browse the repository at this point in the history

  37. [TTS] Fix audio codec type checks (NVIDIA#7373) 

    * [TTS] Fix audio codec type checks

Signed-off-by: Ryan <[email protected]>

* [TTS] Fix audio codec tests

Signed-off-by: Ryan <[email protected]>

---------

Signed-off-by: Ryan <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @rlangman @ssh-meister
    rlangman authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1bd4bd0 View commit details
    Browse the repository at this point in the history

  38. [TTS] Add dataset to path of logged artifacts (NVIDIA#7462) 

    * [TTS] Add dataset to path of logged artifacts

Signed-off-by: Ryan <[email protected]>

* [TTS] Revert axis name back to Audio Frames

Signed-off-by: Ryan <[email protected]>

---------

Signed-off-by: Ryan <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @rlangman @ssh-meister
    rlangman authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d22b4d1 View commit details
    Browse the repository at this point in the history

  39. Fix sft dataset truncation (NVIDIA#7464) 

    * Add fix

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

---------

Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @hsiehjackson @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    bd9e53f View commit details
    Browse the repository at this point in the history

  40. Automatic Lip Reading Recognition (ALR) - ASR/CV (Visual ASR) (NVIDIA… 

    …#7330)

* striding_conv1d_k5 and dw_striding_conv1d_k5 subsampling

Signed-off-by: mburchi <[email protected]>

* transpose conv1d inputs

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: mburchi <[email protected]>

* Update subsampling.py

change striding_conv1d_k5 to striding_conv1d

Signed-off-by: Maxime Burchi <[email protected]>

* cv branch

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* video manifest

Signed-off-by: mburchi <[email protected]>

* add collection classes

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add test_step_outputs

Signed-off-by: mburchi <[email protected]>

* correct manifest bug when having only audio or only videos

Signed-off-by: mburchi <[email protected]>

* correct manifest bug when having only audio or only videos

Signed-off-by: mburchi <[email protected]>

* clean references

Signed-off-by: mburchi <[email protected]>

* freeze unfreeze transcribe cv models

Signed-off-by: mburchi <[email protected]>

* correct manifest get_full_path bug

Signed-off-by: mburchi <[email protected]>

* update for PR

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* guard torchvision

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update nemo/collections/cv/data/video_to_text_dataset.py

Co-authored-by: Igor Gitman <[email protected]>
Signed-off-by: Maxime Burchi <[email protected]>

* _video_speech_collate_fn in cv/data/video_to_text.py

Signed-off-by: mburchi <[email protected]>

* add self.out = None to asr subsampling

Signed-off-by: mburchi <[email protected]>

* Update nemo/collections/cv/data/video_to_text_dataset.py

Co-authored-by: Igor Gitman <[email protected]>
Signed-off-by: Maxime Burchi <[email protected]>

* cv -> multimodal/speech_cv branch

Signed-off-by: mburchi <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: mburchi <[email protected]>
Signed-off-by: Maxime Burchi <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Igor Gitman <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @burchim @pre-commit-ci
    @Kipok @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    b386f5b View commit details
    Browse the repository at this point in the history

  41. HF StarCoder to NeMo conversion script (NVIDIA#7421) 

    * Script to convert HF StarCoder checkpoint to NeMo

Signed-off-by: Jan Lasek <[email protected]>

* StarCoder conversion test

Signed-off-by: Jan Lasek <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Jan Lasek <[email protected]>

* Fix test

Signed-off-by: Jan Lasek <[email protected]>

* Catch up with save_to changes

Signed-off-by: Jan Lasek <[email protected]>

* Don't abbreviate args for clarity

Signed-off-by: Jan Lasek <[email protected]>

* Configurable precision: BF16 vs FP32

Signed-off-by: Jan Lasek <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Jan Lasek <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @janekl @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0140e23 View commit details
    Browse the repository at this point in the history

  42. fix bug when loading dist ckpt in peft (NVIDIA#7452) 

    Signed-off-by: Hongbin Liu <[email protected]>
Co-authored-by: Hongbin Liu <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @lhb8125 @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    24d2e50 View commit details
    Browse the repository at this point in the history

  43. Fix adding positional embeddings in-place in transformer module (NVID… 

    …IA#7440)

Signed-off-by: Tamerlan Tabolov <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @The0nix @hsiehjackson @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6e83a05 View commit details
    Browse the repository at this point in the history

  44. Fix (NVIDIA#7478) 

    Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @hsiehjackson @ssh-meister
    hsiehjackson authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    63a08df View commit details
    Browse the repository at this point in the history

  45. add sleep (NVIDIA#7498) (NVIDIA#7499) 

    * add sleep

* add sleep onto config instead

* add comment

---------

Signed-off-by: Gerald Shen <[email protected]>
Co-authored-by: Gerald Shen <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @gshennvm @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d53b88b View commit details
    Browse the repository at this point in the history

  46. Fix exp manager check for sleep (NVIDIA#7503) (NVIDIA#7504) 

    Signed-off-by: smajumdar <[email protected]>
Co-authored-by: Somshubra Majumdar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @titu1994 @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d36dea1 View commit details
    Browse the repository at this point in the history

  47. bugfix: trainer.accelerator=auto from None. (NVIDIA#7492) (NVIDIA#7493) 

    Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    660d8e4 View commit details
    Browse the repository at this point in the history

  48. [doc] fix broken link (NVIDIA#7481) 

    Signed-off-by: Stas Bekman <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @stas00 @ssh-meister
    stas00 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0a556b7 View commit details
    Browse the repository at this point in the history

  49. [TTS] Read audio as int32 to avoid flac read errors (NVIDIA#7477) 

    * [TTS] Read audio as int32 to avoid flac read errors

Signed-off-by: Ryan <[email protected]>

* [TTS] Add comment about read failures

Signed-off-by: Ryan <[email protected]>

---------

Signed-off-by: Ryan <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @rlangman @ssh-meister
    rlangman authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    952b768 View commit details
    Browse the repository at this point in the history

  50. Add dataset 'AISHELL-3' from OpenSLR for training mandarin TTS (NVIDI… 

    …A#7409)

* Add dataset 'AISHELL-3' from OpenSLR for training mandarin TTS
* Train 'AISHELL-3' dataset with multi-speakers

Signed-off-by: Robin Dong <[email protected]>

* Update get_data.py

update copyright header

Signed-off-by: Xuesong Yang <[email protected]>

* Update get_data.py

added a disclaimer

Signed-off-by: Xuesong Yang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add new configuration file for AISHELL3 with multispeaker of fastpitch

Signed-off-by: Robin Dong <[email protected]>

---------

Signed-off-by: Robin Dong <[email protected]>
Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @pre-commit-ci
    @XuesongYang @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    43df79d View commit details
    Browse the repository at this point in the history

  51. dllogger - log on rank 0 only (NVIDIA#7513) 

    Signed-off-by: Stas Bekman <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @stas00 @ssh-meister
    stas00 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6d2dcca View commit details
    Browse the repository at this point in the history

  52. Fix TTS FastPitch tutorial (NVIDIA#7494) (NVIDIA#7516) 

    * Fix

---------

Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @hsiehjackson @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    a948ce6 View commit details
    Browse the repository at this point in the history

  53. Fix get_dist() tensor dimension (NVIDIA#7506) (NVIDIA#7515) 

    Signed-off-by: Jocelyn Huang <[email protected]>
Co-authored-by: Jocelyn <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @redoctopus @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0d86cad View commit details
    Browse the repository at this point in the history

  54. bugfix: specify trainer.strategy=auto when devices=1 (NVIDIA#7509) (N… 

    …VIDIA#7512)

Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @XuesongYang @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    5195b49 View commit details
    Browse the repository at this point in the history

  55. fix (NVIDIA#7511) 

    Signed-off-by: Abhinav Khattar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @aklife97 @ssh-meister
    aklife97 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    4960b24 View commit details
    Browse the repository at this point in the history

  56. [TTS] Fix FastPitch data prep tutorial (NVIDIA#7524) 

    Signed-off-by: Ryan <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @rlangman @ssh-meister
    rlangman authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    5a252c6 View commit details
    Browse the repository at this point in the history

  57. add italian tokenization (NVIDIA#7486) 

    * add italian tokenization

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add more ipa lexicon it

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix error deletion

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* add test

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: GiacomoLeoneMaria <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @GiacomoLeoneMaria @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    89b00c1 View commit details
    Browse the repository at this point in the history

  58. Replace None strategy with auto in tutorial notebooks (NVIDIA#7521) (N… 

    …VIDIA#7527)

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    52a2486 View commit details
    Browse the repository at this point in the history

  59. unpin setuptools (NVIDIA#7534) (NVIDIA#7535) 

    Signed-off-by: fayejf <[email protected]>
Co-authored-by: fayejf <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @fayejf @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    04d143b View commit details
    Browse the repository at this point in the history

  60. Update per.py 

    - if __name__ == "__main__" removed (now metric can be imported);
- removed excessive classes (like "Sample" and "Statistics");
- transition from pandas df to dict of dicts;
- removed unnecessary "return";
- notation fixing;
- reduced calculation time

Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    2854d39 View commit details
    Browse the repository at this point in the history

  61. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    2f0d6b6 View commit details
    Browse the repository at this point in the history

  62. Create punctuation_rates.py 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6ff3768 View commit details
    Browse the repository at this point in the history

  63. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    89504b6 View commit details
    Browse the repository at this point in the history

  64. Format fixing 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    85b87c0 View commit details
    Browse the repository at this point in the history

  65. added nemo.logging, header, docstrings, how to use 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    21a1ed7 View commit details
    Browse the repository at this point in the history

  66. Added asserions to rate_punctuation.py 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6a05553 View commit details
    Browse the repository at this point in the history

  67. fix typo 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    8d0abc2 View commit details
    Browse the repository at this point in the history

  68. added function for import and call, docstrings 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    a5bc120 View commit details
    Browse the repository at this point in the history

  69. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3627bea View commit details
    Browse the repository at this point in the history

  70. remove auto generated examples (NVIDIA#7510) 

    * explicitly remove autogenerated examples for data parallel evaluation

Signed-off-by: arendu <[email protected]>

* mark autogenrated and remove it for test

Signed-off-by: arendu <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: arendu <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @arendu @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    250b031 View commit details
    Browse the repository at this point in the history

  71. Add the strategy argument to MegatronGPTModel.generate() (NVIDIA#… 

    …7264)

It is passed as an explicit argument rather than through
`**strategy_args` so as to ensure someone cannot accidentally pass other
arguments that would end up being ignored.

It is a keyword-only argument to ensure that if in the future we want to
update the signature to `**strategy_args`, we can do it without breaking
code.

Signed-off-by: Olivier Delalleau <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @odelalleau @ssh-meister
    odelalleau authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    05c8bf6 View commit details
    Browse the repository at this point in the history

  72. Fix PTL2.0 related ASR bugs in r1.21.0: Val metrics logging, None dat… 

    …aloader issue (NVIDIA#7531) (NVIDIA#7533)

* fix none dataloader issue ptl2

* ptl2.0 logging fixes for rnnt_models

---------

Signed-off-by: KunalDhawan <[email protected]>
Co-authored-by: Kunal Dhawan <[email protected]>
Co-authored-by: Nithin Rao <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @KunalDhawan
    @nithinraok @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c847f0b View commit details
    Browse the repository at this point in the history

  73. gpus -> devices (NVIDIA#7542) (NVIDIA#7545) 

    Signed-off-by: Nithin Rao Koluguri <nithinraok>
Co-authored-by: Nithin Rao <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @nithinraok @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    258a159 View commit details
    Browse the repository at this point in the history

  74. Update FFMPEG version to fix issue with torchaudio (NVIDIA#7551) (NVI… 

    …DIA#7553)

Signed-off-by: smajumdar <[email protected]>
Co-authored-by: Somshubra Majumdar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @titu1994 @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    061f9e9 View commit details
    Browse the repository at this point in the history

  75. PEFT GPT & T5 Refactor (NVIDIA#7308) 

    * initial implementation of add_adapters API

* correct type hint

* Add config in add_adapters for save and load (@author bobchen)

* Remove AdapterConfig to avoid import error

* Add AdaterConfig back and move adaptermixin to sft model

* Add NLPSaveRestoreConnector as default in NLPModel.restore_from

* Add restore_from_nemo_with_adapter and test script

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rename t5 file and classes to be consistent with GPT

* add t5 sft dataset

* add support for single-file format with T5SFTDataset

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Various small changes to make T5 SFT work like GPT SFT

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add adapter evaluation test script

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add MultiAdaterConfig for ia3 and fix builder issue

* Make ptuning for T5SFTModel work using mixin

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add IA3_Adapter for AdapterName

* Add adapter name for ptuning and attention adapter

* Make test script GPT/T5 agnostic

* Add layer selection feature

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Integrate adapter name and config

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update gpt peft tuning script to new API

* add t5 peft tuning script with new API

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix IA3 layer selection issue

* Override state_dict on SFT model instead of mixin

* Add load adapter by adapter config

* move peft config map away from example script

* auto get config from nemo adapter

* Move PEFTConfig to new file

* fix ckpt save/load for t5

* name change: add_adapters -> add_adapter

* variable name change

* update t5 script

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix t5 issues

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add weight tying

* update gpt tuning script

* PEFT-API proposal

* Fix according to comments

* update tuning scripts

* move merge_cfg_with to mixin class since it applies to both gpt and t5 and requires the model class for restore

* Add mcore_gpt support for NLPAdapterMixin

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix typo

* variable name change to distinguish "peft" and "adapter"

* override `load_adapters` to support `add_adapter` name change

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tuning and eval script for adapter save/load

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add Ptuning on first stage only

* add lora tutorial for review

* Fix layer selection for mcore

* add landing page

* fix resume training

Signed-off-by: jasonwan <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add mcore condition in sharded_state_dict to make sft work

* Update lora_tutorial.md

First edit of this file for PEFT documentation for NeMO

Signed-off-by: hkelly33 <[email protected]>

* rename Adapter to AttentionAdapter to avoid confusion in doc

* Change load_adapters to load .nemo

* add quick start guide

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add load_adapters with .ckpt

* Remove setup_complete changes in load_adapters

* update landing page

* remove typo

* Updated quick_start.md per Chen Cui

Signed-off-by: hkelly33 <[email protected]>

* Add inference config merger and tutorial

* Add doc string for NLPAdapterModelMixin and deprecated warning on MegatronGPTPEFTModel

* add supported_methods.md and update other documentations

* Update supported_methods.md

minor updates.

Signed-off-by: Adi Renduchintala <[email protected]>

* Update landing_page.md

minor update.

Signed-off-by: Adi Renduchintala <[email protected]>

* Modify doc string for NLPAdapterModelMixin

* Add doc string add_adapters in NLPAdapterModelMixin

* rename canonical adapters

* remove mcore hard dependency

* [PATCH] move microbatch calculator to nemo from apex

* remove apex dependency in gpt and t5 sft models

* remove apex dependency in gpt model

* render doc strings

* fix

* Add missing virtual_tokens on ptuning

* fix docstrings

* update gpt-style model coverage in docs

* update docstring

* Remove pdb

* add lightning_fabric to make docstring rendering work

* Add Ptuning missing key

* try docstring rendering

* Fix ptuning issue

* update gpt t5 peft tuning and eval scripts

* typos

* update eval config

* fix bug relating to apex dependency removal

* typo

* make predict step behave the same as test step

* make lora tutorial work in notebook

* cosmetics

* update yaml scripts

* mcore_gpt attribute optional

* typo

* update eval scripts and fix T5 eval bugs

* add NLPDDPStrategyNotebook and trainer builder logic to use it

* update lora notebook to use new trainer builder

* fix microbatch calculator bug for inference after training

* Convert markdown files to RST and incorporate with doc

* typo

* revise language

* remove extra cell

* remove unnecessary inheritance

* remove old tests

* move layer selection default so logging messages make sense

* remove `save_adapters` as adapter weights are saved automatically during training

* initialize weights from a checkpoint instead of randomly

* multiple fields can form a context (NVIDIA#7147)

* list of context fields and flexible prompt template

Signed-off-by: arendu <[email protected]>

* list of fields for context

Signed-off-by: arendu <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Add multiple truncation fields and middle truncation

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Compatible to old ckpt

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix tokenize detokenize issue

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Remove detokenization, add truncation augmentation

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Resolve comments

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Remove unused import

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert eos

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Add tokenizer space_sensitive attribute

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix error

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Fix erorr and use re

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Change assert logic

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Follow adi suggestion

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Remove merge function

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add example and comment

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Remove context_key and add comment

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* Remove random truncation

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix template none

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix bug

Signed-off-by: Cheng-Ping Hsieh <[email protected]>

---------

Signed-off-by: arendu <[email protected]>
Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>

* revert config changes

* remove accidental breakpoint

* support TP>1 loading

* infer adapter type from checkpoint in during eval

* breakup add adapter

* enable interpolation of train_ds and validation_ds

* update metric calc script to conform to single-file eval format

* remove extraneous print

* update lora notebook for updated merge_inference_cfg

* Update nlp_adapter_mixins.py

variable name change

Signed-off-by: Chen Cui <[email protected]>

* turn off grad scaler for PP to match old scripts

* remove PEFTSaveRestoreConnector since functionality all covered by the new mixin class

* remove resume_from_checkpoint check since covered in NVIDIA#7335

* revert changes made in eval config interpolation

* more interpolation

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove dup line

Signed-off-by: Chen Cui <[email protected]>

* code style warnings

Signed-off-by: Chen Cui <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix config mistake

Signed-off-by: Chen Cui <[email protected]>

* add copyright header

Signed-off-by: Chen Cui <[email protected]>

* fix code check warnings

Signed-off-by: Chen Cui <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert changes to remove apex dependency (mixed apex+nemo microbatch calculator broke some CI tests)

Signed-off-by: Chen Cui <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add more deprecation notices

Signed-off-by: Chen Cui <[email protected]>

* update deprecation notices

Signed-off-by: Chen Cui <[email protected]>

* update deprecation notices

Signed-off-by: Chen Cui <[email protected]>

* consolidate peft and sft scripts

Signed-off-by: Chen Cui <[email protected]>

* update CI tests

Signed-off-by: Chen Cui <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* notebook branch points to main to prepare for merge

Signed-off-by: Chen Cui <[email protected]>

* fix gpt and t5 validation with any metric other than loss

Signed-off-by: Chen Cui <[email protected]>

* support pre-extracted checkpoints

Signed-off-by: Chen Cui <[email protected]>

---------

Signed-off-by: jasonwan <[email protected]>
Signed-off-by: hkelly33 <[email protected]>
Signed-off-by: Adi Renduchintala <[email protected]>
Signed-off-by: arendu <[email protected]>
Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Chen Cui <[email protected]>
Co-authored-by: Chen Cui <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Marc Romeyn <[email protected]>
Co-authored-by: jasonwan <[email protected]>
Co-authored-by: hkelly33 <[email protected]>
Co-authored-by: Adi Renduchintala <[email protected]>
Co-authored-by: Yuanzhe Dong <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @meatybobby @cuichenx
    @pre-commit-ci @marcromeyn @blahBlahhhJ @hkelly33 @arendu @hsiehjackson @ssh-meister
    10 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1291e2a View commit details
    Browse the repository at this point in the history

  76. fix a typo (NVIDIA#7496) 

    Signed-off-by: BestJuly <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @BestJuly @ssh-meister
    BestJuly authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9352c7d View commit details
    Browse the repository at this point in the history

  77. [TTS] remove curly braces from ${BRANCH} in jupyer notebook cell. (NV… 

    …IDIA#7554) (NVIDIA#7560)

* remove curly braces.
* remove installation of pynini.
---------

Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @XuesongYang @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0f2802e View commit details
    Browse the repository at this point in the history

  78. add youtube embed url (NVIDIA#7570) 

    Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @XuesongYang @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    cf6f95f View commit details
    Browse the repository at this point in the history

  79. Remap speakers to continuous range of speaker_id for dataset AISHELL3 (… 

    …NVIDIA#7536)

* Remap speakers to continuous range of speaker_id for dataset AISHELL3
* Add new key/value pair to record raw speaker for AISHELL3 dataset

Signed-off-by: Robin Dong <[email protected]>

---------

Signed-off-by: Robin Dong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @RobinDong @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9b19b68 View commit details
    Browse the repository at this point in the history

  80. fix validation_step_outputs initialization for multi-dataloader (NVID… 

    …IA#7546) (NVIDIA#7572)

* added correct validation_step_outputs initialization for mutli-dataloader

* changed kernel for display

* Update logic for validation and test step outputs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert multidataloader changes in multilang ASR notebook

---------

Signed-off-by: KunalDhawan <[email protected]>
Signed-off-by: smajumdar <[email protected]>
Co-authored-by: Kunal Dhawan <[email protected]>
Co-authored-by: Somshubra Majumdar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @KunalDhawan
    @titu1994 @pre-commit-ci @ssh-meister
    4 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    5a4bff0 View commit details
    Browse the repository at this point in the history

  81. Append output of val step to self.validation_step_outputs (NVIDIA#7530)… 

    … (NVIDIA#7532)

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    edd3490 View commit details
    Browse the repository at this point in the history

  82. [TTS] fixed trainer's accelerator and strategy. (NVIDIA#7569) (NVIDIA… 

    …#7574)

Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @XuesongYang @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    bfbe627 View commit details
    Browse the repository at this point in the history

  83. Append val/test output to instance variable in EncDecSpeakerLabelModel ( 

    NVIDIA#7562) (NVIDIA#7573)

* Append val/test output to the instance variable in EncDecSpeakerLabelModel

* Handle test case in evaluation_step

* Replace type with isinstance

---------

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1ce2455 View commit details
    Browse the repository at this point in the history

  84. Fix CustomProgressBar for resume (NVIDIA#7427) (NVIDIA#7522) 

    * Fix CustomProgress Bar for resume and multiple epochs

* Edit num_training_batches

* Use max_steps as total for progress bar for resume

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten
    @pre-commit-ci @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c7f4ecb View commit details
    Browse the repository at this point in the history

  85. fix typos in nfa and speech enhancement tutorials (NVIDIA#7580) (NVID… 

    …IA#7583)

Signed-off-by: Elena Rastorgueva <[email protected]>
Co-authored-by: Elena Rastorgueva <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @erastorgueva-nv @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9811729 View commit details
    Browse the repository at this point in the history

  86. Add strategy as ddp_find_unused_parameters_true for glue_benchmark.py (… 

    …NVIDIA#7454) (NVIDIA#7461)

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    a6217ea View commit details
    Browse the repository at this point in the history

  87. update strategy (NVIDIA#7577) (NVIDIA#7578) 

    Signed-off-by: Nithin Rao Koluguri <nithinraok>
Co-authored-by: Nithin Rao <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @nithinraok @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    aeac6e8 View commit details
    Browse the repository at this point in the history

  88. Fix typos (NVIDIA#7581) 

    Signed-off-by: Sasha Meister <[email protected]>
    @Kipok @ssh-meister
    Kipok authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    71bd302 View commit details
    Browse the repository at this point in the history

  89. Change hifigan finetune strategy to ddp_find_unused_parameters_true (N… 

    …VIDIA#7579) (NVIDIA#7584)

* Change strategy to auto

---------

Signed-off-by: Cheng-Ping Hsieh <[email protected]>
Co-authored-by: Cheng-Ping Hsieh <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @hsiehjackson @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d062641 View commit details
    Browse the repository at this point in the history

  90. [BugFix] Add missing quotes for auto strategy in tutorial notebooks (N… 

    …VIDIA#7541) (NVIDIA#7548)

* Add missing quotes for auto strategy

* Revert trainer.gpus to trainer.devices in Self_Supervised_Pre_Training.ipynb

---------

Signed-off-by: Abhishree <[email protected]>
Signed-off-by: Abhishree Thittenamane <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0352f30 View commit details
    Browse the repository at this point in the history

  91. added per tests 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c76afc0 View commit details
    Browse the repository at this point in the history

  92. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3f9b7bb View commit details
    Browse the repository at this point in the history

  93. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    8baa297 View commit details
    Browse the repository at this point in the history

  94. [PATCH] PEFT import mcore (NVIDIA#7393) 

    * [PATCH] PEFT import mcore

Signed-off-by: Jason Wang <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Jason Wang <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @blahBlahhhJ @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6c74c25 View commit details
    Browse the repository at this point in the history

  95. add build os key (NVIDIA#7596) (NVIDIA#7599) 

    * add build os key

* add tools

* update to stable version

---------

Signed-off-by: Nithin Rao Koluguri <nithinraok>
Co-authored-by: Nithin Rao <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @nithinraok @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    f3d58b1 View commit details
    Browse the repository at this point in the history

  96. StarCoder SFT test + bump PyT NGC image to 23.09 (NVIDIA#7540) 

    * Add SFT StarCoder test

Signed-off-by: Jan Lasek <[email protected]>

* Remove _modify_config call as it is covered in load_from_nemo just below

Signed-off-by: Jan Lasek <[email protected]>

* Test with pyt:23.09 container

Signed-off-by: Jan Lasek <[email protected]>

---------

Signed-off-by: Jan Lasek <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @janekl @ssh-meister
    janekl authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    deb80c4 View commit details
    Browse the repository at this point in the history

  97. defaults changed (NVIDIA#7600) 

    * defaults changed

Signed-off-by: arendu <[email protected]>

* typo

Signed-off-by: arendu <[email protected]>

* update

Signed-off-by: arendu <[email protected]>

---------

Signed-off-by: arendu <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @arendu @ssh-meister
    arendu authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    620c011 View commit details
    Browse the repository at this point in the history

  98. add ItalianPhonemesTokenizer (NVIDIA#7587) 

    * add ItalianPhonemesTokenizer

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix Italian phonemes

Signed-off-by: GiacomoLeoneMaria <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add test

Signed-off-by: GiacomoLeoneMaria <[email protected]>

---------

Signed-off-by: GiacomoLeoneMaria <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @GiacomoLeoneMaria @pre-commit-ci
    @XuesongYang @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    8c892db View commit details
    Browse the repository at this point in the history

  99. best ckpt fix (NVIDIA#7564) (NVIDIA#7588) 

    Signed-off-by: dimapihtar <[email protected]>
Co-authored-by: Dmytro Pykhtar <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @dimapihtar @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    96ec7ef View commit details
    Browse the repository at this point in the history

  100. rate_punctuation.py 

    Fixed output manifest saving

Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    518b870 View commit details
    Browse the repository at this point in the history

  101. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    c8698d0 View commit details
    Browse the repository at this point in the history

  102. Fix tests 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    98160b8 View commit details
    Browse the repository at this point in the history

  103. Add files via upload (NVIDIA#7598) 

    specifies the branch

Signed-off-by: George <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @Jorjeous @XuesongYang @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    dadf28e View commit details
    Browse the repository at this point in the history

  104. Fix validation in G2PModel and ThutmoseTaggerModel (NVIDIA#7597) (NVI… 

    …DIA#7606)

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    a4702d9 View commit details
    Browse the repository at this point in the history

  105. Broadcast loss only when using pipeline parallelism and within the pi… 

    …peline parallel domain (NVIDIA#7576) (NVIDIA#7586)

* Broadcast loss only when using pipeline parallelism and within the pipeline parallel domain
* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Sangkug Lym <[email protected]>
Co-authored-by: Sangkug Lym <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @erhoo82
    @pre-commit-ci @ssh-meister
    3 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    74d9b63 View commit details
    Browse the repository at this point in the history

  106. Safeguard nemo_text_processing installation on ARM (NVIDIA#7485) 

    * safeguard nemo_text_processing installing

Signed-off-by: Jason <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update check

Signed-off-by: Jason <[email protected]>

---------

Signed-off-by: Jason <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Sasha Meister <[email protected]>
    @blisc @pre-commit-ci @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    098c565 View commit details
    Browse the repository at this point in the history

  107. Function name fixing 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0bb19db View commit details
    Browse the repository at this point in the history

  108. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    fb13052 View commit details
    Browse the repository at this point in the history

  109. Moving PER to speech_to_text_eval.py 

    Added:
- "use_per": PER metric computing;
- "scores_per_sample": metrics computation sample by sample for wer/cer/punctuation rates;
- "output_with_scores_filename": saving manifest with metrics

Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    25f9d92 View commit details
    Browse the repository at this point in the history

  110. Update test_metrics.py 

    Updated "punctuation_error_rate" function name

Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    2c832fd View commit details
    Browse the repository at this point in the history

  111. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    ce75174 View commit details
    Browse the repository at this point in the history

  112. Added use_per description 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    8600bc5 View commit details
    Browse the repository at this point in the history

  113. guard extra dependencies 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    5a2cae1 View commit details
    Browse the repository at this point in the history

  114. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    efaa9aa View commit details
    Browse the repository at this point in the history

  115. Write metrics to "output_filename" if "scores_per_sample=True" 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    db6d1cb View commit details
    Browse the repository at this point in the history

  116. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    873aa84 View commit details
    Browse the repository at this point in the history

  117. scores_per_sample description 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9ffbdd4 View commit details
    Browse the repository at this point in the history

  118. Fix import guards 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9de6049 View commit details
    Browse the repository at this point in the history

  119. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1c0ceac View commit details
    Browse the repository at this point in the history

  120. Stats printing when HAVE_TABLUATE_AND_PANDAS=False 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    ac73188 View commit details
    Browse the repository at this point in the history

  121. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1a752e8 View commit details
    Browse the repository at this point in the history

  122. Bound transformers version in requirements (NVIDIA#7620) 

    Signed-off-by: Abhishree <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @athitten @ssh-meister
    athitten authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    33b0142 View commit details
    Browse the repository at this point in the history

  123. fix llama2 70b lora tuning bug (NVIDIA#7622) 

    * fix llama2 70b lora tuning bug

Signed-off-by: Chen Cui <[email protected]>

* Update peft_config.py

brackets

Signed-off-by: Adi Renduchintala <[email protected]>

---------

Signed-off-by: Chen Cui <[email protected]>
Signed-off-by: Adi Renduchintala <[email protected]>
Co-authored-by: Adi Renduchintala <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @cuichenx @arendu @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    047d1cc View commit details
    Browse the repository at this point in the history

  124. Fix import error no module name model_utils (NVIDIA#7629) 

    Signed-off-by: Mehadi Hasan Menon <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @menon92 @ssh-meister
    menon92 authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    4552cb5 View commit details
    Browse the repository at this point in the history

  125. Delete examples/asr/rate_punctuation.py 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    0322a9c View commit details
    Browse the repository at this point in the history

  126. Added use_per description 

    Signed-off-by: Sasha Meister <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3ce067e View commit details
    Browse the repository at this point in the history

  127. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6bb7d52 View commit details
    Browse the repository at this point in the history

  128. metric and variables name fixing 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9f46c92 View commit details
    Browse the repository at this point in the history

  129. Add else samples = None 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    3be7fbf View commit details
    Browse the repository at this point in the history

  130. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    baef202 View commit details
    Browse the repository at this point in the history

  131. add fc large ls models (NVIDIA#7641) 

    Signed-off-by: Nithin Rao Koluguri <nithinraok>
Co-authored-by: Nithin Rao Koluguri <nithinraok>
Signed-off-by: Sasha Meister <[email protected]>
    @nithinraok @ssh-meister
    nithinraok authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    501d656 View commit details
    Browse the repository at this point in the history

  132. bugfix: trainer.gpus, trainer.strategy, trainer.accelerator (NVIDIA#7621 

    ) (NVIDIA#7642)

* [TTS] bugfix for Tacotron2 tutorial due to PTL 2.0
* trainer.gpus -> trainer.devices
* fixed related tutorial bugs
---------
Signed-off-by: Xuesong Yang <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @ssh-meister
    github-actions[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    ee17a52 View commit details
    Browse the repository at this point in the history

  133. fix ssl models ptl monitor val through logging (NVIDIA#7608) (NVIDIA#… 

    …7614)

Signed-off-by: Nithin Rao Koluguri <nithinraok>
Co-authored-by: Nithin Rao <[email protected]>
Co-authored-by: Eric Harper <[email protected]>
Co-authored-by: Xuesong Yang <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @nithinraok
    @ericharper @XuesongYang @ssh-meister
    4 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d958251 View commit details
    Browse the repository at this point in the history

  134. Fix metrics for SE tutorial (NVIDIA#7604) (NVIDIA#7612) 

    Signed-off-by: Ante Jukić <[email protected]>
Co-authored-by: anteju <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @anteju @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    6f010c3 View commit details
    Browse the repository at this point in the history

  135. Add ddp_find_unused_parameters=True and change accelerator to auto (N… 

    …VIDIA#7623) (NVIDIA#7644)

* Add ddp_find_unused_parameters=True and change acclerator to auto

* Add ddp_find_unused_parameters True for normalization_as_tagging_train.py

---------

Signed-off-by: Abhishree <[email protected]>
Co-authored-by: Abhishree Thittenamane <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @athitten @ssh-meister
    2 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    dd1b6c7 View commit details
    Browse the repository at this point in the history

  136. Fix py3.11 dataclasses issue (NVIDIA#7616) 

    * Fix py3.11 dataclasses issue  (NVIDIA#7582)

* Update ASR configs to support Python 3.11

Signed-off-by: smajumdar <[email protected]>

* Update TTS configs to support Python 3.11

Signed-off-by: smajumdar <[email protected]>

* Guard MeCab and Ipadic

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix remaining ASR dataclasses

Signed-off-by: smajumdar <[email protected]>

* Fix remaining ASR dataclasses

Signed-off-by: smajumdar <[email protected]>

* Fix scripts

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: smajumdar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Update name to ConfidenceMethodConfig

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Broadcast loss only when using pipeline parallelism and within the pipeline parallel domain (NVIDIA#7576) (NVIDIA#7586)

* Broadcast loss only when using pipeline parallelism and within the pipeline parallel domain
* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Sangkug Lym <[email protected]>
Co-authored-by: Sangkug Lym <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Safeguard nemo_text_processing installation on ARM (NVIDIA#7485)

* safeguard nemo_text_processing installing

Signed-off-by: Jason <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update check

Signed-off-by: Jason <[email protected]>

---------

Signed-off-by: Jason <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Fix changes to confidence measure

Signed-off-by: smajumdar <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: smajumdar <[email protected]>
Signed-off-by: Sangkug Lym <[email protected]>
Signed-off-by: Jason <[email protected]>
Co-authored-by: Somshubra Majumdar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sangkug Lym <[email protected]>
Co-authored-by: Jason <[email protected]>
Signed-off-by: Sasha Meister <[email protected]>
    @github-actions @titu1994
    @pre-commit-ci @erhoo82 @blisc @ssh-meister
    5 people authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    32181a6 View commit details
    Browse the repository at this point in the history

  137. moved per sample metrics computing to transcribe_utils 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d703b1f View commit details
    Browse the repository at this point in the history

  138. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    735d8c3 View commit details
    Browse the repository at this point in the history

  139. Moved punctuation rates printing to punct_er 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    36139e2 View commit details
    Browse the repository at this point in the history

  140. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    f8bd001 View commit details
    Browse the repository at this point in the history

  141. Added reset for DatasetPunctuationErrorRate class 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    cca7156 View commit details
    Browse the repository at this point in the history

  142. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    4df6be3 View commit details
    Browse the repository at this point in the history

  143. Added compute_metrics_per_sample description 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    03589b7 View commit details
    Browse the repository at this point in the history

  144. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Sasha Meister <[email protected]>
    @pre-commit-ci @ssh-meister
    pre-commit-ci[bot] authored and ssh-meister committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    aa92203 View commit details
    Browse the repository at this point in the history

  145. Merge branch 'main' into per 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister authored Oct 5, 2023
    Configuration menu
    Copy the full SHA
    69b166a View commit details
    Browse the repository at this point in the history

  146. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    bb79ded View commit details
    Browse the repository at this point in the history

  147. Update megatron_gpt_peft_models.py 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister authored Oct 5, 2023
    Configuration menu
    Copy the full SHA
    9a2018c View commit details
    Browse the repository at this point in the history

  148. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    fe0961b View commit details
    Browse the repository at this point in the history

  149. Update speech_to_text_eval.py 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister authored Oct 5, 2023
    Configuration menu
    Copy the full SHA
    e74ef5d View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Copyright year fixing 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister authored Oct 6, 2023
    Configuration menu
    Copy the full SHA
    04044ab View commit details
    Browse the repository at this point in the history

  2. "& AFFILIATES" added 

    Signed-off-by: Sasha Meister <[email protected]>
    @ssh-meister
    ssh-meister authored Oct 6, 2023
    Configuration menu
    Copy the full SHA
    7fb390b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into per

    @ekmb
    ekmb authored Oct 6, 2023
    Configuration menu
    Copy the full SHA
    57f4347 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into per

    @ssh-meister
    ssh-meister authored Oct 6, 2023
    Configuration menu
    Copy the full SHA
    fbf3a70 View commit details
    Browse the repository at this point in the history