Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix cache aware hybrid bugs #6466

Merged
merged 10 commits into from
Apr 25, 2023
Merged

Fix cache aware hybrid bugs #6466

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
ebb2751
fixed cache-aware bugs.
VahidooX Apr 20, 2023
455b8bc
added hybrid support.
VahidooX Apr 20, 2023
757049a
added hybrid support.
VahidooX Apr 20, 2023
2f5a725
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 20, 2023
5061134
Merge branch 'r1.18.0' of https://github.com/NVIDIA/NeMo into fix_cac…
VahidooX Apr 20, 2023
5c0af72
Merge remote-tracking branch 'origin/fix_cache_aware_hybrid_bugs' int…
VahidooX Apr 20, 2023
646d620
added hybrid support.
VahidooX Apr 20, 2023
f67a55d
Merge branch 'r1.18.0' of https://github.com/NVIDIA/NeMo into fix_cac…
VahidooX Apr 20, 2023
a04594d
fixed the description of pad_and_drop_preencoded.
VahidooX Apr 21, 2023
fec713f
fixed test bug.
VahidooX Apr 21, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
added hybrid support. 
Signed-off-by: Vahid <vnoroozi@nvidia.com>
@VahidooX
VahidooX committed Apr 20, 2023
commit 646d620151f9fa658d5fdf43f2a0f91e73cd67b6
6 changes: 4 additions & 2 deletions examples/asr/asr_cache_aware_streaming/speech_to_text_cache_aware_streaming_infer.py
View file
Original file line number Diff line number Diff line change
@@ -286,8 +286,10 @@ def main():

logging.info(asr_model.encoder.streaming_cfg)
if args.set_decoder is not None:
asr_model.change_decoding_strategy(decoder_type=args.set_decoder)
# asr_model.cur_decoder = args.set_decoder
if hasattr(asr_model, "cur_decoder"):
asr_model.change_decoding_strategy(decoder_type=args.set_decoder)
else:
raise ValueError("Decoder cannot get changed for non-Hybrid ASR models.")

global autocast
if (