Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cli] add first wenet cli #2047

Merged
merged 1 commit into from
Oct 12, 2023
Merged

[cli] add first wenet cli #2047

merged 1 commit into from
Oct 12, 2023

Conversation

robin1001
Copy link
Collaborator

@robin1001 robin1001 commented Oct 11, 2023

fc147ba696d72ea8746d031a84313e3

It works! 这个是第一个版本,后续我们可以在这个基础上不断支持新的功能,例如:

  • 热词
  • 对齐
  • 时间戳
  • 长语音
  • onnx 模型,方便 ARM 等平台使用
    等等。

为什么要作纯基于 python 版本的 cli 的工具?因为

  1. 纯 python 安装等环境问题会少很多,绝大部分情况均可以开箱即用,而 wenetruntime 则环境问题诸多。
  2. 纯 python 开发迭代速度更快,对开发者更友好。

最终,在易用性和间接性上,我们期望对标 whisper。

@xingchensong xingchensong merged commit f926af1 into main Oct 12, 2023
6 checks passed
@xingchensong xingchensong deleted the binbin-cli branch October 12, 2023 00:06
@xingchensong
Copy link
Member

wenetruntime后面准备怎么处理?废弃了还是继续维护

@robin1001
Copy link
Collaborator Author

继续轻维护,后面慢慢以 wenet 这个包为主,支持更多的开箱即用的功能

@robin1001
Copy link
Collaborator Author

robin1001 commented Oct 12, 2023

你们有想支持和增加的功能吗?@Mddct @xingchensong 基于这个开发,速度可以飞起,我记周哥以前提过很多想法

@Mddct
Copy link
Collaborator

Mddct commented Oct 13, 2023

@robin1001 @xingchensong 也许可以先加个paraformer 中文的推理支持

@xingchensong
Copy link
Member

有个疑惑,为啥要用load jit的方式,而不是直接load ckpt?我看whisper都是直接load ckpt

@robin1001
Copy link
Collaborator Author

都可以。jit 可以自描述,ckpt 需要一个额外的模型描述文件,也就是 train.yaml.

@robin1001
Copy link
Collaborator Author

ckpt 会更灵活一些。

@xingchensong
Copy link
Member

get

@xingchensong
Copy link
Member

如果我给model的每个函数都修饰 @torch.jit.export,那么ckpt和jit在使用上感觉没啥区别了?

@robin1001
Copy link
Collaborator Author

对,形式上没有区别了,jit 仅会导出 forward 自动调用到的函数和@torch.jit.export,并且其中的语法规范要满足 jit 准则。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants