Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[runtime/binding] support ort backend in wenetruntime #1708

Merged
merged 2 commits into from
Feb 26, 2023

Conversation

xingchensong
Copy link
Member

@xingchensong xingchensong commented Feb 25, 2023

For aarch64 systems (raspberry pi, horizonx3 pi, etc), ort backend is a better choice.

Test success on x3 pi:

0ac85073-f913-40f9-9700-d8a3c998079b

TODO (in next PR, not this one):

  • update binding/python/py/hub.py, add download for onnx model
  • update README
  • support pip install wenetruntime==v1.0.0.onnx , pip install wenetruntime==v1.0.0.torch, etc
  • cross-compile, so we can upload pypi packages in github workflow

@xingchensong xingchensong requested review from robin1001 and pengzhendong and removed request for robin1001 February 25, 2023 16:56
@xingchensong
Copy link
Member Author

usage: export WENET_CMAKE_ARGS="-DCMAKE_BUILD_TYPE=Release -DTORCH=OFF -DONNX=ON" && python3 setup.py bdist_wheel

@robin1001
Copy link
Collaborator

Great job!
@pengzhendong please also follow the PR, we should add the prebuilt packages using ONNX in the future.

@robin1001 robin1001 merged commit c11db56 into main Feb 26, 2023
@robin1001 robin1001 deleted the xcsong-ort-wenetruntime branch February 26, 2023 02:42
@xingchensong xingchensong mentioned this pull request Mar 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants