Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ONNX Backend #23

Open
wants to merge 302 commits into
base: main
Choose a base branch
from
Open

ONNX Backend #23

wants to merge 302 commits into from

Conversation

dmille
Copy link
Collaborator

@dmille dmille commented Aug 19, 2023 •
edited by abetlen
Loading

Adds a minimal onnx runtime for executing onnx graphs using ggml.

Future work includes:

  • Full support for onnx operators
  • On-the-fly weight quantization
  • GPU / Metal Support

mrezanvari and others added 30 commits August 14, 2023 10:51
@mrezanvari
Sort operators
08af18b
@mrezanvari
Remove unused imports
923532e
@mrezanvari
Add Reshape operator
7ba5b9a
@mrezanvari
Add MatMul operator
55e802a
@mrezanvari
Merge branch 'abetlen:main' into main
b49a12e
@mrezanvari
Use utils functions for shape and dtype
fb1a2ec
@mrezanvari
Add Concat operator and tests
20bbc64
@mrezanvari
Add Where operator
7f08f67
@mrezanvari
Add Pow operator
c58ce0d
@mrezanvari
Merge branch 'abetlen:main' into main
1e09841
@mrezanvari
Merge branch 'main' of github.com:mrezanvari/ggml-python
507268d
@mrezanvari
Use set_tensor_out
8794750
@mrezanvari
Cleanup warnings and stdout logs
3f9198b
@mrezanvari
Remove duplicate Pow test
caaa2fd
@mrezanvari
Add support for np.bool_
842530d
@mrezanvari
Add eval_tensor, can_quantize, broadcasting rules
2812df1
@mrezanvari
Add test_ggml_onnx_qweights
866ef96
@mrezanvari
Remove unwanted comments
74bbd70
@abetlen
Merge branch 'main' into mrezanvari/main
71ca5ff
@abetlen
Remove unnecessary dependencies
94fffbd
@abetlen
Simplify onnx tests and reduce number of backend methods
4036cbb
@abetlen
cleanup and enable passing tests
9838115
@abetlen
Update return types
a89fd6a
@abetlen
broadcast subtract
75fe261
@abetlen
Enable some tests for implemented operators
cba2502
@dmille
Fix Reshape
fed802e
@dmille
Update GH Actions setup
f299f69
@dmille
resolve deps
709174c
@dmille
add missing test deps
59c44e4
@dmille
?
47c7c26
@abetlen
Fix re-evaluate bug, allow for max tensors in graph to be set dynamic…
bd997f0 
…ally.
@abetlen
Merge branch 'main' into onnx-backend
88a76fe
@abetlen
Merge branch 'main' into onnx-backend
0e61da7
@abetlen
docs: Add achknowledgements
18a67cf
@abetlen
Temporarily disable setting data in from_numpy
18f53eb
@abetlen
Test multiple ggml graph chaining
66aa960
@abetlen
Update ggml_gallocr_new signature
13686c4
@abetlen
Add debugging docs
c27fd6e
@abetlen
Update onnx to new ggml alloc apis
9cf3fc7
@abetlen
Merge branch 'main' into onnx-backend
33473e3
@abetlen
Merge branch 'main' into onnx-backend
62e116b
@abetlen
Merge branch 'main' into onnx-backend
91d0daa
@abetlen
fix: test
81d62a9
@abetlen
Merge branch 'main' into onnx-backend
32b8f36
@abetlen
fix: Re-enable tensor set in from_numpy
14a64fa
@abetlen
Track node shapes
fd5c79d
@abetlen
Add simple parameterized test to compare runtimes
7c8d10f
@abetlen
Merge branch 'main' into onnx-backend
e159755
@abetlen
Add shape tracking to more ops
7d3c8ee
@abetlen
Fix more onnx ops
207ff2e
@abetlen
Merge branch 'main' into onnx-backend
f862535
@abetlen
Disable transpose test
ebd2c7c
@abetlen
Merge branch 'main' into onnx-backend
a36f437
@abetlen
check ggml_status
58c092d
@abetlen
Merge branch 'main' into onnx-backend
af5996c
@abetlen
Merge branch 'main' into onnx-backend
522af2a
@abetlen
Update tests
80183bd
@abetlen
Merge branch 'main' into onnx-backend
e53bb98
@abetlen
Update tensor allocator api
166fcdd
@abetlen
Fix type issues
a91780b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@dmille @mrezanvari @abetlen