-
Notifications
You must be signed in to change notification settings - Fork 247
Add ComponentTypeInterpretation for joint matrix type #1835
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
742d425 to
49726cb
Compare
|
@asudarsa @vmaksimo @jcranmer-intel please take a look Most of it should be re-written during switch to opaque pointers (see intel/llvm@7707bb0 ), but the switch has several dependencies still, so to unblock BE development I'd prefer to merge it as is and to create opaque pointers adjustments on top of this patch. |
|
Actually, it's a breaking change already. Need to think how to avoid it. So merge together with opaque pointers should be the way to go. UPD: changing translation for bf16 is already a breaking change. So left only tf32. |
49726cb to
12c0d47
Compare
It specifies how to interpret 'Component Type' when components of a joint matrix are storages for values of different types, for example float for TF32, unsigned short for bfloat16. Spec update: intel/llvm#8175 Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
12c0d47 to
b730243
Compare
Signed-off-by: Sidorov, Dmitry <[email protected]>
|
@asudarsa @vmaksimo @jcranmer-intel please take a look |
Signed-off-by: Sidorov, Dmitry <[email protected]>
Signed-off-by: Sidorov, Dmitry <[email protected]>
| break; | ||
| case internal::InternalJointMatrixCTI::PackedInt2: | ||
| case internal::InternalJointMatrixCTI::PackedInt4: | ||
| // Do nothing just now |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit: add "TODO" mark here
KhronosGroup#1835) It specifies how to interpret 'Component Type' when components of a joint matrix are storages for values of different types, for example float for TF32, unsigned short for bfloat16. At this point only tf32 type interpretation is added during SPIR-V generation. Adding it to bf16 is a breaking change and requires adaptation across drivers. Spec update: intel/llvm#8175 Signed-off-by: Sidorov, Dmitry [email protected] (cherry picked from commit b7c5218)
…trix type (KhronosGroup#1835)" This reverts commit dea14c5.
…trix type (KhronosGroup#1835)" This reverts commit dea14c5.
Original message: Add ComponentTypeInterpretation for joint matrix type (KhronosGroup#1835) It specifies how to interpret 'Component Type' when components of a joint matrix are storages for values of different types, for example float for TF32, unsigned short for bfloat16. At this point only tf32 type interpretation is added during SPIR-V generation. Adding it to bf16 is a breaking change and requires adaptation across drivers. Spec update: intel/llvm#8175 Signed-off-by: Sidorov, Dmitry [email protected]
It specifies how to interpret 'Component Type' when components of a joint matrix are storages for values of different types, for example float for TF32, unsigned short for bfloat16.
At this point only tf32 type interpretation is added during SPIR-V generation. Adding it to bf16 is a breaking change and
requires adaptation across drivers.
Spec update:
intel/llvm#8175
Signed-off-by: Sidorov, Dmitry [email protected]