Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix infer type of kernel in dense. #4125

Merged
merged 3 commits into from
Oct 15, 2019

Conversation

shoubhik
Copy link
Contributor

With the introduction of quantization the kernel and data dtypes can be different (uint8 vs int8). So we can no longer make the assumption that kernel dtype will be the same as data dtype.
In this PR we correctly assign the weight dtype to weight->dtype

@shoubhik
Copy link
Contributor Author

@anijain2305 can you take a look at this pr.

@anijain2305
Copy link
Contributor

@shoubhik You will have to add a test for this.

@yzhliu @zhiics @vinx13

@zhiics zhiics added the status: need test case need test cases to cover the change label Oct 15, 2019
src/relay/op/nn/nn.h Outdated Show resolved Hide resolved
… the branches now.

- Adding test case for validating that data dtype and kernel dtypes can be different.
@shoubhik
Copy link
Contributor Author

Add test case and adde chekc for weight being valid.

@anijain2305
Copy link
Contributor

LGTM. Thanks @shoubhik for the changes.

@shoubhik
Copy link
Contributor Author

@zhiics @vinx13 can you merge this PR.

Copy link
Member

@zhiics zhiics left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhiics zhiics merged commit 11a3a77 into apache:master Oct 15, 2019
@zhiics zhiics added status: accepted and removed status: need test case need test cases to cover the change labels Oct 15, 2019
anijain2305 pushed a commit to anijain2305/tvm that referenced this pull request Oct 17, 2019
* Fix infer type of kernel in dense.

* - Moving the check of weight being nullptr up as it is needed in both the branches now.
- Adding test case for validating that data dtype and kernel dtypes can be different.

* - Fix the dtype check for weight. If the weight is not present then we will use the data dtype.
wweic pushed a commit to neo-ai/tvm that referenced this pull request Oct 18, 2019
* Fix infer type of kernel in dense.

* - Moving the check of weight being nullptr up as it is needed in both the branches now.
- Adding test case for validating that data dtype and kernel dtypes can be different.

* - Fix the dtype check for weight. If the weight is not present then we will use the data dtype.
petrex added a commit to petrex/tvm that referenced this pull request Oct 29, 2019
* master: (51 commits)
  [QNN][TFLite] Parsing QNN Add op. Adding MobilenetV2. (apache#4142)
  [CI] Pin NNPack pthreadtools version (apache#4152)
  Fix typo (apache#4144)
  [Relay][Frontend][TF] Add tensor array ops (apache#3798)
  [relay][vm] Separate VM runtime with executable (apache#4100)
  [PATCH] Fix undefined __floatdihf in libtvmruntime.so on aarch64. (apache#4119)
  [DOCKER] Pin torchvision==0.4.1 (apache#4140)
  [TOPI][x86] Cascade lake support. (apache#4123)
  [Relay] Improve build error when no lowered funcs are produced (apache#4132)
  [RUNTIME] Refactor object python FFI to new protocol. (apache#4128)
  Update PULL_REQUEST_TEMPLATE.md
  Adding support for dequantizing from int32 to float32. (apache#4130)
  [Relay][Training] Add and fix gradients (apache#4126)
  [QNN] Change default rouning to UPWARD. (apache#4131)
  Fix infer type of kernel in dense. (apache#4125)
  [Relay][AlterOpLayout] NHWC to NCHWc pad operator. (apache#4103)
  [ARITH] Fix lowering of floormod(x, y) != 0 (apache#4127)
  [RFC][RUNTIME] Introduce new object protocol. (apache#4115)
  [Relay][Topi] Disable conv NHWC pack int8. (apache#4038)
  Update task_cpp_unittest.sh
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants