Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NPU] cherry-pick gc/dataloader/save&load/optimization from ascendrc to develop #32294

Merged
merged 22 commits into from
Apr 19, 2021

Conversation

zhiqiu
Copy link
Contributor

@zhiqiu zhiqiu commented Apr 15, 2021

PR types

Others

PR changes

Others

Describe

[NPU] cherry-pick gc/dataloader/save&load/optimization from ascendrc to develop

zhiqiu and others added 14 commits April 15, 2021 03:28
* support GarbageCollector for npu

* fix typo

* fix gather_grad

* disable NPUDefaultStreamGarbageCollector on NPU
* support npu for memcpy op

* add ut

* fix ut

* fix typo
* support npu profiler

* add python api

* fix bugs

* add wrapper for incomplete type

* update profile proto

* record npu wait

* add xpu placeholder
…dle#31956)

* enable async copy and  add wait before sync operation

* remove unneccessary wait

* add FillNpuTensorWithConstant

* refine

* fix fill_constant

* make TensorFromVector/TensorToVector sync
* fix npu kernel of cast op to handle casting to same dtype

* add comments
* fix compile problem on cann 20.3

* fix ut

* fix test_mul

* fix check_finite_and_scale

* fix lookup_table_v2_grad

* fix cmake

* support print op
* support save load for NPU

* add save load npu unittest

* support np.array transform in NPU

* fix errors

* delete dygraph in unittest

* add Wait

* fix unittest

* fix review comment

* fix unittest problem

* fix little problem
…rformance (PaddlePaddle#32196)

* change aclrtSynchronizeDevice to aclrtSynchronizeStream for better performace

* refine code
* fix NPUDeviceContext in all c++ unittest

* refine log

Co-authored-by: pangyoki <[email protected]>
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

pangyoki and others added 8 commits April 15, 2021 07:00
…r better performance (PaddlePaddle#31994)

* enable async copy and  add wait before sync operation

* remove unneccessary wait

* add FillNpuTensorWithConstant

* refine

* fix fill_constant

* change TensorFromVector to FillNpuTensorWithConstant

* fix ignored api

* delete extra unittest

* fix little error

* fix update_loss_scaling_op_npu and check_finite_and_unscale_op_npu

* change TensorCopySync to TensorCopy

* delete useless Wait and add StreamWait

* fix npu_stream error

* fix check_finite_and_unscale_op_npu TensorCopy

* only save stream wait

* fix NPUDeviceContext in all c++ unittest

* delete wait

Co-authored-by: zhiqiu <[email protected]>
Copy link
Contributor

@wanghuancoder wanghuancoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhiqiu zhiqiu requested a review from Xreki April 19, 2021 06:46
@zhiqiu zhiqiu merged commit cbe5c9f into PaddlePaddle:develop Apr 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants