Staging profile inference v1#2348

Merged

awan-10 merged 11 commits intostaging-profile-inference-v2from

staging-profile-inference-v1

Sep 23, 2022

Commits on Sep 21, 2022

Commits on Sep 22, 2022

fix the errors when inject=False.
awan-10
committed

Commits on Sep 23, 2022

bug fix for running bert w/o kernels
jeffra
committed
add bert benchmark script and update gpt to pull out model times
jeffra
committed
Merge branch 'jeffra/model-inf-profile' of github.com:microsoft/DeepSpeed into jeffra/model-inf-profile
jeffra
committed
add config checks w.r.t. unsupported cuda-graph modes
jeffra
committed
align cmd args and print model type on error
jeffra
committed
Merge branch 'jeffra/model-inf-profile' of github.com:microsoft/DeepSpeed into jeffra/model-inf-profile
awan-10
committed
Merge branch 'jeffra/model-inf-profile' of github.com:microsoft/DeepSpeed-internal into jeffra/model-inf-profile
awan-10
committed
Merge remote-tracking branch 'public/master' into staging-profile-inference-v1
awan-10
committed