Skip to content
This repository has been archived by the owner on Jan 15, 2024. It is now read-only.

[Discussion] Use control-flow operators (e.g. foreach) to unroll dynamic graph models #259

Open
eric-haibin-lin opened this issue Aug 7, 2018 · 0 comments
Labels
discussion enhancement New feature or request

Comments

@eric-haibin-lin
Copy link
Member

eric-haibin-lin commented Aug 7, 2018

apache/mxnet#11948 introduces foreach to the contrib.unroll method which makes RNNs hybridizable and easy to export to json for deployment. In theory it introduces extra overhead such as calling nd.where. We need to evaluate the performance impact (I assume it's relatively small) and change gluon nlp language models to hybrid blocks for ease of deployment if possible. It should not affect existing pre-trained models since the parameter structure won't change.

@zheng-da @szha

@szha szha added enhancement New feature or request discussion labels Aug 21, 2018
@szha szha changed the title [Discussion] Use foreach to unroll all language models [Discussion] Use control-flow operators (e.g. foreach) to unroll dynamic graph models Aug 28, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
discussion enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants