Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[MXNET-703] TensorRT runtime integration #11325

Merged
merged 47 commits into from
Aug 10, 2018
Merged

[MXNET-703] TensorRT runtime integration #11325

merged 47 commits into from
Aug 10, 2018

Commits on Jul 26, 2018

  1. [MXNET-703] TensorRT runtime integration 

    Co-authored-by: Clement Fuji-Tsang <[email protected]>
Co-authored-by: Kellen Sunderland <[email protected]>
    @Caenorst @KellenSunderland
    3 people committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    268e90b View commit details
    Browse the repository at this point in the history

  2. correctly assign self._optimized_symbol in executor

    @Caenorst
    Caenorst authored and Marek Kolodziej committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    4855d8a View commit details
    Browse the repository at this point in the history

  3. declare GetTrtCompatibleSubsets and ReplaceSubgraph only if MXNET_USE… 

    …_TENSORRT
    @Caenorst
    Caenorst authored and Marek Kolodziej committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    419b294 View commit details
    Browse the repository at this point in the history

  4. add comments in ReplaceSubgraph

    @Caenorst
    Caenorst authored and Marek Kolodziej committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    8d723c9 View commit details
    Browse the repository at this point in the history

  5. Addressing Haibin's code review points

    Marek Kolodziej committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    ca94624 View commit details
    Browse the repository at this point in the history

  6. Check that shared_buffer is not empty when USE_TENSORRT is set

    Marek Kolodziej committed Jul 26, 2018
    Configuration menu
    Copy the full SHA
    75c8642 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2018

  1. Added check that TensorRT binding is for inference only

    Marek Kolodziej committed Jul 28, 2018
    Configuration menu
    Copy the full SHA
    2a11466 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2018

  1. Removed redundant decl.

    @mkolod
    mkolod committed Aug 2, 2018
    Configuration menu
    Copy the full SHA
    190c9bf View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2018

  1. WIP Refactored TRT integration and tests

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    d88ad8b View commit details
    Browse the repository at this point in the history

  2. Add more build guards, remove unused code

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    87ebdce View commit details
    Browse the repository at this point in the history

  3. Remove ccache report

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    83fa475 View commit details
    Browse the repository at this point in the history

  4. Remove redundant const in declaration

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    4a3772f View commit details
    Browse the repository at this point in the history

  5. Clean Cmake TRT files

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    f779537 View commit details
    Browse the repository at this point in the history

  6. Remove TensorRT env var usage 

    We don't want to use environment variables with TensorRT yet, the
logic being that we want to try and have as much fwd compatiblity as
possible when working on an experimental feature.  Were we to add
env vars they would have to be gaurenteed to work in the future until
a major version change.  Moving the functionality to a contrib call
reduces this risk.
    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    b0748ef View commit details
    Browse the repository at this point in the history

  7. Use contrib optimize_graph instaed of bind

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    35e1367 View commit details
    Browse the repository at this point in the history

  8. Clean up cycle detector

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    6338e45 View commit details
    Browse the repository at this point in the history

  9. Convert lenet test to contrib optimize

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    21d0239 View commit details
    Browse the repository at this point in the history

  10. Protect interface with trt build flag

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    f30dbef View commit details
    Browse the repository at this point in the history

  11. Fix whitespace issues

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    eaba593 View commit details
    Browse the repository at this point in the history

  12. Add another build guard to c_api

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    f870a3f View commit details
    Browse the repository at this point in the history

  13. Move get_optimized_symbol to contrib area

    @KellenSunderland
    KellenSunderland committed Aug 8, 2018
    Configuration menu
    Copy the full SHA
    e40d6b3 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2018

  1. Ignore gz files in test folder

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    7fa6a4a View commit details
    Browse the repository at this point in the history

  2. Make trt optimization implicit

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    e777ab5 View commit details
    Browse the repository at this point in the history

  3. Remove unused declaration

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    3ea9b89 View commit details
    Browse the repository at this point in the history

  4. Replace build guards with runtime errors

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    d6d2cac View commit details
    Browse the repository at this point in the history

  5. Change default value of TensorRT to off 

    This is change applies to both TensorRT and non-TensorRT builds.
    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    2d04aee View commit details
    Browse the repository at this point in the history

  6. Warn user when TRT not active at runtime

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    449a195 View commit details
    Browse the repository at this point in the history

  7. Move TensorRTBind declaration, add descriptive errors

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    ed36739 View commit details
    Browse the repository at this point in the history

  8. Test TensorRT graph execution, fix bugs

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    882d8e5 View commit details
    Browse the repository at this point in the history

  9. Fix lint and whitespace issues

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    95a7955 View commit details
    Browse the repository at this point in the history

  10. Fix typo

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    0307467 View commit details
    Browse the repository at this point in the history

  11. Removed default value for set_use_tensorrt

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    8504319 View commit details
    Browse the repository at this point in the history

  12. Improved documentation and fixed spacing issues

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    55dd422 View commit details
    Browse the repository at this point in the history

  13. Merge pull request #8 from KellenSunderland/tensorrt_integration_wip 

    Address design review and feedback from MXNet commiters
    @mkolod
    mkolod authored Aug 9, 2018
    Configuration menu
    Copy the full SHA
    f7ff036 View commit details
    Browse the repository at this point in the history

  14. Move static exec funcs to util files

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    ec9d3ea View commit details
    Browse the repository at this point in the history

  15. Update comments to match util style

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    4b63738 View commit details
    Browse the repository at this point in the history

  16. Apply const to loop element

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    694cbfb View commit details
    Browse the repository at this point in the history

  17. Fix a few namespace issues

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    2be7d25 View commit details
    Browse the repository at this point in the history

  18. Make static funcs inline to avoid compiler warning

    @KellenSunderland
    KellenSunderland committed Aug 9, 2018
    Configuration menu
    Copy the full SHA
    369a3f7 View commit details
    Browse the repository at this point in the history

  19. Merge pull request #9 from KellenSunderland/tensorrt_integration_15 

    Address Pedro and Jun's comments.
    @mkolod
    mkolod authored Aug 9, 2018
    Configuration menu
    Copy the full SHA
    64b7e95 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2018

  1. Remove unused inference code from lenet5_train

    @KellenSunderland
    KellenSunderland committed Aug 10, 2018
    Configuration menu
    Copy the full SHA
    1c7698b View commit details
    Browse the repository at this point in the history

  2. Add explicit trt contrib bind, update tests to use it

    @KellenSunderland
    KellenSunderland committed Aug 10, 2018
    Configuration menu
    Copy the full SHA
    74b6603 View commit details
    Browse the repository at this point in the history

  3. Rename trt bind call

    @KellenSunderland
    KellenSunderland committed Aug 10, 2018
    Configuration menu
    Copy the full SHA
    7fff80c View commit details
    Browse the repository at this point in the history

  4. Remove documentation that is not needed for trt

    @KellenSunderland
    KellenSunderland committed Aug 10, 2018
    Configuration menu
    Copy the full SHA
    a754aab View commit details
    Browse the repository at this point in the history

  5. Merge pull request #10 from KellenSunderland/tensorrt_integration_16 

    Tensorrt integration 16
    @mkolod
    mkolod authored Aug 10, 2018
    Configuration menu
    Copy the full SHA
    7ea6ef9 View commit details
    Browse the repository at this point in the history

  6. Reorder arguments, allow position calling

    @KellenSunderland
    KellenSunderland committed Aug 10, 2018
    Configuration menu
    Copy the full SHA
    22a3823 View commit details
    Browse the repository at this point in the history

  7. Merge pull request #11 from KellenSunderland/tensorrt_integration_16 

    Reorder arguments, allow position calling
    @mkolod
    mkolod authored Aug 10, 2018
    Configuration menu
    Copy the full SHA
    c3ace78 View commit details
    Browse the repository at this point in the history