Patch 1 #1

…t-form representation (apache#13259)

* patch fix * update ignore * rename getContext to bindToDevice * Update JavaBenchmark.java

* use cached version of get thread max * reserve core affects omp singleton * omp_thread_max_ updated in one line * remove enabled block * add brackets * re-add excluded reserved * add missing var * refactor macro

* Addressing PR feedback for merging Java API into master * Changed constructors to package private instead of private

* adding unit test for MKLDNN FullyConnected operator * removing mkldnn filter * removing mkldnn filter

* fix. * add test. * retrigger

* Addressed doc issues * Update optimizer.py

…structions (apache#13267) * Added command line alternative to IntelliJ * Removed the duplicate file * Fixed typos * Fixed minor command issue

* fixing gradcam * changed loading parameters code * fixing type conversions issue with previous versions of matplotlib * gradcam consolidation * creating directory structures in utils * changing location * empty commit

* Adding info_gan example * adjust paths of filenames * Update index.md * Update index.md * Update index.md * Update info_gan.md Added an image * Update info_gan.md Applied some fixes * Update info_gan.md Applied some fixes * Update info_gan.md Applied some fixes * Update info_gan.md * Updated index.md file * Updated index.md file * change links * Fixed typo * Delete Untitled.ipynb * Adding Vishaals comments * Adding Anirudh's comments * Fixed some bugs * Adding Anirudh's comments * some minor fixes

) * Added Java SSD Inference Tutorial for website * Added whitelisting to SSD tutorial * Address PR feedback * Marking intelliJ as optional

* add initial commit * push back predictor * name fix and bug fix * update readme and script to run * minor fix * minor fix * fix on doc * update predictor

…che#13298)

* Fix Sphinx python docstring formatting error (apache#13021). Fixes apache#13021 * Update src/operator/nn/batch_norm.cc Co-Authored-By: frankfliu <[email protected]>

* update the doc for test_optimizer * add docstring for test_score

* update the README to solve the library cannot find problem * fix the broken format * remove redundancy and broken format * add .

* update readme on module prediction * fix typo * update url * improve grammar * update link

* [MXNET-984] Add Java NDArray and introduce Java Operator Builder class (apache#12816) * clean history and add commit * add lint header * bypass the java unittest when make the package * clean up redundant test * clean spacing issue * revert the change * clean up * cleanup the JMacros * adding line escape * revert some changes and fix scala style * fixes regarding to Naveen's comment * Java Inference api and SSD example (apache#12830) * New Java inference API and SSD example * Adding license to java files and fixing SSD example * Fixing SSD example to point to ObjectDetector instead of ImageClassifier * Make scripts for object detector independent to os and hw cpu/gpu * Added API Docs to Java Inference API. Small fixes for PR * Cosmetic updates for API DOCS requested during PR * Attempt to fix the CI Javafx compiler issue * Migrate from Javafx to apache commons for Pair implementation * Removing javafx from pom file * Fixes to appease the ScalaStyle deity * Minor fix in SSD script and Readme * Added ObjectDetectorOutput which is a POJO for Object Detector to simplify the return type * Removing Apache Commons Immutable Pair * Adding license to new file * Minor style fixes * minor style fix * Updating to be in scala style and not explicitly declare some unnecessary variables * NativeResource Management in Scala (apache#12647) (apache#12883) * add Generic MXNetHandle trait and MXNetHandlePhantomRef class that will be used by all MXNetObjects * Generic Handle with AutoCloseable * add NativeResource and NativeResourceManager with Periodic GC calling * use NativeResource trait in NDArray, Symbol and Executor * add run train mnist script * create a Generic ResourceScope that can collect all NativeResources to dispose at the end * modify NativeResource and ResourceScope, extend NativeResource in NDArray, Symbol and Executor * remove GCExecutor * deRegister PhantomReferences by when calling dispose() * add Finalizer(temporary) to NativeResource * refactor NativeResource.dispose() method * update NativeResource/add Unit Test for NativeResource * updates to NativeResource/NativeResourceRef and unit tests to NativeResource * remove redundant code added because of the object equality that was needed * add ResourceScope * Fix NativeResource to not remove from Scope, add Unit Tests to ResourceScope * cleanup log/print debug statements * use TreeSet inplace of ArrayBuffer to speedup removal of resources from ResourceScope Fix Executor dispose and make KVStore a NativeResource * fix segfault that was happening because of NDArray creation on the fly in Optimizer * Add comments for dispose(param:Boolean) * Added unit tests for Resource Scope in Java (apache#12955) * Bumping down minimum java support from 8 to 7 (apache#12965) * [MXNET-984] Java NDArray Documentation Generation (apache#12835) * cherry pick javaDoc changes * update NDArray changes * refactoring change and merge all docGen in a single place * clean the scalastyle * take on Piyush nit * drop the comments * First pass at adding JavaDocs for new java api classes (apache#12963) * First pass at adding JavaDocs for new java api classes * Fix a scalastyle issue * Updating JavaDoc based on feedback * [MXNET-1160] add Java build/run example (apache#12969) * add example * clean up nit * find the pain point * add java tut into whitelist * Trigger CI * add java demo and split scala demo * address the comments * change the examples * fix the wrong configuration * Maven Surefire bug workaround (apache#13097) * use ResourceScope in Model/Trainer/FeedForward.scala (apache#12882) (apache#13164) * use ResourceScope in Model/Trainer/FeedForward.scala * add moveToOuterScope public method to move resources to a outerScope if it exists * fix memory leak in FeedForward.scala by making it a native resource and disposing argparams, auxParams in dispose() method * [MXNET-1187] Added Tutorial for Java under mxnet.io/docs/tutorials (apache#13183) * Added tutorial for Java installation on IntelliJ for mxnet.io website * Added correct image resources * Removed spurious quotes * Added java tutorial to whitelisting * Added community download edition link to intelliJ section * [MXNET-1202] Change Builder class into a better way (apache#13159) * applying changes for Builder functions * simplify the code structure * update docgen * follow Naveen's suggestion * apply comments to Param * clean up param build * change on the comments * add one description line * [MXNET-1041] Add Java benchmark (apache#13095) * add java benchmark * applied changes based on Piyush comments * applies Andrew's change * fix clojure test issue * update the statistic names * follow Naveen's instruction * [MXNET-918] [Introduce Random module / Refact code generation (apache#13038)][Cherry pick] (apache#13242) * [MXNET-918] Introduce Random module / Refact code generation (apache#13038) * refactor code gen * remove xxxAPIMacroBase (overkill) * CI errors / scala-style * PR review comments * clean up the duplicated code * add comments * Fixed missing break statement (apache#13257) * Java Benchmark failure (apache#13258) * patch fix * update ignore * rename getContext to bindToDevice * Update JavaBenchmark.java * Addressing PR feedback for merging Java API into master (apache#13277) * Addressing PR feedback for merging Java API into master * Changed constructors to package private instead of private * clean up the NDArray follow the comments (apache#13281) * [MXNET-1181] Added command line alternative to IntelliJ in install instructions (apache#13267) * Added command line alternative to IntelliJ * Removed the duplicate file * Fixed typos * Fixed minor command issue * add defaults and clean up the tests (apache#13295) * [MXNET-1187] Added Java SSD Inference Tutorial for website (apache#13201) * Added Java SSD Inference Tutorial for website * Added whitelisting to SSD tutorial * Address PR feedback * Marking intelliJ as optional * [MXNET-1182] Predictor example (apache#13237) * add initial commit * push back predictor * name fix and bug fix * update readme and script to run * minor fix * minor fix * fix on doc * update predictor * Reducing the length of setup tutorial (apache#13306)

* enabling test_dropout after fixing flaky issue * adding a check for positive seed

…3210)

* fixing gradcam * changed loading parameters code * fixing type conversions issue with previous versions of matplotlib * gradcam consolidation * creating directory structures in utils * changing location * empty commit * fix file lock issue * fix link * removing other commits * remove commit

* Updated Instructions for Label Bot * Updated instructions for mxnet-label-bot * Including myself as a contributor * Clarified usage of label bot * Fixed typos and instructions/examples have been made more clear * Added link for available labels

…11047) * fix mkldnn pooling to support full convention * backward with full convention * fix * add pooling test for full convention * add function for computing padding size * fix unit test * only support max-pooling * fix pooling bwd * address review comment

* add centos build for Scala * migrate the build portion to docker * update build script and chmod +x * address Jenkins change * allow CentOS provide all depdencies

* [MXNET-860] Use modernized ranged loops where possible * [MXNET-860] Use uniform ref, use const where possible * [MXNET-860] Fix build error after conflict resolve * [MXNET-860] Apply const, improve naming

…pache#11778) * add conv test * remove pool type * gettestinput can receive scale input * create kernels and bias arrays * fix shape of kernel / bias * fix format * bias is 1dim * fix output shape * fix backwards input * fix var name to backwards_ex_outputs * filter inputs with diff memory dims * fix lint * remove extra spaces * fix lint * add deconv test * add calc devconv size * remove bias from deconv input * create deconv kernel * fix num outputs for deconv * fix lint * use random inputs for deconv * can init random mldnn array * round scale * update for loops with size_t instead of ints * remove comment * fix merge * use bounded random inputs * fix merge issue * conv op uses filter * reorder if view * reorder backwards * rename to out_grad * fix lint * filter pooling tpyes * reorder * add bias * fix typo * fix ref * filter arrays * reorder devcon inputs * reorder devonc forward inputs * fix missing var * remove unused var * reorder inputs for deconv forward * remove const * avoid reorder * set bias * fix typo * set bias with string * set bias with string * remove use bias * add bias * add bias shape * cannot use reshaped non n*** format * add spatial filter * fix conv * fix missing conv * fix input * fix merge * add missing header * add inline * fix input * add spatial filter in test * fix get test input params * fix get test input params * fix num inputs * fix input num of backwards * fix bias * add missing bias * fix output num for backwards * fix num outputs for deconv * fix test input * remove comments * use deconv param * use template * filter out incompatible widths * fix lint * update comment * reorder weights in deconv * remove const from set_data handle * fix lint * retrigger * remove data format * retrigger * retrigger * use check_eq * retrriger * refactor deconv if/else block

- keepdims is stored as a boolean string, not an int - Operators: - argmax - argmin - min - max - prod - mean

* adding unit test for MKLDNN FullyConnected operator * adding unit test for MKLDNN Softmax operator * merging TestSoftmaxOp with TestOpEx * adding unit test for MKLDNN Softmax operator * adding accepted dimension support * changing set to unordered set * adding check for non-empty accept_dims

) * Add NDArray with lazy shape, Add boolean mask operator * Fix lints * Address comments and refactor forward pass * Add backward pass for boolean index * Fix tests.... * Add unittests * Make lint happy * Address comments * Address comments, and complete docstring * Update docstring

* include mkl headers * add include to mac build

* Update Requests version to 2.20.0 to handle security risk * Add version limit for requests

…13323) * fix apache#13320 * add support for 1.3.0 and 1.3.1 settings * turn off java for tutorials * update to reflect actual name of 1.3.x branch!

This reverts commit 0e9a1ff.

* delete print to make the log more clean * delete the log user don't need

Update C++ tutorials up to date

From documentation: The value of this variable should never be modified by project code. ... changing the value has undefined behavior. * https://cmake.org/cmake/help/latest/variable/CMAKE_GENERATOR_TOOLSET.html

add 75 in Makefile

…x branch (apache#13231)

* change CMAKE_CXX_FLAGS * change cxx flags for mkldnn * limit change to MSVC * Revert "change CMAKE_CXX_FLAGS" This reverts commit bc67ed3. * retrigger ci

* Add custom context for GitHub * Refactor * Split files * Extract steps into separate file * Revert main Jenkinsfile changes * Resolve typos * Fix typo around wildcards for examples * Make debug output non blocking * Skip website publishing in dev * Revert Jenkinsfile and add deprecation message * Remove unmatching nodes * Improve documentation of assign_node_labels * Remove unused code

* fix formatting * formalize steps; circumvent web publishing misrendering

* add codepath for implicit conversion to half precision for batch_gemm on gpu * fix argument call * document implicit float32 conversions * separate gemm test from laop tests, add test for tensorcore code path for gemm

…che#13328) * adding test for mkldnn softmax operator for large negative inputs * asserting real output * add test for non mkldnn case too * adding more corner cases * replacing assert with assert_almost_equal * adding default context

* Add timing output to python tests * Fix wrong parameter and add windows * Replace floats with ints

* fix quantized pooling and enable it in INT8 SqueezeNet * add test * fix test * address review comments * refine the test for quantized pooling

* edge_id op csr forward on CPU (apache#34) * add node subgraph generator. (apache#35) * create DGLSubgraph. * fix. * return old eids in node_subgraph. * accelerate subgraph construction. * Add neighborhood op (apache#37) * add csr_neighborhood op * update neighborhood sample * Update csr_neighborhood_sample-inl.h * Update csr_neighborhood_sample-inl.h * Update csr_neighborhood_sample.cc * add graph compact operator. * fix a bug in dgl_subgraph. * fix a bug in dgl_graph_compact. * Update csr sample op (apache#39) * add csr_neighborhood op * update neighborhood sample * Update csr_neighborhood_sample-inl.h * Update csr_neighborhood_sample-inl.h * Update csr_neighborhood_sample.cc * Update csr_neighborhood_sample-inl.h * Update csr_neighborhood_sample.cc * Update csr_neighborhood_sample-inl.h * remove space. * move to dgl_graph to contrib. * move code. * move edge id. * fix compilation error. * add test for subgraph. * cleanup. * fix. * fix. * fix compile error. * fix compile error. * fix compile error. * fix. * add operator doc. * remove graph_compact * update doc. * address comments. * retrigger. * address comments. * retrigger * fix a bug in test. * retrigger * add check_format

* Updated the paths for images * Empty commit * Empty commit * Nudge to CI

* add flag to disable mkldnn cache * update docs * fix typos * update var name * fix ordering * set cache size * fix log message * update docs * fix lint * fix lint * fix comparison * update method name * fix missing * fix logging * remove random item when cache exceeded * update helper name * update hash namespace * make ophash template * udpate function params * fix return * fix return * update return for helper * chagne class to typename * add typename * fix lint * update doc * pass ptr to cache * retrigger * retrigger * retrigger * change env var name to MXNET_MKLDNN_CACHE_NUM * fix log env name * retrigger

* Initial website documentation for Java API * Changing paths to be relative * Refactoring Java API website landing page * Update Java web docs based on feedback * Minor formatting fixes * Update maven repo to nightly build so that java will be available prior to 1.4.0 release * Adding java tutorial index to test_sanity_tutorials whitelist * Fix link to javadocs * Fix javadoc for infer package and minor install doc fix * Minor path fix

…pache#13402) * Replace mxnetci dockcross with public dockcross due to missing image * Remove source lists change * Disable Jetson * Move to mxnetcipinned

* Correct shapes of images in cifar10 and cifar100 cifar10 and cifar100 have 3 channels * Retrigger build

* initial modification recommender * Recommender updates * fix notebooks * Update README.md * trigger build * Update README.md * Retrigger build

…3318) * improving multi-processing reliability for gluon dataloader I found some multi-processing-related issues in the Gluon DataLoader. 1) Each time a _MultiWorkerIter shuts down, it could leave some dangling processes. The shutdown mechanism could not guarantee that all worker processes can be terminated. As a result, after running for several epochs, more and more dangling processes will stay there. This problem barely happens during training. In this case, there is a decent time interval between the last-batch data prefetching and the _MultiWorkerIter's shutting down). But the problem frequently happens 1) when I stop the iter before the end of an epoch, and 2) when I use the DataLoader for a data loading service and load the data as fast as possible. In both cases, the time interval between the most recent data prefetching and the iter shutdown are short. I guess that the _MultiWorkerIter iter is unable to shut down properly during active data prefetching. To fix this, I explicitly terminate the worker processes inside the shutdown function. 2) When loading data fast (still mostly during testing and data serving), there seems to be a risk of data racing. The data iter uses a _MultiWorkerIter to cache prefetched data, but the dict does not seem to be thread-safe for concurrent inserting and deleting elements. So occasionally, the data can be missing from the dict. To prevent this, I use a scope lock to guard the dict access. * do not wait for the workers to join, and kill any alive wokers as soon as possible

* Fix ONNX export to support multi-output graphs * Add ONNX unit-test * Added multi-output shape inference. - Removed unnecessary forward_pass() call - Modified infer_output_shape to return multiple shapes for multiple outputs as well as output names. * Fixed pylint

Update the main website links

* dynamic omp for dot update heuristic * add doc * Update mxnet_op.h * Update dot-inl.h

…13415)

- Update notebook to avoid divide by 0 causing a warning. - Add MXBoard dependency.

…13393)

* Minor fixes to documentation * Updated the Maven Repository URL to point to staging repo

…#13284) * fix inception-bn and training acc issue * add parameter initialization, fix lint * fix comparison * change optimizer to sgd * update sgd and update model name * add inception_bn in jenkins build * make max epoch an argument * remove inception_bn test * trigger ci * remove ci test * trigger ci

* add instruction to get the data and fix typo * fix typo * update file name * trigger CI * add unit_test for unit_test_mlp_csv * add mlp_csv to jenkinsfile * revert jenkinsfile to another PR * trigger CI * trigger CI

* Fix scaladoc and javadoc errors * Stop on errors starting on scala 1.3.x build

…che#13420) * Adding Java to ubuntu setup install page and minor fixes to other java api docs * Improving javadoc for java-api predictor class Mostly documentation changes

* randint operator add along with add optional tag to params * register param * lint space issue * randn issue fix * uniform_int_distribution doesn't support int8, uint8 fix * dtype ftype * ftype to dtype - invalid template arg * fix template arg issue * test with int dtype for windows * removed int8,uint8 from test * gpu implementation * gpu engine state diff * removed gpu support * empty commit * temporary fix : batchnorm flaky test skip * removed randn symbol specific code since other PR is on it * revert ndarray/randn for compatibility * added unit test for checking extremes and uniform distribution for sufficient samples * increased the high val * int32 to int64 support, indentation fix, check for optype correctly based on type of random function * gpu support, revert finfertype using template specialization, remove defaults, prints, test other low high val * fix for invalid template arg by checking for int32,int64 * gpu randint in random_generator * sample_uniform issue and param, removed old flaky test skip line * replaced discrete_uniform function by rand_int64 for consistency * formula update and removed itype * change ctx to include gpu, randint samepl_op.cu typo * trigger ci * doc fix, check fix, whitespace remove * added the without dtype testcase

* fix on ubuntu * add readme instruction * fix intellij Tutorials * fix intelliJ tutorial * fix the document * update demo * revert the change on intelliJ tutorial * fix make process * fix documentation

* Add quantized concat * Fix non-mkldnn build * Add size check for MKLDNNQuantizedConcatForward * use all capital for constant * Rename constant with Google C++ style. * Address apeforest comments * Address apeforest comments * fix lint * Add frontend interface. * Retrigger CI

* Add ARMv7 builds to dev_menu.py * Add Python3 CPU Intel MKLDNN unittests to dev_menu

* add find_include_path API * address reviewer comment * change return type from list to string * add unit test * address reviewer comment * address reviewer comment * address reviewer comment * address reviewer comment

* add adjacency. * fix lint. * add GPU impl. * retrigger * address comments. * Update dgl_graph.cc

* added java install option * update maven blocks * update maven button url to snapshot search for java * add version; remove formatting on dependency * merge clojure updates * merge clojure updates - give code some breathing room * merge clojure updates - give code even more breathing room

* 1.3.1 website updates * Java added to install page (apache#13404) * added java install option * update maven blocks * update maven button url to snapshot search for java * add version; remove formatting on dependency * merge clojure updates * merge clojure updates - give code some breathing room * merge clojure updates - give code even more breathing room

* remove redundant link * retrigger * retrigger

) * ONNX export: Comparison operators * ONNX export: Hard sigmoid

I noticed that the symbols and parameters in the model zoo are infact from https://github.com/apache/incubator-mxnet/blob/master/example/image-classification/symbols/inception-bn.py, which is not inception v3. It is inception + batch normalization. In this commit, I update the documentation and link to the correct research basis.

* exclude the error folder from sphinx toc * bumping commit for CI

* update MKL-DNN CI id * fix the reorder perf issue * bumped version to v0.17.1 * bumped to MKL-DNN v0.17.1 * pin to v0.17.1

- KL never succeeds so it always goes exponential - Too many weight matrices were rejected because of zero weights, simplify generation to not include 0 weight edges

…2926) * parallelize NDArray::Copy<cpu, cpu> by OpenMP when data size > MXNET_CPU_PARALLEL_COPY_SIZE * code specification according to reviewer's suggestions * align with std::memcpy api * add descriptive error message * update MXNET_CPU_PARALLEL_COPY_SIZE doc * update MXNET_CPU_PARALLEL_COPY_SIZE doc again

) * init commit with Predictor Improvement * add predictor Example * change into dArr * add img config * add new line and fix code style important bug fixes

* add test case * revert refactor * use with seed decorator * retrigger * remove seed * remove iteration * remove old test * update deconvolution test to have filter length that triggers mkldnn reorder

* add csr sample op * fix compile error in some platform * update * update openmp * speedup sampling * update csr * update csr * update time seed * update * fix compiler error * update doc * fix ci error

…ingle node (apache#13000) * fix quantize_graph pass error when there're multiple outputs from a single node that need to insert 'contrib_quantize', 'min' and 'max' nodes for these outputs. * fix lint * Make the single output align with multiple outputs when inserting contrib_quantize * Change op comparing from its name to itself * skip unsupported quantize_concat * retrigger ci

* add find_include_path API * address reviewer comment * change return type from list to string * add unit test * address reviewer comment * address reviewer comment * address reviewer comment * address reviewer comment * fix include path problem in pip package * add comment * fix lint error * address reviewer comment * address reviewer comment

…ed on reboot (apache#13431)

…iability (apache#13447) * fix recordio.py * rewrite dataloader with pool * fix batch as tuple * fix prefetching * fix pylint * picklable function * use pickle * add missing commit

…13463)

* update train_mnist * Add documentation for JVM Memory Management * update doc * address nit picks * address nit picks * Grammar and clarity edits for memory management doc * Edits for scala memory management * Update memory-management.md * Update memory-management.md * Update memory-management.md * capitalization fix

Update row_sparse tutorial

* Added resiliency to onnx export code - With previous infer-shape implementation, if input shape was list instead of tuple or if extra non-existent parameters were provided, the code would still work. The fixes in this commit make sure that behavior is restored to prevent any compatibility issues with existing export code. * Fixed name of net in unittest * Fix pylint

…e#13418) * fix a few operators with large arrays (# of elements) * fix bug in broadcast_div and add tests * address reviewer comment * add unit test * add empty line * retrigger CI

* Initialized the example * Addressed PR comments, about existing synset.txt file - no overwrite * RST - docstring issues fixed * added README * Addressed PR comments * Addressed PR comments, checking Divide by 0 * Raising error if format is not supported. * changed a line for ndarray of labels * Trigger CI * Trigger CI * PR comments addressed around skip_header argument * Addressed PR comments around librosa import * PR Comments * Passing lazy=lazy from argument * Added PR comments, labels to README.MD * Trigger CI * Addressing PR Comments in README * Modified README.md * Added example under audio folder * Retrigger CI * Retrigger CI

* ONNX import/export: Make backend_rep common * ONNX export: Instance Normalization * ONNX export: Shape operator

…3495)

* add graph_compact. * fix. * add doc. * add tests for graph_compact. * address comments. * update docs. * trigger CI

Updated to https://github.com/dmlc/gluon-nlp/blob/master/src/gluonnlp/model/sampled_block.py

…ace (apache#13499)

Add GPU+MKLDNN unittests to dev_menu

This reverts commit 7541021.

* build mkldnn as static lib * update makefile to statically build mkldnn * build static mkldnn * fix static name * fix static name * update static for mac * rename mkldnn dep in ci * remove moving mkldnn dynamic lib * remove commented code * remove mkldnn dnaymic for unitest * force static for mkldnn lib * remove dynamic mkldnn bind * only link windows * add mkldnn.mk * try force linking * remove mkldnn dynanmic check * remove test mkldnn install * fix spacing * fix index * add artifacts * add comment about windows * remove static * update makefile

* fix toctree errors * nudging file for CI

…a_loader_multiworker (apache#13527)

…che#13409) * Provide a failing test for ReLU activation shape inference bug * Fix Activation backward shape inference fixes: apache#13333 * Add softsign Activation to test_gluon.py * Use activation in GPU if we are using CUDNN and not MKLDNN as it's happening right now * Don't disable MKLDNN

* fix scala ndarray docs; remove interpreter style * fix docs error in kvstore * remove interpreter format in examples * remove python indicator for these non-functioning python code blocks; clears a sphinx error * remove old table that was not being used and was triggering a sphinx error * get rid of curly braces that was causing a pygments error * fix ambiguous reference causing sphinx error * nudging file for CI

* Add a test for AdaMax optimizer * Modify nested for loop with itertools.product and left tolerance to default * Trigger

* adadelta test * comments

* Update java setup docs for 1.4.0 * Update Java-demo to 1.4.0

This reverts commit 65edc95.

* Add header files required by horovod * Add symbolic link and cherry picked required header * add python API to return include path * update link * fix windows CI * fix windows build * fix dlpack link * merge with master * exclude 3rd party header files from license check * exclude license check * exclude include directory * remove commented lines

…ile (apache#13478) * updated to v1.5.0 * Bumped minor version from 1.4.0 to 1.5.0 on master * added Anirudh as maintainer for R package ... adding something useful and re-trigger PR check * Updated license file for clojure, onnx-tensorrt, gtest, R-package * Get the correct include path in pip package (apache#13452) * add find_include_path API * address reviewer comment * change return type from list to string * add unit test * address reviewer comment * address reviewer comment * address reviewer comment * address reviewer comment * fix include path problem in pip package * add comment * fix lint error * address reviewer comment * address reviewer comment * Use ~/.ccache as default ccache directory so is not cache is not erased on reboot (apache#13431) * Skip flaky test apache#13446 (apache#13480) * Rewrite dataloader with process pool, improves responsiveness and reliability (apache#13447) * fix recordio.py * rewrite dataloader with pool * fix batch as tuple * fix prefetching * fix pylint * picklable function * use pickle * add missing commit * Fix errors in docstrings for subgraph op; use code directive (apache#13463) * [MXNET-1158] JVM Memory Management Documentation (apache#13105) * update train_mnist * Add documentation for JVM Memory Management * update doc * address nit picks * address nit picks * Grammar and clarity edits for memory management doc * Edits for scala memory management * Update memory-management.md * Update memory-management.md * Update memory-management.md * capitalization fix * Update row_sparse tutorial (apache#13414) Update row_sparse tutorial * Add resiliency to onnx export code (apache#13426) * Added resiliency to onnx export code - With previous infer-shape implementation, if input shape was list instead of tuple or if extra non-existent parameters were provided, the code would still work. The fixes in this commit make sure that behavior is restored to prevent any compatibility issues with existing export code. * Fixed name of net in unittest * Fix pylint * [MXNET-1185] Support large array in several operators (part 1) (apache#13418) * fix a few operators with large arrays (# of elements) * fix bug in broadcast_div and add tests * address reviewer comment * add unit test * add empty line * retrigger CI * [MXNET-1210 ] Gluon Audio - Example (apache#13325) * Initialized the example * Addressed PR comments, about existing synset.txt file - no overwrite * RST - docstring issues fixed * added README * Addressed PR comments * Addressed PR comments, checking Divide by 0 * Raising error if format is not supported. * changed a line for ndarray of labels * Trigger CI * Trigger CI * PR comments addressed around skip_header argument * Addressed PR comments around librosa import * PR Comments * Passing lazy=lazy from argument * Added PR comments, labels to README.MD * Trigger CI * Addressing PR Comments in README * Modified README.md * Added example under audio folder * Retrigger CI * Retrigger CI * ONNX export: Instance normalization, Shape (apache#12920) * ONNX import/export: Make backend_rep common * ONNX export: Instance Normalization * ONNX export: Shape operator * Clarify dependency on OpenCV in CNN Visualization tutorial. (apache#13495) * clarify ops faq regarding docs strings (apache#13492) * Add graph_compact operator. (apache#13436) * add graph_compact. * fix. * add doc. * add tests for graph_compact. * address comments. * update docs. * trigger CI * Deprecate Jenkinsfile (apache#13474) * update github location for sampled_block.py (apache#13508) Updated to https://github.com/dmlc/gluon-nlp/blob/master/src/gluonnlp/model/sampled_block.py * apache#13453 [Clojure] - Add Spec Validations to the Optimizer namespace (apache#13499) * ONNX export: Logical operators (apache#12852) * Fix cmake options parsing in dev_menu (apache#13458) Add GPU+MKLDNN unittests to dev_menu * Revert "Manually track num_max_thread (apache#12380)" (apache#13501) This reverts commit 7541021. * Feature/mkldnn static 2 (apache#13503) * build mkldnn as static lib * update makefile to statically build mkldnn * build static mkldnn * fix static name * fix static name * update static for mac * rename mkldnn dep in ci * remove moving mkldnn dynamic lib * remove commented code * remove mkldnn dnaymic for unitest * force static for mkldnn lib * remove dynamic mkldnn bind * only link windows * add mkldnn.mk * try force linking * remove mkldnn dynanmic check * remove test mkldnn install * fix spacing * fix index * add artifacts * add comment about windows * remove static * update makefile * fix toctree Sphinx errors (apache#13489) * fix toctree errors * nudging file for CI * Disabled flaky test test_gluon_data.test_recordimage_dataset_with_data_loader_multiworker (apache#13527) * [MXNET-1234] Fix shape inference problems in Activation backward (apache#13409) * Provide a failing test for ReLU activation shape inference bug * Fix Activation backward shape inference fixes: apache#13333 * Add softsign Activation to test_gluon.py * Use activation in GPU if we are using CUDNN and not MKLDNN as it's happening right now * Don't disable MKLDNN

* Reduce post processing time * fix ssd * fix the CI * add comments

…denied due t… (apache#13531) * Use MXNET_HOME in cwd in windows to prevent access denied due to concurrent data downloads Fixes apache#13484 * Revert "Disabled flaky test test_gluon_data.test_recordimage_dataset_with_data_loader_multiworker (apache#13527)" This reverts commit 3d499cb.

Fixes apache#13504

* fix pool release * fix

…he#13094) * Simplify mnist Gluon tutorial and add mislabelled sample plotting * Add mnist Gluon tutorial images * Gluon MNIST tutorial: Use modern Gluon constructs, fix some wordings * [Gluon] Move to data loaders and improve wording in MNIST tutorial * Fix broken links * Fix spelling of mislabeled * Final rewordings and code simplifications * Fix things according to review - Apply hybrid blocks - Move outputs outside of code blocks and mark for notebooks to ignore - Remove images, use external link - Fix a few formulations * Change activations to sigmoid in MNIST tutorial * Remove superfluous last layer activations in MNIST tutorial

* updated docs for randint * added randint in __all__ and reordered acc to categorical then alphabetical * Trigger CI * minus mxnet.symbol and alphabetical for ndarray,symbol.md * alphabetical order

* check for bucket instead of index * enumerate instead of range(len()) * count instead of sum to solve attribute error * revert to sum * seperate discrete and continuous * Trigger CI

…icense file" (apache#13558) * Revert "Chi_square_check for discrete distribution fix (apache#13543)" This reverts commit cf6e8cb. * Revert "Updated docs for randint operator (apache#13541)" This reverts commit e0ff3c3. * Revert "Simplifications and some fun stuff for the MNIST Gluon tutorial (apache#13094)" This reverts commit 8bbac82. * Revert "Fix apache#13521 (apache#13537)" This reverts commit f6b4665. * Revert "Add a retry to qemu_provision (apache#13551)" This reverts commit f6f8401. * Revert "[MXNET-769] Use MXNET_HOME in a tempdir in windows to prevent access denied due t… (apache#13531)" This reverts commit bd8e0f8. * Revert "[MXNET-1249] Fix Object Detector Performance with GPU (apache#13522)" This reverts commit 1c8972c. * Revert "Fixing a 404 in the ubuntu setup doc (apache#13542)" This reverts commit cb0db29. * Revert "Bumped minor version from 1.4.0 to 1.5.0 on master, updated License file (apache#13478)" This reverts commit 40db619.

…apache#13523)

* Add workspace cleaning after job finished * Update Jenkinsfile_utils.groovy * Update Jenkinsfile_utils.groovy

* updated seed, alpha value, comments * typo in comment fix * added nrepeat * removed unusued variable, added link for scipy alpha, rephrased the sentence for discrete distribution buckets * removed fixed seed, alpha

* Update DESCRIPTION * update version to v1.5.0 except for clojure * update version from 1.4.0 to 1.5.0 - add utility script to help bump versions in future - fix README to correct to current maven versions

* Update LICENSE * update license for Clojure, R, ONNX-TRT and location of 3rd party dependencies. * fixed typo

minor fix the image.py add last_batch_handle for imagedeiter remove the label type refactor the imageiter unit test fix the trailing whitespace fix coding style add new line move helper function to the top of the file

Fix typos

* Fix exception handling api doc * Update waitall api doc Co-Authored-By: anirudh2290 <[email protected]>

* add inception test * fix max iter for mlp * rename and add comment * rename epoch num

* Add imresize API to docs * address comments * copyMakeBorder

* fix control_flow_op * change type for M * add test for sparse where op

* add mkl blas to Jenkins * add mkl install script * fix bug in mkl script * remove python2 ut and add cpu-mkl node

…e#13554)

Merge this PR for 1.4.x

* [MXNET-1155] Add scala packageTest utility * Clean up utility * Safe change directory in Makefile for scala * mvn install file instructions with details

Major JNI feature changes. Please find more info here: https://cwiki.apache.org/confluence/display/MXNET/Scala+maven+build+improvement

…e#13364) * Always use config.mk in make install instructions * Specify Cuda 0 for ubuntu with mkldnn * Scala install doc avoid build_from_source Minor doc fixes * Fix build_from_source CMake usage * CPP Install Instruction with CMake * Use cmake out of source build

* Optimize C++ API Pass parameter with reference instead of value. Add const as well as it is not changed. * fix docs/architecture/overview.md Fix BinaryShapeFunction typedef Add a right brace for SmoothL1Shape_

…ed in the model (apache#13596)

* openblas script * ps-lite dependencies * USE_S3 dependencies * image libraries * license

* add batch norm test * fix formatting * use out_arr as input * fix typo * remove const * use ptr * eval ptr

* Fix the bug of BidirectionalCell I did hybridize( ) and pass "valid_length" to the unroll( ) function of BidirectionalCell, then returned AssertionError in line 79. Because symbol.split( ) return a symbol but not a symbol list. Result in the length of inputs dont equal parameter "length" when call unroll( ) to compute r_outputs and r_states. * add a test for BidirectionalCell * Fix the bug of BidirectionalCell I did hybridize( ) and pass "valid_length" to the unroll( ) function of BidirectionalCell, then returned AssertionError in line 79. Because symbol.split( ) return a symbol but not a symbol list. Result in the length of inputs dont equal parameter "length" when call unroll( ) to compute r_outputs and r_states. * fix test_bidirectional_unroll_valid_length( ) Fix the error of parameter. * Fix the bug of BidirectionalCell I did hybridize( ) and pass "valid_length" to the unroll( ) function of BidirectionalCell, then returned AssertionError in line 79. Because symbol.split( ) return a symbol but not a symbol list. Result in the length of inputs dont equal parameter "length" when call unroll( ) to compute r_outputs and r_states. * fix test_bidirectional_unroll_valid_length( )

* Revert "Revert "Feature/mkldnn static 2 (apache#13503)" (apache#13540)" This reverts commit a3eca5f. * include headers on mkldnn lib * retrigger * retrigger

* config for pip * symbol whitelist * maven build config

…pache#13602) * apache#12255 doing import mxnet in multiple processes take very long time. Details : apache#12255 One of the reason we have OMP tuning code which iterates to find OMP tune overhead. We are reducing this iteration count to reduce the overehead of tuning code. Also, We added an environment variable where users can set the number of cores that should be used to determine tuning. * cpplint fix * Adding new environment variable: MXNET_USE_NUM_CORES_OPERATOR_TUNING to doc * fixing formatting in doc

* Add reshape op supported by MKL-DNN * fix build issue * fix lint * fix lint * fix lint * fix lint * fix lint * fix lint * fix white space * add unit test * merge if blocks

* Improve dev_menu, add build command and virtualenv creation with local builds for easy testing * Update dev_menu.py Co-Authored-By: larroy <[email protected]> * Cuda off by default, use ccache * address CR

@kohr-h

…e latest maven.org release (apache#13507) * Correct the versions so they correspond to the latest maven.org release * trigger build * feedback from @kohr-h

* Change argsort to argpartition * Global statistics in metrics * Fix lint * Fixes from review * Trigger * Fixes from review, fix to F1, MCC and perplexity metrics, added test for global stats * Fix lint * Fix compatibility with Python 2

This reverts commit 5bcf2bd.

* support mkl log when dtype is fp32 or fp64 * remove macro * ensure data size less than or equal MKL_INT_MAX * code specification * fix indent * for retrigger

* transpose tutorial * Adding Anirudhs comments * Update tutorial with some more examples * Adding links * Fixing the links, adding more examples * Update reshape_transpose.md * Fixing spelling mistakes * Updating image resolution * Adding Simon's comments * Small fixes * Update reshape_transpose.md * Update reshape_transpose.md * empty commit * empty commit

* init * add tests * doc * lint * fix openmp

* Remove gitignore entries * Modify Makefile * Modify user permissions * Add new ccache wrapper function * Change PATH rewrite to a different one to resolve CUDA issues * Add ccache to gpu cmake * Enable ccache for every build * Set permissions for arm dockerfiles * Disable ccache for ASAN * Remove g++-8 ccache redirect * Update Android Dockerfiles for user permissions * Fix ASAN compiler typo * Remove sanity for speed * Move build dir creation in android armv8 * Revert "Remove sanity for speed" This reverts commit e8386a7. * Add ccache for NVCC in Makefile

* introduce random API * revert useless changes * shorter types in APIDoc gen code * fix after merge from master * Trigger CI * temp code / diag on CI * cleanup type-class code * cleanup type-class code * fix scalastyle

…13376) * Fix bad delete. Delete the pointed-to handle on cleanup, not the location of the handle itself. Also don't delete it if we didn't set it in the first place. * Remove unusued 'exec' var from MXExecutorBindEX.

* Basic configuration to do static-linking * update build script and place it in the install part * clean up the code further * revert maven into build-from-source * add curl to deps

* Updated the Scala-Readme with upto-date information * Updated the header * Removed redundant build status * Minor formatting changes * Addressed the PR feedback * Added section on Scala training APIs * Removed mention of deprecated Model API

* add script for making all dependencies * tools for building pip package * build scripts for lib and wheel

…ing C++ API (apache#13294) * [MXNET-1083] Add the example to demonstrate the inference workflow using C++ API * [MXNET-1083] Add the example to demonstrate the inference workflow using C++ API * Updated the code to address the review comments. * Added the README file for the folder. * Addressed the review comments * Addressed the review comments to use argmax and default mean values.

* add quantized fully connect support * disable qfc cpu case since s8u8s32 is only supported by MKL BLAS library * retrigger to ci testing * move implementation to cc file and add STORAGE_TYPE_ASSIGN_CHECK * fix typo bug * retrigger the ci test * fix typo bug * retrigger ci * retrigger the ci test * retrigger the ci * retrigger the ci test * retrigger ci test * fix indent issue * retrigger the ci * retrigger the ci test * add verbose message * update log message * using range for loop * using for auto range * enable MKL BLAS ci test * fix typo issue * use TYPE_ASSIGN_CHECK * retrigger the ci

* Revert "remove omp which can cause ssd accuracy variance (apache#13622)" This reverts commit 655f1c6. * Revert "Fix Jetson compilation (apache#13532)" This reverts commit 48e25c4.

* turn on warnings as errors * move warnings as error logic to build_all_version * fix typo in comment * add warning as error option for docs pipeline * bump ci to test again; use this chance to add notes on this feature * fix bugs in image.py docs

…pache#13672) This reverts commit 3433776.

* Speedup and fix bug in dgl_csr_sampling op * Update dgl_graph.cc * simplify functions. * avoid adding nodes in the last level in the queue. * remove a hashtable lookup in neigh_pos. * reduce a hashtable lookup in sub_ver_mp. * merge copying vids and layers. * reduce hashtable lookup when writing to output csr. * fix a bug. * limit the number of sampled vertices. * fix lint. * fix a compile error. * fix compile error. * fix compile. * remove one hashtable lookup per vertex and hashtable iteration. * remove queue. * use vector for neigh_pos. * fix lint * avoid init output arrays. * fix tests. * fix tests. * update docs. * retrigger * retrigger

…ersion (apache#13659)

* merge NEWS.md from 1.4.x to master * NEWS.md backport from v1.4.x to master

…e#13599) * fallback to dense version for grad(reshape), grad(expand_dims) * add _backward_reshape gpu version * reshape test case comments * fix gpu test * remove mkldnn support for _backward_reshape

* Add Flatten before Gemm * ONNX export test: Allow multiple inputs in forward pass * ONNX export: Test for fully connected

…che#12977) * Adding cpp-package directory to the Doxyfile. Updating the index.md file in c++ api directory. * Updating the link to classes in C++ API to point to correct html file. * Updated the links to use relative paths. * Removed the extra slash character in the url * Excluded the 3rdparty folder as per the review comment.

* Added timeout/retry (linear backoff) to docker cache download * Units changed, as time.sleep takes seconds as argument * Improved error handling * Using retry decorator * Added retry decorator to _login_dockerhub method * Fixed wrong import

* Update test_gluon_trainer.py * Update test_gluon_trainer.py * test

* fp16 dot * update mshadow * update mshadow * update mshadow

* fix the quantization script to support python2 * Fix comments, fix similiar issue in imagenet_inference.py

* ONNX test code cleanup * Make tests use the common test case list * Remove import test_cases * Make Gluon backend rep common * Partially enable broadcast tests * Common function to populate tests * Make backend common * test models * Test nodes * ONNX export: Test for fully connected * Edit CI scripts mxnet export test cleanup * Further cleanup backend tests * README * Some corrections * test case format for test_models

* Port of scala infer package to clojure * Add inference examples * Fix project.clj * Update code for integration tests * Address comments and add unit tests * Add specs and simplify interface * Minor nit * Update README

…3728) * tests * remove optimizer and move op to contrib * rename parameter

…e#13654) * Logsoftmax, missing tests * Support multiple outputs in Gluon backendrep * Remove repeated unsqueeze test * Allow multiple output support

* Common test caller * Remove incorrect comment * Make corrections to CI * fix ci script

* ONNX import: Hardmax * Fix lint errors * add github link for issue with reshape

* add clarification for param_dict * more tests for dist kvstore * more unittests * fix a bug * more dist exception test * revert optimizer list * fix bug and comment * fix doc rendering and lint * add invalid sched test * fix website * trigger * update doc

* Reorder module import orders for dist-kvstore * more code comments

* Allow CMake based installation of cpp-package * Add installation of missing nnvm headers * Add documentation as to where public headers will be installed

https://github.com/apache/incubator-mxnet/blob/a38278ddebfcc9459d64237086cd7977ec20c70e/example/image-classification/train_imagenet.py#L42 When I try to train imagenet with this line commented, the train-accuracy reaches 99% while the validation-accuracy is only less than 50% (single machine, 8 GPUs, global batchsize=2048, Resnet50). Absolutely this is overfitting. Then I uncomment this line and try again with the same experiment settings. This time both train and validation accuracy converge to about 70%. Thus, it seems that this data augmentation is pretty important for ImageNet training. Perhaps it will be better to uncomment this as default, so that future developers won't get confused by the over-fit issue.

Patch 1 #1

Patch 1 #1

Commits on Nov 14, 2018

Commits on Nov 15, 2018

Commits on Nov 16, 2018

Commits on Nov 17, 2018

Commits on Nov 19, 2018

Commits on Nov 20, 2018

Commits on Nov 21, 2018

Commits on Nov 22, 2018

Commits on Nov 23, 2018

Commits on Nov 24, 2018

Commits on Nov 25, 2018

Commits on Nov 26, 2018

Commits on Nov 27, 2018

Commits on Nov 28, 2018

Commits on Nov 29, 2018

Commits on Nov 30, 2018

Commits on Dec 1, 2018

Commits on Dec 2, 2018

Commits on Dec 3, 2018

Commits on Dec 4, 2018

Commits on Dec 5, 2018

Commits on Dec 6, 2018

Commits on Dec 7, 2018

Commits on Dec 8, 2018

Commits on Dec 10, 2018

Commits on Dec 11, 2018

Commits on Dec 12, 2018

Commits on Dec 13, 2018

Commits on Dec 14, 2018

Commits on Dec 15, 2018

Commits on Dec 16, 2018

Commits on Dec 17, 2018

Commits on Dec 18, 2018

Commits on Dec 19, 2018

Commits on Dec 20, 2018

Commits on Dec 21, 2018

Commits on Dec 22, 2018

Commits on Dec 23, 2018

Commits on Dec 26, 2018

Commits on Dec 27, 2018

Commits on Dec 28, 2018

Commits on Dec 29, 2018

Commits on Dec 31, 2018

Commits on Jan 2, 2019

Commits on Mar 19, 2019