[RFC][Tracking Issue] CMSIS-NN Integration

[asparkhi]

1. Graph partitioner for CMSIS-NN target [1/10] CMSIS-NN graph partitioner for softmax #8653
2. Code generation using existing BYOC [2/10] CMSIS-NN code generator for softmax #8833
   2a. tvmc support to generate code for [2/10] CMSIS-NN code generator for softmax #8833
3. Moved TIR generator to C++ [3/10] Moved TIR generation from Python to C++ for CMSIS-NN #8951
4. Use of CMSIS-NN data structures while supporting Convolution [4/10] Code generation for Conv2D via CMSIS-NN #9331
   4a. Buffer sizes based on arch extensions [4a/10] [CMSIS-NN] Calculate CMSIS-NN buffer size with respect to architecture extensions #9338
5. Support for Depthwise Convolution [5/10] Code generation for Depthwise Convolution via CMSIS-NN #9409
6. Support for Fully connected [7/10] Code generation for Pooling and Fully Connected via CMSIS-NN #9531
7. Support for Max Pooling [7/10] Code generation for Pooling and Fully Connected via CMSIS-NN #9531
8. Support for Avg Pooling [7/10] Code generation for Pooling and Fully Connected via CMSIS-NN #9531
9. Support for elementwise add and multiply [CMSIS-NN] Initial operator support for Add #9167 and [CMSIS-NN] Initial operator support for Mul #9163
10. Move TIR and C codegen to target hooks [CMSIS-NN] Convert CMSIS-NN to use Target Hooks #9397

[areusch]

apache/tvm-rfcs#15

[Mousius]

All of this seems to have landed, huzzah! Thanks to @ashutosh-arm for coordinating this effort 😸