Add performance tests

[stephenworsley]

Add performance tests for preparing a regridder to the CI performance tests and add long running performance tests (with the ability to run them separately via nox) which test the scalability of preparing and performing with real and lazy data for all the regridders.

[codecov]

Codecov Report

Merging #117 (488a1a0) into unstructured_scheme (582502e) will not change coverage.
The diff coverage is n/a.

@@                 Coverage Diff                  @@
##           unstructured_scheme     #117   +/-   ##
====================================================
  Coverage                99.48%   99.48%           
====================================================
  Files                       24       24           
  Lines                     1550     1550           
====================================================
  Hits                      1542     1542           
  Misses                       8        8           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 582502e...488a1a0. Read the comment docs.

[trexfeathers]

Seems like a good pattern to me 👍

[trexfeathers]

@stephenworsley this reads beautifully clearly! You've made sure that the only thing that changes is the scaling parameter, even between benchmark classes - very nice.

I know this is still in progress, but I have a few more comments for the meantime.

[stephenworsley]

When these benchmarks are run on my machine (via nox --session="benchmarks(long snapshot)") we get the following results

[ 55.56%] ··· ======== ===========
               height             
              -------- -----------
                100      517±40ms 
                200      621±60ms 
                400      974±90ms 
                600     1.50±0.1s 
                800     2.05±0.1s 
                1000    2.62±0.4s 
              ======== ===========

[ 61.11%] ··· long.esmf_regridder.PerformScalabilityGridToGrid.time_perform                                                                                                                         ok
[ 61.11%] ··· ======== ============
               height              
              -------- ------------
                100      181±10ms  
                200      415±40ms  
                400      917±50ms  
                600     1.74±0.1s  
                800     2.53±0.1s  
                1000    3.37±0.03s 
              ======== ============

[ 66.67%] ··· long.esmf_regridder.PerformScalabilityGridToMesh.time_lazy_perform                                                                                                                    ok
[ 66.67%] ··· ======== ===========
               height             
              -------- -----------
                100     706±200ms 
                200     935±100ms 
                400     1.37±0.2s 
                600     2.38±0.4s 
                800     3.15±0.5s 
                1000    4.50±0.6s 
              ======== ===========

[ 72.22%] ··· long.esmf_regridder.PerformScalabilityGridToMesh.time_perform                                                                                                                         ok
[ 72.22%] ··· ======== ===========
               height             
              -------- -----------
                100      207±40ms 
                200      400±70ms 
                400     858±200ms 
                600     1.70±0.4s 
                800     2.97±0.5s 
                1000    3.98±0.7s 
              ======== ===========

[ 77.78%] ··· long.esmf_regridder.PerformScalabilityMeshToGrid.time_lazy_perform                                                                                                                    ok
[ 77.78%] ··· ======== ============
               height              
              -------- ------------
                100      363±80ms  
                200      425±90ms  
                400     815±100ms  
                600     1.21±0.05s 
                800     1.53±0.1s  
                1000    2.08±0.2s  
              ======== ============

[ 83.33%] ··· long.esmf_regridder.PerformScalabilityMeshToGrid.time_perform                                                                                                                         ok
[ 83.33%] ··· ======== ============
               height              
              -------- ------------
                100      83.7±6ms  
                200      192±9ms   
                400      452±20ms  
                600      704±20ms  
                800      956±10ms  
                1000    1.26±0.05s 
              ======== ============

[ 88.89%] ··· long.esmf_regridder.PrepareScalabilityGridToGrid.time_prepare                                                                                                                 1/6 failed
[ 88.89%] ··· ============ ===========
               grid width             
              ------------ -----------
                   50        147±10ms 
                  100        589±20ms 
                  200       2.48±0.1s 
                  400       11.0±0.4s 
                  600       25.6±0.4s 
                  800         failed  
              ============ ===========

[ 94.44%] ··· long.esmf_regridder.PrepareScalabilityGridToMesh.time_prepare                                                                                                                 1/6 failed
[ 94.44%] ··· ============ ============
               grid width              
              ------------ ------------
                   50        141±5ms   
                  100        584±8ms   
                  200       2.59±0.05s 
                  400       11.7±0.1s  
                  600       27.0±0.01s 
                  800         failed   
              ============ ============

[100.00%] ··· long.esmf_regridder.PrepareScalabilityMeshToGrid.time_prepare                                                                                                                 2/6 failed
[100.00%] ··· ============ ===========
               grid width             
              ------------ -----------
                   50        168±4ms  
                  100        772±20ms 
                  200       3.24±0.1s 
                  400       13.9±0.3s 
                  600         failed  
                  800         failed  
              ============ ===========

[trexfeathers]

When these benchmarks are run on my machine (via nox --session="benchmarks(long snapshot)") we get the following results

I have successfully replicated.