-
Notifications
You must be signed in to change notification settings - Fork 300
Closed as not planned
Labels
Description
Benchmark comparison has identified performance shifts at:
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: 7bca716
Performance shifts
| Change | Before [836e179a] <main~6> | After [7bca716b] <main~5> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|------------------------------------------------------------------------------------------|
| + | 549±0.8k | 808±0.6k | 1.47 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) |
Full benchmark results
Benchmarks that have stayed the same:
| Change | Before [836e179a] <main~6> | After [7bca716b] <main~5> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|---------------------------------------------------------------------------------------------|
| | 60.5±1ms | 59.2±0.8ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) |
| | 61.1±1ms | 59.9±1ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) |
| | 214±3ms | 212±3ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) |
| | 214±3ms | 213±2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) |
| | 39.0±0.4ms | 38.4±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| | 39.5±0.6ms | 39.3±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) |
| | 38.6±0.3ms | 38.6±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) |
| | 39.9±0.6ms | 39.5±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) |
| | 51.8±1ms | 51.1±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) |
| | 52.3±0.8ms | 52.2±0.8ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) |
| | 136±1ms | 137±2ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) |
| | 138±1ms | 136±2ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) |
| | 56.2±1ms | 56.8±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) |
| | 57.4±0.8ms | 57.7±0.9ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) |
| | 38.7±0.4ms | 38.3±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) |
| | 39.9±0.4ms | 39.3±0.5ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) |
| | 51.3±1ms | 50.6±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) |
| | 52.4±0.8ms | 52.0±0.9ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) |
| | 1.08±0.01s | 1.08±0.01s | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) |
| | 1.07±0.01s | 1.09±0.01s | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) |
| | 491±10ms | 500±20ms | 1.02 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| | 519±20ms | 509±10ms | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| | 37.1±0.4ms | 37.1±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| | 38.0±0.4ms | 37.8±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| | 69.0±0.9ms | 68.3±1ms | 0.99 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) |
| | 69.6±0.8ms | 69.8±0.9ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) |
| | 70.1±0.8ms | 71.0±1ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) |
| | 71.4±0.6ms | 71.7±1ms | 1.00 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) |
| | 66.2±0.8ms | 66.7±0.9ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) |
| | 66.7±0.7ms | 67.6±3ms | 1.01 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) |
| | 25.6±0.3ms | 25.5±0.4ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| | 29.7±0.2ms | 29.5±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| | 148±1ms | 149±3ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) |
| | 164±3ms | 165±2ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) |
| | 23.6±0.2ms | 23.6±1ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| | 27.8±0.2ms | 27.9±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| | 23.5±0.4ms | 23.4±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| | 27.8±0.5ms | 27.6±0.4ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| | 24.4±0.5ms | 24.4±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| | 28.4±0.3ms | 28.3±0.3ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| | 38.0±0.5ms | 37.6±1ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| | 41.8±0.6ms | 42.7±0.7ms | 1.02 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) |
| | 25.0±0.5ms | 24.8±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| | 29.1±0.3ms | 29.0±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| | 25.2±0.5ms | 24.7±0.3ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| | 29.2±0.6ms | 29.1±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| | 24.2±0.6ms | 24.4±0.6ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| | 28.5±0.3ms | 28.3±0.6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| | 541±4ms | 543±6ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) |
| | 548±5ms | 544±3ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) |
| | 163±2ms | 163±0.7ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) |
| | 182±1ms | 182±2ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) |
| | 23.2±0.3ms | 23.1±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| | 27.3±0.2ms | 27.3±0.2ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| | 26.6±0.2ms | 26.5±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| | 30.8±0.5ms | 31.0±0.5ms | 1.01 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| | 26.6±0.5ms | 26.6±0.5ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| | 30.6±0.3ms | 30.7±0.4ms | 1.00 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| | 25.6±0.5ms | 25.4±0.5ms | 0.99 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| | 30.2±0.4ms | 29.6±0.2ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| | 93.8±1ms | 92.6±0.7ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) |
| | 94.2±0.7ms | 93.7±0.8ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) |
| | 108±1ms | 106±0.9ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) |
| | 107±0.9ms | 108±1ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) |
| | 63.8±0.8ms | 64.0±1ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) |
| | 65.1±0.5ms | 64.8±1ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) |
| | 31.2±0.7ms | 30.7±0.5ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| | 35.1±0.6ms | 34.6±0.9ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| | 32.9±1ms | 32.9±0.4ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| | 37.0±0.9ms | 36.7±0.5ms | 0.99 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| | 26.7±0.4ms | 26.2±0.3ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| | 31.0±0.6ms | 30.5±0.4ms | 0.98 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
| | 331±4ms | 336±2ms | 1.01 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) |
| | 349±4ms | 348±3ms | 1.00 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) |
| | 1.13±0.01ms | 1.12±0.01ms | 0.98 | cube.CubeCreation.time_create(False, 'construct') |
| | 405±5μs | 400±4μs | 0.99 | cube.CubeCreation.time_create(False, 'instantiate') |
| | 961±20μs | 938±10μs | 0.98 | cube.CubeCreation.time_create(True, 'construct') |
| | 586±6μs | 574±5μs | 0.98 | cube.CubeCreation.time_create(True, 'instantiate') |
| | 235±2ms | 235±3ms | 1.00 | cube.CubeEquality.time_equality(False, False, 'all_equal') |
| | 127±2ms | 126±2ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'coord_inequality') |
| | 260±2ms | 258±3ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'data_inequality') |
| | 16.6±0.3μs | 17.0±0.3μs | 1.02 | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') |
| | 334±5ms | 336±4ms | 1.01 | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| | 228±2ms | 229±3ms | 1.00 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| | 363±4ms | 366±6ms | 1.01 | cube.CubeEquality.time_equality(False, True, 'data_inequality') |
| | 17.4±0.2μs | 17.2±0.3μs | 0.98 | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') |
| | 236±3ms | 236±2ms | 1.00 | cube.CubeEquality.time_equality(True, False, 'all_equal') |
| | 128±2ms | 128±1ms | 1.00 | cube.CubeEquality.time_equality(True, False, 'coord_inequality') |
| | 261±3ms | 259±3ms | 0.99 | cube.CubeEquality.time_equality(True, False, 'data_inequality') |
| | 52.9±0.3μs | 53.2±0.7μs | 1.01 | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') |
| | 337±4ms | 336±3ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| | 228±2ms | 229±2ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| | 361±3ms | 361±4ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| | 54.9±0.6μs | 54.7±0.5μs | 1.00 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| | 779±3μs | 796±7μs | 1.02 | import_iris.Iris.time__concatenate |
| | 181±2μs | 179±3μs | 0.99 | import_iris.Iris.time__constraints |
| | 111±1μs | 109±1μs | 0.98 | import_iris.Iris.time__data_manager |
| | 94.4±0.5μs | 93.0±0.7μs | 0.99 | import_iris.Iris.time__deprecation |
| | 138±1μs | 136±0.8μs | 0.98 | import_iris.Iris.time__lazy_data |
| | 900±7μs | 920±10μs | 1.02 | import_iris.Iris.time__merge |
| | 78.4±0.4μs | 76.7±1μs | 0.98 | import_iris.Iris.time__representation |
| | 590±5μs | 597±6μs | 1.01 | import_iris.Iris.time_analysis |
| | 145±3μs | 140±1μs | 0.96 | import_iris.Iris.time_analysis__area_weighted |
| | 111±0.7μs | 110±1μs | 0.99 | import_iris.Iris.time_analysis__grid_angles |
| | 243±3μs | 242±2μs | 1.00 | import_iris.Iris.time_analysis__interpolation |
| | 188±2μs | 190±1μs | 1.01 | import_iris.Iris.time_analysis__regrid |
| | 114±2μs | 110±0.5μs | 0.97 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 141±2μs | 140±2μs | 0.99 | import_iris.Iris.time_analysis_calculus |
| | 340±3μs | 338±7μs | 0.99 | import_iris.Iris.time_analysis_cartography |
| | 95.7±2μs | 94.1±0.8μs | 0.98 | import_iris.Iris.time_analysis_geomerty |
| | 222±5μs | 216±2μs | 0.98 | import_iris.Iris.time_analysis_maths |
| | 98.5±0.7μs | 96.9±1μs | 0.98 | import_iris.Iris.time_analysis_stats |
| | 175±2μs | 173±1μs | 0.99 | import_iris.Iris.time_analysis_trajectory |
| | 304±6μs | 304±2μs | 1.00 | import_iris.Iris.time_aux_factory |
| | 85.0±1μs | 84.2±0.8μs | 0.99 | import_iris.Iris.time_common |
| | 163±2μs | 163±1μs | 1.00 | import_iris.Iris.time_common_lenient |
| | 1.32±0.01ms | 1.34±0.01ms | 1.02 | import_iris.Iris.time_common_metadata |
| | 139±0.8μs | 138±0.5μs | 0.99 | import_iris.Iris.time_common_mixin |
| | 1.18±0.01ms | 1.19±0.01ms | 1.01 | import_iris.Iris.time_common_resolve |
| | 200±1μs | 199±4μs | 0.99 | import_iris.Iris.time_config |
| | 126±1μs | 125±0.9μs | 0.99 | import_iris.Iris.time_coord_categorisation |
| | 360±3μs | 362±3μs | 1.01 | import_iris.Iris.time_coord_systems |
| | 738±5μs | 751±8μs | 1.02 | import_iris.Iris.time_coords |
| | 640±7μs | 658±30μs | 1.03 | import_iris.Iris.time_cube |
| | 226±2μs | 228±2μs | 1.01 | import_iris.Iris.time_exceptions |
| | 78.4±0.5μs | 77.0±0.9μs | 0.98 | import_iris.Iris.time_experimental |
| | 184±2μs | 184±1μs | 1.00 | import_iris.Iris.time_fileformats |
| | 251±2μs | 252±3μs | 1.00 | import_iris.Iris.time_fileformats__ff |
| | 2.76±0.02ms | 2.75±0.02ms | 1.00 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 79.9±0.7μs | 79.3±0.4μs | 0.99 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 115±0.7μs | 114±0.7μs | 0.99 | import_iris.Iris.time_fileformats_abf |
| | 410±8μs | 412±5μs | 1.00 | import_iris.Iris.time_fileformats_cf |
| | 5.26±0.08ms | 5.31±0.04ms | 1.01 | import_iris.Iris.time_fileformats_dot |
| | 77.0±0.5μs | 74.0±0.9μs | 0.96 | import_iris.Iris.time_fileformats_name |
| | 259±2μs | 257±2μs | 0.99 | import_iris.Iris.time_fileformats_name_loaders |
| | 121±2μs | 119±0.7μs | 0.98 | import_iris.Iris.time_fileformats_netcdf |
| | 125±2μs | 124±0.8μs | 0.99 | import_iris.Iris.time_fileformats_nimrod |
| | 213±4μs | 211±2μs | 0.99 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 784±8μs | 792±4μs | 1.01 | import_iris.Iris.time_fileformats_pp |
| | 183±2μs | 183±2μs | 1.00 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 138±2μs | 136±2μs | 0.99 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 547±10μs | 552±2μs | 1.01 | import_iris.Iris.time_fileformats_rules |
| | 223±5μs | 218±1μs | 0.98 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 85.1±0.3μs | 83.4±0.5μs | 0.98 | import_iris.Iris.time_fileformats_um |
| | 160±2μs | 160±1μs | 1.00 | import_iris.Iris.time_fileformats_um__fast_load |
| | 139±2μs | 138±1μs | 0.99 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 77.1±0.3μs | 76.2±0.6μs | 0.99 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 83.3±0.4μs | 82.1±0.5μs | 0.99 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 1.01±0.01ms | 1.00±0ms | 0.99 | import_iris.Iris.time_fileformats_um_cf_map |
| | 138±1μs | 136±0.8μs | 0.99 | import_iris.Iris.time_io |
| | 172±1μs | 172±0.7μs | 1.00 | import_iris.Iris.time_io_format_picker |
| | 288±2μs | 287±2μs | 0.99 | import_iris.Iris.time_iris |
| | 128±0.7μs | 129±1μs | 1.01 | import_iris.Iris.time_iterate |
| | 8.23±0.03ms | 8.26±0.02ms | 1.00 | import_iris.Iris.time_palette |
| | 1.94±0.02ms | 1.90±0.01ms | 0.98 | import_iris.Iris.time_plot |
| | 106±0.7μs | 104±0.5μs | 0.98 | import_iris.Iris.time_quickplot |
| | 2.24±0.01ms | 2.24±0ms | 1.00 | import_iris.Iris.time_std_names |
| | 1.76±0.01ms | 1.77±0.03ms | 1.01 | import_iris.Iris.time_symbols |
| | 14.7±1ms | 12.7±1ms | 0.87 | import_iris.Iris.time_tests |
| | 261±2μs | 252±1μs | 0.97 | import_iris.Iris.time_third_party_cartopy |
| | 4.73±0.05ms | 4.73±0.03ms | 1.00 | import_iris.Iris.time_third_party_cf_units |
| | 121±0.8μs | 119±0.8μs | 0.98 | import_iris.Iris.time_third_party_cftime |
| | 2.84±0.02ms | 2.83±0.03ms | 1.00 | import_iris.Iris.time_third_party_matplotlib |
| | 1.54±0.01ms | 1.55±0.02ms | 1.01 | import_iris.Iris.time_third_party_numpy |
| | 175±3μs | 172±3μs | 0.98 | import_iris.Iris.time_third_party_scipy |
| | 101±1μs | 99.8±1μs | 0.99 | import_iris.Iris.time_time |
| | 328±4μs | 334±5μs | 1.02 | import_iris.Iris.time_util |
| | 71.2±0.6μs | 72.8±0.8μs | 1.02 | iterate.IZip.time_izip |
| | 9.81±0.04ms | 9.76±0.09ms | 0.99 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| | 26.8±0.3ms | 27.2±0.3ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| | 9.95±0.08ms | 9.88±0.07ms | 0.99 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| | 9.84±0.05ms | 9.85±0.08ms | 1.00 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| | 22.3±0.07ms | 22.3±0.2ms | 1.00 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| | 9.89±0.03ms | 9.84±0.08ms | 0.99 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| | 1.54±0.03s | 1.52±0.01s | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| | 22.6±0.2ms | 22.4±0.3ms | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| | 1.57±0.01s | 1.56±0.02s | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| | 1.55±0.01s | 1.52±0.02s | 0.98 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| | 22.7±0.1ms | 22.5±0.2ms | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| | 1.56±0.02s | 1.55±0.02s | 0.99 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| | 5.08±0.03ms | 5.01±0.04ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| | 21.0±0.1ms | 20.8±0.2ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| | 5.07±0.05ms | 5.00±0.03ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| | 5.05±0.02ms | 5.06±0.08ms | 1.00 | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| | 20.8±0.1ms | 21.1±0.2ms | 1.01 | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| | 5.06±0.02ms | 5.03±0.02ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| | 28.9±3ms | 24.6±3ms | 0.85 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| | 19.7±0.4ms | 19.4±0.3ms | 0.98 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| | 13.6±3ms | 13.0±1ms | 0.96 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| | 26.4±2ms | 26.4±2ms | 1.00 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| | 79.3±0.4ms | 79.4±0.5ms | 1.00 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| | 27.5±2ms | 25.8±1ms | 0.94 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| | 483±4ms | 483±4ms | 1.00 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| | 2.80±0.08ms | 2.80±0.08ms | 1.00 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| | 484±3ms | 483±3ms | 1.00 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| | 497±4ms | 492±3ms | 0.99 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| | 2.88±0.09ms | 2.93±0.07ms | 1.02 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| | 497±4ms | 491±3ms | 0.99 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| | 1.68±0.08ms | 1.69±0.07ms | 1.01 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| | 2.88±0.06ms | 2.91±0.1ms | 1.01 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| | 1.71±0.1ms | 1.72±0.07ms | 1.00 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| | 1.73±0.08ms | 1.69±0.08ms | 0.98 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| | 2.96±0.07ms | 2.91±0.08ms | 0.98 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| | 1.73±0.06ms | 1.71±0.1ms | 0.98 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| | 363±3ms | 360±4ms | 0.99 | load.ManyVars.time_many_var_load |
| | 9.95±0.07ms | 9.90±0.07ms | 1.00 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| | 10.0±0.1ms | 10.1±0.2ms | 1.00 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| | 1.56±0.01s | 1.54±0.01s | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| | 1.58±0.01s | 1.58±0.01s | 1.00 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| | 5.12±0.02ms | 5.07±0.08ms | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| | 5.11±0.04ms | 5.05±0.07ms | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| | 9.01±0.1ms | 8.95±0.07ms | 0.99 | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| | 5.86±0.03ms | 5.83±0.08ms | 1.00 | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| | 1.53±0.01s | 1.52±0.02s | 1.00 | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| | 531±4ms | 524±6ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| | 4.30±0.1ms | 4.25±0.06ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| | 4.15±0.02ms | 4.11±0.06ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| | 163±0.5ms | 162±0.6ms | 1.00 | load.TimeConstraint.time_time_constraint(20, 'FF') |
| | 24.3±0.3ms | 24.2±0.1ms | 0.99 | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| | 164±1ms | 165±2ms | 1.00 | load.TimeConstraint.time_time_constraint(20, 'PP') |
| | 32.4±0.08ms | 32.3±0.3ms | 1.00 | load.TimeConstraint.time_time_constraint(3, 'FF') |
| | 23.8±0.2ms | 23.7±0.2ms | 1.00 | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| | 32.6±0.2ms | 32.5±0.2ms | 1.00 | load.TimeConstraint.time_time_constraint(3, 'PP') |
| | 19.0±0.3ms | 19.0±0.4ms | 1.00 | load.ugrid.BasicLoading.time_load_file(1) |
| | 55.5±1ms | 55.7±1ms | 1.00 | load.ugrid.BasicLoading.time_load_file(200000) |
| | 14.8±0.2ms | 14.9±0.4ms | 1.01 | load.ugrid.BasicLoading.time_load_mesh(1) |
| | 24.6±0.4ms | 25.3±0.9ms | 1.03 | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | 19.3±0.3ms | 19.4±0.3ms | 1.00 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| | 23.3±0.4ms | 23.9±0.4ms | 1.03 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| | 14.5±0.2ms | 14.6±0.3ms | 1.00 | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | 18.9±0.5ms | 19.1±0.5ms | 1.01 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | 19.9±0.1ms | 20.1±0.5ms | 1.01 | load.ugrid.Callback.time_load_file_callback(1) |
| | 65.8±0.9ms | 65.1±1ms | 0.99 | load.ugrid.Callback.time_load_file_callback(200000) |
| | 19.9±0.3ms | 19.9±0.2ms | 1.00 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| | 25.3±0.5ms | 25.5±0.4ms | 1.01 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| | 2.80±0.08ms | 2.74±0.09ms | 0.98 | load.ugrid.DataRealisation.time_realise_data(10000) |
| | 4.72±0.3ms | 4.79±0.07ms | 1.02 | load.ugrid.DataRealisation.time_realise_data(200000) |
| | 34.9±1ms | 35.4±0.9ms | 1.01 | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | 777±8ms | 781±4ms | 1.01 | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | 430±5ms | 426±3ms | 0.99 | merge_concat.Concatenate.time_concatenate(False) |
| | 428±3ms | 425±3ms | 0.99 | merge_concat.Concatenate.time_concatenate(True) |
| | 109±0.4M | 109±0.4M | 1.00 | merge_concat.Concatenate.tracemalloc_concatenate(False) |
| | 109±0.4M | 109±0.4M | 1.00 | merge_concat.Concatenate.tracemalloc_concatenate(True) |
| | 57.0±0.5ms | 56.8±0.5ms | 1.00 | merge_concat.Merge.time_merge |
| | 758±200k | 1.61±0.4M | ~2.13 | merge_concat.Merge.tracemalloc_merge |
| | 468±5ns | 456±3ns | 0.97 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| | 214±2ms | 213±2ms | 0.99 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| | 659±2k | 659±1k | 1.00 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(50) |
| | 60.1±0M | 60.1±0M | 1.00 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(500) |
| | 16.9±0.2ms | 16.8±0.3ms | 0.99 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| | 18.6±0.4ms | 18.7±0.3ms | 1.01 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| | 12.4±0M | 12.7±0M | 1.02 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(500) |
| | 118±2ms | 119±1ms | 1.00 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| | 678±5ms | 674±5ms | 0.99 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| | 1.22±0.03M | 1.21±0.02M | 0.99 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(50) |
| | 96.3±0.02M | 96.2±0.03M | 1.00 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(500) |
| | 76.5±0.9ms | 76.3±0.9ms | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) |
| | 625±4ms | 622±8ms | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) |
| | 1.18±0.01M | 1.18±0.01M | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(50) |
| | 96.2±0.01M | 96.2±0.02M | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(500) |
| | 2.1752849999999997 | 2.1752849999999997 | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| | 216.01528499999998 | 216.01528499999998 | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| | 6.41±0.03ms | 6.46±0.07ms | 1.01 | plot.AuxSort.time_aux_sort |
| | 78.2±4ms | 80.9±4ms | 1.03 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 136±3M | 136±3M | 1.00 | regridding.CurvilinearRegridding.tracemalloc_regrid_pic |
| | 100±0.8ms | 99.9±0.4ms | 1.00 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 48.9±0.9ms | 49.0±1ms | 1.00 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 106±0.06M | 106±0.03M | 1.00 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w |
| | 147±0.02M | 147±0.02M | 1.00 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w_new_grid |
| | 4.51±0.05ms | 4.46±0.06ms | 0.99 | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | 81.1±2ms | 79.5±0.8ms | 0.98 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| | 52.2±0.9ms | 53.0±1ms | 1.02 | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | 581±3ms | 578±3ms | 0.99 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| | 91.9±1ns | 90.3±1ns | 0.98 | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | 62.6±0.6ms | 62.0±0.7ms | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| | 91.7±1ns | 89.2±1ns | 0.97 | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | 509±3ms | 510±3ms | 1.00 | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | 28.4±0.06k | 28.9±0.06k | 1.02 | save.NetcdfSave.tracemalloc_netcdf_save(50, False) |
| | 1.7±0.2M | 1.64±0.2M | 0.96 | save.NetcdfSave.tracemalloc_netcdf_save(50, True) |
| | 28.4±0.06k | 28.9±0.07k | 1.02 | save.NetcdfSave.tracemalloc_netcdf_save(600, False) |
| | 208±20M | 216±20M | 1.04 | save.NetcdfSave.tracemalloc_netcdf_save(600, True) |
| | 42.4±0.5ms | 41.9±0.4ms | 0.99 | stats.PearsonR.time_lazy |
| | 8.91±0.2ms | 8.95±0.2ms | 1.01 | stats.PearsonR.time_real |
| | 24.4±2M | 22.8±1M | 0.94 | stats.PearsonR.tracemalloc_lazy |
| | 18.4±0.01M | 18.4±0.01M | 1.00 | stats.PearsonR.tracemalloc_real |
| | 23.1±0.7ms | 23.3±0.7ms | 1.01 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 60.8±0.4ms | 60.3±0.6ms | 0.99 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
| | 23.3±0.01M | 23.3±0.01M | 1.00 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_linear |
| | 12.1±0.05M | 12.1±0.03M | 1.00 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [836e179a] <main~6> | After [7bca716b] <main~5> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|------------------------------------------------------------------------------------------|
| + | 549±0.8k | 808±0.6k | 1.47 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) |
Generated by GHA run 11787490257