ci(profiling): temporary, fix#15675
ci(profiling): temporary, fix#15675KowalskiThomas wants to merge 30 commits intokowalski/fix-profiling-workaround-for-on-cpu-task-race-conditionfrom
Conversation
|
|
6294cbb to
53ed501
Compare
Performance SLOsComparing candidate kowalski/temp-attempt-to-fix (712b840) with baseline kowalski/fix-profiling-workaround-for-on-cpu-task-race-condition (974e661) ❌ Test Failures (1 suite)❌ iastaspects - 116/118✅ add_aspectTime: ✅ 18.178µs (SLO: <20.000µs -9.1%) vs baseline: 📈 +22.1% Memory: ✅ 43.018MB (SLO: <43.250MB 🟡 -0.5%) vs baseline: +4.7% ✅ add_inplace_aspectTime: ✅ 14.962µs (SLO: <20.000µs 📉 -25.2%) vs baseline: -0.5% Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 0.339µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -0.6% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 0.546µs (SLO: <10.000µs 📉 -94.5%) vs baseline: +0.6% Memory: ✅ 42.939MB (SLO: <43.000MB 🟡 -0.1%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 17.909µs (SLO: <30.000µs 📉 -40.3%) vs baseline: +0.2% Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8% ✅ bytearray_extend_aspectTime: ✅ 23.690µs (SLO: <30.000µs 📉 -21.0%) vs baseline: ~same Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 2.635µs (SLO: <10.000µs 📉 -73.7%) vs baseline: -0.2% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.7% ✅ bytearray_noaspectTime: ✅ 1.444µs (SLO: <10.000µs 📉 -85.6%) vs baseline: +0.3% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8% ✅ bytes_aspectTime: ✅ 16.802µs (SLO: <20.000µs 📉 -16.0%) vs baseline: +0.2% Memory: ✅ 43.057MB (SLO: <43.000MB +0.1%) vs baseline: +5.0% ✅ bytes_noaspectTime: ✅ 1.397µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.2% Memory: ✅ 42.998MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.7% ✅ bytesio_aspectTime: ✅ 55.200µs (SLO: <70.000µs 📉 -21.1%) vs baseline: +0.5% Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8% ✅ bytesio_noaspectTime: ✅ 3.219µs (SLO: <10.000µs 📉 -67.8%) vs baseline: +1.5% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7% ✅ capitalize_aspectTime: ✅ 14.690µs (SLO: <20.000µs 📉 -26.6%) vs baseline: +0.7% Memory: ✅ 42.979MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.9% ✅ capitalize_noaspectTime: ✅ 2.559µs (SLO: <10.000µs 📉 -74.4%) vs baseline: +0.5% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +4.9% ✅ casefold_aspectTime: ✅ 14.609µs (SLO: <20.000µs 📉 -27.0%) vs baseline: -0.6% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +4.9% ✅ casefold_noaspectTime: ✅ 3.079µs (SLO: <10.000µs 📉 -69.2%) vs baseline: +0.1% Memory: ✅ 42.979MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 15.481µs (SLO: <30.000µs 📉 -48.4%) vs baseline: -0.5% Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +5.1% ✅ decode_noaspectTime: ✅ 1.588µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.5% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9% ✅ encode_aspectTime: ✅ 18.180µs (SLO: <30.000µs 📉 -39.4%) vs baseline: 📈 +22.9% Memory: ✅ 43.057MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 1.458µs (SLO: <10.000µs 📉 -85.4%) vs baseline: -1.6% Memory: ✅ 43.057MB (SLO: <43.000MB +0.1%) vs baseline: +4.8% ✅ format_aspectTime: ✅ 171.170µs (SLO: <200.000µs 📉 -14.4%) vs baseline: ~same Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +4.5% ✅ format_map_aspectTime: ✅ 191.191µs (SLO: <200.000µs -4.4%) vs baseline: -0.1% Memory: ✅ 43.155MB (SLO: <43.500MB 🟡 -0.8%) vs baseline: +5.0% ✅ format_map_noaspectTime: ✅ 3.735µs (SLO: <10.000µs 📉 -62.6%) vs baseline: ~same Memory: ✅ 43.057MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +5.1% ✅ format_noaspectTime: ✅ 3.154µs (SLO: <10.000µs 📉 -68.5%) vs baseline: +0.7% Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +4.9% ✅ index_aspectTime: ✅ 15.234µs (SLO: <20.000µs 📉 -23.8%) vs baseline: -0.5% Memory: ✅ 43.018MB (SLO: <43.250MB 🟡 -0.5%) vs baseline: +4.9% ✅ index_noaspectTime: ✅ 0.466µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +1.3% Memory: ✅ 43.057MB (SLO: <43.000MB +0.1%) vs baseline: +5.1% ✅ join_aspectTime: ✅ 16.941µs (SLO: <20.000µs 📉 -15.3%) vs baseline: +0.3% Memory: ✅ 43.018MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +5.0% ✅ join_noaspectTime: ✅ 1.499µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -0.4% Memory: ✅ 42.959MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 20.819µs (SLO: <30.000µs 📉 -30.6%) vs baseline: +0.7% Memory: ✅ 43.057MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +5.1% ✅ ljust_noaspectTime: ✅ 2.649µs (SLO: <10.000µs 📉 -73.5%) vs baseline: -0.6% Memory: ✅ 43.018MB (SLO: <43.250MB 🟡 -0.5%) vs baseline: +4.7% ✅ lower_aspectTime: ✅ 17.855µs (SLO: <30.000µs 📉 -40.5%) vs baseline: -0.2% Memory: ✅ 43.057MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 2.369µs (SLO: <10.000µs 📉 -76.3%) vs baseline: ~same Memory: ✅ 43.077MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 17.641µs (SLO: <20.000µs 📉 -11.8%) vs baseline: ~same Memory: ✅ 42.939MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +4.6% ✅ lstrip_noaspectTime: ✅ 1.830µs (SLO: <10.000µs 📉 -81.7%) vs baseline: +0.5% Memory: ✅ 42.959MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.8% ✅ modulo_aspectTime: ✅ 166.216µs (SLO: <200.000µs 📉 -16.9%) vs baseline: ~same Memory: ✅ 43.116MB (SLO: <43.500MB 🟡 -0.9%) vs baseline: +5.0% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 174.456µs (SLO: <200.000µs 📉 -12.8%) vs baseline: ~same Memory: ✅ 43.195MB (SLO: <43.500MB 🟡 -0.7%) vs baseline: +5.1% ✅ modulo_aspect_for_bytesTime: ✅ 168.309µs (SLO: <200.000µs 📉 -15.8%) vs baseline: +0.2% Memory: ✅ 43.175MB (SLO: <43.500MB 🟡 -0.7%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 171.765µs (SLO: <200.000µs 📉 -14.1%) vs baseline: ~same Memory: ✅ 43.155MB (SLO: <43.500MB 🟡 -0.8%) vs baseline: +5.1% ✅ modulo_noaspectTime: ✅ 3.709µs (SLO: <10.000µs 📉 -62.9%) vs baseline: -1.1% Memory: ✅ 42.979MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.9% ✅ replace_aspectTime: ✅ 214.870µs (SLO: <300.000µs 📉 -28.4%) vs baseline: ~same Memory: ✅ 43.155MB (SLO: <44.000MB 🟡 -1.9%) vs baseline: +5.1% ✅ replace_noaspectTime: ✅ 5.799µs (SLO: <10.000µs 📉 -42.0%) vs baseline: 📈 +12.1% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +4.7% ✅ repr_aspectTime: ✅ 1.390µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.7% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8% ✅ repr_noaspectTime: ✅ 0.524µs (SLO: <10.000µs 📉 -94.8%) vs baseline: +0.3% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +5.0% ✅ rstrip_aspectTime: ✅ 23.053µs (SLO: <30.000µs 📉 -23.2%) vs baseline: 📈 +20.8% Memory: ✅ 42.998MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.8% ✅ rstrip_noaspectTime: ✅ 1.877µs (SLO: <10.000µs 📉 -81.2%) vs baseline: +1.0% Memory: ✅ 43.018MB (SLO: <43.000MB ~same) vs baseline: +5.0% ❌ slice_aspectTime: ✅ 15.965µs (SLO: <20.000µs 📉 -20.2%) vs baseline: -0.4% Memory: ❌ 43.136MB (SLO: <43.000MB +0.3%) vs baseline: +5.2% ✅ slice_noaspectTime: ✅ 0.601µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -0.4% Memory: ✅ 43.057MB (SLO: <43.000MB +0.1%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 53.565µs (SLO: <80.000µs 📉 -33.0%) vs baseline: -0.3% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ stringio_noaspectTime: ✅ 3.515µs (SLO: <10.000µs 📉 -64.8%) vs baseline: +0.1% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8% ✅ strip_aspectTime: ✅ 17.606µs (SLO: <20.000µs 📉 -12.0%) vs baseline: -0.1% Memory: ✅ 42.998MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.7% ✅ strip_noaspectTime: ✅ 1.820µs (SLO: <10.000µs 📉 -81.8%) vs baseline: +0.3% Memory: ✅ 43.037MB (SLO: <43.000MB ~same) vs baseline: +4.8% ✅ swapcase_aspectTime: ✅ 18.246µs (SLO: <30.000µs 📉 -39.2%) vs baseline: -0.7% Memory: ✅ 42.939MB (SLO: <43.000MB 🟡 -0.1%) vs baseline: +4.6% ✅ swapcase_noaspectTime: ✅ 2.735µs (SLO: <10.000µs 📉 -72.6%) vs baseline: ~same Memory: ✅ 43.057MB (SLO: <43.000MB +0.1%) vs baseline: +5.0% ✅ title_aspectTime: ✅ 18.155µs (SLO: <20.000µs -9.2%) vs baseline: -0.2% Memory: ✅ 42.939MB (SLO: <43.000MB 🟡 -0.1%) vs baseline: +4.6% ✅ title_noaspectTime: ✅ 2.637µs (SLO: <10.000µs 📉 -73.6%) vs baseline: ~same Memory: ✅ 43.037MB (SLO: <43.000MB ~same) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 20.298µs (SLO: <30.000µs 📉 -32.3%) vs baseline: -0.3% Memory: ✅ 42.979MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.7% ✅ translate_noaspectTime: ✅ 4.318µs (SLO: <10.000µs 📉 -56.8%) vs baseline: +1.0% Memory: ✅ 43.037MB (SLO: <43.000MB ~same) vs baseline: +4.9% ❌ upper_aspectTime: ✅ 17.951µs (SLO: <30.000µs 📉 -40.2%) vs baseline: +0.7% Memory: ❌ 43.096MB (SLO: <43.000MB +0.2%) vs baseline: +5.1% ✅ upper_noaspectTime: ✅ 2.370µs (SLO: <10.000µs 📉 -76.3%) vs baseline: -0.7% Memory: ✅ 42.959MB (SLO: <43.000MB 🟡 ~same) vs baseline: +4.8% 📈 Performance Regressions (2 suites)📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 5.192µs (SLO: <10.000µs 📉 -48.1%) vs baseline: 📈 +23.1% Memory: ✅ 41.327MB (SLO: <43.000MB -3.9%) vs baseline: +4.8% ✅ ospathbasename_noaspectTime: ✅ 4.292µs (SLO: <10.000µs 📉 -57.1%) vs baseline: ~same Memory: ✅ 41.386MB (SLO: <43.000MB -3.8%) vs baseline: +4.7% ✅ ospathjoin_aspectTime: ✅ 6.102µs (SLO: <10.000µs 📉 -39.0%) vs baseline: -0.9% Memory: ✅ 41.425MB (SLO: <43.000MB -3.7%) vs baseline: +4.8% ✅ ospathjoin_noaspectTime: ✅ 6.186µs (SLO: <10.000µs 📉 -38.1%) vs baseline: -0.7% Memory: ✅ 41.386MB (SLO: <43.000MB -3.8%) vs baseline: +4.9% ✅ ospathnormcase_aspectTime: ✅ 3.533µs (SLO: <10.000µs 📉 -64.7%) vs baseline: +1.8% Memory: ✅ 41.543MB (SLO: <43.000MB -3.4%) vs baseline: +5.2% ✅ ospathnormcase_noaspectTime: ✅ 3.581µs (SLO: <10.000µs 📉 -64.2%) vs baseline: -0.5% Memory: ✅ 41.504MB (SLO: <43.000MB -3.5%) vs baseline: +5.1% ✅ ospathsplit_aspectTime: ✅ 4.846µs (SLO: <10.000µs 📉 -51.5%) vs baseline: -0.1% Memory: ✅ 41.425MB (SLO: <43.000MB -3.7%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 4.941µs (SLO: <10.000µs 📉 -50.6%) vs baseline: +0.5% Memory: ✅ 41.425MB (SLO: <43.000MB -3.7%) vs baseline: +4.9% ✅ ospathsplitdrive_aspectTime: ✅ 3.774µs (SLO: <10.000µs 📉 -62.3%) vs baseline: ~same Memory: ✅ 41.366MB (SLO: <43.000MB -3.8%) vs baseline: +4.6% ✅ ospathsplitdrive_noaspectTime: ✅ 0.751µs (SLO: <10.000µs 📉 -92.5%) vs baseline: -0.7% Memory: ✅ 41.445MB (SLO: <43.000MB -3.6%) vs baseline: +5.0% ✅ ospathsplitext_aspectTime: ✅ 4.636µs (SLO: <10.000µs 📉 -53.6%) vs baseline: ~same Memory: ✅ 41.406MB (SLO: <43.000MB -3.7%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 4.746µs (SLO: <10.000µs 📉 -52.5%) vs baseline: +1.4% Memory: ✅ 41.386MB (SLO: <43.000MB -3.8%) vs baseline: +4.4% 📈 iastaspectssplit - 12/12✅ rsplit_aspectTime: ✅ 1.712µs (SLO: <10.000µs 📉 -82.9%) vs baseline: 📈 +10.2% Memory: ✅ 41.406MB (SLO: <43.000MB -3.7%) vs baseline: +5.0% ✅ rsplit_noaspectTime: ✅ 1.623µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.8% Memory: ✅ 41.366MB (SLO: <43.000MB -3.8%) vs baseline: +4.6% ✅ split_aspectTime: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.9% Memory: ✅ 41.484MB (SLO: <43.000MB -3.5%) vs baseline: +5.1% ✅ split_noaspectTime: ✅ 1.624µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.3% Memory: ✅ 41.484MB (SLO: <43.000MB -3.5%) vs baseline: +4.8% ✅ splitlines_aspectTime: ✅ 1.508µs (SLO: <10.000µs 📉 -84.9%) vs baseline: -2.3% Memory: ✅ 41.504MB (SLO: <43.000MB -3.5%) vs baseline: +5.0% ✅ splitlines_noaspectTime: ✅ 1.567µs (SLO: <10.000µs 📉 -84.3%) vs baseline: -0.1% Memory: ✅ 41.386MB (SLO: <43.000MB -3.8%) vs baseline: +4.5% 🟡 Near SLO Breach (16 suites)🟡 coreapiscenario - 10/10 (1 unstable)
|
53ed501 to
b01c5c2
Compare
f8f2d14 to
974e661
Compare
… temp! attempt to fix
… fixup! temp! attempt to fix
… fixup! fixup! temp! attempt to fix
… fixup! fixup! fixup! temp! attempt to fix
… fixup! fixup! fixup! fixup! temp! attempt to fix
… fixup! fixup! fixup! fixup! fixup! temp! attempt to fix
|
/gitlab estimate-cost |
|
View all feedbacks in Devflow UI.
Estimated cost is $28.05 for ci(profiling): temporary, fix (cumulated CI duration: -219895h38m13.843206144s) |
… fixup! fixup! fixup! fixup! fixup! fixup! temp! attempt to fix
718f77c to
bab34b3
Compare
Description
Testing
Risks
Additional Notes