Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci(runner): Add benchmark example and print benchmark results #512

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

ci(runner): Add benchmark example and print benchmark results #512

wants to merge 2 commits into from

Conversation

espzav
Copy link
Collaborator

@espzav espzav commented Feb 18, 2025 •
edited
Loading

ESP-BSP Pull Request checklist

  • Version of modified component bumped
  • CI passing

Change description

  • Added new example exactly for benchmark
  • CI run benchmark example, compare results with master and print results to comment (with diff)
  • For run benchmark, there is needed to add label "Run benchmark"

@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from d8b355f to 5c6f8f9 Compare February 18, 2025 13:54
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 18, 2025 •
edited
Loading

Benchmark for BOARD esp32_p4_function_ev_board

DATE: 24.02.2025 07:33

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 28% 27 6 0 6
Moving wallpaper 37% 28 12 11 1
Single rectangle 4% 28 0 0 0
Multiple rectangles 12% 28 4 2 2
Multiple RGB images 46% (-2) 28 16 (+1) 13 3 (+1)
Multiple ARGB images 96% (+1) 24 34 (-1) 32 (-1) 2
Rotated ARGB images 99% 3 250 (+1) 249 (+3) 1 (-2)
Multiple labels 85% (+3) 28 24 (-2) 24 (-1) 0 (-1)
Screen sized text 6% (+1) 28 1 (-2) 1 (-2) 0
Multiple arcs 69% (+1) 28 21 (-1) 19 2 (-1)
Containers 46% (+2) 28 11 (-1) 11 (-1) 0
Containers with overlay 93% (-1) 17 51 (+1) 48 3 (+1)
Containers with opa 65% (-2) 28 20 (-1) 20 (-1) 0
Containers with opa_layer 96% (-1) 10 83 (+1) 81 2 (+1)
Containers with scrolling 99% 18 51 49 2
Widgets demo 98% 17 (+1) 52 (-2) 50 (-2) 2
All scenes avg. 61% 23 (+1) 39 38 1

Benchmark for BOARD esp32_s3_eye

DATE: 24.02.2025 07:37

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 21% 27 3 2 1
Moving wallpaper 15% 28 4 4 0
Single rectangle 2% 28 0 0 0
Multiple rectangles 39% 28 13 1 12
Multiple RGB images 8% 28 0 0 0
Multiple ARGB images 10% 28 2 2 0
Rotated ARGB images 43% 28 14 14 0
Multiple labels 17% 28 3 0 3
Screen sized text 42% 28 14 14 0
Multiple arcs 2% 28 0 0 0
Containers 11% 28 4 4 0
Containers with overlay 33% 28 11 11 0
Containers with opa 20% 28 8 7 1
Containers with opa_layer 29% 28 13 13 0
Containers with scrolling 38% 28 11 11 0
Widgets demo 61% 28 9 8 1
All scenes avg. 24% 27 6 5 1

Benchmark for BOARD esp32_s3_lcd_ev_board_2

DATE: 24.02.2025 07:44

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 71% 24 (-1) 26 (-1) 19 (-1) 7
Moving wallpaper 97% 14 64 51 (-1) 13 (+1)
Single rectangle 42% (-1) 28 8 (-2) 3 (-1) 5 (-1)
Multiple rectangles 78% 27 27 19 (-1) 8 (+1)
Multiple RGB images 98% 20 44 (+1) 33 (+1) 11
Multiple ARGB images 100% 16 55 46 9
Rotated ARGB images 100% 3 274 (+2) 266 (+2) 8
Multiple labels 76% 28 (+1) 23 16 (-1) 7 (+1)
Screen sized text 99% (+1) 12 78 (-1) 66 (-1) 12
Multiple arcs 58% (+1) 28 15 (+1) 7 (+1) 8
Containers 79% (-2) 25 30 24 6
Containers with overlay 98% 11 78 (-1) 68 (-1) 10
Containers with opa 91% (-1) 21 38 (-1) 29 (-1) 9
Containers with opa_layer 98% (-1) 11 (+1) 81 (-1) 75 (-1) 6
Containers with scrolling 100% (+1) 14 64 55 9
Widgets demo 99% 11 67 (+1) 58 9 (+1)
All scenes avg. 86% 18 60 52 8

Benchmark for BOARD esp32_s3_lcd_ev_board

DATE: 24.02.2025 07:41

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 98% 16 53 29 24
Moving wallpaper 99% 9 (-1) 91 (+3) 81 10 (+3)
Single rectangle 60% (-2) 28 (+1) 18 (-1) 5 13 (-1)
Multiple rectangles 95% (+1) 17 (+1) 52 (-1) 30 22 (-1)
Multiple RGB images 99% 11 80 (+1) 59 (+2) 21 (-1)
Multiple ARGB images 99% (-1) 10 (-1) 88 (+8) 80 (+1) 8 (+7)
Rotated ARGB images 100% 2 333 324 (-1) 9 (+1)
Multiple labels 99% 16 50 31 19
Screen sized text 100% (+1) 8 110 (+1) 97 (+1) 13
Multiple arcs 99% 17 51 46 5
Containers 100% (+1) 10 83 (+2) 72 (+2) 11
Containers with overlay 99% 7 114 (+2) 101 (+2) 13
Containers with opa 99% 8 104 87 17
Containers with opa_layer 100% (+1) 4 191 184 (+3) 7 (-3)
Containers with scrolling 99% (-1) 8 110 100 (+1) 10 (-1)
Widgets demo 99% 8 (+1) 96 (-2) 81 15 (-2)
All scenes avg. 96% 11 100 87 13

Benchmark for BOARD esp_box_3

DATE: 24.02.2025 07:39

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 93% 26 34 3 31
Moving wallpaper 98% 25 36 5 31
Single rectangle 5% 28 0 0 0
Multiple rectangles 51% 28 16 6 10
Multiple RGB images 21% 28 6 0 6
Multiple ARGB images 28% 28 9 4 5
Rotated ARGB images 92% 22 41 28 13
Multiple labels 12% 28 0 0 0
Screen sized text 94% 16 55 24 31
Multiple arcs 19% 28 0 0 0
Containers 33% 28 19 6 13
Containers with overlay 88% 21 43 13 30
Containers with opa 48% 28 19 6 13
Containers with opa_layer 57% 27 29 15 14
Containers with scrolling 96% 20 45 14 31
Widgets demo 94% 25 25 11 14
All scenes avg. 58% 25 23 8 15

Benchmark for BOARD m5dial

DATE: 24.02.2025 07:48

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 79% 27 26 6 20
Moving wallpaper 83% 28 24 9 15
Single rectangle 9% 28 0 0 0
Multiple rectangles 43% 28 13 7 6
Multiple RGB images 16% 28 1 1 0
Multiple ARGB images 18% 28 5 4 1
Rotated ARGB images 52% 28 17 16 1
Multiple labels 20% 28 3 2 1
Screen sized text 82% 27 31 27 4
Multiple arcs 12% 28 0 0 0
Containers 28% 28 13 8 5
Containers with overlay 74% 28 27 18 9
Containers with opa 38% 28 14 11 3
Containers with opa_layer 38% 28 19 17 2
Containers with scrolling 81% 28 28 19 9
Widgets demo 82% 27 14 13 1
All scenes avg. 47% 27 13 9 4

Benchmark for BOARD m5stack_core_s3

DATE: 24.02.2025 07:51

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 94% 27 33 5 28
Moving wallpaper 97% 26 33 9 24
Single rectangle 14% 28 0 0 0
Multiple rectangles 41% 28 14 6 8
Multiple RGB images 25% 28 6 3 3
Multiple ARGB images 27% 28 8 6 2
Rotated ARGB images 70% 28 28 28 0
Multiple labels 17% 28 1 0 1
Screen sized text 93% 23 39 31 8
Multiple arcs 18% 28 2 1 1
Containers 30% 28 15 7 8
Containers with overlay 92% 25 35 17 18
Containers with opa 41% 28 17 9 8
Containers with opa_layer 50% 28 25 21 4
Containers with scrolling 95% 24 37 20 17
Widgets demo 82% 27 16 13 3
All scenes avg. 55% 27 19 11 8

Benchmark for BOARD m5stack_core_s3_se

DATE: 24.02.2025 07:54

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 94% 26 32 4 28
Moving wallpaper 96% 26 32 8 24
Single rectangle 14% 28 0 0 0
Multiple rectangles 41% 28 14 6 8
Multiple RGB images 25% 28 6 3 3
Multiple ARGB images 27% 28 8 6 2
Rotated ARGB images 70% 28 28 28 0
Multiple labels 17% 28 1 0 1
Screen sized text 93% 23 39 31 8
Multiple arcs 18% 28 2 1 1
Containers 30% 28 15 7 8
Containers with overlay 92% 25 35 17 18
Containers with opa 41% 28 17 9 8
Containers with opa_layer 50% 28 25 21 4
Containers with scrolling 95% 24 37 20 17
Widgets demo 82% 27 16 13 3
All scenes avg. 55% 26 18 10 8

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 18, 2025 •
edited
Loading

Test Results

 17 files  17 suites   5m 55s ⏱️
 68 tests 24 ✅  44 💤 0 ❌
408 runs  24 ✅ 384 💤 0 ❌

Results for commit 183916d.

♻️ This comment has been updated with latest results.

@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 5c6f8f9 to 52f1ff6 Compare February 18, 2025 14:26
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 52f1ff6 to ef17a13 Compare February 19, 2025 06:40
@espzav
Copy link
Collaborator Author

espzav commented Feb 19, 2025

@tore-espressif @igrr PTAL

tore-espressif
tore-espressif reviewed Feb 19, 2025
View reviewed changes
Copy link
Collaborator

@tore-espressif tore-espressif left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks very nice @espzav !

I put few comments about the workflow file.

I also added few non-blocking nitpicks in Python

@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 5 times, most recently from 4f32c0f to 7b18341 Compare February 20, 2025 14:16
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 9 times, most recently from 0f67a76 to a4118c2 Compare February 21, 2025 09:05
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 2 times, most recently from d4e089d to 5196883 Compare February 21, 2025 10:56
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 6 times, most recently from c20a9de to 538ca59 Compare February 24, 2025 06:49
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 538ca59 to 183916d Compare February 24, 2025 08:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tore-espressif tore-espressif tore-espressif left review comments

@igrr igrr Awaiting requested review from igrr

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@espzav @tore-espressif