Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test support to build_examples.py, including fake platform compilation and run #12887

Merged
merged 9 commits into from
Dec 10, 2021

Conversation

andy31415
Copy link
Contributor

Problem

build_examples does not build tests
fake platform builds are not supported except the large gn_build.sh script.

Change overview

Add linux-x64-tests and linux-fake-tests targets that run a 'check' (i.e. run tests as well, not only compile)

Testing

Manually ran build on linux using the new targets
added CI targets for this.

@github-actions
Copy link

github-actions bot commented Dec 10, 2021

PR #12887: Size comparison from b9baddc to 1d5c67f

Full report (15 builds for efr32, k32w, linux, p6, qpg, telink)
platform target config section b9baddc 1d5c67f change % change
efr32 lighting-app BRD4161A (read only) 809188 809188 0 0.0
(read/write) 123148 123148 0 0.0
.bss 121288 121288 0 0.0
.data 1860 1860 0 0.0
.text 809180 809180 0 0.0
BRD4161A+rpc (read only) 796824 796824 0 0.0
(read/write) 139824 139824 0 0.0
.bss 137864 137864 0 0.0
.data 1960 1960 0 0.0
.text 796816 796816 0 0.0
window-app BRD4161A (read only) 786164 786164 0 0.0
(read/write) 121280 121280 0 0.0
.bss 119456 119456 0 0.0
.data 1824 1824 0 0.0
.text 786156 786156 0 0.0
k32w lighting-app k32w061+se05x+release (read/write) 669576 669576 0 0.0
.bss 73872 73872 0 0.0
.data 1892 1892 0 0.0
.text 588012 588012 0 0.0
lock-app k32w061+debug (read/write) 619524 619524 0 0.0
.bss 72024 72024 0 0.0
.data 1852 1852 0 0.0
.text 539848 539848 0 0.0
shell k32w061+debug (read/write) 624624 624624 0 0.0
.bss 74252 74252 0 0.0
.data 1832 1832 0 0.0
.text 542740 542740 0 0.0
linux chip-tool-ipv6only arm64 (read only) 6848196 6848196 0 0.0
(read/write) 318945 318945 0 0.0
.bss 51985 51985 0 0.0
.data 1192 1192 0 0.0
.data.rel.ro 208656 208656 0 0.0
.dynamic 560 560 0 0.0
.got 53384 53384 0 0.0
.init 24 24 0 0.0
.init_array 176 176 0 0.0
.rodata 364116 364116 0 0.0
.text 5803380 5803380 0 0.0
thermostat-no-ble arm64 (read only) 1947044 1947044 0 0.0
(read/write) 137201 137201 0 0.0
.bss 59601 59601 0 0.0
.data 832 832 0 0.0
.data.rel.ro 70304 70304 0 0.0
.dynamic 560 560 0 0.0
.got 3592 3592 0 0.0
.init 24 24 0 0.0
.init_array 272 272 0 0.0
.rodata 125444 125444 0 0.0
.text 1614096 1614096 0 0.0
p6 all-clusters-app default (read/write) 2354544 2354544 0 0.0
.bss 112436 112436 0 0.0
.data 2520 2520 0 0.0
.heap 918384 918384 0 0.0
.text 1312808 1312808 0 0.0
light-app default (read/write) 2294720 2294720 0 0.0
.bss 101016 101016 0 0.0
.data 2360 2360 0 0.0
.heap 929968 929968 0 0.0
.text 1252984 1252984 0 0.0
lock-app default (read/write) 2270784 2270784 0 0.0
.bss 99896 99896 0 0.0
.data 2328 2328 0 0.0
.heap 931120 931120 0 0.0
.text 1229048 1229048 0 0.0
qpg lighting-app qpg6100+debug (read only) 521328 521328 0 0.0
(read/write) 122336 122336 0 0.0
.bss 82712 82712 0 0.0
.data 992 992 0 0.0
.text 516008 516008 0 0.0
lock-app qpg6100+debug (read only) 495696 495696 0 0.0
(read/write) 122332 122332 0 0.0
.bss 81848 81848 0 0.0
.data 948 948 0 0.0
.text 490376 490376 0 0.0
persistent-storage-app qpg6100+debug (read only) 108104 108104 0 0.0
(read/write) 122336 122336 0 0.0
.bss 36160 36160 0 0.0
.data 288 288 0 0.0
.text 102784 102784 0 0.0
telink lighting-app tlsr9518adk80d (read/write) 810978 810978 0 0.0
bss 82864 82864 0 0.0
noinit 37160 37160 0 0.0
text 566032 566032 0 0.0

@github-actions
Copy link

github-actions bot commented Dec 10, 2021

PR #12887: Size comparison from b9baddc to 5bfcc78

Increases above 0.2%:

platform target config section b9baddc 5bfcc78 change % change
efr32 lighting-app BRD4161A (read only) 809188 815260 6072 0.8
.text 809180 815252 6072 0.8
BRD4161A+rpc (read only) 796824 802908 6084 0.8
.text 796816 802900 6084 0.8
window-app BRD4161A (read only) 786164 792224 6060 0.8
.text 786156 792216 6060 0.8
linux thermostat-no-ble arm64 .got 3592 3624 32 0.9
p6 all-clusters-app default (read/write) 2354544 2360584 6040 0.3
.text 1312808 1318848 6040 0.5
light-app default (read/write) 2294720 2300800 6080 0.3
.text 1252984 1259064 6080 0.5
lock-app default (read/write) 2270784 2276872 6088 0.3
.text 1229048 1235136 6088 0.5
Increases (29 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
platform target config section b9baddc 5bfcc78 change % change
efr32 lighting-app BRD4161A (read only) 809188 815260 6072 0.8
.text 809180 815252 6072 0.8
BRD4161A+rpc (read only) 796824 802908 6084 0.8
.text 796816 802900 6084 0.8
window-app BRD4161A (read only) 786164 792224 6060 0.8
.text 786156 792216 6060 0.8
esp32 all-clusters-app c3devkit (read only) 856018 856528 510 0.1
.flash.text 856018 856528 510 0.1
m5stack (read only) 959935 960191 256 0.0
.flash.text 954551 954807 256 0.0
k32w lighting-app k32w061+se05x+release (read/write) 669576 669744 168 0.0
.text 588012 588196 184 0.0
lock-app k32w061+debug (read/write) 619524 619696 172 0.0
.text 539848 540036 188 0.0
shell k32w061+debug (read/write) 624624 625016 392 0.1
.bss 74252 74316 64 0.1
.text 542740 543068 328 0.1
linux chip-tool-ipv6only arm64 .got 53384 53408 24 0.0
thermostat-no-ble arm64 (read only) 1947044 1947668 624 0.0
.data.rel.ro 70304 70344 40 0.1
.got 3592 3624 32 0.9
.rodata 125444 125476 32 0.0
.text 1614096 1614416 320 0.0
mbed all-clusters-app CY8CPROTO_062_4343W+release .heap 846912 846928 16 0.0
lighting-app CY8CPROTO_062_4343W+release (read/write) 2308944 2309168 224 0.0
.heap 855096 855112 16 0.0
.text 1271544 1271768 224 0.0
lock-app CY8CPROTO_062_4343W+release (read/write) 2282064 2282288 224 0.0
.heap 856064 856080 16 0.0
.text 1244664 1244888 224 0.0
shell CY8CPROTO_062_4343W+release (read/write) 2053336 2053672 336 0.0
.bss 156900 156980 80 0.1
.text 1015936 1016272 336 0.0
nrfconnect lighting-app nrf52840dk_nrf52840 (read/write) 906795 907035 240 0.0
text 612912 613240 328 0.1
nrf52840dk_nrf52840+rpc (read/write) 869827 870099 272 0.0
text 587640 587984 344 0.1
nrf5340dk_nrf5340_cpuapp (read/write) 832794 833034 240 0.0
text 543340 543668 328 0.1
lock-app nrf52840dk_nrf52840 (read/write) 879407 879695 288 0.0
text 592356 592684 328 0.1
nrf5340dk_nrf5340_cpuapp (read/write) 805666 805934 268 0.0
text 522876 523204 328 0.1
pump-app nrf52840dk_nrf52840 (read/write) 884347 884631 284 0.0
text 595948 596276 328 0.1
pump-controller-app nrf52840dk_nrf52840 (read/write) 877587 877843 256 0.0
text 591144 591472 328 0.1
shell nrf52840dk_nrf52840 (read/write) 781927 782267 340 0.0
bss 109544 109624 80 0.1
rodata 74276 74296 20 0.0
text 523588 523840 252 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 696974 697346 372 0.1
bss 110524 110604 80 0.1
rodata 68920 68940 20 0.0
text 444228 444480 252 0.1
p6 all-clusters-app default (read/write) 2354544 2360584 6040 0.3
.bss 112436 112484 48 0.0
.text 1312808 1318848 6040 0.5
light-app default (read/write) 2294720 2300800 6080 0.3
.bss 101016 101064 48 0.0
.text 1252984 1259064 6080 0.5
lock-app default (read/write) 2270784 2276872 6088 0.3
.bss 99896 99944 48 0.0
.text 1229048 1235136 6088 0.5
qpg lighting-app qpg6100+debug (read only) 521328 521532 204 0.0
.text 516008 516212 204 0.0
lock-app qpg6100+debug (read only) 495696 495896 200 0.0
.text 490376 490576 200 0.0
telink lighting-app tlsr9518adk80d (read/write) 810978 811522 544 0.1
text 566032 566628 596 0.1
Decreases (26 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
platform target config section b9baddc 5bfcc78 change % change
efr32 lighting-app BRD4161A (read/write) 123148 123132 -16 -0.0
.bss 121288 121272 -16 -0.0
BRD4161A+rpc (read/write) 139824 139808 -16 -0.0
.bss 137864 137848 -16 -0.0
window-app BRD4161A (read/write) 121280 121264 -16 -0.0
.bss 119456 119440 -16 -0.0
esp32 all-clusters-app c3devkit (read/write) 1305050 1304970 -80 -0.0
.dram0.bss 65032 65016 -16 -0.0
.flash.rodata 172856 172792 -64 -0.0
m5stack (read/write) 450776 450704 -72 -0.0
.dram0.bss 74320 74304 -16 -0.0
.flash.rodata 210620 210564 -56 -0.0
k32w lighting-app k32w061+se05x+release .bss 73872 73856 -16 -0.0
lock-app k32w061+debug .bss 72024 72008 -16 -0.0
linux chip-tool-ipv6only arm64 (read only) 6848196 6846220 -1976 -0.0
(read/write) 318945 318849 -96 -0.0
.bss 51985 51889 -96 -0.2
.data.rel.ro 208656 208632 -24 -0.0
.rodata 364116 364028 -88 -0.0
.text 5803380 5801396 -1984 -0.0
thermostat-no-ble arm64 (read/write) 137201 137185 -16 -0.0
.bss 59601 59505 -96 -0.2
mbed all-clusters-app CY8CPROTO_062_4343W+release (read/write) 2313768 2313680 -88 -0.0
.bss 184300 184284 -16 -0.0
.text 1276344 1276256 -88 -0.0
lighting-app CY8CPROTO_062_4343W+release .bss 175824 175808 -16 -0.0
lock-app CY8CPROTO_062_4343W+release .bss 174864 174848 -16 -0.0
shell CY8CPROTO_062_4343W+release .heap 874680 874600 -80 -0.0
nrfconnect lighting-app nrf52840dk_nrf52840 bss 116296 116280 -16 -0.0
rodata 101980 101932 -48 -0.0
nrf52840dk_nrf52840+rpc bss 112644 112628 -16 -0.0
rodata 93276 93228 -48 -0.1
nrf5340dk_nrf5340_cpuapp bss 117672 117656 -16 -0.0
rodata 97236 97188 -48 -0.0
lock-app nrf52840dk_nrf52840 bss 113560 113544 -16 -0.0
rodata 98096 98048 -48 -0.0
nrf5340dk_nrf5340_cpuapp bss 114968 114952 -16 -0.0
rodata 93388 93336 -52 -0.1
pump-app nrf52840dk_nrf52840 bss 113472 113456 -16 -0.0
rodata 99452 99400 -52 -0.1
pump-controller-app nrf52840dk_nrf52840 bss 113348 113332 -16 -0.0
rodata 97588 97540 -48 -0.0
p6 all-clusters-app default .heap 918384 918336 -48 -0.0
light-app default .heap 929968 929920 -48 -0.0
lock-app default .heap 931120 931072 -48 -0.0
qpg lighting-app qpg6100+debug .bss 82712 82696 -16 -0.0
lock-app qpg6100+debug .bss 81848 81832 -16 -0.0
telink lighting-app tlsr9518adk80d bss 82864 82848 -16 -0.0
Full report (32 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
platform target config section b9baddc 5bfcc78 change % change
efr32 lighting-app BRD4161A (read only) 809188 815260 6072 0.8
(read/write) 123148 123132 -16 -0.0
.bss 121288 121272 -16 -0.0
.data 1860 1860 0 0.0
.text 809180 815252 6072 0.8
BRD4161A+rpc (read only) 796824 802908 6084 0.8
(read/write) 139824 139808 -16 -0.0
.bss 137864 137848 -16 -0.0
.data 1960 1960 0 0.0
.text 796816 802900 6084 0.8
window-app BRD4161A (read only) 786164 792224 6060 0.8
(read/write) 121280 121264 -16 -0.0
.bss 119456 119440 -16 -0.0
.data 1824 1824 0 0.0
.text 786156 792216 6060 0.8
esp32 all-clusters-app c3devkit (read only) 856018 856528 510 0.1
(read/write) 1305050 1304970 -80 -0.0
.dram0.bss 65032 65016 -16 -0.0
.dram0.data 14124 14124 0 0.0
.flash.rodata 172856 172792 -64 -0.0
.flash.text 856018 856528 510 0.1
.iram0.text 62076 62076 0 0.0
m5stack (read only) 959935 960191 256 0.0
(read/write) 450776 450704 -72 -0.0
.dram0.bss 74320 74304 -16 -0.0
.dram0.data 34048 34048 0 0.0
.flash.rodata 210620 210564 -56 -0.0
.flash.text 954551 954807 256 0.0
.iram0.text 123451 123451 0 0.0
k32w lighting-app k32w061+se05x+release (read/write) 669576 669744 168 0.0
.bss 73872 73856 -16 -0.0
.data 1892 1892 0 0.0
.text 588012 588196 184 0.0
lock-app k32w061+debug (read/write) 619524 619696 172 0.0
.bss 72024 72008 -16 -0.0
.data 1852 1852 0 0.0
.text 539848 540036 188 0.0
shell k32w061+debug (read/write) 624624 625016 392 0.1
.bss 74252 74316 64 0.1
.data 1832 1832 0 0.0
.text 542740 543068 328 0.1
linux chip-tool-ipv6only arm64 (read only) 6848196 6846220 -1976 -0.0
(read/write) 318945 318849 -96 -0.0
.bss 51985 51889 -96 -0.2
.data 1192 1192 0 0.0
.data.rel.ro 208656 208632 -24 -0.0
.dynamic 560 560 0 0.0
.got 53384 53408 24 0.0
.init 24 24 0 0.0
.init_array 176 176 0 0.0
.rodata 364116 364028 -88 -0.0
.text 5803380 5801396 -1984 -0.0
thermostat-no-ble arm64 (read only) 1947044 1947668 624 0.0
(read/write) 137201 137185 -16 -0.0
.bss 59601 59505 -96 -0.2
.data 832 832 0 0.0
.data.rel.ro 70304 70344 40 0.1
.dynamic 560 560 0 0.0
.got 3592 3624 32 0.9
.init 24 24 0 0.0
.init_array 272 272 0 0.0
.rodata 125444 125476 32 0.0
.text 1614096 1614416 320 0.0
mbed all-clusters-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2313768 2313680 -88 -0.0
.bss 184300 184284 -16 -0.0
.data 5232 5232 0 0.0
.heap 846912 846928 16 0.0
.text 1276344 1276256 -88 -0.0
lighting-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2308944 2309168 224 0.0
.bss 175824 175808 -16 -0.0
.data 5528 5528 0 0.0
.heap 855096 855112 16 0.0
.text 1271544 1271768 224 0.0
lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2282064 2282288 224 0.0
.bss 174864 174848 -16 -0.0
.data 5520 5520 0 0.0
.heap 856064 856080 16 0.0
.text 1244664 1244888 224 0.0
pigweed-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 1140008 1140008 0 0.0
.bss 11756 11756 0 0.0
.data 4376 4376 0 0.0
.heap 1020312 1020312 0 0.0
.text 103392 103392 0 0.0
shell CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2053336 2053672 336 0.0
.bss 156900 156980 80 0.1
.data 4864 4864 0 0.0
.heap 874680 874600 -80 -0.0
.text 1015936 1016272 336 0.0
nrfconnect lighting-app nrf52840dk_nrf52840 (read/write) 906795 907035 240 0.0
bss 116296 116280 -16 -0.0
rodata 101980 101932 -48 -0.0
text 612912 613240 328 0.1
nrf52840dk_nrf52840+rpc (read/write) 869827 870099 272 0.0
bss 112644 112628 -16 -0.0
rodata 93276 93228 -48 -0.1
text 587640 587984 344 0.1
nrf5340dk_nrf5340_cpuapp (read/write) 832794 833034 240 0.0
bss 117672 117656 -16 -0.0
rodata 97236 97188 -48 -0.0
text 543340 543668 328 0.1
lock-app nrf52840dk_nrf52840 (read/write) 879407 879695 288 0.0
bss 113560 113544 -16 -0.0
rodata 98096 98048 -48 -0.0
text 592356 592684 328 0.1
nrf5340dk_nrf5340_cpuapp (read/write) 805666 805934 268 0.0
bss 114968 114952 -16 -0.0
rodata 93388 93336 -52 -0.1
text 522876 523204 328 0.1
pigweed-app nrf52840dk_nrf52840 (read/write) 497463 497463 0 0.0
bss 51820 51820 0 0.0
rodata 45852 45852 0 0.0
text 339492 339492 0 0.0
pump-app nrf52840dk_nrf52840 (read/write) 884347 884631 284 0.0
bss 113472 113456 -16 -0.0
rodata 99452 99400 -52 -0.1
text 595948 596276 328 0.1
pump-controller-app nrf52840dk_nrf52840 (read/write) 877587 877843 256 0.0
bss 113348 113332 -16 -0.0
rodata 97588 97540 -48 -0.0
text 591144 591472 328 0.1
shell nrf52840dk_nrf52840 (read/write) 781927 782267 340 0.0
bss 109544 109624 80 0.1
rodata 74276 74296 20 0.0
text 523588 523840 252 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 696974 697346 372 0.1
bss 110524 110604 80 0.1
rodata 68920 68940 20 0.0
text 444228 444480 252 0.1
p6 all-clusters-app default (read/write) 2354544 2360584 6040 0.3
.bss 112436 112484 48 0.0
.data 2520 2520 0 0.0
.heap 918384 918336 -48 -0.0
.text 1312808 1318848 6040 0.5
light-app default (read/write) 2294720 2300800 6080 0.3
.bss 101016 101064 48 0.0
.data 2360 2360 0 0.0
.heap 929968 929920 -48 -0.0
.text 1252984 1259064 6080 0.5
lock-app default (read/write) 2270784 2276872 6088 0.3
.bss 99896 99944 48 0.0
.data 2328 2328 0 0.0
.heap 931120 931072 -48 -0.0
.text 1229048 1235136 6088 0.5
qpg lighting-app qpg6100+debug (read only) 521328 521532 204 0.0
(read/write) 122336 122336 0 0.0
.bss 82712 82696 -16 -0.0
.data 992 992 0 0.0
.text 516008 516212 204 0.0
lock-app qpg6100+debug (read only) 495696 495896 200 0.0
(read/write) 122332 122332 0 0.0
.bss 81848 81832 -16 -0.0
.data 948 948 0 0.0
.text 490376 490576 200 0.0
persistent-storage-app qpg6100+debug (read only) 108104 108104 0 0.0
(read/write) 122336 122336 0 0.0
.bss 36160 36160 0 0.0
.data 288 288 0 0.0
.text 102784 102784 0 0.0
telink lighting-app tlsr9518adk80d (read/write) 810978 811522 544 0.1
bss 82864 82848 -16 -0.0
noinit 37160 37160 0 0.0
text 566032 566628 596 0.1

@andy31415 andy31415 merged commit 98a1e36 into project-chip:master Dec 10, 2021
@andy31415 andy31415 deleted the build_example_tests branch June 14, 2023 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants