The eventd.proxy test occasionally fails

[sonic-otn]

Description

The eventd.proxy test occasionally fails on my build server, but the issue is resolved when I rerun the command make target/debs/bookworm/sonic-eventd_1.0.0-0_amd64.deb. I'm working on the main branch with PR #20024.

[----------] 6 tests from eventd
[ RUN ] eventd.proxy
Proxy TEST started
tests/eventd_ut.cpp:170: Failure
Expected equality of these values:
1
rc
Which is: 36
Finished building: rsyslog_plugin/rsyslog_plugin.cpp

Buidling Target: rsyslog-plugin
Invoking: G++ Linker
g++ -Wl,-z,relro -Wl,-z,now -o rsyslog_plugin/rsyslog_plugin ./rsyslog_plugin/rsyslog_plugin.o ./rsyslog_plugin/syslog_parser.o ./rsyslog_plugin/timestamp_formatter.o ./rsyslog_plugin/main.o -levent -lhiredis -lswsscommon -lpthread -lboost_thread -lboost_system -lzmq -lboost_serialization -luuid -llua5.1
Finished building target: rsyslog-plugin

tests/eventd_ut.cpp:279: Failure
Expected equality of these values:
rd_cevts_sz
Which is: 6
wr_evts.size()
Which is: 5
eventd_proxy is tested GOOD
[ FAILED ] eventd.proxy (1627 ms)

Steps to reproduce the issue:

1. make SONIC_BUILD_JOBS=8 target/sonic-vs.img.gz

Describe the results you received:

Describe the results you expected:

Output of show version:

(paste your output here)

Output of show techsupport:

(paste your output here or download and attach the file here )

Additional information you deem important (e.g. issue happens only occasionally):

[sonic-otn]

Can not reproduce it now, close it

[dprital]

Hi @sonic-otn ,

Lately, we do see this issue frequently during build:

01:44:39  eventd_proxy is tested GOOD
01:44:39  [  FAILED  ] eventd.proxy (1606 ms)
01:44:39  [ RUN      ] eventd.capture
01:44:39  Capture TEST started
01:44:39  Capture TEST completed
01:44:39  [       OK ] eventd.capture (2017 ms)
01:44:39  [ RUN      ] eventd.captureCacheMax
01:44:39  Capture TEST with matchinhg cache-max started
01:44:39  Capture TEST with matchinhg cache-max completed
01:44:39  [       OK ] eventd.captureCacheMax (2017 ms)
01:44:39  [ RUN      ] eventd.service
01:44:39  Service TEST started
01:44:39  Service TEST completed
01:44:39  [       OK ] eventd.service (6308 ms)
01:44:39  [ RUN      ] eventd.heartbeat
01:44:39  heartbeat TEST started
01:44:39  heartbeat TEST completed
01:44:39  [       OK ] eventd.heartbeat (6521 ms)
01:44:39  [ RUN      ] eventd.testDB
01:44:39  DB TEST started
01:44:39  redis not available; Hence DB TEST skipped
01:44:39  [       OK ] eventd.testDB (0 ms)
01:44:39  [----------] 6 tests from eventd (18470 ms total)
01:44:39  
01:44:39  [----------] Global test environment tear-down
01:44:39  [==========] 6 tests from 1 test suite ran. (18484 ms total)
01:44:39  [  PASSED  ] 5 tests.
01:44:39  [  FAILED  ] 1 test, listed below:
01:44:39  [  FAILED  ] eventd.proxy
01:44:39  
01:44:39   1 FAILED TEST
01:44:39  make[2]: *** [Makefile:60: eventd-tests] Error 1
01:44:39  make[2]: Leaving directory '/sonic/src/sonic-eventd'
01:44:39  dh_auto_build: error: make -j30 "INSTALL=install --strip-program=true" returned exit code 2
01:44:39  make[1]: *** [debian/rules:6: build] Error 25
01:44:39  make[1]: Leaving directory '/sonic/src/sonic-eventd'
01:44:39  dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2

Please let me know what you need from my side in order to investigate it.

Thanks,
Dror.

[bluecmd]

Same for us using 202411 branch. I see it fail about 50% of the time.

[10:03:07] Finished building target: sonic-eventd
[10:03:07]  
[10:03:07] Finished building target: eventd-tests
[10:03:07] tests/tests
[10:03:07] [==========] Running 6 tests from 1 test suite.
[10:03:07] [----------] Global test environment set-up.
[10:03:07] Default : isInit = 0
[10:03:07] INIT: load local db config file, isInit = 1
[10:03:07] Default : isGlobalInit = 0
[10:03:08] INIT: load global db config file, isInit = 1
[10:03:08] INIT: Invoking SonicDBConfig::getDbId(APPL_DB, invalid)
[10:03:08] Unable to get DB Connector, e=(Unable to connect to redis - Connection refused(1): Cannot assign requested address)
[10:03:08] [----------] 6 tests from eventd
[10:03:08] [ RUN      ] eventd.proxy
[10:03:09] Proxy TEST started
[10:03:09] tests/eventd_ut.cpp:279: Failure
[10:03:09] Expected equality of these values:
[10:03:09]   rd_cevts_sz
[10:03:09]     Which is: 6
[10:03:09]   wr_evts.size()
[10:03:09]     Which is: 5
[10:03:09] eventd_proxy is tested GOOD
[10:03:09] [  FAILED  ] eventd.proxy (1433 ms)

[bluecmd]

You can see this issue happening on recent official builds e.g. here: https://dev.azure.com/mssonic/build/_build/results?buildId=728859&view=logs&j=88ce9a53-729c-5fa9-7b6e-3d98f2488e3f&t=b71397ab-4d88-53c1-4db7-b4fc5ec36f6f - search for "FAILED"