Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

double entries in slowest duration list #9838

Closed
fenchu opened this issue Apr 5, 2022 · 4 comments
Closed

double entries in slowest duration list #9838

fenchu opened this issue Apr 5, 2022 · 4 comments
Labels
status: needs information reporter needs to provide more information; can be closed after 2 or more weeks of inactivity type: question general question, might be closed after 2 weeks of inactivity

Comments

@fenchu
Copy link

fenchu commented Apr 5, 2022

Why the double entries in slowest durations

Anyone know how to manipulate it. can it be done via conftest?

Python 3.10.4 (tags/v3.10.4:9d38120, Mar 23 2022, 23:13:41) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import pytest
>>> pytest.__version__
'7.1.1'

same in windows and linux. Any version of pytests since 5.1.0 back in 2019

pytest.exe --durations=0 -vv -s --tb=short .\\tests --webhost=test1
:
<the tests run and do their stuff>
:
============================== slowest durations ===============================
132.21s call     tests/test_08_idproofing_no.py::TestClass::test02_idproofing[test1]
132.21s call     tests/test_08_idproofing_no.py::TestClass::test02_idproofing[test1]
125.02s call     tests/test_09_idproofing_en.py::TestClass::test02_idproofing[test1]
125.01s call     tests/test_09_idproofing_en.py::TestClass::test02_idproofing[test1]
97.22s call     tests/test_02_scim.py::TestClass::test04_groups[test1]
97.22s call     tests/test_02_scim.py::TestClass::test04_groups[test1]
92.76s call     tests/test_13_user_admin_no.py::TestClass::test02_user_admin[test1]
92.76s call     tests/test_13_user_admin_no.py::TestClass::test02_user_admin[test1]
76.77s call     tests/test_02_scim.py::TestClass::test05_patch[test1]
76.77s call     tests/test_02_scim.py::TestClass::test05_patch[test1]
76.00s call     tests/test_06_keyregistration_no.py::TestClass::test01_frontend[test1]
74.89s call     tests/test_06_keyregistration_no.py::TestClass::test01_frontend[test1]
72.49s call     tests/test_02_scim.py::TestClass::test03_delete_insert[test1]
72.49s call     tests/test_02_scim.py::TestClass::test03_delete_insert[test1]
70.29s call     tests/test_09_idproofing_en.py::TestClass::test01_idproofing_precond[test1]
70.29s call     tests/test_09_idproofing_en.py::TestClass::test01_idproofing_precond[test1]
63.65s call     tests/test_10_phone_registration_en.py::TestClass::test02_phone_registration[test1]
63.65s call     tests/test_10_phone_registration_en.py::TestClass::test02_phone_registration[test1]
62.63s call     tests/test_11_lastsuccessfullogontime.py::TestClass::test01_lastsuccessfullogin[test1]
62.63s call     tests/test_11_lastsuccessfullogontime.py::TestClass::test01_lastsuccessfullogin[test1]
60.80s call     tests/test_08_idproofing_no.py::TestClass::test01_idproofing_precond[test1]
60.80s call     tests/test_08_idproofing_no.py::TestClass::test01_idproofing_precond[test1]
39.71s call     tests/test_9999_grafana_board.py::TestClass::test01_bks_metrics[test1]
39.71s call     tests/test_9999_grafana_board.py::TestClass::test01_bks_metrics[test1]
39.10s call     tests/test_07_keyregistration_en.py::TestClass::test01_frontend[test1]
39.10s call     tests/test_07_keyregistration_en.py::TestClass::test01_frontend[test1]
31.38s call     tests/test_13_user_admin_no.py::TestClass::test01_useradmin_precond[test1]
31.38s call     tests/test_13_user_admin_no.py::TestClass::test01_useradmin_precond[test1]
28.36s call     tests/test_12_passport_mock.py::TestClass::test02_passportmock[test1]
28.36s call     tests/test_12_passport_mock.py::TestClass::test02_passportmock[test1]
23.55s call     tests/test_02_scim.py::TestClass::test06_put[test1]
23.55s call     tests/test_02_scim.py::TestClass::test06_put[test1]
23.33s call     tests/test_01_services_up.py::TestClass::test05_users_in_ldap[test1]
23.33s call     tests/test_01_services_up.py::TestClass::test05_users_in_ldap[test1]
20.43s call     tests/test_03_scim_filtering.py::TestClass::test01_filtering[test1]
20.43s call     tests/test_03_scim_filtering.py::TestClass::test01_filtering[test1]
18.54s call     tests/test_05_fido2.py::TestClass::test01_fido2_getcredential[test1]
18.54s call     tests/test_05_fido2.py::TestClass::test01_fido2_getcredential[test1]
12.11s call     tests/test_01_services_up.py::TestClass::test01_services_up[test1]
12.11s call     tests/test_01_services_up.py::TestClass::test01_services_up[test1]
8.07s call     tests/test_99_karma_board.py::TestClass::test01_karma[test1]
8.06s call     tests/test_99_karma_board.py::TestClass::test01_karma[test1]
4.90s call     tests/test_01_services_up.py::TestClass::test03_diffservice
4.90s call     tests/test_01_services_up.py::TestClass::test03_diffservice
4.08s call     tests/test_99_kibana_errors.py::TestClass::test01_log_errors[test1]
4.08s call     tests/test_99_kibana_errors.py::TestClass::test01_log_errors[test1]
1.66s call     tests/test_98_events_in_kibana.py::TestClass::test01_get_events[test1]
1.66s call     tests/test_98_events_in_kibana.py::TestClass::test01_get_events[test1]
1.63s call     tests/test_01_services_up.py::TestClass::test06_urlcheck[test1]
1.63s call     tests/test_01_services_up.py::TestClass::test06_urlcheck[test1]
1.50s call     tests/test_04_freg.py::TestClass::test01_freg_check_users[test1]
1.50s call     tests/test_04_freg.py::TestClass::test01_freg_check_users[test1]
1.13s call     tests/test_98_events_in_kibana.py::TestClass::test03_external_events[test1]
1.13s call     tests/test_98_events_in_kibana.py::TestClass::test03_external_events[test1]
1.11s setup    tests/test_06_keyregistration_no.py::TestClass::test01_frontend[test1]
1.06s call     tests/test_01_services_up.py::TestClass::test04_group_operators_must_exists[test1]
1.05s call     tests/test_01_services_up.py::TestClass::test04_group_operators_must_exists[test1]
1.02s call     tests/test_99_prometheus_errors.py::TestClass::test01_prometheus_errors[test1]
0.85s call     tests/test_99_prometheus_errors.py::TestClass::test01_prometheus_errors[test1]
0.76s call     tests/test_00_vulnerabilities.py::TestClass::test01_safety
0.76s call     tests/test_00_vulnerabilities.py::TestClass::test01_safety
0.72s call     tests/test_12_passport_mock.py::TestClass::test01_enroll_user[test1]
0.71s call     tests/test_12_passport_mock.py::TestClass::test01_enroll_user[test1]
0.44s call     tests/test_01_services_up.py::TestClass::test02_health[test1]
0.44s call     tests/test_01_services_up.py::TestClass::test02_health[test1]
0.14s call     tests/test_00_init.py::TestClass::test01_init[test1]
0.12s call     tests/test_05_otp.py::TestClass::test01_gen_otp[test1]
0.12s call     tests/test_05_otp.py::TestClass::test01_gen_otp[test1]
0.12s call     tests/test_05_fido2.py::TestClass::test02_fido2_accepted_authenticators[test1]
0.11s call     tests/test_05_fido2.py::TestClass::test02_fido2_accepted_authenticators[test1]
0.09s call     tests/test_00_init.py::TestClass::test01_init[test1]
0.08s call     tests/test_02_scim.py::TestClass::test07_put_method_not_allowed[test1]
0.07s call     tests/test_02_scim.py::TestClass::test07_put_method_not_allowed[test1]
0.07s call     tests/test_99_logstash.py::TestClass::test01_gather_logstash[test1]
0.07s call     tests/test_99_logstash.py::TestClass::test01_gather_logstash[test1]
0.07s call     tests/test_05_phone.py::TestClass::test01_generate_code[test1]
0.07s call     tests/test_05_phone.py::TestClass::test01_generate_code[test1]
0.06s call     tests/test_10_phone_registration_en.py::TestClass::test01_delete_user_on_phone[test1]
0.06s call     tests/test_02_scim.py::TestClass::test02_config[test1]
0.06s call     tests/test_10_phone_registration_en.py::TestClass::test01_delete_user_on_phone[test1]
0.06s call     tests/test_02_scim.py::TestClass::test02_config[test1]
0.05s call     tests/test_04_passport.py::TestClass::test01_passport_verify_token[test1]
0.05s call     tests/test_04_passport.py::TestClass::test01_passport_verify_token[test1]
0.05s setup    tests/test_00_init.py::TestClass::test01_init[test1]
0.05s call     tests/test_02_scim.py::TestClass::test10_paging[test1]
0.05s call     tests/test_02_scim.py::TestClass::test10_paging[test1]
0.04s call     tests/test_05_otp.py::TestClass::test02_verify_otp[test1]
0.04s call     tests/test_05_otp.py::TestClass::test02_verify_otp[test1]
0.04s call     tests/test_02_scim.py::TestClass::test09_schema_validation[test1]
0.04s call     tests/test_02_scim.py::TestClass::test09_schema_validation[test1]
0.03s call     tests/test_05_phone.py::TestClass::test02_verify_code[test1]
0.03s call     tests/test_05_phone.py::TestClass::test02_verify_code[test1]
(66 durations < 0.005s hidden.  Use -vv to show these durations.)
================== 46 passed, 9 skipped in 1198.85s (0:19:58) ==================
@nicoddemus
Copy link
Member

Hi @fenchu,

That's strange, should not happen. Any chance you got a plugin installed which runs tests multiple times?

@nicoddemus nicoddemus added the type: question general question, might be closed after 2 weeks of inactivity label Apr 5, 2022
@fenchu
Copy link
Author

fenchu commented Apr 6, 2022

the tests are only run once, you see the times are the same,
I use the following plugin, but it is the same without:

'Plugins': {'html': '0.1.dev415', 'metadata': '1.11.0', 'reportportal': '5.0.12'}

is it possible to alter this list via conftest.py, reason is that reportportal uses it for reporting. and dobule entries messes up the settings.

@nicoddemus
Copy link
Member

I use the following plugin, but it is the same without:

Hmm weird. Can you provide a minimal reproducible example?

@Zac-HD Zac-HD added the status: needs information reporter needs to provide more information; can be closed after 2 or more weeks of inactivity label Jun 1, 2022
@Zac-HD
Copy link
Member

Zac-HD commented Jun 1, 2022

Closing this because we can't do anything more without a reproducing example. Might be related to #9909?

@Zac-HD Zac-HD closed this as completed Jun 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
status: needs information reporter needs to provide more information; can be closed after 2 or more weeks of inactivity type: question general question, might be closed after 2 weeks of inactivity
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@nicoddemus @fenchu @Zac-HD