Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: write results in separate files #441

Closed
nqb opened this issue Oct 20, 2021 · 3 comments · Fixed by #560
Closed

feat: write results in separate files #441

nqb opened this issue Oct 20, 2021 · 3 comments · Fixed by #560
Assignees
Milestone

Comments

@nqb
Copy link
Contributor

nqb commented Oct 20, 2021

When you use Venom on one system to run several test suites one by one, venom.log and test_results.XX are overwritten by latest test suite.

Steps to reproduce

# cat a.yml 
name: a
version: 2
testcases:
- name: a
  steps:
  - type: exec
    script: echo 'a'

# cat A.yml 
name: A
version: 2
testcases:
- name: A
  steps:
  - type: exec
    script: echo 'A' 

Run test suite one by one:

venom run -v --output-dir=results a.yml
venom run -v --output-dir=results A.yml

Actual results

results/test_results.xml and results/venom.log contains results from A.yml

Expected results

results directory contains results for a.yml and A.yml

Workaround

Run test suite at same time using venom run a.yml A.yml

@nqb
Copy link
Contributor Author

nqb commented Jan 20, 2022

It could be interesting to have a directory per test suite inside output_dir

@yesnault
Copy link
Member

yesnault commented Aug 1, 2022

venom should create different file. test_result_a.xml and test_result_A.xml, same with venom.log file

@yesnault yesnault self-assigned this Aug 1, 2022
@nqb
Copy link
Contributor Author

nqb commented Aug 2, 2022

Agree with your solution @yesnault 👍

@fsamin fsamin added this to the 1.1.0 milestone Aug 2, 2022
yesnault added a commit that referenced this issue Aug 2, 2022
yesnault added a commit that referenced this issue Aug 3, 2022
* feat: output a test_result files per testsuite

close #441

Signed-off-by: Yvonnick Esnault <[email protected]>

* feat: add venom.outputdir var

close #492

Signed-off-by: Yvonnick Esnault <[email protected]>

* feat: venom.x.log if venom.log exists

Signed-off-by: Yvonnick Esnault <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants