fix coverage paths

[dbanda]

Some of the tests were overwriting each others coverage files. This fix renames the coverage paths to give each tests its own coverage file.

[codecov-commenter]

Codecov Report

Base: 91.14% // Head: 21.68% // Decreases project coverage by -69.46% ⚠️

Coverage data is based on head (25581da) compared to base (9b91174).
Patch has no changes to coverable lines.

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #3499       +/-   ##
===========================================
- Coverage   91.14%   21.68%   -69.47%     
===========================================
  Files         717      673       -44     
  Lines       33371    32124     -1247     
===========================================
- Hits        30415     6965    -23450     
- Misses       2956    25159    +22203     

Impacted Files	Coverage Δ
tests/base.py	0.00% <0.00%> (-100.00%)	⬇️
tests/helpers.py	0.00% <0.00%> (-100.00%)	⬇️
tests/conftest.py	0.00% <0.00%> (-100.00%)	⬇️
tests/fixtures.py	0.00% <0.00%> (-100.00%)	⬇️
tests/test_cli.py	0.00% <0.00%> (-100.00%)	⬇️
tests/test_util.py	0.00% <0.00%> (-100.00%)	⬇️
snuba/admin/user.py	0.00% <0.00%> (-100.00%)	⬇️
tests/assertions.py	0.00% <0.00%> (-100.00%)	⬇️
tests/test_redis.py	0.00% <0.00%> (-100.00%)	⬇️
tests/test_writer.py	0.00% <0.00%> (-100.00%)	⬇️
... and 644 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[lynnagara]

Thanks!

[lynnagara]

Is this why we have reports like the one posted above in this PR? (project coverage changed by -69.46%)

[dbanda]

Is this why we have reports like the one posted above in this PR? (project coverage changed by -69.46%)

That's one of the reasons. But the bigger issue is that sometimes codecov uploads fail. They are pretty unreliable. But by default codecov will not return a fail code if that happens. you have to specify that behavior with the -Z flag.