New benchmark runners

[alecandido]

#95

[codecov]

Codecov Report

Merging #99 (01ba64b) into develop (247d6e7) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop      #99   +/-   ##
========================================
  Coverage    71.34%   71.34%           
========================================
  Files           48       48           
  Lines         1888     1888           
========================================
  Hits          1347     1347           
  Misses         541      541           

Flag	Coverage Δ
unittests	71.34% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

[giacomomagni]

From my side it's possible to merge. I added a small modification in the yadmark runner to make it more flexible with the order of the points returned by the external program.

[felixhekhorn]

running with pytest I still get 2 errors for xspace-bench:

E                   ValueError: Sort problem: x and/or Q2 do not match.
...
======================================== short test summary info ========================================
FAILED benchmarks/runners/xspace_bench_bench.py::BenchmarkPlain::benchmark_lo - ValueError: Sort probl...
FAILED benchmarks/runners/xspace_bench_bench.py::BenchmarkPlain::benchmark_nlo - ValueError: Sort prob...

please make sure to have pytest report everything passed

[felixhekhorn]

and in qcdnum I get

E                   NotImplementedError: flavor total is not implemented!

[felixhekhorn]

Remember to mark the conversations as "resolved" if it is ;-)