Move temporary dir deletion to inner function, delete temp dir in skipped benchmarks

Move temporary dir deletion to inner function, delete temp dir in skipped benchmarks #168