-
Notifications
You must be signed in to change notification settings - Fork 130
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add runtime observation type to LLVM service. #307
Add runtime observation type to LLVM service. #307
Conversation
Codecov Report
@@ Coverage Diff @@
## development #307 +/- ##
===============================================
+ Coverage 85.59% 85.88% +0.28%
===============================================
Files 87 87
Lines 4700 4754 +54
===============================================
+ Hits 4023 4083 +60
+ Misses 677 671 -6
Continue to review full report at Codecov.
|
1d6e0ac
to
6f7bb7e
Compare
6f7bb7e
to
b731133
Compare
601c938
to
43bbb79
Compare
43bbb79
to
bea089f
Compare
This extends RETURN_IF_ERROR() with an additional try/catch block to report details of an exception that is raised.
eb1a4b8
to
6dc33e6
Compare
This adds support to the LLVM environments for optimizing for runtime. To evaluate the runtime, the LLVM-IR module is compiled down to a binary and executed on the host machine multiple times. The wall time of each execution is then returned as a list. This is exposed through a new
Runtime
observation space.To compute the program runtimes, use the new
Runtime
observation space:The
Runtime
observation space returns a list of runtimes in seconds, resulting from running the compiled binary multiple times. Set the number of runtimes to measure using:This supports the
cbench-v1
dataset partially and thecsmith-v0
dataset fully. To check if a benchmark is compatible with the runtime observation space, use theIsRunnable
observation: