Skip to content

Commit

Permalink
benchexec: add an example XML and .set file for benchexec
Browse files Browse the repository at this point in the history
  • Loading branch information
Marek Chalupa authored and mchalupa committed Nov 4, 2020
1 parent 2e5ad16 commit 3bc81f4
Show file tree
Hide file tree
Showing 3 changed files with 28 additions and 1 deletion.
14 changes: 13 additions & 1 deletion misc/benchexec/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,16 @@
## Benchexec modules for running tools from DG

Copy to "benchexec/benchexec/tools" and then you can
Copy the python files to `benchexec/benchexec/tools` and then you can
use the tool in the XML spec of benchexec.

### An example

If you setup benchexec, copy `dgtool.py` to `benchexec/benchexec/tools.py` and
put the path to `dgtool` into PATH (`llvm-slicer` too in the case of
out-of-source build) and run:

```
benchexec llvm-slicer-tests.xml
```

then benchexec will benchmark llvm-slicer on the test files from DG.
14 changes: 14 additions & 0 deletions misc/benchexec/llvm-slicer-tests.xml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
<?xml version="1.0"?>
<!DOCTYPE benchmark PUBLIC "+//IDN sosy-lab.org//DTD BenchExec benchmark 1.9//EN" "https://www.sosy-lab.org/benchexec/benchmark-1.9.dtd">
<benchmark tool="dgtool" timelimit="20 s" memlimit="6 GB" cpuCores="1">

<option name="llvm-slicer"/>
<option name="-c">test_assert</option>

<rundefinition name="slicer-tests">
<tasks name="BenchmarkingSlicingTests">
<includesfile>slicing-tests.set</includesfile>
</tasks>
</rundefinition>

</benchmark>
1 change: 1 addition & 0 deletions misc/benchexec/slicing-tests.set
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
../../tests/slicing/sources/*.c

0 comments on commit 3bc81f4

Please sign in to comment.