@@ -19,18 +19,22 @@ To run the benchmarks, simply load this file normally or build it with
19
19
20
20
## The `bchmk` command.
21
21
22
- This is a custom command with the following syntax :
23
- `#bchmk (nIter : Nat) with (l : List Nat) using (b : Benchmark)`
22
+ This is a custom command with syntax
23
+ ```
24
+ #bchmk (nIter : Nat) with (l : List Nat) using (b : Benchmark)
25
+ ```
24
26
25
- In this command, `nIter` determines the number of times the benchmark will be run.
27
+ `nIter` determines the number of times the benchmark is be run.
26
28
27
- Then, given `l : List Nat` we execute a benchmark `b` for each element of `l`.
29
+ Then, given `l : List Nat`, we execute a benchmark `b` for each element of `l`.
28
30
We output the average over `nIter` runs for each element of `l`.
29
- See below for a description of the different benchmarks studied. (Uncomment the #check benchX)
31
+ See below for a description of the different benchmarks studied. (Uncomment the
32
+ `#check benchX` lines.)
30
33
31
- See also `Benchmark/Basic` for the definition of the `Benchmark` type.
34
+ See `Benchmark/Basic.lean ` for the definition of the `Benchmark` type.
32
35
33
36
## Lists with relevant values
37
+
34
38
We run the benchmarks on the following lists:
35
39
36
40
- `pows (n : Nat)` :
@@ -40,13 +44,12 @@ The list of the first `n` powers of two : `(List.range n).map (2 ^ ·)`
40
44
The range between `1` and `n - 1`: `(List.range' 1 (n - 1))`
41
45
This contains the relevant values for the depth test.
42
46
43
- ## Technical Detail
44
- The benchmarks are set up with the same configuration as in the paper.
45
- However by default they do only one run (As opposed of taking the average of 20 runs).
46
- This take about 8 minutes on our machine.
47
- (MacBook Pro with an Apple M2 Pro processor and 32GB of RAM.)
47
+ ## Benchmark Configuration
48
48
49
- To run the exact same test as shown in the paper, set `nIter` to 20.
49
+ The benchmarks are set up with the same configuration as in the paper, only with
50
+ `nIter = 1` instead of `nIter = 20`.
51
+ This take about 8 minutes on our machine (a MacBook Pro with an Apple M2 Pro
52
+ processor and 32GB of RAM).
50
53
-/
51
54
52
55
/- We effectively disable Lean's deterministic timeout mechanism
0 commit comments