Skip to content

Commit 162edd5

Browse files
committed
Rename "stdlib" benchmark to "build"
1 parent 18598af commit 162edd5

File tree

6 files changed

+20
-20
lines changed

6 files changed

+20
-20
lines changed
Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,28 +1,28 @@
1-
# The `stdlib` benchmark
1+
# The `build` benchmark
22

33
This benchmark executes a complete build of the stage3 stdlib
44
and collects global and per-module metrics.
55

66
The following metrics are collected by a wrapper around the entire build process:
77

8-
- `stdlib//instructions`
9-
- `stdlib//maxrss`
10-
- `stdlib//task-clock`
11-
- `stdlib//wall-clock`
8+
- `build//instructions`
9+
- `build//maxrss`
10+
- `build//task-clock`
11+
- `build//wall-clock`
1212

1313
The following metrics are collected from `leanc --profile` and summed across all modules:
1414

15-
- `stdlib/profile/<name>//wall-clock`
15+
- `build/profile/<name>//wall-clock`
1616

1717
The following metrics are collected from `lakeprof report`:
1818

19-
- `stdlib/lakeprof/longest build path//wall-clock`
20-
- `stdlib/lakeprof/longest rebuild path//wall-clock`
19+
- `build/lakeprof/longest build path//wall-clock`
20+
- `build/lakeprof/longest rebuild path//wall-clock`
2121

2222
The following metrics are collected individually for each module:
2323

24-
- `stdlib/module/<name>//lines`
25-
- `stdlib/module/<name>//instructions`
24+
- `build/module/<name>//lines`
25+
- `build/module/<name>//instructions`
2626

27-
If the file `stdlib_upload_lakeprof_report` is present in the repo root,
27+
If the file `build_upload_lakeprof_report` is present in the repo root,
2828
the lakeprof report will be uploaded once the benchmark run concludes.

tests/bench-radar/stdlib/lean_wrapper.py renamed to tests/bench-radar/build/lean_wrapper.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77
import sys
88
from pathlib import Path
99

10-
NAME = "stdlib"
10+
NAME = "build"
1111
REPO = Path("..")
1212
BENCH = REPO / "tests" / "bench-radar"
1313
STAGE2 = REPO / "build" / "release" / "stage2"

tests/bench-radar/stdlib/run renamed to tests/bench-radar/build/run

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -18,23 +18,23 @@ export PATH="$PWD/$STAGE2/bin:$PATH"
1818

1919
# Substitute our own wrapper script
2020
mv "$STAGE2/bin/lean" "$STAGE2/bin/lean.wrapped"
21-
cp "$BENCH/stdlib/lean_wrapper.py" "$STAGE2/bin/lean"
21+
cp "$BENCH/build/lean_wrapper.py" "$STAGE2/bin/lean"
2222

2323
# Build stage3
24-
"$BENCH/measure.py" -t stdlib \
24+
"$BENCH/measure.py" -t build \
2525
-m instructions -m maxrss -m task-clock -m wall-clock -- \
2626
lakeprof record -- \
2727
make -C build/release -j"$(nproc)" stage3
2828

2929
# Analyze lakeprof data
3030
mv lakeprof.log src
3131
pushd src
32-
lakeprof report -pj | jq -r '"radar::measurement=\({metric: "stdlib/lakeprof/longest build path//wall-clock", value: .[-1][2], unit: "s"})"'
33-
lakeprof report -rj | jq -r '"radar::measurement=\({metric: "stdlib/lakeprof/longest rebuild path//wall-clock", value: .[-1][2], unit: "s"})"'
32+
lakeprof report -pj | jq -r '"radar::measurement=\({metric: "build/lakeprof/longest build path//wall-clock", value: .[-1][2], unit: "s"})"'
33+
lakeprof report -rj | jq -r '"radar::measurement=\({metric: "build/lakeprof/longest rebuild path//wall-clock", value: .[-1][2], unit: "s"})"'
3434
popd
3535

3636
# Upload lakeprof report
3737
# Guarded to prevent accidental uploads (which wouldn't work anyways) during local runs.
38-
if [ -f stdlib_upload_lakeprof_report ]; then
39-
python3 "$BENCH/stdlib/lakeprof_report_upload.py"
38+
if [ -f build_upload_lakeprof_report ]; then
39+
python3 "$BENCH/build/lakeprof_report_upload.py"
4040
fi
Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
#!/usr/bin/env bash
22
set -euo pipefail
33

4-
echo "Running benchmark: stdlib"
5-
tests/bench-radar/stdlib/run
4+
echo "Running benchmark: build"
5+
tests/bench-radar/build/run
66

77
echo "Running benchmark: size"
88
tests/bench-radar/size/run

0 commit comments

Comments
 (0)