Skip to content

[evals] evals welcome — animated onboarding on the agent benchmarks #2880

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
miguelg719 wants to merge 5 commits into from
Closed

[evals] evals welcome — animated onboarding on the agent benchmarks #2880

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
c2c60db
feat(evals): terminal animation engine + block typography for onboarding
miguelg719 Sep 3, 2026
0517867
feat(evals): `evals welcome` — three onboarding designs on the agent …
miguelg719 Sep 3, 2026
81636e9
docs/test(evals): welcome onboarding — README section, framework unit…
miguelg719 Sep 3, 2026
17f432c
feat(evals): welcome intro — the mark from geometry; `welcome intro` …
miguelg719 Sep 4, 2026
f89d974
fix(evals): welcome intro — smaller mark (24×12 cells, centered)
miguelg719 Sep 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions packages/evals/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,18 @@ Inside the REPL (or as `evals <command>` from your shell):

Use `Esc` to abort an in-flight run without exiting the REPL.

### Onboarding

`evals welcome` runs a guided first-run flow built on the agent benchmarks. Three designs are available while we decide which one ships. Each opens with the same short intro (logo → what we measure → top of the board):

| Command | Design |
| ----------------- | ------------------------------------------------------------------------- |
| `evals welcome a` | **Arena** — three models race the same real WebVoyager task in lanes |
| `evals welcome b` | **Trace** — scrub through a recorded agent trajectory (← → space) |
| `evals welcome c` | **Dialogue** — the agent narrates a real task in first person, chat-style |

`evals welcome intro` plays just the shared opening (handy while iterating on the animation). `welcome` alone shows a picker; `welcome-a`, `welcome-b`, `welcome-c` are one-token spellings. With a provider key and a browser each design hands off to a real `run b:webvoyager -l 3`; without them it replays scripted trajectories of real benchmark tasks and says what unlocks the real thing. Set `EVALS_WELCOME_WIZARD=<variant>` (or `1`) to auto-run one on the first REPL launch; `EVALS_NO_WELCOME=1` suppresses the first-run welcome. Esc skips ahead, Ctrl+C cancels.

## Run targets

`evals run` accepts any of these shapes:
Expand Down
Loading
Loading