Skip to content
Test Linux

test_runner: support test order randomization #80923

Sign in to view logs

test_runner: support test order randomization

test_runner: support test order randomization #80923

Triggered via pull request February 10, 2026 22:34
@pmarchinipmarchini
synchronize #61747
pmarchini:test_runner/deterministic-test-randomizer
Status Failure
Total duration 48m 14s
Artifacts –

test-linux.yml

on: pull_request
Matrix: test-linux
Fit to window
Zoom out
Zoom in

Annotations

4 errors and 2 notices
test-linux (ubuntu-24.04-arm)
Process completed with exit code 2.
test-linux (ubuntu-24.04-arm): test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + + '✔ f.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + - '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/home/runner/work/node/node/node/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/home/runner/work/node/node/node/test/common/assertSnapshot.js:142:3) at async file:///home/runner/work/node/node/node/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/node/node/node/test/test-runner/test-output-randomize-output-cli.mjs
test-linux (ubuntu-24.04)
Process completed with exit code 2.
test-linux (ubuntu-24.04): test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + + '✔ f.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + - '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/home/runner/work/node/node/node/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/home/runner/work/node/node/node/test/common/assertSnapshot.js:142:3) at async file:///home/runner/work/node/node/node/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/node/node/node/test/test-runner/test-output-randomize-output-cli.mjs
sccache stats
58% - 2808 hits, 2050 misses, 0 errors
sccache stats
64% - 3091 hits, 1754 misses, 0 errors