flake: e2e create workspace with default and required parameters

[flake-investigator]

CI Run: https://github.com/coder/coder/actions/runs/19690006849
Commit: 9c2f94b574fc40d79d9abb0d23ef71b18a9d6b4f (Benjamin Cohen)
Job: test-e2e

Failure summary:

• Playwright test failed: [tests] › e2e/tests/workspaces/createWorkspace.spec.ts:79:5 › create workspace with default and required parameters
• Assertion mismatch in helpers.ts when verifying parameter input value

Error excerpt:

Error: expect(received).toEqual(expected) // deep equality

Expected: "12345"
Received: ""

at helpers.ts:211
  209 |     const parameterField = parameterLabel.locator("input");
  210 |     const value = await parameterField.inputValue();
> 211 |     expect(value).toEqual(buildParameter.value);
      |                   ^
  212 |   }
  213 |   break;
  214 |   default:
  at verifyParameters (site/e2e/helpers.ts:211:20)
  at site/e2e/tests/workspaces/createWorkspace.spec.ts:103:2

Timing verification:

• Job completed at 2025-11-26T02:06:23Z (within minutes of Slack alert at 02:27Z).

Duplicate check:

• Searched coder/internal for similar issues by test name and key error messages ("create workspace with default and required parameters", "verifyParameters", Playwright e2e) — none found.

Initial assessment:

• Root cause classification: Flaky test or product change affecting default parameter handling.
• Recent changes to parameters and e2e tests exist (e.g., removal of classic parameters frontend code). This failure suggests the test expects an initial value of "12345" but UI input is empty.

Assignment analysis:

• Primary: test ownership. The failing spec lives at site/e2e/tests/workspaces/createWorkspace.spec.ts and helper at site/e2e/helpers.ts.
• Recent meaningful changes to the spec file were by Kayla Washburn-Love. GitHub did not allow assigning automatically; leaving unassigned and tagging the area for triage.

Next steps requested:

• Confirm whether the expected default parameter value still applies post-frontend changes.
• If behavior change is intended, update the test expectations; otherwise, fix the UI logic and/or test setup that populates default/required parameters.

[flake-investigator]

New occurrence detected in main.

• CI Run: https://github.com/coder/coder/actions/runs/19692001331
• Job: test-e2e
• Commit: c87c33f7dda82eb91ee8ba9504f749101bb367d6 (Mykyta Protsenko)
• Job timing: completed at 2025-11-26T04:13:00Z (Slack alert at ~04:16Z) — within minutes.

Failure excerpt:

[tests] › e2e/tests/workspaces/createWorkspace.spec.ts:79:5 › create workspace with default and required parameters

Error: expect(received).toEqual(expected) // deep equality

Expected: "12345"
Received: ""

at helpers.ts:211
  209 |     const parameterField = parameterLabel.locator("input");
  210 |     const value = await parameterField.inputValue();
> 211 |     expect(value).toEqual(buildParameter.value);
      |                   ^
  212 |   }
  213 |   break;
  214 |   default:
  at verifyParameters (/home/runner/work/coder/coder/site/e2e/helpers.ts:211:20)
  at /home/runner/work/coder/coder/site/e2e/tests/workspaces/createWorkspace.spec.ts:103:2

Classification: Flaky E2E test (Playwright) — parameter input value is empty when expecting user-specified value.

Notes:

• Other jobs (including test-go-race-pg) passed; not a matrix cancellation artifact.
• Console shows repeated 403s to /api/v2/deployment/stats, likely unrelated to the assertion failure.

Please see the run for artifacts (failed test video, debug logs) linked above for further triage.

[flake-investigator]

Reoccurrence detected.

CI run: https://github.com/coder/coder/actions/runs/19692001331/job/56410125648
Commit: c87c33f7dda82eb91ee8ba9504f749101bb367d6 (Mykyta Protsenko)
Job: test-e2e
Completed: 2025-11-26T04:13:00Z

Failure summary:

• Playwright test failed: [tests] › site/e2e/tests/workspaces/createWorkspace.spec.ts:79:5 › create workspace with default and required parameters
• Assertion mismatch in helpers.ts when verifying parameter input value

Error excerpt:

Error: expect(received).toEqual(expected) // deep equality

Expected: "12345"
Received: ""

at helpers.ts:211
  209 |     const parameterField = parameterLabel.locator("input");
  210 |     const value = await parameterField.inputValue();
> 211 |     expect(value).toEqual(buildParameter.value);
      |                   ^
  212 |   }
  213 |   break;
  214 |   default:
  at verifyParameters (site/e2e/helpers.ts:211:20)
  at site/e2e/tests/workspaces/createWorkspace.spec.ts:103:2

Additional notes:

• Not a matrix cancellation artifact (run_attempt=1, actual e2e test failure).
• No data race, panic, or OOM indicators present in logs.

Artifacts:

• Failed test video: https://github.com/coder/coder/actions/runs/19692001331/artifacts/4681715710
• Debug log: https://github.com/coder/coder/actions/runs/19692001331/artifacts/4681715762
• pprof dumps: https://github.com/coder/coder/actions/runs/19692001331/artifacts/4681715812

Root cause classification: Flaky test (expected default parameter value not present in UI under test).

Please see if recent parameter defaulting changes or test setup affect this expectation and adjust test or product behavior accordingly.

[flake-investigator]

Reoccurrence detected in main CI.

CI Run: https://github.com/coder/coder/actions/runs/19698739304
Job: test-e2e
Commit: e7dbbcde87e73a3785f8fccbd6caadf46e2d5018 (Danielle Maywood)
Completed: 2025-11-26T09:47:59Z (Slack alert at ~09:53Z)

Failure summary:

• Playwright test failed: [tests] › e2e/tests/workspaces/createWorkspace.spec.ts:79:5 › create workspace with default and required parameters
• Assertion mismatch in helpers.ts when verifying parameter input value

Error excerpt:

Error: expect(received).toEqual(expected) // deep equality

Expected: "12345"
Received: ""

at helpers.ts:211
  209 |     const parameterField = parameterLabel.locator("input");
  210 |     const value = await parameterField.inputValue();
> 211 |     expect(value).toEqual(buildParameter.value);
      |                   ^
  212 |   }
  213 |   break;
  214 |   default:
  at verifyParameters (/home/runner/work/coder/coder/site/e2e/helpers.ts:211:20)
  at /home/runner/work/coder/coder/site/e2e/tests/workspaces/createWorkspace.spec.ts:103:2

Additional context seen in logs:

• Multiple 403 responses from /api/v2/deployment/stats during the test, e.g.:
  • GET http://localhost:3111/api/v2/deployment/stats -> 403 Forbidden

Classification: Flaky test (UI parameter value not populated as expected). No panic/OOM/data-race indicators observed in this run; other checks passed and the failure is isolated to e2e.

Link to artifacts (failed test video, debug logs):

• https://github.com/coder/coder/actions/runs/19698739304/artifacts/4684083221 (video)
• https://github.com/coder/coder/actions/runs/19698739304/artifacts/4684083296 (debug log)
• https://github.com/coder/coder/actions/runs/19698739304/artifacts/4684083359 (pprof dump)

Assignment: Keeping existing assignment; this matches the same failing scenario already tracked here.

If helpful, the spec defines the expected values at site/e2e/tests/workspaces/createWorkspace.spec.ts around line ~79, and the failing check is in site/e2e/helpers.ts around the string/number input path (inputValue() equality).

[flake-investigator]

New occurrence on main.

• CI Run: https://github.com/coder/coder/actions/runs/19727625664
• Commit: caf711d70a05e58fc12b82cbb5befe79fb3c162d (Jake Howell)
• Job: test-e2e
• Failing test: [tests] › site/e2e/tests/workspaces/createWorkspace.spec.ts:112:5 › create workspace and overwrite default parameters

Error excerpt:

Error: expect(received).toEqual(expected) // deep equality

Expected: "AAAAA"
Received: "abc"

at helpers.ts:211
  209 |                 const parameterField = parameterLabel.locator("input");
  210 |                 const value = await parameterField.inputValue();
> 211 |                 expect(value).toEqual(buildParameter.value);
      |                               ^
  212 |             }
  213 |             break;
  214 |         default:
  at verifyParameters (site/e2e/helpers.ts:211:20)
  at site/e2e/tests/workspaces/createWorkspace.spec.ts:140:2

Notes:

• Matches the same helper assertion and area as this issue’s original report (parameter value verification in verifyParameters).
• Recent changes touching these files:
  • helpers.ts last modified in: chore: remove classic parameters frontend code (#20710) — 956cbe77511f743046ee55e739d12bce0f1f2fa4
    coder/coder@956cbe7
  • Spec also updated in that timeframe.

Assessment: Flaky/product-behavior mismatch in parameters UI/tests. Suggest reviewing expected vs actual for overwritten parameter values in the new parameters flow and adjusting either the UI logic or the test fixture as appropriate.

[flake-investigator]

New occurrence on main.

CI run: https://github.com/coder/coder/actions/runs/19756084671
Job: test-e2e
Head SHA: ce627bf23f86fc251e24c1c1cfbe1f749d7127dc
Completed: 2025-11-28T06:41:01Z (within minutes of Slack alert)

Failure details:

• Playwright test failed: [tests] › site/e2e/tests/workspaces/createWorkspace.spec.ts:79:5 › create workspace with default and required parameters
• Assertion mismatch in verifyParameters (site/e2e/helpers.ts)

Error excerpt:

Error: expect(received).toEqual(expected) // deep equality

Expected: "12345"
Received: ""

at helpers.ts:211
  209 |     const parameterField = parameterLabel.locator("input");
  210 |     const value = await parameterField.inputValue();
> 211 |     expect(value).toEqual(buildParameter.value);
      |                   ^
  212 |   }
  213 |   break;
  214 |   default:
  at verifyParameters (site/e2e/helpers.ts:211:20)
  at site/e2e/tests/workspaces/createWorkspace.spec.ts:103:2

Classification: Flaky E2E or behavior change in parameter UI/verification. No data race or process crash indicators in logs.

Ownership analysis:

• The failing assertion is in site/e2e/helpers.ts within verifyParameters(). Recent changes to this function were introduced by commit 956cbe77511f743046ee55e739d12bce0f1f2fa4 ("chore: remove classic parameters frontend code (#20710)") which updated selectors to use displayName and altered parameter handling. This may be related to the empty input value observed here.
• The spec itself (createWorkspace.spec.ts) was not modified recently around the failing test region (lines 78–110).

Suggested next steps:

• Confirm whether required/mutable parameter inputs should be pre-populated at creation time in this flow. If intended behavior changed with the parameters revamp, update verifyParameters() and/or the test expectations accordingly. Otherwise, adjust UI logic or e2e setup to ensure the input reflects provided buildParameters (e.g., { name: sixthParameter.name, value: "12345" }).

I will continue to watch for additional occurrences.