Skip to content

test(e2e): unify testagent-lifecycle waits on a shared 15s timeout - #99

Draft
paultyng wants to merge 2 commits into
mainfrom
fix/deflake-test-ui-mcp-timeout
Draft

test(e2e): unify testagent-lifecycle waits on a shared 15s timeout#99
paultyng wants to merge 2 commits into
mainfrom
fix/deflake-test-ui-mcp-timeout

Conversation

@paultyng

Copy link
Copy Markdown
Owner

test-ui has flaked on main since ~2026-07-07 on 10s readiness/exit waits that time out on loaded CI runners. ac3607a already bumped dashboard's equivalent wait 5s→15s ("MCP connect latency on loaded CI runners is the dominant flake driver") but never propagated it.

Extract AGENT_LIFECYCLE_TIMEOUT_MS (15s) in ptyCapture.ts and route all 11 mcp connected: / session-exit waits through it (idea-session, demos, claude-sync, sidebar-collapse) so the value can't drift back below the proven threshold.

Follow-ups (not this PR):

  • command-palette.spec.ts:124 — separate navigation-timing flake, not MCP-connect.
  • testagent Connect() has no retry: a transient MCP initialize failure becomes a hard timeout (upstream paultyng/testagent).

🤖 Generated with Claude Code

paultyng and others added 2 commits August 11, 2026 12:17
The MCP-connect readiness and session-exit status waits were duplicated
across specs with a 10s literal, while ac3607a had already bumped
dashboard's equivalent wait to 15s ("MCP connect latency on loaded CI
runners is the dominant flake driver"). The un-propagated 10s copies in
idea-session/demos/claude-sync/sidebar-collapse time out under CI load —
the recurring test-ui flake since ~2026-07-07.

Extract AGENT_LIFECYCLE_TIMEOUT_MS (15s) in ptyCapture.ts and route all
11 readiness/exit waits through it so the value can't drift back down.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
review-all C1: screenshots.spec.ts's mcp-connected buffer-scan was left
at 10s — same flake class as the others, and it runs in CI test:ui (no
testIgnore). Route it through AGENT_LIFECYCLE_TIMEOUT_MS too.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant