Skip to content

eval: fix flaky testProcessor state machine in EvaluatorSuite#1895

Merged
brharrington merged 1 commit intoNetflix:mainfrom
brharrington:flakey
Apr 10, 2026
Merged

eval: fix flaky testProcessor state machine in EvaluatorSuite#1895
brharrington merged 1 commit intoNetflix:mainfrom
brharrington:flakey

Conversation

@brharrington
Copy link
Copy Markdown
Contributor

Simplify the state machine from 4 states to 3, removing the unreliable check that "one" messages had stopped arriving. With async boundaries and buffering in the pipeline, buffered messages for a removed data source can continue to arrive intermittently, causing the old state 3 to never complete. The simplified version verifies the essential behavior: data source additions and removals propagate correctly.

Simplify the state machine from 4 states to 3, removing the unreliable
check that "one" messages had stopped arriving. With async boundaries
and buffering in the pipeline, buffered messages for a removed data
source can continue to arrive intermittently, causing the old state 3
to never complete. The simplified version verifies the essential
behavior: data source additions and removals propagate correctly.
@brharrington brharrington added this to the 1.9.0 milestone Apr 10, 2026
@brharrington brharrington merged commit d151e0e into Netflix:main Apr 10, 2026
5 checks passed
@brharrington brharrington deleted the flakey branch April 10, 2026 02:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant