Feature request: Ability to perform "incremental runs" or "resume runs"

[jmg-duarte]

Motivation

I'm migrating a codebase from one library to another, this is breaking a bunch of setup code that is specific to single tests — i.e. all tests broke, but test A has a slightly different setup cerimony than test B, etc

Since the suite is long, I don't want to re-run A when I fix B, and rerun B when I fix C, etc

Proposal

Under a certain flag, or run kind (--incremental for example), nextest should be able to keep track of passed and failed tests and it doesn't run tests that already passed.

Alternatives

I list all tests manually, run nextest with said big list and remove them one by one.

Additional context

No response

[sunshowers]

This is a long-requested feature -- see #1265 for some initial work that I did. Looking for folks to help out!

[nachog00]

I would love this feature. I work with a massive testsuite that takes really long to run. After running it once and getting something like 5-10 fails, I can't find some easy way of re-running only those failing ones. I suppose a manual filter-set listing the tests would work? pretty cumbersome to set up tho.

[sunshowers]

This is now available: https://nexte.st/docs/features/record-replay-rerun/