Post

How many times did you press "Re-run failed jobs" this week? I haven't been coding much the last few days, and I still think I'm at 5 😅

Usually there's way too much to dig through to figure out whether a failure is real, or just a flaky test, check or service. So my default reaction is to rerun without checking what's wrong.

Lately we've set up an agent to review every test failure in CI. It decides one of three things: → it's a real failure → it should be rerun → it's been flaky enough to quarantine

Here's one from this week. 1 failing test. It has failed 3 times in 1,038 runs over the last 4 weeks, with the same error each time, and the commit only touched an unrelated email file. Verdict: recurring flake, rerun.

With the Endform MCP server, the agent can access history and trace data from your previous test runs. So it can tell what type of issue it is, whether it's worth rerunning, or quarantine the test directly if it's been causing a lot of trouble lately.