Questions tagged [flaky]
"Flaky" term is used to describe tests which produce unstable results
5 questions
2
votes
2
answers
95
views
Is there any tool to determine if a test is flaky?
I'm thinking about a new approach to include autotests to CI/CD pipeline and my thought is to determine if a test is flaky before they are in pipeline.
In this case, the only way to do that is to
...
- 99
6
votes
5
answers
462
views
Balancing readability and reliability in end-to-end testing
One of the things that often helps to make tests more reliable and to reduce flakiness is Explicit Waits - waiting for an element to be visible or clickable before interacting with it, waiting for a ...
- 11.4k
7
votes
1
answer
209
views
Test Quarantine in Protractor
Follow-up to How to deal with flaky tests?
One of the approaches to tackle flaky tests is to temporarily quarantine the tests - move them to a special "bucket" with other flaky tests:
I offer one ...
- 11.4k
23
votes
6
answers
10k
views
How to deal with flaky tests that have intermittent failures?
Having flaky tests that sometimes fail and sometimes pass is very frustrating:
there is no single reason each of the flaky tests fail
the failures don't seem to happen to real users using the ...
- 11.4k
3
votes
1
answer
7k
views
Rerun failed (flaky) tests with Jest
We are using Jest as our test runner for our JavaScript (React and Selenium) tests. We have one or two flaky tests (as TeamCity marks them flaky and we process them as technical-debt), although we ...
- 32.6k