Questions tagged [intermittent-failures]

An intermittent fault, often called simply an "intermittent", is a malfunction of a device or system that occurs at intervals, usually irregular, in a device or system that functions normally at other times. Intermittent faults are common to all branches of technology, including computer software.

Filter by
Sorted by
Tagged with
40
votes
6answers
9k views

If a problem only occurs randomly once in every N times on average, how many tests do I have to perform to be certain that it's now fixed?

I know that you can never be 100% sure, but is there a method to determine an appropriate number of tests?
2
votes
2answers
1k views

How can I run one spec 100 times using the command line?

We're getting intermittent failures. Hope can I run one test 100 times to see how 'stable' it is?
2
votes
3answers
439 views

What is the difference between explicit and implicit waits in Selenium? [duplicate]

There is a lot of discussion in the selenium space about explicit and implicit waits. Getting ones wait strategy is clearly key to solving many intermittent test failures. There are warning however ...
2
votes
2answers
82 views

What techniques can I use to determine the reasons for intermittent automated UI test failures?

Intermittent failures of UI feature specs that run in browsers but fail intermittently are the bane of automated testers lives and I've experienced them at every place I've worked at. Not so much ...