25

I am an entry-level tester and been experiencing new things about testing every day which is great. So I am thinking, how do I deal with an intermittent bug since its most likely that developers won't be able to reproduce the error. Should I file it still for the record?

0

3 Answers 3

31

Yes, by all means - you must write a bug report! In your report, note that the bug is intermittent, and leave comments about your investigation, what you have done to try and reproduce the problem, and any other clues you can think of.

  • Developers may not be able to reproduce the issue, but they may be able to see the bug in the code itself, or add additional code to help expose the bug
  • Another reader of the bug report may be able to add additional information which leads to a way to reproduce the bug
  • Sometimes writing it down, walking away for a day, then returning to the bug can lead to a breakthrough for reproducing the bug

Perhaps it turns out not to be an important bug, or not to be an actual bug at all. In that case, it has only cost you a little bit of time.

The only way you can lose here is to not write a bug report, only to find out later that it was indeed an important bug. Imagine that the VP of Client Services comes to you and says that an important customer has this bug. Then she asks you why you didn't find it first. Are you going to be happy to say "Well, I did find it, but because it was intermittent, I didn't bother to file a bug report"? Yikes!

Here's more on my thinking: https://strazzere.blogspot.com/2010/04/non-reproducible-bugs.html

And here's an excellent article from James Bach about How to Investigate Intermittent Issues: http://www.satisfice.com/blog/archives/34

5
  • 4
    Absolutely agree. Another technique I like to use if you have automation is to execute the automation a number of times (100?) and see how often it occurs and see if there are any patterns you can see about when/why it occurs.
    – Sam Woods
    Jan 3, 2013 at 17:29
  • Excellent point, Sam! Use whatever tools you have at your disposal - and test automation is most likely candidate. Jan 3, 2013 at 19:49
  • i don't know how to do automation testing at the moment but will surely keep this in mind. thank you. Jan 4, 2013 at 1:58
  • 1
    There's a number of posts on StackExchange how to gather more information for such bugs to help isolate/reproduce them: stackoverflow.com/questions/1102716/…, stackoverflow.com/questions/1102716/…. Some solutions may require closer cooperation with devs, e.g., adding more logging to the code under test.
    – dzieciou
    Jan 5, 2013 at 7:25
  • @JoeStrazzere - In addition, IMO, it is good to record a video of the bug if possible, so that people know that you saw a real issue. This is especially useful when you don't have logs or access to logs. Get a free/paid screen recorder & keep it handy at all times.
    – JohnSink
    Jul 27, 2017 at 22:23
10

Log the bug.

Firstly, it's often turns out to be useful to have a record of the bug. If the bug manifests itself on a customer's machine at some later point (perhaps months later) and it suddenly becomes important to fix it, at least you've got somewhere to start from.

Even if the developer cannot reproduce the bug, they may be able to add extra logging that will help identify the cause if the bug appears again. They may also be able to review their code and identify the cause that way.

4

You should certainly log the issue, probably with the word intermittent in the title and perhaps a keyword/tag specifically for these kinds of bugs (depending upon your defect tracker).

In addition to the steps taken to recreate this bug, because so many of them depend on what you did before the particular operation that triggered the bug, try to capture as many of the steps you can remember between your fresh session and the bug.

For example, instead of just associating the bug with the Edit a Comment function with the steps associated with what post you commented on and what text you entered in the comment, try to frame it with some of the things you did before that (I visited the site, I logged in, I looked at my profile, I changed my avatar, I clicked a like and then clicked the unlike, I added a comment to post A, and then I added a comment to post B and the error occurred.

These valuable details might help establish a pattern, especially if you revisit the report and add this path every time it occurs.

Some Friday, when you've got an hour to kill until quitting time and your desk already sparkles, you might want to look for these kinds of bugs and see what sort of pattern emerges over time.

Oh, and for Pete's sake, don't let them close intermittent issues as not reproducible.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.