1

What are the chief causes for defect leakage into software despite stringent quality measures being applied?

Why do bugs still happen and how can they be mitigated?

I know that with good coding practices and careful quality measures many bugs can be prevented, but I don't understand why they can't all be prevented. It can't be that the programmers aren't good enough because even very good programmers write code with flaws. It can't be that the testers aren't doing their jobs properly because they find many bugs even when the programmers are using the best possible combination of tools and techniques to write the code.

2
  • 1
    You should provide more details because yet it is not clear what you're asking. To broad context. Explain your particular situation in more details.
    – Alexey R.
    Oct 30 '18 at 10:34
  • 3
    This question has the potential to be great - with some editing it could be an excellent reference question for this site.
    – Kate Paulk
    Oct 30 '18 at 11:26
5

There are several factors involved in the reasons it's impossible to create non-trivial bug-free software.

Technical

Even the simplest software has effectively infinite pathways through it. Consider a very basic calculator application, one that allows addition, subtraction, multiplication, and division. Not only does it need to detect keyboard input and know which calculations to perform, it needs to be able to follow the order of operations rules, handle nested brackets, and generate the correct answers.

Then, on the user interface side, it also needs to be able to handle undo or cancel operations at any time. It has to maintain the full list of user input and not calculate anything until the user triggers calculation (generally with =) because otherwise input such as 1 + 2 * 3 would return 9 instead of 7.

If that were not enough, the app is using the underlying architecture to perform its operations. In the calculator example, it might be using libraries from the language it was programmed in, but those libraries are calling on the machine GPU to actually perform the calculations. The notorious Pentium Bug comes to mind here.

User-Related

What a developer or tester sees as a bug is not necessarily what a user sees as a bug. If you're writing say, point of sale software, users will want the process of selling something and collecting payment to be quick and easy. They'll accept a clumsier product set-up process because they'll be spending most of the time they use the software making sales transactions.

Imagine a word processor where the process of writing or editing a document was the most complicated part of using it - users would consider that a defect even though technically the software is doing what it's designed to do. Similarly, today's users would likely consider using anything other than an x icon to indicate a close button a bug because twenty-some years of personal computing has taught them that x means close.

Interactivity

Modern software does not run in isolation. Even embedded device software is typically communicating with something. That means that the software has to be able to manage its communications, handle its memory requirements with grace, and not leave resources locked after it quits.

General Comments

As a rule, any software is trying to solve at least one problem for at least one person. Often software attempts to solve multiple related problems for multiple people with similar problems.

Every interaction between modules, every potential configuration setting, every problem, every potential user forms an "edge", a place where some part of the software interacts with something else. Each new edge multiplies the complexity of the software exponentially, because it has to interact in some way with (usually) every other edge.

That level of interaction quickly becomes impossible for human minds to manage. We can write software that has millions of interaction points, but we can't truly understand it. The best we can do is keep a small subset in our minds at a given time.

This means that even if all the technical, user-related, and interactivity-related potential problems can be prevented (which usually isn't possible), we're still going to miss things because there's simply too much in any non-trivial application for any human to handle.

The Short-Short Version

By its nature software works in binary logic. Something is or it is not. Even the work towards AI eventually decomposes to binary in the form of something is above the probability threshold or it isn't.

Reality is complex and often fuzzy/analog where something can be part of something else or partway through a process, or both.

While this remains true, there will always be bugs because it's impossible for software to completely handle the kinds of things people do all the time instinctively, and people will always see the gaps as bugs.

3
  • Great summary. I think the point "What a developer or tester sees as a bug is not necessarily what a user sees as a bug." is really valid in today's software scenario.
    – srini
    Oct 31 '18 at 17:48
  • 1
    Thanks! One of the blog posts that started me thinking along those lines was about perceived vs objective quality: blogs.msdn.microsoft.com/steverowe/2014/06/23/… - the short version being that if the most common path is solid, people will be more forgiving of issues in the less common pathways and perceive a higher quality level than an objective measurement might return.
    – Kate Paulk
    Nov 1 '18 at 12:04
  • +1 for perceived vs objective. Nov 22 '18 at 3:57
4

There is a says in testing

There is no patch for Human Stupidity ..!!!

There are many reasons for software bugs human mistakes in software design and coding. There is a very good BLOG may help to find your answer in detail, I believe your answer hidden inside this question.

Why Does Software Have Bugs?

3

Not really much that could be added to Kate's answer, but here is my attempt anyway.

Is it possible? - Maybe, but NOT Feasible.

Going through all of the permutations of data, configurations, interactions, edge cases, negative cases, failure cases, unknown cases (this one may be tricky) would take a tremendous amount of time and effort. I doubt any organization is ready to allocate a budget and time for this level of testing.

So, trade-offs have to be made. We have to make sure that we test as much as we can in the time frame and budget that we are given. This is why in some organizations, requirements are given risk assessments. How likely is this to fail? How complex? How much is this feature used? If this feature fails, how bad is the impact to the rest of the application? How bad is the impact to the customer?

All of these trade-offs mean that we know that we are not going through every single scenario that is possible. Our hope is that we can make educated decisions to reduce the possibility that bugs that do make it through to the end-user are not catastrophic.

1
  • It's Aristotelian possible - technically not zero, but not bloody likely Oct 31 '18 at 16:59
0

Have a look at Lecture 5: impossibility of complete testing by Cem Kaner. It provides a nice picture why testing is complex and why being 'complete' and therefore prevent all problems is impossible.

Another interesting point is the question what is a bug? What seem wrong to you might not seem wrong to me. You believe you have found all relevant bugs and I think it is riddled by them. So even finding common ground there is not easy.

I think in some way your question is a bit like: "why can't accidents be completely prevented"?

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.