Skip to main content
92 votes

Found a minor bug, affecting 1% of users. What should QA do?

What I would do with any other bug - report it, write the bug report.
Mate Mrše's user avatar
  • 4,119
52 votes

Found a minor bug, affecting 1% of users. What should QA do?

1% of 100 users is a very different issue to 1% of 1,000,000 users - make your team and stakeholders aware of the issue (preferably in writing, with a defect report) and then they can make the ...
dvniel's user avatar
  • 2,548
36 votes
Accepted

With good unit tests, do I also need acceptance tests?

Is it still needed to write acceptance tests that target verifying those business rules implementation? Yes, it is absolutely necessary. Your unit tests cover the business rules in isolation. ...
Kate Paulk's user avatar
  • 31.5k
30 votes

Found a minor bug, affecting 1% of users. What should QA do?

This is called Risk Analysis. By the book, the over-simplified step is to analyze Impact x Frequency. Things that happen rarely but with huge impact can be prioritized, as well as things with little ...
João Farias's user avatar
  • 10.9k
26 votes

Found a minor bug, affecting 1% of users. What should QA do?

There's already 2 correct answers but I can't stress this enough. You found a bug, you file a bug report. It doesn't matter who it affects or how. It could conceivably affect 0 real users and still ...
xyious's user avatar
  • 361
12 votes

I am a Junior software QA specialist, I am kind lost to understand what to do in this scenario?

Wonder why you want to present this to management? What is your goal here, what do you hope to achieve. Do you want to show them they have unknown quality issues? Normaly I would expect the product ...
Niels van Reijmersdal's user avatar
6 votes

Found a minor bug, affecting 1% of users. What should QA do?

There are plenty of answers here talking about how all users matter. Essentially, this is a good reason to care about rare bugs, but I thought I would give a developer's perspective on some other ...
Josiah's user avatar
  • 161
5 votes

Found a minor bug, affecting 1% of users. What should QA do?

It really depends on many different things like: What is the severity of this bug? What is the effort of fixing it? 1% of how many users? There are a lot more things to consider, but a bug is a bug. ...
Amit Yahav's user avatar
5 votes

Found a minor bug, affecting 1% of users. What should QA do?

How do you know bug will affect only 1% of the Users? Even if bug severity is low (impact low number of user as you say), business like Product owners might increase bug priority and fix it. If you ...
Dusan Kovacevic's user avatar
5 votes

With good unit tests, do I also need acceptance tests?

Yes you should have scenarios which verify the unit tested business rules. Some reasons: good unit tests mock and stub the datastore. Acceptance tests make sure it is configured and works correctly....
Michael Durrant's user avatar
5 votes

BDD / Cucumber - what level of testing can I use it with?

Although the main purpose of BDD is to enhance conversation between people involved in a project is can be used to described any level of test. Besides UAT, one can describe an object behavior (unit ...
João Farias's user avatar
  • 10.9k
5 votes

Found a minor bug, affecting 1% of users. What should QA do?

A bug that is considered minor today may become critical tomorrow. As an example, many external HDDs only implemented USB mass storage properly, and had buggy USB attached SCSI implementation. That ...
Dmitry Grigoryev's user avatar
4 votes

What are good tools for managing user acceptance testing?

Jira, like Trello, VSTS, Pivotal Tracker and others are story ticket management systems. I've used them all and prefer Jira the most due to its UI, usability and integrations with both other ...
Michael Durrant's user avatar
4 votes

BDD / Cucumber - what level of testing can I use it with?

BDD is suitable for all levels of testing, Gherkin not so much. Writing unit-tests with the overhead of Gherkin (e.g. English feature files, regular expressions and functions to execute the tests) is ...
Niels van Reijmersdal's user avatar
4 votes

I am a Junior software QA specialist, I am kind lost to understand what to do in this scenario?

You state you are junior. I wonder if you are a "team of senior + junior QAs and you are one of the juniors of the team" or you are "alone in charge of this". If it's the first case, don't do any ...
Xavi Montero's user avatar
3 votes

Found a minor bug, affecting 1% of users. What should QA do?

What I'd do is, as many already said here, to write a bug report. In it you describe what impact it has (not only in terms of affected users but what it causes as well) and with what frequency it ...
pavelsaman's user avatar
  • 4,548
3 votes

How far would you go in ETL and data warehouse testing?

As a general principle, testing is about risk/reward, which comes down to cost in terms of money/time/resources (people/machines) in various combinations. The test coverage curve will be some sort of ...
Marcus D's user avatar
  • 320
3 votes
Accepted

Is UAT really UAT?

I don't fully agree with your definitions of UAT. "Real world" is a bit vague and could imply "production", which isn't the case - UAT could be performed in a separate, isolated ...
Thomas Owens's user avatar
  • 1,506
2 votes

With good unit tests, do I also need acceptance tests?

Yes, most of the time you do. Personally I have implemented some new features TDD, with 100% unit-test coverage on my classes, but I forgot to update the implementation code that was used during the ...
Niels van Reijmersdal's user avatar
2 votes

With good unit tests, do I also need acceptance tests?

Good unit tests are not interchangeable with acceptance tests. They are different concepts and serve different purposes. Unit tests, as its name suggests, they are aiming at testing individual units....
Yu Zhang's user avatar
  • 9,942
2 votes

With good unit tests, do I also need acceptance tests?

Unit tests and integration tests are designed to facilitate the development of the product. Oversimplifying in this area can lead to difficulty in regression testing and failure/fault isolation, ...
Jim's user avatar
  • 129
2 votes

With good unit tests, do I also need acceptance tests?

As others have mentioned, unit tests cover functionality in isolation. There's a great little illustration of why that's not enough that's gone around recently. It can be seen here: https://www....
Rick Liddle's user avatar
2 votes

Can you share your experience about UAT tool to enter issues from users?

In our process, users of production system do not enter bugs: they enter feedback. It is shared responsibility (developers, QA, problem matter experts, analysts, sys admins etc) to triage the ...
Peter M. - stands for Monica's user avatar
2 votes

Handle errors that occur in Acceptance Testing, in parallel with running and upcoming sprints?

It depends Every team works out its own process for handling bugs that escape to acceptance testing (or beyond). The method I prefer works this way: Any bug found during acceptance testing or ...
Kate Paulk's user avatar
  • 31.5k
2 votes
Accepted

Is seeding test data in e2e tests a correct approach?

No, Create a single E2E test without seed accounts and test individual features in integration tests using seed accounts. In this scenario, I would create a single E2E test covering primary user flow(...
Vishal Aggarwal's user avatar
2 votes

Found a minor bug, affecting 1% of users. What should QA do?

I would suggest that you bring it to the client/sponsor's attention and let them prioritize the fix. At the end of the day it's their call as to the severity of the issue.
Robb Smith's user avatar
2 votes

How to write user acceptance testing for web app?

For starters, don't pass to your client the impression that you can document all your testing, because testing is a performance, not artifact generation. It is made of both explicit and tacit ...
João Farias's user avatar
  • 10.9k
2 votes

QA to UAT handover process?

Obviously, we can't solve this remotely, we'd need to actually sit and talk together with their team and think together why the testing is not what it should be (whatever it means in your context). ...
pavelsaman's user avatar
  • 4,548
1 vote

User Acceptance Tests with mouse/keyboard capture and picture compare

The mouse capture tool you've mentioned is known as Record & Playback. There are a manifold of tools created for such approach, and most were deprecated in favor of coding based tools. However, ...
João Farias's user avatar
  • 10.9k
1 vote

Handle errors that occur in Acceptance Testing, in parallel with running and upcoming sprints?

Q: How do you handle errors that occur in Acceptance Testing, in parallel with running / upcoming sprints? Ans: Note the first agile value which says "individuals and interactions over processes and ...
Sandeep Chandra Sekhar's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible