Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [test-management]

Use for questions about managing the test process, including organizing test cases and test results.

92
votes
15answers
20k views

Should a tester feel bad about finding too many defects/bugs in the product?

I work as a junior black box tester in a small software house. I work on a medical industry web application. I was assigned a module to test. I did a lot of research and risk analysis and logged at ...
52
votes
15answers
19k views

How should a Software Tester deal with missed Defects/bugs in Production?

I work as a QA/test engineer in a small software company. It is an e-commerce based product. I was assigned a few projects by my manager. I mostly do functional/blackbox testing. Before the production ...
40
votes
12answers
12k views

Can a Manual Tester survive in software industry without learning Automation?

I mean to say is that if I dislike coding and don't understand complex code , then will I be able to survive as a QA. Or do I need to learn test automation to grow position and pay in my career, as i ...
40
votes
12answers
7k views

What should Testers do if they are not able to find good defects in the product?

I work as manual/black-box tester. My responsibility primarily includes functional testing of a web application and to some extent database testing using sql server, based on the functional ...
28
votes
12answers
7k views

How to explain the concept of test automation to a team that only knows manual testing?

I have been working as a QA in our 9 developer team for about a year. Had lots of 'firsts' within the year between personal and professional life. I replaced a QA who only did manual testing and ...
28
votes
8answers
5k views

Who is responsible for pinpointing bugs?

Let's imagine this common situation: a tester creates an issue for a developer to fix, providing the steps to reproduce, screenshots and other details (if available). Then, a developer does not think ...
28
votes
9answers
30k views

How to write a test plan

I am new to "Test Plan Writing" and I want to learn how to write test plan. As a beginner, what do I need to understand and learn first to write quality/effective test plan? What would you suggest?
28
votes
10answers
7k views

Senior management expected bug discovery rate to match their expectation

We are four weeks in testing a new application. In summary There is only one developer assigned to this project, basically, 8 man hour is available for this project. The rate of bug discovery is ...
23
votes
7answers
4k views

What should a Software Tester do to become more valuable and helpful for the Development Team?

When I write detailed defect descriptions or bug reports, then my team's Development manager feels satisfied. What are few things a blackbox tester can do to help the Developers become more productive ...
23
votes
3answers
2k views

Good resources for building a QA team

Our corporation has, up until this point, largely lacked a 'quality mentality' of any kind. From no testers, they went to two testers - but 5 or 6 product teams still rely on a mix of developer and ...
22
votes
14answers
3k views

Should QA report bugs on features before they are fully implemented?

I am a developer and I generally check in partial implementations so that I don't have too much uncommited code at any time. I make sure that the application compiles and that it does not interfere ...
22
votes
7answers
4k views

How can I be sure that rarely reproduced issue is fixed?

I have a bug that is rarely reproduced, in about 1 case out of 5 attempts (20% reproducibility). Developers made a new version with the fix. How many times do I need to run a test to be sure that the ...
22
votes
9answers
18k views

Copying Production Data to a QA Environment

Many companies have a match of their production platform available in a QA environment, with the only difference being that the QA environment connects to QA datasources (which generally contain fake ...
21
votes
3answers
2k views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
20
votes
6answers
4k views

What would be the strategy when too many bugs are found in the final round of testing?

The QA team starts testing a software/product and there are “way too many” defects…! Every other scenario is failing, new flows are explored & clarifications sought. What would be the strategy now?...
19
votes
9answers
2k views

Should application and automated test languages match?

If an application is written in a certain language, e.g. Python, Ruby, Clojure, etc. should Quality Engineers use the same language to write the tests? Should this be a decision that we can apply ...
18
votes
14answers
2k views

When is it OK not to have dedicated testers/QA team?

I noticed that there are no dedicated QAs in the stackexchange team. Since they are indeed making an awesome product, I wonder: When is it possible to have an absence of dedicated quality assurance ...
17
votes
8answers
3k views

Asking UI developers to adjust markup to improve automated tests

From time to time when doing test automation, a locator for the desired element is either too complicated, fragile or not readable. In cases like this, we ask developers to add IDs or other data-...
17
votes
18answers
36k views

Alternatives to HP Quality Center for small business

Which are the alternatives today? Not only freeware, but tools affordable for a development team of 3-5 men. I like the structure and flexibility of HP QC, so a similar tool would be nice to have.
17
votes
1answer
675 views

Questions to ask when estimating testing effort?

I've been a software tester for a little more than a couple of years now and I'm looking to upgrade my skills for the role of Team Lead. Team leaders and managers usually have to do the planning and ...
16
votes
5answers
2k views

How should I respond when the team wants to ignore a critical but hard to reproduce bug

I am a Test engineer in a company. Recently, I caught a special bug. Here is the bug description. Process: Send money to a recipient via online banking. Fill in all the required details and ...
16
votes
11answers
90k views

Looking for an excellent example of using a spreadsheet for test case management

It is an unfortunate reality of our industry that many testers are stuck using a spreadsheet to manage their test cases. I wanted to ask (in a community wiki), what are some good techniques and ...
15
votes
6answers
8k views

How should a tester deal with a bug found in production?

In my previous project, I was working as a black-box/manual tester. My major responsibilities were performing function testing, executing regression suites, running smoke tests etc. I was testing a ...
15
votes
6answers
4k views

How to deal with flaky tests that have intermittent failures?

Having flaky tests that sometimes fail and sometimes pass is very frustrating: there is no single reason each of the flaky tests fail the failures don't seem to happen to real users using the ...
15
votes
7answers
9k views

How can I structure Selenium tests in a way that minimizes the maintenance work?

What is the best way to build/structure the tests in a way that will minimize the work needed to keep the tests up to date as the product changes and improves?
15
votes
4answers
2k views

Estimating a testing project

How do you estimate a testing project? What are the things to be take care of while estimating the time for a testing project ?
15
votes
4answers
281 views

What techniques are available to determine which browsers to test?

When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?" I am not asking that question because it will soon become ...
14
votes
7answers
2k views

The test team as an enemy of development? And how can this be avoided?

Details Forming a Scrum team should include all the skills necessary to develop a user story in order to deliver a potentially deliverable product increment with each sprint. In traditional ...
14
votes
3answers
782 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
13
votes
8answers
6k views

Gamification in software testing

Is there a place for gamification in software testing? Could it be made as a part of a regular testing process and could it have a positive impact on productivity and quality? I've been thinking ...
13
votes
5answers
3k views

What to do when a bug is fixed, unfixed and fixed

A blocker bug I raised last week had been fixed and ready for re-testing. This morning, I re-tested it, it passed and subsequently closed. In the afternoon, by accident, I noticed this feature was ...
13
votes
7answers
8k views

What test management tool to manage Cucumber tests?

In my company we have our tests specified in Gherkin (Cucumber), and we use Jenkins to schedule the execution of these tests. We have the need of a management tool, where we can associate the tests ...
13
votes
2answers
664 views

Maintaining automation framework for different browsers like IE and FF

How to maintain automation framework for different browsers like IE and FF? In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
13
votes
10answers
3k views

Test Case Management Software

I currently write automated tests using WebDriver/Selenium 2 and utilize the Page Object model. I'd like to start documenting manual tests but our current process is only creating test cases in MS ...
12
votes
4answers
1k views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
12
votes
4answers
7k views

Is there a guide for systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
12
votes
6answers
692 views

How to know if an existing set of automated tests are effective?

I came to a new project and it was already written 100 autotests. The product is new. How to determine whether the tests are effective? What is the best way?
12
votes
4answers
2k views

Keeping automation code away from application source code

Disclaimer: this question is not related to - "Test cases in source code" I am working on a super fast development environment where manual test cases were given no importance (thankfully things are ...
11
votes
8answers
3k views

What could a QA engineer do when a project is in an early stage?

Good day, beautiful and smart people! We've been prototyping an application and it is more or less at the MVP stage and the customer, seeing the minimum desired functionality, is taking things ...
11
votes
7answers
2k views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get "...
11
votes
4answers
1k views

Retest whole system or just changes with regression tests

After regression tests are done, bugs are filed and fixed. A new release build is made with bug fixes. Should you re-run regression tests again on new build or is it enough to do only re-testing of ...
11
votes
5answers
306 views

Heuristics for identifying “one-time” tests?

I understand the importance of having good "regression tests" to ensure fixed bugs don't get reintroduced. But I think it's possible to go too far and end up with a massive "regression test suite" for ...
11
votes
5answers
3k views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
11
votes
1answer
733 views

Tools for tracking automated tests

I have used STAF/STAX in the past, and liked the way that information was tracked in the tests. I'm currently investigating Technologies to tie together a few tools that use XML-RPC, and am ...
10
votes
4answers
25k views

Test Suite vs. Test Plan

I am having a difficult time pinning down an official description of what a test suite is compared to a test plan. In Test Computer Software they don't even mention suites. (I assume because the book ...
10
votes
2answers
17k views

What is the difference between Software Test Engineer, Test Automation Engineer and Software Developer in Test (SDET)?

Software Test Engineer usualy performs “manual” testing (without spending time on automating and supporting the tests). Usually is responsible to find all (as more as possible) critical bugs in the ...
10
votes
4answers
2k views

Test Data Bank creation: approach, important points, useful links, data generators, file storages?

Being Senior QA, I often face one and the same problem: for every project I'm involved in I need to prepare / collect / generate various sort of testing data. It might be VERY different - below are ...
10
votes
2answers
1k views

Testing NOSQL DB's like distributed Cassandra

Has anybody worked on testing Cassandra DB which is a NOSQL distributed DB? What are the important things to be taken into account while doing this?
9
votes
8answers
2k views

Should Software Testers say that functionality is “working fine” or should they say that “it seems/appears to working fine or looks good”?

As a blackbox tester, while giving my testing status to the management, i usually refrain from saying that a particular feature, enhancement of defect is "working fine" and say that it seems/appear to ...
9
votes
5answers
923 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...