Questions tagged [test-management]
Use for questions about managing the test process, including organizing test cases and test results.
574
questions
5
votes
2
answers
175
views
KPI/ways to identify areas in need of testing
My Problem:
I am in a situation where there is no immediate demand to test any feature (no new features in need of testing, or no new changes made)
This makes it difficult to identify areas that are ...
- 153
8
votes
3
answers
1k
views
What should senior QA know to transition to a Test Manager position?
I am looking to transition to a test manager role and I'm up for an interview.
Been doing test automation for more than 2 years, being QA lead at a startup where I initiated and executed QA process, ...
- 181
11
votes
3
answers
4k
views
What is Snapshot Testing?
I've recently stumbled upon this new (at least to me) testing type: Snapshot Testing:
For Facebook's native apps we use a system called “snapshot testing”: a snapshot test system that renders UI ...
- 11.4k
6
votes
1
answer
6k
views
What are the differences between Microsoft Test Manager MTM, Team Foundation Server TFS & Visual Studio Test Professional VSTS?
Recently I got Visual studio Enterprises Subscription from my company and I was asked to prepare the system for testing, With the help of support team somehow I manage to set up the system but during ...
- 5,611
2
votes
2
answers
119
views
Handling large backlog of Jira issues
We are using Jira bug tracking system and have a custom status workflow configuration. After a Jira ticket is sent to "In Testing" status and assigned to a tester and if this tester confirms a bug is ...
- 11.4k
4
votes
2
answers
287
views
How to deal with a test failing but with a fix in the works?
I have automated tests running on our Continuous Integration machine.
I have a test failing because of a commit, but this fail has been considered minor, and some more urgent work was scheduled for ...
- 337
1
vote
2
answers
108
views
Proper button names for warning popups
In our application, we show warning popup about unsaved data and that popup contains following message with two buttons OK and Cancel
You've unsaved data. Do you want to continue?
If we look at the ...
- 311
2
votes
1
answer
140
views
Management of test cases and test runs for an application developed for multiple countries?
I am working on an application which is developed on multiple countries.
It has common features, and based on country, specific features, which are according to the countries.
We use QC for test ...
- 31
5
votes
3
answers
350
views
How important is doing QA considered today (2017)?
I'm doing QA since a while now and I am content with my job. However one thing I'm not so sure about is the value of being QA. The reason why I am asking this is because I see far more developers ...
- 53
34
votes
8
answers
6k
views
Who is responsible for pinpointing bugs?
Let's imagine this common situation: a tester creates an issue for a developer to fix, providing the steps to reproduce, screenshots and other details (if available). Then, a developer does not think ...
- 11.4k
0
votes
1
answer
649
views
Defect prevention audit
This is testing certification question .I think the ans will be B . Need your opinion
During an Audit , Auditor asked for evidences that the defect
prevention activities are effective.Which of ...
- 63
6
votes
5
answers
546
views
Test automation | Are we focusing more on automation than testing?
Take a very specified example of web application testing with selenium: It seems obvious that (almost) everyone is suggesting using element ID as the best locator strategy, and that your GUI-...
- 61
4
votes
4
answers
218
views
How to make management to accept major refactoring of the test codebase?
Our test codebase is relatively huge - more than 1300 tests with about 23000 lines of JavaScript.
We've been thinking towards migrating to a TypeScript and/or potentially to a different testing ...
- 11.4k
1
vote
2
answers
197
views
What are the top browsers to test on?
I have made a web platform for the cab booking service. And I want to ensure the user interface and functionality of my web application is working across different browsers.
But there are many ...
- 163
7
votes
6
answers
610
views
Quality assurance when people's lives are at stake
We are currently working in an insurance claims processing space and even though we have high quality standards, testing and quality assurance overall has always been, honestly speaking, a supporting ...
- 11.4k
2
votes
3
answers
427
views
How to ask our boss that we need more time for testing?
Our release cycles are not strictly periodical but happen about every month. Sometimes, after a regular testing phase, we, a QA team, are not satisfied with the amount of testing and feel that this ...
- 11.4k
3
votes
1
answer
129
views
Supervised machine learning in a "one-time-test" classification problem
Being inspired by the question "Good practices for identifying "one-time" tests?" I decided to make a proof of concept for the idea of applying supervised machine learning algorithms to a ...
- 11.6k
5
votes
4
answers
534
views
Defending corner cases
Sometimes, we find specific corner cases that cause a failure in our application - for example, broken relationships between the main entities in our application that are not properly handled (that ...
- 11.4k
23
votes
9
answers
5k
views
Should application and automated test languages match?
If an application is written in a certain language, e.g. Python, Ruby, Clojure, etc. should Quality Engineers use the same language to write the tests?
Should this be a decision that we can apply ...
- 331
1
vote
2
answers
508
views
Recon testing sessions
I've recently stumbled upon a new term I have not heard before - "Recon testing sessions" - from what I understand these are the very first manual testing sessions of a software when one learns about ...
- 11.4k
5
votes
2
answers
162
views
Communicating markup changes between developers and testers
From time to time, our end-to-end tests fail because of a markup change made by one of our UI developers - for instance, there was an id on an element but it got removed/replaced, or an Angular ...
- 11.4k
2
votes
2
answers
2k
views
Organizing test cases. By feature or by page?
I'm new to test case management. I am having trouble trying to figure out the best way to organize test cases, either by 'feature' or by 'page'.
For instance if I had a feature called 'email ...
- 121
5
votes
2
answers
608
views
How should agile stories be written to make QA testing easy?
I often see agile stories that don't clearly describe what is being developed. Often, nothing is mentioned about how the story must be tested at a high level. I generally don't see this issue in UI ...
- 567
3
votes
2
answers
142
views
Showing system test coverage for customers/stakeholders in agile
I work for a software consultancy as a test analyst and was looking for some advice on testing in agile.
Since my company moved agile, I think that testing has turned into mini iterations of ...
- 43
-1
votes
3
answers
161
views
How to track progress of automating multi-parameter tests for legacy product
I am working on a project to automate legacy code, and I'm looking for a good metric to track my team's progress and estimate how long it will take to complete the project.
My thought was to take ...
- 147
18
votes
8
answers
5k
views
Asking UI developers to adjust markup to improve automated tests
From time to time when doing test automation, a locator for the desired element is either too complicated, fragile or not readable. In cases like this, we ask developers to add IDs or other data-...
- 11.4k
1
vote
2
answers
68
views
Modeling application state transitions
I am a little bit confused with the "state transition modeling" technique used for testing.
On a high-level, we have 3 major states when a user logs into the application under test:
logged out
...
- 11.4k
7
votes
2
answers
527
views
How to link test cases back to the requirement (specification) document, and vice-versa
We are slowly generating small automated test cases for some software we develop. We've only got a few dozen or so written so far and we expect that in the end, we will have a few hundred, maybe a few ...
- 171
4
votes
2
answers
696
views
How to use fictitious people and personas in testing?
I've recently stumbled upon the concept of "Personas":
A persona, first introduced by Alan Cooper, defines an archetypical
user of a system, an example of the kind of person who would interact
...
- 11.4k
2
votes
1
answer
3k
views
Exporting test results from TFS to Excel
I have a test plan in MTM, now I have run (executed) all the test cases of that plan and have the results in MTM (and TFS).
How can I export the test execution results to an excel or any other type ...
- 4,580
4
votes
3
answers
76
views
Should I voluntarily provide a risk report to our customer?
We are a consultant firm that offers software testing services to our customers. Once our contract is finished, we will no longer have access to customers sites or projects.
Recently one thing is ...
- 1,515
17
votes
9
answers
6k
views
Gamification in software testing
Is there a place for gamification in software testing? Could it be made as a part of a regular testing process and could it have a positive impact on productivity and quality?
I've been thinking ...
- 11.4k
1
vote
3
answers
86
views
Testing at scale
I'm part of a team building a relatively large platform that needs high code coverage in its testing.
With code coverage: 1 hour of execution
Without code coverage: 10min of execution
We are just at ...
- 119
23
votes
6
answers
10k
views
How to deal with flaky tests that have intermittent failures?
Having flaky tests that sometimes fail and sometimes pass is very frustrating:
there is no single reason each of the flaky tests fail
the failures don't seem to happen to real users using the ...
- 11.4k
6
votes
3
answers
589
views
What if the application has functionality that wasn't in the requirements?
It may take serious effort to determine if an application has significant unexpected or hidden functionality, and it would indicate deeper problems in the software development process.
If the ...
- 6,785
17
votes
5
answers
2k
views
How should I respond when the team wants to ignore a critical but hard to reproduce bug
I am a Test engineer in a company. Recently, I caught a special bug. Here is the bug description.
Process: Send money to a recipient via online banking. Fill in all the
required details and ...
- 271
13
votes
5
answers
376
views
Heuristics for identifying "one-time" tests?
I understand the importance of having good "regression tests" to ensure fixed bugs don't get reintroduced. But I think it's possible to go too far and end up with a massive "regression test suite" for ...
- 2,679
9
votes
1
answer
466
views
How do I deal with poorly documented tests?
I work in a big multinational company. There are too many testers in my company whose test cases (i.e. test steps) are unclear & are riddled with grammatical errors. Many of these testers are ...
- 567
14
votes
5
answers
4k
views
What to do when a bug is fixed, unfixed and fixed
A blocker bug I raised last week had been fixed and ready for re-testing.
This morning, I re-tested it, it passed and subsequently closed.
In the afternoon, by accident, I noticed this feature was ...
- 1,515
6
votes
4
answers
362
views
How do we deal with occasional (but real) application failures
Background:
In our UAT testing environment, there have been a few intermittent bugs that come and go.
I am not a permanent employee here, my current contract will finish early August.
What I have ...
- 9,932
28
votes
10
answers
7k
views
Senior management expected bug discovery rate to match their expectation
We are four weeks in testing a new application. In summary
There is only one developer assigned to this project, basically, 8 man hour is available for this project.
The rate of bug discovery is ...
- 1,515
3
votes
3
answers
153
views
Contract tester: Customer expectations don't match what I thought was needed
I have been deployed at a customer's site for about two weeks now.
Yesterday I sat down with my manager and he told me that:
The customer's test manager thought I was not doing my job pro-actively ...
- 1,007
5
votes
1
answer
1k
views
Best practices for automating manual test cases in TestRail
Note, this is specific to TestRail but some questions could be considered generic issues:
I have worked for a couple companies that have gone through the implementation of automation into TestRail. ...
- 61
5
votes
4
answers
228
views
How to create test data/pre-requisites if it is required for only few of test cases of a test class?
I've clubbed feature related tests in one test class. Suppose we've 50 tests in that class.
Out of 50, suppose there are 5 test cases which require common test data or pre-requisites.
If I create/set ...
- 311
49
votes
16
answers
16k
views
Can a Manual Tester survive in software industry without learning Automation?
I mean to say is that if I dislike coding and don't understand complex code, then will I be able to survive as a QA. Or do I need to learn test automation to grow position and pay in my career, as I ...
- 491
4
votes
2
answers
1k
views
How machine learning can help in predicting defect prone modules in applications before testing?
I have looked and read in the internet that using static code analysis data, we can predict what modules in the application are defect prone. When I try to imagine of dataset,it is getting difficult ...
- 41
10
votes
3
answers
1k
views
Test Planning of a new project before coding starts
I have some experience (less than two years) as a Java developer but relatively new in Testing (experience of 3-4 months in Manual Testing). I have been assigned role of a Test Manager for a new ...
- 101
63
votes
17
answers
28k
views
How should a Software Tester deal with missed Defects/bugs in Production?
I work as a QA/test engineer in a small software company. It is an e-commerce based product. I was assigned a few projects by my manager. I mostly do functional/blackbox testing. Before the production ...
- 611
1
vote
2
answers
488
views
metrics in exploratory testing
I want to track and measure session based exploratory testing effectively. What are the main metrics used in session based exploratory testing to measure efforts, charters, bugs, opportunities and ...
-2
votes
2
answers
137
views
What test case management tools are available? [closed]
What exists and what are advantages / disadvantages of each one ?
- 118