Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [test-design]

Use for questions about designing tests, specifically selecting test techniques to use in specific circumstances.

52
votes
15answers
19k views

How should a Software Tester deal with missed Defects/bugs in Production?

I work as a QA/test engineer in a small software company. It is an e-commerce based product. I was assigned a few projects by my manager. I mostly do functional/blackbox testing. Before the production ...
41
votes
12answers
7k views

What should Testers do if they are not able to find good defects in the product?

I work as manual/black-box tester. My responsibility primarily includes functional testing of a web application and to some extent database testing using sql server, based on the functional ...
40
votes
12answers
12k views

Can a Manual Tester survive in software industry without learning Automation?

I mean to say is that if I dislike coding and don't understand complex code , then will I be able to survive as a QA. Or do I need to learn test automation to grow position and pay in my career, as i ...
28
votes
10answers
8k views

How can developers be assured that their software is fault free?

For example when creating software for critical real time applications, like those used in aviation, how certain are you that it's going to run without problems? Are you 100% certain or are you >90% ...
24
votes
7answers
4k views

What should a Software Tester do to become more valuable and helpful for the Development Team?

When I write detailed defect descriptions or bug reports, then my team's Development manager feels satisfied. What are few things a blackbox tester can do to help the Developers become more productive ...
21
votes
7answers
4k views

How to report a bug that has no technical solution?

When we were testing a project, which would require an Excel sheet as an input. The only validating mechanism of this whole file importing process was offered by Excel macro (validate against inputs' ...
21
votes
2answers
1k views

Systematic approaches to selection of test data

I've used Phadke's design of experiments approach to select parameter values for testing (software) systems. In a nutshell, the approach uses minimum, typical and maximum values of test (method) ...
19
votes
9answers
2k views

Should application and automated test languages match?

If an application is written in a certain language, e.g. Python, Ruby, Clojure, etc. should Quality Engineers use the same language to write the tests? Should this be a decision that we can apply ...
17
votes
8answers
678 views

How to obtain “fresh mind” results?

I noticed that when you start on a project with a beginner mind (for that particular product) you have a fresh approach and start noticing a lot of bugs. After a while and some experience with that ...
17
votes
5answers
1k views

What Are Some Examples of Why Explicitly Sleep Statements Are Bad?

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
15
votes
6answers
4k views

Is inverted test pyramid really anti-pattern?

I know that the inverted test pyramid, i.e., having more end-to-end tests than unit tests is an anti-pattern. However, I've started to think, what could be advantage of having less unit tests then ...
15
votes
7answers
9k views

How can I structure Selenium tests in a way that minimizes the maintenance work?

What is the best way to build/structure the tests in a way that will minimize the work needed to keep the tests up to date as the product changes and improves?
15
votes
4answers
280 views

What techniques are available to determine which browsers to test?

When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?" I am not asking that question because it will soon become ...
14
votes
7answers
2k views

The test team as an enemy of development? And how can this be avoided?

Details Forming a Scrum team should include all the skills necessary to develop a user story in order to deliver a potentially deliverable product increment with each sprint. In traditional ...
14
votes
3answers
1k views

Test strategy to bring automated tests from UI to lower(API/Unit) layers?

Background/Problem Statement: Recently I came across a project team, which is having thousands of UI automated tests covering all kind of manual tests including positive, negative etc., and obviously ...
13
votes
5answers
3k views

What to do when a bug is fixed, unfixed and fixed

A blocker bug I raised last week had been fixed and ready for re-testing. This morning, I re-tested it, it passed and subsequently closed. In the afternoon, by accident, I noticed this feature was ...
13
votes
4answers
719 views

Good strategy for automated regression where initial state can't be guaranteed or predicted

The situation I need to start building automated regression for a very large web application with thousands of users. It is impossible to start from a known state, or even to be sure that data ...
13
votes
1answer
4k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
12
votes
9answers
4k views

Tools for Server application testing [closed]

I'm currently working (almost finishing) a Java project that consists on a server application and some client applications on the same network, that will communicate with the server only to request ...
12
votes
6answers
2k views

Whose responsibility is it to design test cases?

The question: Is it the developer's responsibility to design test cases, or the QA tester's? Or is it someone else's? I am a software engineer at a small company in the United States. We have an ...
12
votes
5answers
722 views

Signal to noise ratio during early testing

The Context For the past several years our QA team has been very active in manual and automated testing of our products which led to a very small amount of real-user complaints about the functioning ...
12
votes
4answers
7k views

Is there a guide for systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
12
votes
5answers
2k views

Test for unknown issues

We have been developing wifi/2g boards that communicate to a server and store data. This project has been running for several years already, and we are constantly updating both boards' firmware and ...
12
votes
6answers
454 views

What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?

I'll be giving a 3-day course on software test design later this month with lots of hands-on exercises. I'd like to include one or more exercises that would involve testing an online game for ...
12
votes
3answers
4k views

Random test data: How to do it right?

Several months ago I started an experiment in test automation. Each test, before it starts, picks up random test data. For instance, when my test requires a user with administration privileges, I draw ...
11
votes
5answers
305 views

Heuristics for identifying “one-time” tests?

I understand the importance of having good "regression tests" to ensure fixed bugs don't get reintroduced. But I think it's possible to go too far and end up with a massive "regression test suite" for ...
11
votes
5answers
3k views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
11
votes
4answers
34k views

Difference between requirement, use case, and scenario?

I've taken a class on software testing best practices and test design. In the content, they have a model that basically shows that the three items are derived in this way: Requirements > Use case &...
10
votes
11answers
505 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
10
votes
4answers
25k views

Test Suite vs. Test Plan

I am having a difficult time pinning down an official description of what a test suite is compared to a test plan. In Test Computer Software they don't even mention suites. (I assume because the book ...
10
votes
7answers
17k views

How to test a toaster? (interview question)

I want to know how we should approach for testing real world objects. The problem that I faced before is to get the list of use cases from the interviewer. Whenever I asked what the real world object ...
10
votes
4answers
319 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
10
votes
3answers
705 views

How do you know if you are writing high quality tests?

Inspired by Exercises on software testing We can learn to write automated tests and we can learn to do tdd and bdd but what tools / resources / guides are available to tell us if the actual tests we ...
9
votes
7answers
901 views

Testing without direction, how not to miss things? What about layout?

So this might sound like a "complain" post but it really isn't meant to be. But often-times I will be handed a project, lets say a Website. And be told to give it a "Full run through". So I take a ...
9
votes
5answers
923 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
9
votes
2answers
793 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
9
votes
6answers
2k views

What is Scenario Testing and how to create complex test scenario's?

Is there any general approach or methodology to create complex user scenarios for any application or is it completely context-driven. Are there some general test ideas/patterns/strategies to create ...
9
votes
1answer
3k views

What goes in a Testing playbook?

The concept of the Testing Playbook has been recently added to the list of possible tools in your Context-Driven toolset. The Playbook has been described as being similar to the list of plays that a ...
9
votes
3answers
308 views

Resources on implementing a well-balanced test pyramid

The test pyramid is a concept developed by Mike Cohn, described in his book "Succeeding with Agile". Basically, end-to-end tests (often called UI tests) go across all the layers of the application, ...
8
votes
5answers
3k views

Are state transition diagrams a good software testing technique

I have been looking at different testing techniques and wondered if anyone had some "real world" examples of using state transition diagrams rather than the bog standard clock and light switch ones ...
8
votes
6answers
422 views

Quality assurance when people's lives are at stake

We are currently working in an insurance claims processing space and even though we have high quality standards, testing and quality assurance overall has always been, honestly speaking, a supporting ...
8
votes
5answers
27k views

How can I test a user story? Examples please?

I'm a new QA tester in a company in an Agile environment. During the sprint commit I was told that one of my tasks was going to be testing user stories. How exactly do you test something like that? If ...
8
votes
4answers
2k views

How to implement qa test process for large scale application?

There is a large scale application with thousands of functional points and which never had any QA team or person. So when a QA person or team starts working with this type of product what should be ...
8
votes
4answers
1k views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
8
votes
3answers
266 views

Which testing process will be good to start building a new product? [closed]

Your company is started building a new product and they are hired you as a Sr. QA position for this new product. As of the companies expectation you have to work on both manual and automation (...
8
votes
3answers
437 views

How do I train a new manual tester?

We're looking to promote one of our customer service agents into a testing role. Right now they roughly go through our deploys in a staging environment prior to it going live. They've requested more ...
8
votes
1answer
450 views

How do I deal with poorly documented tests?

I work in a big multinational company. There are too many testers in my company whose test cases (i.e. test steps) are unclear & are riddled with grammatical errors. Many of these testers are ...
8
votes
3answers
5k views

Please suggest some ideas to test an IVR system?

I have to test an DTMF tones via keypad with toll free number, which has a company IVR automated response system. The IVR allows the user to login to the system and user can know account balance, talk ...
8
votes
4answers
2k views

Testing/Verifying Google Analytic code

I need help figuring out a test methods for Google Analytic. Our client pushes out a lot of marketing campaigns and they love using GA to track what is working, what is not working and where to focus ...
8
votes
5answers
5k views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory. I found the approach of log files analysis unexpected but quite beneficial on many levels. It seems to ...