Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [test-design]

Use for questions about designing tests, specifically selecting test techniques to use in specific circumstances.

15
votes
7answers
9k views

How can I structure Selenium tests in a way that minimizes the maintenance work?

What is the best way to build/structure the tests in a way that will minimize the work needed to keep the tests up to date as the product changes and improves?
17
votes
5answers
1k views

What Are Some Examples of Why Explicitly Sleep Statements Are Bad?

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
21
votes
2answers
1k views

Systematic approaches to selection of test data

I've used Phadke's design of experiments approach to select parameter values for testing (software) systems. In a nutshell, the approach uses minimum, typical and maximum values of test (method) ...
2
votes
1answer
135 views

Is there a dancing pony on the screen? (Visual testing)

Motivated by this talk about the accidental unexpected pony dancing on the screen. We currently have a rather rich subset of end-to-end tests for our AngularJS applications. And, we do get a lot of ...
11
votes
5answers
306 views

Heuristics for identifying “one-time” tests?

I understand the importance of having good "regression tests" to ensure fixed bugs don't get reintroduced. But I think it's possible to go too far and end up with a massive "regression test suite" for ...
27
votes
10answers
8k views

How can developers be assured that their software is fault free?

For example when creating software for critical real time applications, like those used in aviation, how certain are you that it's going to run without problems? Are you 100% certain or are you >90% ...
3
votes
1answer
5k views

Software Tester Job Interview: Case studies on Test Design

Case Studies during job interview is a great technique which allows to find out how the candidate would behave in different situation. For instance, the following case: Given a developer ...
11
votes
5answers
3k views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
8
votes
3answers
5k views

Please suggest some ideas to test an IVR system?

I have to test an DTMF tones via keypad with toll free number, which has a company IVR automated response system. The IVR allows the user to login to the system and user can know account balance, talk ...
3
votes
2answers
348 views

What are some good thinking tools that a tester can use to generate ideas? [closed]

As a tester I want to generate more out of the box ideas, so that I can test all positive as well as negative test scenarios and find most critical defects before the product is released. Are there ...
3
votes
4answers
848 views

When should a Test Case be marked as “No Apply”?

When executing test cases when should we mark a test case as 'No Apply'. When the test conditions/requirement is not clear or when its not feasible/possible to perm a test. Also why not mark a test ...
52
votes
15answers
19k views

How should a Software Tester deal with missed Defects/bugs in Production?

I work as a QA/test engineer in a small software company. It is an e-commerce based product. I was assigned a few projects by my manager. I mostly do functional/blackbox testing. Before the production ...
40
votes
12answers
7k views

What should Testers do if they are not able to find good defects in the product?

I work as manual/black-box tester. My responsibility primarily includes functional testing of a web application and to some extent database testing using sql server, based on the functional ...
10
votes
7answers
17k views

How to test a toaster? (interview question)

I want to know how we should approach for testing real world objects. The problem that I faced before is to get the list of use cases from the interviewer. Whenever I asked what the real world object ...
40
votes
12answers
12k views

Can a Manual Tester survive in software industry without learning Automation?

I mean to say is that if I dislike coding and don't understand complex code , then will I be able to survive as a QA. Or do I need to learn test automation to grow position and pay in my career, as i ...
11
votes
4answers
34k views

Difference between requirement, use case, and scenario?

I've taken a class on software testing best practices and test design. In the content, they have a model that basically shows that the three items are derived in this way: Requirements > Use case &...
13
votes
3answers
1k views

Test strategy to bring automated tests from UI to lower(API/Unit) layers?

Background/Problem Statement: Recently I came across a project team, which is having thousands of UI automated tests covering all kind of manual tests including positive, negative etc., and obviously ...
19
votes
9answers
2k views

Should application and automated test languages match?

If an application is written in a certain language, e.g. Python, Ruby, Clojure, etc. should Quality Engineers use the same language to write the tests? Should this be a decision that we can apply ...
12
votes
4answers
7k views

Is there a guide for systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
12
votes
9answers
4k views

Tools for Server application testing [closed]

I'm currently working (almost finishing) a Java project that consists on a server application and some client applications on the same network, that will communicate with the server only to request ...
8
votes
4answers
2k views

How to implement qa test process for large scale application?

There is a large scale application with thousands of functional points and which never had any QA team or person. So when a QA person or team starts working with this type of product what should be ...
4
votes
6answers
8k views

How to categorize defects?

Many project managers and other non-tester roles search for proper categorization according to severity (A-B-C) of the defects and they search for description how to distinguish between each category. ...
8
votes
6answers
2k views

What is Scenario Testing and how to create complex test scenario's?

Is there any general approach or methodology to create complex user scenarios for any application or is it completely context-driven. Are there some general test ideas/patterns/strategies to create ...
14
votes
6answers
4k views

Is inverted test pyramid really anti-pattern?

I know that the inverted test pyramid, i.e., having more end-to-end tests than unit tests is an anti-pattern. However, I've started to think, what could be advantage of having less unit tests then ...
6
votes
4answers
8k views

How to write proper Test Case steps?

I am beginner in writing test cases. I am working on a live mobile testing project. Consider a test case to login to a Mobile application: Test case Description: To verify that user is able ...
10
votes
4answers
25k views

Test Suite vs. Test Plan

I am having a difficult time pinning down an official description of what a test suite is compared to a test plan. In Test Computer Software they don't even mention suites. (I assume because the book ...
6
votes
5answers
343 views

Test automation | Are we focusing more on automation than testing?

Take a very specified example of web application testing with selenium: It seems obvious that (almost) everyone is suggesting using element ID as the best locator strategy, and that your GUI-...
5
votes
1answer
127 views

How to identify and justify how many test cases is enough when you have a potentially huge number of combinations?

I'm working on a form builder project. Users can drag and drop elements to build questionnaires. If we simplify and say there is only 3 form elements that can be used: Numeric answer, with ...
5
votes
7answers
10k views

How to test dynamic GPS location in mobile

How to test my application for gps location without travelling in real time ? Problem behind my query : I am in need to test a travel based application where your location will change according to ...
6
votes
1answer
300 views

What are the first steps a tester should perform when using combinational testing?

Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique. Where should a tester start this ...
4
votes
3answers
1k views

How to break down a single test case that covers an entire process into multiple interconnected tests?

I have a particular end to end test scenario which am trying to automate using Selenium Webdriver. If I automate the whole scenario into one test case, the test case is going to take a minimum of 25 ...
4
votes
3answers
945 views

What are some Problem solving techniques that can be used in testing? [closed]

What are some Problem solving techniques that can be used in testing. For example I need to think of all the test ideas to test a module ..administrator module for instance. How can I improve test ...
3
votes
7answers
28k views

Test data to test form input fields?

I am testing web based user profiles forms which have multiple fields like input box, radio buttons, checkboxes, combo-boxes, alphanumeric fields etc. what are some good tests that I can run to find ...
13
votes
1answer
4k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
12
votes
3answers
4k views

Random test data: How to do it right?

Several months ago I started an experiment in test automation. Each test, before it starts, picks up random test data. For instance, when my test requires a user with administration privileges, I draw ...
7
votes
3answers
351 views

What criteria do I apply to a highly complex development project to warrant getting “real world” data?

Both the product I used to work on and the one I'm working on now have a fairly large and complex matrix of possible configurations, work-flows, and data scenarios. The one product had, no joke, ...
5
votes
2answers
463 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
4
votes
5answers
348 views

Where to start when testing web pages with large number of options

I have inherited a web application that has no useful requirements/specifications, and no tests. The page that I am currently looking at sets the configuration options for the application and consists ...
3
votes
5answers
1k views

When to use White box Testing in a software or a website?

In a software or an website, when to use white box testing technique?
3
votes
2answers
468 views

How to use fictitious people and personas in testing?

I've recently stumbled upon the concept of "Personas": A persona, first introduced by Alan Cooper, defines an archetypical user of a system, an example of the kind of person who would interact ...
1
vote
1answer
91 views

What material can help a tester generate more and better ideas? [duplicate]

which domain knowledge other than software engineering can help a tester generate good test ideas? any books , courses, philosophy, theories , puzzles etc.
0
votes
4answers
3k views

How to Incorporate the Defunct PageFactory in Selenium with C#?

I just discovered the page object design pattern recently and really wanted to implement it into my company's UI Test Automation suite. I started to do so and immediately ran into problems which lead ...
15
votes
4answers
281 views

What techniques are available to determine which browsers to test?

When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?" I am not asking that question because it will soon become ...
6
votes
3answers
630 views

Is page object a framework or design pattern?

Currently I'm using page object design pattern with testing.
4
votes
2answers
390 views

Using a system test framework that handles test dependencies

To explain better, if test B depends on test A, then if test A fails, then test B should not be run and fail implicitly if test A produces some output, then it should be available for test B I can ...
4
votes
2answers
293 views

Black box testing methods without knowledge

I stumbled upon some black box techniques (1), but I don't really get how it works. I found sources saying that black box techniques are techniques in which you input something in a program and check ...
2
votes
2answers
1k views

What are the best practices for Integration Testing of a middle-ware?

I want to know about the best practices of Integration Testing for a middle-ware product. It includes several backends and also I want to test it over multiple platforms. The features of Clustering is ...
1
vote
1answer
97 views

Standard for accessiblity testing

As a Software Engineer I want to create software that contains accessibility for people with disabilities. I've been making modifications so that JAWS correctly reads all the fields in my interface. ...
1
vote
0answers
349 views

How can I set different parameters for two different calls to Call to Test in HP ALM

I have a test template Fill in account information with params: account_number, email_address. The template is calles in test Legal entity registration twice, and should be called with different ...
1
vote
4answers
2k views

What are some good test cases in order to do License Key authentication while software is being installed?

I want to learn about: What could be the test cases to ensure the test coverage while any proprietary software is being installed using a license key. I wish to avoid (a) re-installation (b) multiple ...