Test Design is the selection of test aims, methodologies and implementation methods to satisfy the goals of a testing scenario.

learn more… | top users | synonyms

15
votes
7answers
444 views

How to obtain “fresh mind” results?

I noticed that when you start on a project with a beginner mind (for that particular product) you have a fresh approach and start noticing a lot of bugs. After a while and some experience with that ...
15
votes
2answers
512 views

Systematic approaches to selection of test data

I've used Phadke's design of experiments approach to select parameter values for testing (software) systems. In a nutshell, the approach uses minimum, typical and maximum values of test (method) ...
11
votes
6answers
332 views

What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?

I'll be giving a 3-day course on software test design later this month with lots of hands-on exercises. I'd like to include one or more exercises that would involve testing an online game for ...
9
votes
5answers
316 views

What Are Some Examples of Why Explicit Sleep Statements Are Bad

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
8
votes
1answer
921 views

What goes in a Testing playbook?

The concept of the Testing Playbook has been recently added to the list of possible tools in your Context-Driven toolset. The Playbook has been described as being similar to the list of plays that a ...
7
votes
5answers
259 views

Workflow shortcut to meet the release deadline

When you design a test scenario or even when you run your tests and you stumble to lack of specifications from your marketing Dept. should you bypass them and take the initiative of making your own ...
7
votes
4answers
275 views

Good strategy for automated regression where initial state can't be guaranteed or predicted

The situation I need to start building automated regression for a very large web application with thousands of users. It is impossible to start from a known state, or even to be sure that data ...
7
votes
4answers
728 views

Testing/Verifying Google Analytic code

I need help figuring out a test methods for Google Analytic. Our client pushes out a lot of marketing campaigns and they love using GA to track what is working, what is not working and where to focus ...
7
votes
1answer
167 views

Where to start with introducing a testing framework

This I hope won't come across too broad of a question. If you've been tasked with introducing testing process' for a web application developed in an 'agile' environment, released in 2 weekly cycles. ...
7
votes
1answer
2k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
6
votes
5answers
2k views

Are state transition diagrams a good software testing technique

I have been looking at different testing techniques and wondered if anyone had some "real world" examples of using state transition diagrams rather than the bog standard clock and light switch ones ...
6
votes
5answers
2k views

Is there a guide or systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
6
votes
4answers
672 views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
6
votes
4answers
241 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
6
votes
4answers
372 views

Testing techniques repository?

I was wondering if there are any repositories or wikis of formal testing techniques - test design ideas, like pairwise or boundary. I couldn't find one so far. Thanks! Ahmet
6
votes
2answers
1k views

How does the DataSource attribute on a test run the test multiple times?

This is going to be a bit long/wordy/verbose, but I've been looking at it for a while and I think that I'm bad at explaining things because people seem to get confused about what I'm asking. You know ...
6
votes
1answer
542 views

PageObjects: Aggregation/Composition vs Inheritance for nested components

I need to refactor my Selenium tests, and was wondering what the best design solution would be for a portal with a hierarchical page organization. We are using tiles, and we have defined a baselayout ...
5
votes
6answers
311 views

How to prevent cheating by manual testers?

I'm the guy who is motivated to bring some quality assurance into our team. The problem is, that our developers very often hate testing and even if they have a test protocol, not all of them are ...
5
votes
3answers
442 views

When is it inappropriate to use white box testing?

Sometimes, tasked with testing a piece of software for which there are no requirements, a tester will resort to white box testing. Are there times when that is inappropriate? Here is an example. At ...
5
votes
3answers
177 views

Internationalization testing

By internationalization testing I intend testing application with one or more additional languages and one or more additional regional settings (locale). We expect a number of risks with ...
5
votes
2answers
518 views

How to test a location based application

Our application is location based. We have tested its main functionality, (using mock locations) and now it is time to test how it reacts on real cases using GPS. So, what are the main limitations ...
5
votes
4answers
594 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
2answers
345 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
5
votes
3answers
181 views

What criteria do I apply to a highly complex development project to warrant getting “real world” data?

Both the product I used to work on and the one I'm working on now have a fairly large and complex matrix of possible configurations, work-flows, and data scenarios. The one product had, no joke, ...
5
votes
4answers
416 views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory: http://compass.informatik.rwth-aachen.de/ws-slides/havelund.pdf I found the approach of log files ...
5
votes
1answer
234 views

How can I use causal loop diagrams to help me test?

Causal loop diagrams seem like a really powerful tool for modelling a system - but I have no experience with applying them to my testing. Do you use causal loop diagrams? How do you use them, and ...
5
votes
1answer
289 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
5k views

How to use Selenium's PageFactory annotations with dynamic loaded elements?

I'm rewriting some Selenium tests according to the page object design pattern taking advantage of Seleniums' annotations. My problem is that I have some html select elements whose option elements are ...
4
votes
5answers
161 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
3answers
289 views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
4
votes
8answers
182 views

Is it necessary to test third party tools?

I have a question about best practices for writing test cases. At my job, I am using a closed source, third party tool that parses files into a database. Since this is a third party tool, is it ...
4
votes
4answers
261 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
3answers
302 views

What types of testing are LEAST suited to using pairwise testing (and similar test design approaches)?

For those of you who have used pairwise test design methods (or similar combinatorial software testing methods) in an attempt to zero in on a manageable number of unusually powerful tests from among a ...
4
votes
5answers
361 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
4
votes
5answers
120 views

Testing non-central features

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
4
votes
1answer
117 views

Can a requirement be verified just by white or gray box testing?

I've read that if a requirement can't be verified by black-box testing or inspection, then it's not a requirement, but a design specification. I'm building a software that makes processing with on ...
4
votes
5answers
864 views

How can I test a user story? Examples please?

I'm a new QS tester in a company in an Agile environment. During the sprint commit I was told that one of my tasks was going to be testing user stories? How exactly do you test something like that. If ...
4
votes
2answers
237 views

Test isolation and automation

We are using Selenium webservices for our automated functional testing . I have a test which tests creation of some objects. If I run the same test again, I need to make sure that each test has a ...
4
votes
2answers
193 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
4
votes
2answers
105 views

Is there a name for this type of vector operation?

I often find myself wanting to generate a lot of negative test cases by mutating a known good set of inputs. Let's say I have a function that will accept (a, b, c) as an expected valid input for a ...
4
votes
2answers
159 views

Turning software testing into an internal service

I've been tasked with changing the focus of my team from a "can do everything" team into one that is more service orientated, i.e. we can provide the framework for your testing rather than being there ...
4
votes
1answer
100 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
4
votes
1answer
93 views

Resources on implementing a well-balanced test pyramid

The test pyramid is a concept developed by Mike Cohn, described in his book "Succeeding with Agile". Basically, end-to-end tests (often called UI tests) go across all the layers of the application, ...
3
votes
1answer
212 views

What are the first steps a tester should perform when using combinational testing?

Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique. Where should a tester start this ...
3
votes
3answers
256 views

How to test the field with different languages?

I have a few pages where we allow the people to enter other language characters like german, dutch, spanish etc.... I want to test the field by using words of different languages to make sure all ...
3
votes
2answers
535 views

Automated White box/backend testing for a Test Engineer?

I have been writing a lot of UI tests lately using Selenium and I want to do more integration testing from the backend as well. What is a good approach to start with this, where can I find some more ...
3
votes
3answers
197 views

Why testing, by definition, cannot find deadlocks and stack overflows?

Sean M. Beatty says in "Where testing fails" article that "deadlocks, stack overflows, race conditions and timing problems cannot be detected by testing (whether it is code inspection, whide-box ...
3
votes
4answers
180 views

When to use White box Testing in a software or a website?

In a software or an website, when to use white box testing technique?
3
votes
1answer
112 views

Are there common techniques for testing the conformance of an implementation to a general contract?

Say you have defined some abstract interface and you specify a general contract for that interface to which all implementations must adhere. Are there common techniques that can facilitate testing the ...
3
votes
1answer
80 views

What particular testing requirements do data driven applications have?

Different sorts of software need different approaches to testing. An interactive GUI-driven application will be tested in a very different way from a piece of middleware, for example. Specifically ...