Test Design is the selection of test aims, methodologies and implementation methods to satisfy the goals of a testing scenario.

learn more… | top users | synonyms

15
votes
7answers
457 views

How to obtain “fresh mind” results?

I noticed that when you start on a project with a beginner mind (for that particular product) you have a fresh approach and start noticing a lot of bugs. After a while and some experience with that ...
15
votes
2answers
548 views

Systematic approaches to selection of test data

I've used Phadke's design of experiments approach to select parameter values for testing (software) systems. In a nutshell, the approach uses minimum, typical and maximum values of test (method) ...
11
votes
6answers
342 views

What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?

I'll be giving a 3-day course on software test design later this month with lots of hands-on exercises. I'd like to include one or more exercises that would involve testing an online game for ...
10
votes
5answers
353 views

What Are Some Examples of Why Explicit Sleep Statements Are Bad

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
8
votes
1answer
984 views

What goes in a Testing playbook?

The concept of the Testing Playbook has been recently added to the list of possible tools in your Context-Driven toolset. The Playbook has been described as being similar to the list of plays that a ...
7
votes
5answers
265 views

Workflow shortcut to meet the release deadline

When you design a test scenario or even when you run your tests and you stumble to lack of specifications from your marketing Dept. should you bypass them and take the initiative of making your own ...
7
votes
4answers
286 views

Good strategy for automated regression where initial state can't be guaranteed or predicted

The situation I need to start building automated regression for a very large web application with thousands of users. It is impossible to start from a known state, or even to be sure that data ...
7
votes
4answers
789 views

Testing/Verifying Google Analytic code

I need help figuring out a test methods for Google Analytic. Our client pushes out a lot of marketing campaigns and they love using GA to track what is working, what is not working and where to focus ...
7
votes
1answer
175 views

Where to start with introducing a testing framework

This I hope won't come across too broad of a question. If you've been tasked with introducing testing process' for a web application developed in an 'agile' environment, released in 2 weekly cycles. ...
7
votes
1answer
2k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
6
votes
5answers
2k views

Are state transition diagrams a good software testing technique

I have been looking at different testing techniques and wondered if anyone had some "real world" examples of using state transition diagrams rather than the bog standard clock and light switch ones ...
6
votes
5answers
2k views

Is there a guide or systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
6
votes
4answers
792 views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
6
votes
4answers
245 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
6
votes
2answers
379 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
6
votes
4answers
385 views

Testing techniques repository?

I was wondering if there are any repositories or wikis of formal testing techniques - test design ideas, like pairwise or boundary. I couldn't find one so far. Thanks! Ahmet
6
votes
5answers
548 views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory: http://compass.informatik.rwth-aachen.de/ws-slides/havelund.pdf I found the approach of log files ...
6
votes
1answer
5k views

How to use Selenium's PageFactory annotations with dynamic loaded elements?

I'm rewriting some Selenium tests according to the page object design pattern taking advantage of Seleniums' annotations. My problem is that I have some html select elements whose option elements are ...
6
votes
2answers
2k views

How does the DataSource attribute on a test run the test multiple times?

This is going to be a bit long/wordy/verbose, but I've been looking at it for a while and I think that I'm bad at explaining things because people seem to get confused about what I'm asking. You know ...
6
votes
1answer
571 views

PageObjects: Aggregation/Composition vs Inheritance for nested components

I need to refactor my Selenium tests, and was wondering what the best design solution would be for a portal with a hierarchical page organization. We are using tiles, and we have defined a baselayout ...
5
votes
6answers
344 views

How to prevent cheating by manual testers?

I'm the guy who is motivated to bring some quality assurance into our team. The problem is, that our developers very often hate testing and even if they have a test protocol, not all of them are ...
5
votes
5answers
383 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
5
votes
3answers
462 views

When is it inappropriate to use white box testing?

Sometimes, tasked with testing a piece of software for which there are no requirements, a tester will resort to white box testing. Are there times when that is inappropriate? Here is an example. At ...
5
votes
3answers
187 views

Internationalization testing

By internationalization testing I intend testing application with one or more additional languages and one or more additional regional settings (locale). We expect a number of risks with ...
5
votes
3answers
139 views

How to implement qa test process for large scale application?

There is a large scale application with thousands of functional points and which never had any QA team or person. So when a QA person or team starts working with this type of product what should be ...
5
votes
2answers
663 views

How to test a location based application

Our application is location based. We have tested its main functionality, (using mock locations) and now it is time to test how it reacts on real cases using GPS. So, what are the main limitations ...
5
votes
4answers
647 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
3answers
188 views

What criteria do I apply to a highly complex development project to warrant getting “real world” data?

Both the product I used to work on and the one I'm working on now have a fairly large and complex matrix of possible configurations, work-flows, and data scenarios. The one product had, no joke, ...
5
votes
1answer
238 views

How can I use causal loop diagrams to help me test?

Causal loop diagrams seem like a really powerful tool for modelling a system - but I have no experience with applying them to my testing. Do you use causal loop diagrams? How do you use them, and ...
5
votes
1answer
315 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
4
votes
3answers
319 views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
4
votes
5answers
165 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
8answers
219 views

Is it necessary to test third party tools?

I have a question about best practices for writing test cases. At my job, I am using a closed source, third party tool that parses files into a database. Since this is a third party tool, is it ...
4
votes
4answers
266 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
3answers
311 views

What types of testing are LEAST suited to using pairwise testing (and similar test design approaches)?

For those of you who have used pairwise test design methods (or similar combinatorial software testing methods) in an attempt to zero in on a manageable number of unusually powerful tests from among a ...
4
votes
4answers
129 views

Are test set cases always meant to be run in succession?

We are in the process of developing an in-house testing solution that is tailored to our applications. As of right now when you add a new test case to a plan you must choose the prerequisite steps, ...
4
votes
5answers
123 views

Testing non-central features

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
4
votes
1answer
118 views

Can a requirement be verified just by white or gray box testing?

I've read that if a requirement can't be verified by black-box testing or inspection, then it's not a requirement, but a design specification. I'm building a software that makes processing with on ...
4
votes
5answers
2k views

How can I test a user story? Examples please?

I'm a new QS tester in a company in an Agile environment. During the sprint commit I was told that one of my tasks was going to be testing user stories? How exactly do you test something like that. If ...
4
votes
2answers
241 views

Test isolation and automation

We are using Selenium webservices for our automated functional testing . I have a test which tests creation of some objects. If I run the same test again, I need to make sure that each test has a ...
4
votes
2answers
197 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
4
votes
2answers
107 views

Is there a name for this type of vector operation?

I often find myself wanting to generate a lot of negative test cases by mutating a known good set of inputs. Let's say I have a function that will accept (a, b, c) as an expected valid input for a ...
4
votes
2answers
161 views

Turning software testing into an internal service

I've been tasked with changing the focus of my team from a "can do everything" team into one that is more service orientated, i.e. we can provide the framework for your testing rather than being there ...
4
votes
1answer
108 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
4
votes
1answer
53 views

Standard set of unit tests for data layer code

While designing test cases for an application's database code (the data layer), I would like to determine a good subset of tests to run in order to guarantee its proper function. In essence, the goal ...
4
votes
1answer
114 views

Resources on implementing a well-balanced test pyramid

The test pyramid is a concept developed by Mike Cohn, described in his book "Succeeding with Agile". Basically, end-to-end tests (often called UI tests) go across all the layers of the application, ...
3
votes
3answers
355 views

How to test the field with different languages?

I have a few pages where we allow the people to enter other language characters like german, dutch, spanish etc.... I want to test the field by using words of different languages to make sure all ...
3
votes
1answer
215 views

What are the first steps a tester should perform when using combinational testing?

Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique. Where should a tester start this ...
3
votes
2answers
791 views

Automated White box/backend testing for a Test Engineer?

I have been writing a lot of UI tests lately using Selenium and I want to do more integration testing from the backend as well. What is a good approach to start with this, where can I find some more ...
3
votes
3answers
200 views

Why testing, by definition, cannot find deadlocks and stack overflows?

Sean M. Beatty says in "Where testing fails" article that "deadlocks, stack overflows, race conditions and timing problems cannot be detected by testing (whether it is code inspection, whide-box ...