Questions tagged [test-design]

Use for questions about designing tests, specifically selecting test techniques to use in specific circumstances.

Filter by
Sorted by
Tagged with
4
votes
3answers
2k views

Repeat/common Test steps in multiple test cases - to do or not to?

I am trying to seek some input on what might be an efficient best practice. I have been told that end-to-end test cases might have certain steps that are being repeated on other test cases. Let's take ...
2
votes
4answers
908 views

Is unit and component testing sufficient?

If you can test every line of [your product's] code via unit tests, wouldn't unit testing alone (theoretically) be sufficient? Are there other "necessary" benchmarks of proper test coverage other ...
16
votes
7answers
48k views

Difference between requirement, use case, and scenario?

I've taken a class on software testing best practices and test design. In the content, they have a model that basically shows that the three items are derived in this way: Requirements > Use case &...
4
votes
2answers
365 views

Any good test plan/cycles or experiences without using crowdsourcing?

I'm trying to rethink our test cycle that we use at my company and am wondering if anyone could give any leads, examples, experiences, etc. to how you test without the use of crowdsource data. The ...
3
votes
3answers
231 views

Why testing, by definition, cannot find deadlocks and stack overflows?

Sean M. Beatty says in "Where testing fails" article that "deadlocks, stack overflows, race conditions and timing problems cannot be detected by testing (whether it is code inspection, whide-box ...
2
votes
2answers
459 views

Testing asynchronous concurrent systems in a systematic way

Problem I have a system with two logical threads, living on different machines and operating concurrently and asynchronously. First one receives data from an external system and puts them into DB. ...
2
votes
5answers
2k views

how to test mobile application which uses wifi connection?

i am in need to test the application which was working based on the wi-fi signal strength,is it there any application/automation tool to randomize my wifi signal and check for applications ...
3
votes
1answer
1k views

testing an nfc application

My company is currently developing a Near Field Communication(NFC) based application. What test scenarios need to be checked for NFC-based applications? How do I test the applications which use NFC? ...
17
votes
9answers
724 views

How to obtain “fresh mind” results?

I noticed that when you start on a project with a beginner mind (for that particular product) you have a fresh approach and start noticing a lot of bugs. After a while and some experience with that ...
5
votes
2answers
536 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
4
votes
2answers
5k views

Web application GUI automation best practices

Our team develops automation solutions for various web based products. I'd like to compile a list of patterns and best practices from the GUI web automation space that have been used and proven as ...
3
votes
3answers
7k views

Best practices for organising and naming test cases

I have a Python package which may contain several modules. Of course, I have unit tests, component tests, and functional tests. All of them are in package/module/test directories, most of them are ...
5
votes
3answers
301 views

Internationalization testing

By internationalization testing I intend testing application with one or more additional languages and one or more additional regional settings (locale). We expect a number of risks with ...
4
votes
5answers
376 views

Where to start when testing web pages with large number of options

I have inherited a web application that has no useful requirements/specifications, and no tests. The page that I am currently looking at sets the configuration options for the application and consists ...
6
votes
2answers
6k views

How to test a location based application

Our application is location based. We have tested its main functionality, (using mock locations) and now it is time to test how it reacts on real cases using GPS. So, what are the main limitations ...
5
votes
4answers
415 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
12
votes
4answers
7k views

Is there a guide for systematic way of writing test scenarios?

Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
3
votes
1answer
811 views

Fitnesse editor with syntax validation?

We use Fitnesse with tens of project-specific fixtures to design the tests. However, writing the correct test is tedious, because of some trivial errors we make: Syntax errors: unclosed tables, ...
9
votes
2answers
1k views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
5
votes
1answer
185 views

Are there common techniques for testing the conformance of an implementation to a general contract?

Say you have defined some abstract interface and you specify a general contract for that interface to which all implementations must adhere. Are there common techniques that can facilitate testing the ...
2
votes
2answers
736 views

Layer testing - How should I test data replication/update?

I have a development background and now I'm starting with software QA. While building a solution developers often create code which is shared among different platforms/applications. One example is the ...
18
votes
5answers
2k views

What Are Some Examples of Why Explicitly Sleep Statements Are Bad?

I've read various places that explicit sleep statements are bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I can'...
5
votes
1answer
243 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
2
votes
1answer
125 views

What is the best practice for testing against modules which collect statistic

We have a distributed application which should be monitored. There are some modules which collect external data (disk usage, free disk space, CPU utilization, memory utilization, etc) and some ...
2
votes
2answers
1k views

What are the best practices for Integration Testing of a middle-ware?

I want to know about the best practices of Integration Testing for a middle-ware product. It includes several backends and also I want to test it over multiple platforms. The features of Clustering is ...
2
votes
2answers
978 views

Conditional statement for fail and error test outcomes in Selenium?

Say I have this function: def tearDown(self): """ clean up by closing the browser window """ self.driver.quit() I want to skip closing the browser if the test failed or errored out (so I ...
5
votes
2answers
124 views

Is there a name for this type of vector operation?

I often find myself wanting to generate a lot of negative test cases by mutating a known good set of inputs. Let's say I have a function that will accept (a, b, c) as an expected valid input for a ...
10
votes
5answers
6k views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory. I found the approach of log files analysis unexpected but quite beneficial on many levels. It seems to ...
6
votes
1answer
309 views

What are the first steps a tester should perform when using combinational testing?

Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique. Where should a tester start this ...
12
votes
5answers
3k views

Are Mind Maps useful as a testing tool?

I don’t know much about Mind maps but I’ve seen expert testers (James Bach and Michael Bolton) use them to plan out their test strategy – usually in a demonstration. It seems like a plausible way to ...
3
votes
1answer
237 views

Encouraging project teams to define Edge cases

Can you please give me concrete examples of Edge cases preferably for Financial systems (General Ledger) and STP Settlements to help us kick start the right kind of thinking /approach by both the ...
6
votes
2answers
1k views

How to test the graphical contents of a bitmap or a PDF file?

The module I'm testing creates some graphical reports which include things like scatter plots and multipage line graphs. The bitmap will never be exactly the same between test runs, since some ...
1
vote
4answers
2k views

What are some good test cases in order to do License Key authentication while software is being installed?

I want to learn about: What could be the test cases to ensure the test coverage while any proprietary software is being installed using a license key. I wish to avoid (a) re-installation (b) multiple ...
1
vote
7answers
367 views

Promoting Non-Functional Testing

What advice can you give for encouraging Project managers, and Developers to factor in tests for purposes of proving an application system's performance, resilience, capacity, scaleability etc beyond ...
2
votes
2answers
786 views

test cases for conversation unsubscription in a email

I am a newbie at testing. The scenario described here is what happens when a user tries to unsubscribe from a conversation using Mailing list manager. To unsubscribe the user sends an email sample+...
4
votes
2answers
256 views

IPv4/IPv6 dependency testing

Research from the Software Improvement Group has shown that 1 in every 12 applications behaves incorrectly when confronted with a dual-stack IPv4+IPv6 environment. How does Quality Assurance usually ...
8
votes
4answers
2k views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
8
votes
4answers
2k views

Testing/Verifying Google Analytic code

I need help figuring out a test methods for Google Analytic. Our client pushes out a lot of marketing campaigns and they love using GA to track what is working, what is not working and where to focus ...
6
votes
1answer
300 views

How can I use causal loop diagrams to help me test?

Causal loop diagrams seem like a really powerful tool for modelling a system - but I have no experience with applying them to my testing. Do you use causal loop diagrams? How do you use them, and ...
3
votes
2answers
425 views

What new things need to be covered in Embedded Systems testing compared to normal manual testing?

Can you provide me with some common checklist for Embedded Systems testing please? What are the new things that are covered in this? And can you also advise me some interesting references for reading ...
6
votes
2answers
456 views

Test isolation and automation

We are using Selenium web services for our automated functional testing. I have a test that tests the creation of some objects. If I run the same test again, I need to make sure that each test has a ...
3
votes
1answer
149 views

xUnit tests patterns for testing threaded applications

Are there either any xUnit (or otherwise) design patterns or anti-patterns for testing threaded code?
12
votes
6answers
469 views

What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?

I'll be giving a 3-day course on software test design later this month with lots of hands-on exercises. I'd like to include one or more exercises that would involve testing an online game for ...
2
votes
1answer
378 views

Testing database transformation mappings

If regularly testing the creation of different datawarehouse tables using mappings from source tables. What do you suggest is the best approach or specific SQLs to do the trick?
9
votes
5answers
995 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
5
votes
2answers
181 views

Turning software testing into an internal service

I've been tasked with changing the focus of my team from a "can do everything" team into one that is more service orientated, i.e. we can provide the framework for your testing rather than being there ...
4
votes
2answers
424 views

XMLs and JMS queue trigger to database - what to test?

I'm testing a system that involves XMLs from a JMS queue getting inserted into a database using a JMS trigger (webmethods). Firstly, I turn off the JMS trigger to let messages accumulate on the ...
7
votes
1answer
1k views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
10
votes
1answer
4k views

What goes in a Testing playbook?

The concept of the Testing Playbook has been recently added to the list of possible tools in your Context-Driven toolset. The Playbook has been described as being similar to the list of plays that a ...
8
votes
2answers
4k views

How does the DataSource attribute on a test run the test multiple times?

This is going to be a bit long/wordy/verbose, but I've been looking at it for a while and I think that I'm bad at explaining things because people seem to get confused about what I'm asking. You know ...

1
6 7 8
9
10