Questions tagged [test-design]

Use for questions about designing tests, specifically selecting test techniques to use in specific circumstances.

Filter by
Sorted by
Tagged with
4
votes
5answers
135 views

Testing non-central features

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
1
vote
1answer
79 views

Best way to wait till the status changes

I have to automate a web page. Which has the following behaviour. I will create an application and the created application will be displayed in a table. The table has a column named status. The ...
2
votes
3answers
2k views

How do you manage dependencies between automated UI tests?

I am currently helping out with the TodoMVC project by adding automated tests. I have been 'exercising' my tests by trying them out on new submissions, such as this one recently. One problem I have ...
3
votes
3answers
2k views

How to test the field with different languages?

I have a few pages where we allow the people to enter other language characters like german, dutch, spanish etc.... I want to test the field by using words of different languages to make sure all ...
3
votes
3answers
221 views

Release methodology for complex distributed system

I have a problem on deciding how to guarantee good testing of a complex distributed system before release. We have an automated testing infrastructure in place. The problem is that running all the ...
-3
votes
1answer
137 views

A tool that migrates data from database A to B has been developed [duplicate]

A tool that migrates data from database A to B has been developed. The tool will be used to migrate all production data from version 1.0 of our app (operating on A) to version 2.0, currently being ...
8
votes
5answers
3k views

Are state transition diagrams a good software testing technique

I have been looking at different testing techniques and wondered if anyone had some "real world" examples of using state transition diagrams rather than the bog standard clock and light switch ones ...
3
votes
1answer
233 views

Encouraging project teams to define Edge cases

Can you please give me concrete examples of Edge cases preferably for Financial systems (General Ledger) and STP Settlements to help us kick start the right kind of thinking /approach by both the ...
4
votes
8answers
2k views

Is it necessary to test third party tools?

I have a question about best practices for writing test cases. At my job, I am using a closed source, third party tool that parses files into a database. Since this is a third party tool, is it ...
3
votes
1answer
5k views

Software Tester Job Interview: Case studies on Test Design

Case Studies during job interview is a great technique which allows to find out how the candidate would behave in different situation. For instance, the following case: Given a developer ...
7
votes
3answers
645 views

When is it inappropriate to use white box testing?

Sometimes, tasked with testing a piece of software for which there are no requirements, a tester will resort to white box testing. Are there times when that is inappropriate? Here is an example. At ...
2
votes
5answers
2k views

how to test mobile application which uses wifi connection?

i am in need to test the application which was working based on the wi-fi signal strength,is it there any application/automation tool to randomize my wifi signal and check for applications ...
-3
votes
3answers
157 views

Suggestions for Software Testing Blogs [duplicate]

I want to be more up to date with current events and ideas in SQA. I was wondering if anyone could offer any suggestions for Software Testing Blogs.
5
votes
1answer
822 views

Path to becoming a security tester for a QA Engineer?

I was looking for some guidelines/documentation on how to start security testing my app and progress on as a security tester. It seems interesting to me to be able to break an application using trial ...
13
votes
4answers
728 views

Good strategy for automated regression where initial state can't be guaranteed or predicted

The situation I need to start building automated regression for a very large web application with thousands of users. It is impossible to start from a known state, or even to be sure that data ...
3
votes
2answers
538 views

Test data specification to generate actual test data

I don't want to describe the domain I work in at my work, so I will describe some fake scenario; might be silly but hopefully illustrative enough. Let's say we have a system that qualifies whether an ...
9
votes
2answers
804 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
0
votes
1answer
101 views

What are some typical javascript, HTML and AJAX issues that I should write test cases for?

HTML rendering, Javascript and AJAX plays an important role in the development of modern web applications. How significant is JavaScript when designing test cases for a website that uses it? What ...
4
votes
2answers
392 views

Using a system test framework that handles test dependencies

To explain better, if test B depends on test A, then if test A fails, then test B should not be run and fail implicitly if test A produces some output, then it should be available for test B I can ...
6
votes
1answer
172 views

Can a requirement be verified just by white or gray box testing?

I've read that if a requirement can't be verified by black-box testing or inspection, then it's not a requirement, but a design specification. I'm building a software that makes processing with on ...
4
votes
5answers
190 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
7
votes
3answers
1k views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
2
votes
1answer
808 views

Stability testing for open source operating systems

You can find quite an interesting panoply of open source operating systems to choose from. Being open source you can have access to a lot of their code, build systems, bug tracking, etc. As of this ...
8
votes
2answers
4k views

How does the DataSource attribute on a test run the test multiple times?

This is going to be a bit long/wordy/verbose, but I've been looking at it for a while and I think that I'm bad at explaining things because people seem to get confused about what I'm asking. You know ...
8
votes
1answer
221 views

Where to start with introducing a testing framework

This I hope won't come across too broad of a question. If you've been tasked with introducing testing process' for a web application developed in an 'agile' environment, released in 2 weekly cycles. ...
3
votes
1answer
408 views

Use case testing tools and methods

Is use case testing standard practice and if so could people point me towards some methodology and perhaps some tools. I was thinking that my Test cases could easily be represented via some type of ...
3
votes
2answers
125 views

Level of detail in a Scenario - when to stop

Scenario: Installer Link When user enters "product.company.com" into a web browser Then a hyperlink is presented to 'ProductSetup.exe' TODO: There is nothing here about presentation, e.g., ...
3
votes
1answer
132 views

What particular testing requirements do data driven applications have?

Different sorts of software need different approaches to testing. An interactive GUI-driven application will be tested in a very different way from a piece of middleware, for example. Specifically ...
4
votes
3answers
2k views

Repeat/common Test steps in multiple test cases - to do or not to?

I am trying to seek some input on what might be an efficient best practice. I have been told that end-to-end test cases might have certain steps that are being repeated on other test cases. Let's take ...
1
vote
7answers
361 views

Promoting Non-Functional Testing

What advice can you give for encouraging Project managers, and Developers to factor in tests for purposes of proving an application system's performance, resilience, capacity, scaleability etc beyond ...
3
votes
3answers
229 views

Why testing, by definition, cannot find deadlocks and stack overflows?

Sean M. Beatty says in "Where testing fails" article that "deadlocks, stack overflows, race conditions and timing problems cannot be detected by testing (whether it is code inspection, whide-box ...
5
votes
2answers
484 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
4
votes
2answers
5k views

Web application GUI automation best practices

Our team develops automation solutions for various web based products. I'd like to compile a list of patterns and best practices from the GUI web automation space that have been used and proven as ...
5
votes
1answer
172 views

Are there common techniques for testing the conformance of an implementation to a general contract?

Say you have defined some abstract interface and you specify a general contract for that interface to which all implementations must adhere. Are there common techniques that can facilitate testing the ...
3
votes
3answers
5k views

Best practices for organising and naming test cases

I have a Python package which may contain several modules. Of course, I have unit tests, component tests, and functional tests. All of them are in package/module/test directories, most of them are ...
5
votes
3answers
289 views

Internationalization testing

By internationalization testing I intend testing application with one or more additional languages and one or more additional regional settings (locale). We expect a number of risks with ...
6
votes
2answers
5k views

How to test a location based application

Our application is location based. We have tested its main functionality, (using mock locations) and now it is time to test how it reacts on real cases using GPS. So, what are the main limitations ...
5
votes
4answers
371 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
3
votes
1answer
736 views

Fitnesse editor with syntax validation?

We use Fitnesse with tens of project-specific fixtures to design the tests. However, writing the correct test is tedious, because of some trivial errors we make: Syntax errors: unclosed tables, ...
2
votes
2answers
667 views

Layer testing - How should I test data replication/update?

I have a development background and now I'm starting with software QA. While building a solution developers often create code which is shared among different platforms/applications. One example is the ...
1
vote
4answers
2k views

What are some good test cases in order to do License Key authentication while software is being installed?

I want to learn about: What could be the test cases to ensure the test coverage while any proprietary software is being installed using a license key. I wish to avoid (a) re-installation (b) multiple ...
5
votes
1answer
198 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
2
votes
1answer
123 views

What is the best practice for testing against modules which collect statistic

We have a distributed application which should be monitored. There are some modules which collect external data (disk usage, free disk space, CPU utilization, memory utilization, etc) and some ...
2
votes
2answers
1k views

What are the best practices for Integration Testing of a middle-ware?

I want to know about the best practices of Integration Testing for a middle-ware product. It includes several backends and also I want to test it over multiple platforms. The features of Clustering is ...
5
votes
2answers
120 views

Is there a name for this type of vector operation?

I often find myself wanting to generate a lot of negative test cases by mutating a known good set of inputs. Let's say I have a function that will accept (a, b, c) as an expected valid input for a ...
2
votes
2answers
964 views

Conditional statement for fail and error test outcomes in Selenium?

Say I have this function: def tearDown(self): """ clean up by closing the browser window """ self.driver.quit() I want to skip closing the browser if the test failed or errored out (so I ...
8
votes
4answers
2k views

Testing/Verifying Google Analytic code

I need help figuring out a test methods for Google Analytic. Our client pushes out a lot of marketing campaigns and they love using GA to track what is working, what is not working and where to focus ...
2
votes
2answers
553 views

test cases for conversation unsubscription in a email

I am a newbie at testing. The scenario described here is what happens when a user tries to unsubscribe from a conversation using Mailing list manager. To unsubscribe the user sends an email sample+...
6
votes
1answer
303 views

What are the first steps a tester should perform when using combinational testing?

Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique. Where should a tester start this ...
6
votes
2answers
1k views

How to test the graphical contents of a bitmap or a PDF file?

The module I'm testing creates some graphical reports which include things like scatter plots and multipage line graphs. The bitmap will never be exactly the same between test runs, since some ...