Questions tagged [test-design]

Use for questions about designing tests, specifically selecting test techniques to use in specific circumstances.

Filter by
Sorted by
Tagged with
5
votes
6answers
841 views

How can 100% test coverage be “not enough to prove working code”?

It is known that 100% test/code coverage does not mean your code "works" as expected. What is generally meant by this statement and what use cases could demonstrate that 100% coverage is not enough?
5
votes
5answers
301 views

How to test a system alone with very little experience?

I have little experience with testing and I'm being hired to work on a team where I am the only tester. I'm struggling to find the best approach for the process. Being alone should I write down a test ...
5
votes
4answers
366 views

Defending corner cases

Sometimes, we find specific corner cases that cause a failure in our application - for example, broken relationships between the main entities in our application that are not properly handled (that ...
5
votes
4answers
389 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
5
votes
3answers
12k views

Difference between Test case, Test specification, Test procedure and Test design?

I have researched this question on the web, but still don't understand the difference clearly. please help! thanks.
5
votes
4answers
285 views

How do you know when to stop testing?

Background: While manually testing an application in scenarios, where an application has complex functionality features, supporting multiple platforms(Web/mobile/Web APIs)/versions(OS Versions) where ...
5
votes
3answers
327 views

How important is doing QA considered today (2017)?

I'm doing QA since a while now and I am content with my job. However one thing I'm not so sure about is the value of being QA. The reason why I am asking this is because I see far more developers ...
5
votes
3answers
451 views

What types of testing are LEAST suited to using pairwise testing (and similar test design approaches)?

For those of you who have used pairwise test design methods (or similar combinatorial software testing methods) in an attempt to zero in on a manageable number of unusually powerful tests from among a ...
5
votes
3answers
296 views

Internationalization testing

By internationalization testing I intend testing application with one or more additional languages and one or more additional regional settings (locale). We expect a number of risks with ...
5
votes
4answers
128 views

How do I make my test suite keep running when one test fails?

I have a suite of automated test cases, around 50 in total. When one of my tests fails, an exception is caught and an error message is displayed. However, since all test cases are executed ...
5
votes
4answers
2k views

How to choose page object design & structure

We had a discussion between several automation engineers on page object design, specifically about how many layers it should have and what are the responsibilities of the layers. I hope you guys could ...
5
votes
1answer
9k views

How to ensure 100% coverage of requirements in test cases?

How do I ensure that my test cases covers every aspect of the requirements? For example I had written test cases for the login page with all possible combinations I can think of and submitted for ...
5
votes
2answers
526 views

Should A Formal Test Plan For Dynamic String Testing Include All Combinations?

Situation: Large enterprise web application Formal test plan in HP Application Lifecycle Management (née Quality Center) Many dynamic text strings in the web application with several variables An ...
5
votes
3answers
164 views

Why do some Software Testers never analyze the product extensively or use different techniques/heuristics to generate better ideas?

I am a black-box tester myself. I take my job seriously and try to find new ways to improve my test design experience. I have seen some of the Software Testers in my company take their job very ...
5
votes
2answers
235 views

What changes for testers when they are testing in agile environments?

We know that the whole development team is responsible for the quality of the product. If only the testers test, there can be no question of shared responsibility. Of course, the testers in the team ...
5
votes
2answers
123 views

Is there a name for this type of vector operation?

I often find myself wanting to generate a lot of negative test cases by mutating a known good set of inputs. Let's say I have a function that will accept (a, b, c) as an expected valid input for a ...
5
votes
2answers
6k views

Test Architecture Design document?

What is Test Architecture Design? I have used Test Design Specification and Test Case Specification before but have not heard of a Test Architecture Design document before. I'm not sure what I should ...
5
votes
2answers
152 views

Does cascading tests violate the “one assertion per Test” principle?

Since I have been writing tests, I always stuck to the principle of one assertion per test. Now assume I have a simple application where I want to perform a system test with the following three test ...
5
votes
1answer
978 views

Path to becoming a security tester for a QA Engineer?

I was looking for some guidelines/documentation on how to start security testing my app and progress on as a security tester. It seems interesting to me to be able to break an application using trial ...
5
votes
1answer
181 views

Are there common techniques for testing the conformance of an implementation to a general contract?

Say you have defined some abstract interface and you specify a general contract for that interface to which all implementations must adhere. Are there common techniques that can facilitate testing the ...
5
votes
4answers
866 views

What is definition of done in automation testing?

Team, What is definition of done for automation testing? For example, do we consider execution time or test case coverage?
5
votes
3answers
858 views

Testing Access Control

I'm in the process of writing Access Control tests for a system in the Utilities industry. A component of the system is accessed depending on the role of the User (Role Based Access Control). There ...
5
votes
2answers
181 views

Turning software testing into an internal service

I've been tasked with changing the focus of my team from a "can do everything" team into one that is more service orientated, i.e. we can provide the framework for your testing rather than being there ...
5
votes
3answers
137 views

How to automate tests for a fancy web site

I am going to take up the responsibility of automating an in-house "Media" website that looks really fancy and has more than 50 elements per page. But being from "industrial and data-center network" ...
5
votes
1answer
368 views

cause effect graphing - creating simple graph

I need to draw an cause-effect-graph, I have read a lot about these graphs but still I am not able to draw one. I you could help me it would be perfect. Here is the description of program: function ...
5
votes
3answers
680 views

Why does ISTQB say Boundary Value Analysis is a black box technique

Boundary Value Analysis is, according to ISTQB - a black box technique. How can anyone agree with that? Most developers write unit tests following equivalence partitioning and boundary value ...
5
votes
1answer
221 views

In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?

Background: MFAT = "Multiple Factors at a Time" OFAT = "One Factor at a Time" In the field of Design of Experiments, practitioners in a large variety of fields (including software testing) have ...
5
votes
1answer
188 views

How to identify and justify how many test cases is enough when you have a potentially huge number of combinations?

I'm working on a form builder project. Users can drag and drop elements to build questionnaires. If we simplify and say there is only 3 form elements that can be used: Numeric answer, with ...
5
votes
2answers
2k views

How to test current time, date/time through automation?

I've tests where I've to check whether current time and current date/time is correctly returned by my APIs through automation. Suppose, getCurrentTime() returns current time in format HH:MM:SS (A/P)M ...
5
votes
1answer
87 views

Standard set of unit tests for data layer code

While designing test cases for an application's database code (the data layer), I would like to determine a good subset of tests to run in order to guarantee its proper function. In essence, the goal ...
5
votes
1answer
426 views

How should I design a testing framework for a trading system?

I work in finance and my firm would really like me to automate our execution platform's testing suite. Right now the tests communicate directly with the system; they are extremely brittle and tightly ...
5
votes
0answers
48 views

How to load test video streaming with traffic, internally?

We use centos 6, apache prefork, PHP 5, MySQL, and we have Wowza streaming engine on a different server. Nothing is on the cloud, we have on-premise servers. We'd like to test a couple of things ...
4
votes
8answers
2k views

Is it necessary to test third party tools?

I have a question about best practices for writing test cases. At my job, I am using a closed source, third party tool that parses files into a database. Since this is a third party tool, is it ...
4
votes
5answers
372 views

Where to start when testing web pages with large number of options

I have inherited a web application that has no useful requirements/specifications, and no tests. The page that I am currently looking at sets the configuration options for the application and consists ...
4
votes
5answers
192 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
4answers
108 views

Certify in writing that your software will work flawlessly

A client pays you for a job and on delivery he wants you to assure him in writing that your software will work flawlessly. What if that software is for an airplane;do you deliver it with a notice of '...
4
votes
4answers
226 views

Are test set cases always meant to be run in succession?

We are in the process of developing an in-house testing solution that is tailored to our applications. As of right now when you add a new test case to a plan you must choose the prerequisite steps, ...
4
votes
5answers
138 views

Testing non-central features

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
4
votes
6answers
9k views

How to categorize defects?

Many project managers and other non-tester roles search for proper categorization according to severity (A-B-C) of the defects and they search for description how to distinguish between each category. ...
4
votes
3answers
539 views

What are the steps/action plan to introduce Test Automation in a company?

My colleague and I have been given the task of Piloting Test Automation in our company. We need help deciding on the Action Plan. Some Actions we noted are as below : Design an Architecture of "...
4
votes
2answers
5k views

Automated White box/backend testing for a Test Engineer?

I have been writing a lot of UI tests lately using Selenium and I want to do more integration testing from the backend as well. What is a good approach to start with this, where can I find some more ...
4
votes
3answers
129 views

Can existing tests and data effectively compare old and new systems?

This idea was presented to me recently: You have a complex legacy ETL system in Java in a TEST environment that no one understands completely. You write some tests that run it and compare the output ...
4
votes
2answers
161 views

Area of responsibility of a test manager within the agile process?

At first glance, Scrum doesn't say anything about how to test and who should take responsibility for it. Sure, it is always said that in Scrum the team is testing. But who bears the responsibility? ...
4
votes
2answers
592 views

How to use fictitious people and personas in testing?

I've recently stumbled upon the concept of "Personas": A persona, first introduced by Alan Cooper, defines an archetypical user of a system, an example of the kind of person who would interact ...
4
votes
1answer
967 views

Should test cases contain business logic?

I'm in a disagreement with my superior. Background: Basically, for our application, which is very complex at times we have: App specification in .doc documents JIRA requirement tickets that repeat ...
4
votes
1answer
277 views

How do I assess the testing process of a project?

I need to asses the efficiency/productivity of a project's testing process, which also uses SCRUM. How do I go about? Are there some peer-reviewed or well-known standard approachs to evaluate the ...
4
votes
2answers
63 views

Equal or different test data for higher test levels

It's just a little issue, but one that pops up in my mind regularly when writing test scripts. Imagine you have an application which does some car tax calculation, having a REST service which has a ...
4
votes
2answers
5k views

How to test a video call

I have an Android app that allows to make video calls and I need to test the quality of the video and if both video streamings match correctly. How would you test it, in an automatic proccess? I ...
4
votes
4answers
33k views

How to click a button from multiple buttons on same page in selenium web driver?

Here my requirement is need to click on one button from multiple buttons, but which are having same class and type on same page. I need to click on button number 4 from below example. For example ...
4
votes
5answers
17k views

Difference between Exploratory Testing , Monkey Testing and Ad-hoc Testing?

Monkey testing is a software testing technique in which the testing is performed on the system under test randomly. Exploratory testing is simultaneous learning, test designing and execution.Tester ...

1 2
3
4 5
10