Questions tagged [test-strategy]
A test strategy is the set of big-picture ideas embodying the overarching direction or design of a test effort.
198
questions
21
votes
6
answers
11k
views
Is an inverted test pyramid really an anti-pattern?
I know that the inverted test pyramid, i.e., having more end-to-end tests than unit tests is an anti-pattern.
However, I've started to think, what could be advantage of having less unit tests then ...
- 10.5k
21
votes
7
answers
27k
views
How to test data migration procedure?
We are migrating our production data (DB and filesystem) from a fairly complex data model to another fairly complex data model. The migration process is given by the specification as a set of mapping ...
- 10.5k
20
votes
9
answers
12k
views
How can a Software Tester use "Out of the Box" thinking approach to find more bugs?
Well, I am a black-box tester and I don't think out of the box.
I just think about happy paths, thus I want to improve.
I always read that testers should have great critical, analytical skills and ...
- 201
17
votes
6
answers
5k
views
Writing test automation in Java, while the company domain uses C#/.NET
I´ve recently got a job as a automation tester in a company, that basically only have manual testers (except me). The short term plan is to come up with a good test strategy for identifying which of ...
- 179
16
votes
4
answers
314
views
What techniques are available to determine which browsers to test?
When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?"
I am not asking that question because it will soon become ...
- 9,740
14
votes
3
answers
1k
views
Mutation testing: is it useful for assessing test quality?
This is part of my quest how to test my tests and test data. I looked at the techniques that would help improve my test cases. While code/branch coverage can tell me whether my test suites cover my ...
- 10.5k
12
votes
12
answers
7k
views
How do I execute/test a large set of test cases with limited time and resources?
We have a large set of test cases but limited time and resources to execute/test them all. We thought but it's not possible to execute/test everything.
I want to know strategies which will be ...
- 1,815
12
votes
4
answers
2k
views
What best practices should be applied to data generation for QA testing
This question is kind of general and not very specific.
We have a Java project that uses Oracle database. We are currently using SoapUI tool for the QA tests. Each test needs some data to exist on the ...
- 223
11
votes
7
answers
28k
views
How to test a toaster? (interview question)
I want to know how we should approach for testing real world objects. The problem that I faced before is to get the list of use cases from the interviewer. Whenever I asked what the real world object ...
- 271
11
votes
3
answers
2k
views
How to set up a Testers Guild
In our organization we plan to set up a Testers Guild: a group of test professionals, that work in different Scrum teams.
We have about 10 teams across the organization. Most teams have one tester on ...
- 149
9
votes
6
answers
1k
views
What are some small, standalone or web applications for test new QA staff on?
I'm permanently stuck with the following trouble: being Senior QA I need to quickly check and hire people for short-time testing projects.
I specialize mostly in manual testing, while the range of ...
- 1,096
9
votes
3
answers
23k
views
What are the test cases or test scenarios for palindrome?
In an interview, the interviewer asked me to write test cases or test scenarios to check if the input/string is a palindrome.
I told them one positive test case and another negative test cases. But ...
- 93
9
votes
1
answer
445
views
Building trust in automated front-end testing
I recently came across a Google Tech Talk during which the speakers seemed to stress, that trust in a test suite is crucial to the overall software development process. Here the link.
Can anyone share ...
- 93
8
votes
2
answers
54k
views
Components of a Test Plan document?
What are the most important components/parts of a well-written test plan document for a testing project. Consider you are testing a Financial web app.
Is test plan a part of overall test strategy ...
- 81
8
votes
2
answers
1k
views
How to define test strategy of a company (how testing is done at a specific company)?
We have to deal at times with requests where a prospective customer is approaching us for some work and wants to know how we do testing. Generally what we hear is a high level statement (or one liner ...
- 1,358
8
votes
7
answers
209
views
Mathematical / statistical relationship between tests and bugs?
As project manager, I would like to convince higher management to invest more time for development of unit tests for existing methods. My understanding is that unit testing is foundation/pre-req for ...
- 81
6
votes
4
answers
903
views
No tests in the legacy project - what to start with as tester? [duplicate]
I've just joined a project, which is developed for internal use for over 10 years now.
There are no unit tests nor any other manual/automated tests designed. I'm going to be the only tester.
What ...
- 79
6
votes
5
answers
540
views
Test automation | Are we focusing more on automation than testing?
Take a very specified example of web application testing with selenium: It seems obvious that (almost) everyone is suggesting using element ID as the best locator strategy, and that your GUI-...
- 61
6
votes
4
answers
2k
views
When do you stop testing? [closed]
When do you decide to stop testing, for me it boils down to -
Allocated time is exhausted
No high severity/priority defects are found
Any other pointers which you consider while deciding to stop ...
- 3,447
6
votes
4
answers
9k
views
How to inspect elements on pages with 'loading' spinners?
Note:
This is intended as a Q and A post for sharing successful strategies. Please, feel free to add more solutions!
Problem background:
Automating a web application
Tester with limited access to ...
- 4,119
6
votes
3
answers
30k
views
Order of execution for Tests in TestNg, If Priority set only for few Test Methods
I have three methods as mentioned below, two with priority ( 0 , 1 ) and third method(Test) with no priority attribute.
What is the order of execution.
Code snippet given below.
@Test(priority = 1)
...
- 435
6
votes
3
answers
3k
views
How to Organize Tests for Software That's Already Developed?
I've managed tests for a project that I was with since its infancy. I used Microsoft Test Manager to tie tests to requirements and organize them in folders. It went well.
However, now I'm being ...
- 61
6
votes
2
answers
231
views
Testing a system with scheduled, event-driven data changes
I'm testing a software system that forces users to take action on their data every 60 or 180 days. The users get notified when the due date is approaching or if they have missed one. These users can ...
- 111
6
votes
2
answers
689
views
Load testing web service with SoapUI to confirm android app's slowness
The AUT is on Android platform, which has experienced slowness or long time loading a section's contents (more than 17s).
I can notice the app only has long time loading the first time I enter that ...
- 143
6
votes
1
answer
309
views
How can I use causal loop diagrams to help me test?
Causal loop diagrams seem like a really powerful tool for modelling a system - but I have no experience with applying them to my testing.
Do you use causal loop diagrams? How do you use them, and ...
- 5,125
6
votes
1
answer
913
views
Nothings gets recorded when using JMeter for load testing of Vaddin-based app
We have been trying to do a Quick Load test on one of the POC application developed in Vaddin using JMeter tool, the server is hosted on local network.
The settings for automating Vaddin application ...
Chandrakant
5
votes
4
answers
2k
views
Strategies for discovering undocumented API
Inspired by this question: How to approach API testing.
The first point of a checklist in the above question is "API Endpoints".
But, what to do when you don't have the endpoints documented because ...
- 4,119
5
votes
5
answers
147
views
Testing non-central features
Only 1% of our clients use particular features or scenarios.
Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
- 463
5
votes
4
answers
346
views
How to track which stories / functionality in an agile project have automation test coverage?
I'm a developer trying to find some guidance for the testers on our team. Our strategy regarding selenium automation testing has been rocky to this point. (A .NET project for context).
We started off ...
- 159
5
votes
3
answers
3k
views
Pros and cons of complex test scenario / test case / checklist?
I know, that test scenarios, test cases and checklists are different things and are important for testing. I've landed a job as a QA in startup that's adopted scrum methodology and is fast paced.
...
- 133
5
votes
1
answer
192
views
Are there common techniques for testing the conformance of an implementation to a general contract?
Say you have defined some abstract interface and you specify a general contract for that interface to which all implementations must adhere. Are there common techniques that can facilitate testing the ...
5
votes
1
answer
141
views
How to accelerate the release process by rethinking test automation
Background: web security company which was acquired by a bigger one. It was a startup with only manual testing, test automation started after the acquisition with a contractor team with mostly UI ...
- 81
5
votes
2
answers
892
views
How to Demo Automated Tests
I automate tests based on test plans written by manual testers.
I would like to demo the automated tests to the authors of the manual test plans to ensure, that I've implemented the test correctly and ...
- 51
5
votes
2
answers
83
views
Avoiding GUI test overload working on legacy systems
I'm currently tasked with automating a 10+ year old, and rather large application.
There are no exposed APIs, it's built as a monolith. There are no unit tests, nor promise of unit tests to come. The ...
- 111
5
votes
3
answers
156
views
How to automate tests for a fancy web site
I am going to take up the responsibility of automating an in-house "Media" website that looks really fancy and has more than 50 elements per page.
But being from "industrial and data-center network" ...
- 61
5
votes
1
answer
109
views
One issue with symbolic execution
I'm reading the slides of a famous random test+symbolic execution software test tool cute's slides.
In one slide, I see this claim on classic symbolic execution:
So my question is :
Why author claims ...
- 215
5
votes
3
answers
1k
views
Functional Testing - How do you track your test cases?
So I'm the sole-developer maintaining a software project owned by a non-profit. Being the sole CS guy on the project, I'm finding myself wearing many different hats. One of those is of your typical ...
- 153
5
votes
1
answer
275
views
JMeter graph interpretation
I'm very new at JMeter and am trying to get an idea of how to interpret the graphs below.
The test I performed used 1 thread group with 600 users ramped up ever 5 seconds. What concerns me is the ...
- 59
5
votes
2
answers
418
views
BDD living documentation for Product Owners
We have been using BDD in our team for over a year now. The jobs, that run our tests generate a published report in business language, that anyone is available to read.
We find these very useful ...
- 51
5
votes
1
answer
2k
views
Test Strategies for Stream Processing / Event Processing
My org is looking into the possibility of using Kafka data streaming as part of our applications.
In order to understand this a little bit more I have been doing some research online and think I've ...
- 51
4
votes
3
answers
274
views
One tool to rule them all
This question may have already been asked/answered in various places, and in various forms, but this is my problem. I have been in software testing for a few years now, most of this has been manual ...
- 41
4
votes
4
answers
567
views
What is best approach to run regression Automation in Agile
We are following agile methods in manual testing. We had not done any automation until sprint 10.
Our current sprint is 15.
After sprint 10, We started automation using Java, Maven, and Selenium ...
- 2,514
4
votes
6
answers
2k
views
How Can a Tester Increase his Observation Skills?
How should a tester increase his observation skills? I feel that I somewhere lack sharp observation and attention to detail. any games or exercises that can make my approach towards testing easier ...
- 41
4
votes
3
answers
472
views
Bug Fix Verification - UI Design
I'm working on this ticket created by a fellow QA Tester. The ticket requires a notification message with a link to be created. Our developer worked on it and acceptance test was met. However, upon ...
- 761
4
votes
3
answers
166
views
Alpha Testing via Company Testing Day?
In a server-client environment we want to test / observe interaction of several clients and stress of the server.
As it's a product the whole company is familiar with (we use it ourselves), I've ...
- 81
4
votes
2
answers
245
views
Success rate of "click" actions with Selenium? (Relatively)
I've used a tool called Ranorex for my test automation projects, and it has an annoying issue with click actions: They are not stable. A click on any element can be missed at any time, even when the ...
- 41
4
votes
1
answer
7k
views
Check if password field displays masked characters (Selenium + Python)
I'm new to automation testing, so I have a question regarding the code, that I used to execute a simple test case: Check if password is masked.
Steps:
Open the browser;
Enter the URL “http://practice....
- 197
4
votes
2
answers
269
views
IPv4/IPv6 dependency testing
Research from the Software Improvement Group has shown that 1 in every 12 applications behaves incorrectly when confronted with a dual-stack IPv4+IPv6 environment. How does Quality Assurance usually ...
- 143
4
votes
3
answers
167
views
What experience do you have with the idea "QA designs, Developer develops"
There is the opinion that QA should design cucumber scenarios, define the right data for tests, communicate with business and end users to fully understand use cases, focus to semantics and look also ...
- 143
4
votes
3
answers
10k
views
WebDriverWait ExpectedConditions stopped working after updating Selenium.Support NuGet
Before updating Selenium.Support Nuget, all test cases in my test suite were running correctly. When I updated the Nuget yesterday, all my test cases in which I use WebDriverWait ExpectedConditions, ...
