Questions tagged [coverage]
Coverage measures the amount of testing done of a certain type. It is always in relation to some kind of measure, for example: statement coverage, branch coverage, etc. (Not restricted to code coverage).
69
questions
1
vote
2
answers
44
views
Should most of the Regression testing items be automated?
I work on a very complex financial product. We have very few Regression items/test cases automated. Like 20% is automated. Now, should I automate more and reach till 70-80 % coverage.
Is it necessary ...
- 21
1
vote
3
answers
191
views
Difference between Test Coverage AND code coverage?
My team asked me to measure the Test coverage percentage via a tool i choose ( how many tests from the app features are covered by automated testing ) , so i added the gitlab coverage badge and now i ...
- 57
0
votes
1
answer
108
views
Understanding identified prime paths in the prime path coverage example given
I'm trying to understand this example in paper Code coverage and test automation. Please refer to the figure.
Why is (n3, n4, n1, n3) a prime path, while (n3, n4, n1, n2) is not?
- 101
0
votes
1
answer
105
views
Assertion coverage and assertions count in industry
I have recently found one of my test is verifying only 3 of 10 fields of entity modified by the system under test.
I've added a couple of more assertions to the same tests. That obviously hasn't ...
- 10.5k
0
votes
0
answers
36
views
tool recommendation to get line coverage against Manual and Automated test cases (offline instrumentation)
Our team uses the traditional method of building new test cases based on the feature requirements and testing them (manually or through automation) and getting them reviewed by the dev and product ...
1
vote
1
answer
1k
views
How many more test cases are required to achieve provide 100% statement and 100% decision coverage?
You have designed test cases to provide 100% statement and 100% decision coverage for the following fragment of code.
if width > length
then
biggest_dimension = width
else
biggest_dimension = ...
- 139
0
votes
1
answer
7k
views
Given the following fragment of code, how many tests are required for 100% decision coverage?
if width > length
then
biggest_dimension = width
if height > width
then
biggest_dimension = height
end_if
else
biggest_dimension = length
if height > ...
- 139
-1
votes
1
answer
364
views
What will be the statement coverage, decision coverage and branch coverage of these following problem?
I have been trying to get ISTQB certification and this is my first time with manual testing stuffs, I found it very interesting but can some please tell me how to find the statement coverage, decision ...
- 139
1
vote
1
answer
27
views
Should cross-browser and cross-platform be performed for testing network calls from a website?
My team is implementing Adobe Analytics on a web site.
We have three layers where it should be tested.
Adobe Data Layer.
The required variables and their values are added to an object handled by a ...
- 572
1
vote
4
answers
959
views
How to calculate condition coverage?
I am trying to prepare to test and I see the next exercise in internet:
How many test cases are needed to achieve 100 % condition coverage?
if ((temperature < 0) or (temperature > 100)) {
...
- 121
0
votes
1
answer
651
views
Code coverage tool for Python Web application tested by Java selenium tests
I have Web Application where the source code is in Python. All the regression tests are in Java. I wish to perform Code Coverage for the application. Please suggest a code coverage tool to instrument ...
- 1
4
votes
6
answers
6k
views
How can I measure the coverage of my E2E tests?
I'm looking for a way to measure the coverage of my end-to-end tests. I have some existing E2E tests already and I'm adding more test scenarios to it. But I would like to have a way to quantify the ...
- 151
0
votes
1
answer
90
views
How many test cases can I run if I'm using domain testing?
I'd like to understand what is domain testing, and how do we use it to calculate coverage (if possible)?
My question is imagine I have 3 loops in series and I'm using domain testing approach how many ...
- 193
2
votes
1
answer
136
views
Working just on branch or line coverage could prevent us from finding which defect?
Achieving branch coverage is possible but it doesn't mean complete testing.
What kind of defect you can find with this technique?
what kind of risk you could have with this technique?
what possible ...
- 193
-2
votes
5
answers
224
views
Can test case break after changes in lines of code that are not hit by the test case?
If I have a test case that passes on one version of the code and a change is made to some lines in the code that are not hit by this test case, is there a possibility that the test case fails after ...
1
vote
1
answer
159
views
Code coverage in react webapp
I'm a little bit stuck with a task that I have been researching.
It's about code coverage in a react webapp.
I implemented a few unit tests using jest + enzyme. also some functional test, using ...
- 13
1
vote
1
answer
2k
views
Equivalent of code coverage for selenium test
I'm currently writing test using cucumber + selenium. I will also write tests for web services (using SoapUI) and my chief would like to have a quick and clear view of what fonctionnality/feature is ...
- 652
5
votes
6
answers
2k
views
How can 100% test coverage be "not enough to prove working code"?
It is known that 100% test/code coverage does not mean your code "works" as expected.
What is generally meant by this statement and what use cases could demonstrate that 100% coverage is not enough?
- 11.4k
1
vote
0
answers
61
views
Code Coverage using Scala Automation Testing for JS web application
I'm looking if there's an existing application or tool that will run code coverage based on a scala implemented automation suite running against a Javascript web application.
Our automation framework ...
- 11
3
votes
3
answers
3k
views
How to get Code coverage via external rest assured API automation using jacoco?
I have a multi module application "Project A". This application is hosted in clustered app nodes using tomcat as web server. We are using Spring, Web Services as primary among many other technologies ...
6
votes
4
answers
1k
views
How would we know when we are over-testing?
I've recently heard the idea of over-testing for the first time while listening to the interview of the coverage.py maintainer on the Talk Python to Me podcast show.
coverage.py has a new feature to ...
- 11.4k
3
votes
1
answer
2k
views
ISTQB question: Statement Coverage and Decision Coverage with loop
I'm learning ISTQB and encountering a question about Statement and Decision coverage in a sample exam of ISTQB org.
Evaluate the following control flow diagram and determine the ...
2
votes
1
answer
3k
views
ISTQB question: Statement and Decision coverage
READ A
READ B
READ C
IF C>A THEN
IF C>B THEN
PRINT "C must be smaller bla bla.."
ELSE
PRINT "Proceed to next stage"
ENDIF
ELSE
PRINT "B CAN BE SMALLER THEN C"
ENDIF
Could someone explain to me ...
- 186
4
votes
3
answers
125
views
Determine most depended-on code
Another title might be: determine strongest candidates for 100% test coverage. I'm looking for a tool that will display the methods/functions that are most depended on by my code base. To be clear, I'...
- 141
6
votes
4
answers
520
views
Can code coverage be used for Java tests that work against a Python code base?
Development stack is in Python (flask) and our automation suite(API) is coded in Java.
Can we do code coverage and if Yes, which plugin to use?
- 61
-3
votes
1
answer
5k
views
How many test cases required to achieve 100 % statement coverage
1. if A > B
2. if A > C
3. Add A to X
4. End if
5. End if
According to my understanding 2 test cases are required to achieve 100 % of the statement above. My reasons are:
One statement ...
1
vote
0
answers
547
views
Cobertura analysis reporting "[ERROR] SLF4J: Class path contains multiple SLF4J bindings."
Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact:
[ERROR] SLF4J: Class path contains ...
- 269
3
votes
1
answer
2k
views
How to merge different karma coverage html reports into single html file?
I am new to TDD. we have already executed the test cases through karma-coverage.. If the test case count increases, the code coverage took more time to complete the job. so i had switched into ...
- 357
6
votes
1
answer
1k
views
Why Phantomjs got crashed while running more test cases?
I have written 751 test cases in Jasmine JavaScript. 116 test cases for Mobile View and 645 test cases on Desktop view. While executing test cases, most of the times, test case execution was not ...
- 357
2
votes
2
answers
61
views
Is running tests with coverage functionally the same as running without?
This is a follow-up to Is it a good practice to run functional tests with coverage? which made me confused a little bit.
I was under the impression that typically a test run with enabled coverage ...
- 11.4k
6
votes
2
answers
414
views
Is it a good practice to run functional tests with coverage?
Does it make sense to run once in a while, say, on a weekly basis, integration/functional tests against special build to have a coverage report. If anyone here has some practical experience of using ...
- 361
1
vote
3
answers
9k
views
ISTQB Foundation Level Paper 3, no. 37
How many test cases are necessary to cover all the possible sequences of statements (paths) for the following program fragment?
if (condition 1)
then statement 1
else statement 2
fi
if ...
- 19
1
vote
1
answer
42
views
How to document the paths of my windows service in an easy to read diagram?
I have a windows service that issues thousands of android ADB commands to devices, I plan to go through the source for it and document all possible scenarios/paths, there are a lot of if x do y ...
- 934
4
votes
2
answers
4k
views
How should a Black-box Tester measure Test Coverage?
I work in Product based company as a QA/Test Engineer. For ex:I have been assigned a new project/enhancement that would be delivered to the clients in the next production release. The Business Analyst ...
user15122
0
votes
1
answer
1k
views
How should I go ahead and increase code coverage from functional tests report?
Currently, in our code base, we have unit tests written for each class and its classes coverage is close to 89%. Now, my task is to increase code coverage wrt functional tests which is about 56%.
...
- 101
9
votes
2
answers
14k
views
Why do code coverage of integration test?
in my project I started code coverage for unit and integration test with gradle + jacoco. It's already working and generating reports.
I saw a lot of questions and tutorials about how to do code ...
3
votes
4
answers
131
views
Testing approaches with temporal delays
I am working with a system that has fairly complicated business logic. It has reasonably good unit, and integration tests.
We recently ran into a bug which we had missed. This bug only became ...
- 131
2
votes
1
answer
126
views
Comparing test coverage metrics to identify an increase/decrease after implementing automation
I would like to compare the levels of test coverage for projects before and after implementing an automation framework. I would like to know if there has been an increase or decrease in test coverage.
...
- 23
2
votes
1
answer
805
views
Examples for LOC figures, of test suites, and software projects?
To learn what kind of "software" project my automated testing team faces (I consider test automation a certain kind of software project), I assessed the size of our automated (functional, GUI-focussed)...
- 133
1
vote
1
answer
44
views
Identifying test coverage for item without detailed specification
I am working in a HW area. Recently I have been given a device to test (just hardware validation) but there is no detailed specification, just a block diagram where each block performs certain ...
- 223
7
votes
2
answers
635
views
C++ coverage tool for QA personnel
Background: Our QA organization is considering using NCover Collector to gather code coverage information for manual and automated GUI tests (this is a desktop application). NCover will only work on ...
- 171
2
votes
2
answers
205
views
What non-structural coverage criteria are there?
There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications.
...
2
votes
1
answer
848
views
Test coverage tool that shows call graph of untested new code from a merge
I'm looking for a test coverage tool that can show the call path/call graph of new untested code that came from a merge.
Example: I have a git repo (on github or bitbucket) and a test suite that ...
6
votes
3
answers
1k
views
Measuring feature coverage with BDDs
I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement.
My question is: do ...
- 191
0
votes
1
answer
380
views
Which tool can I use (as a tester) to track the code coverage for a web based application?
I am a QA Intern and we use Selenium Webdriver to test our web based application. We are provided with a server on which the build to be tested is deployed. I wish to know is there a tool that I can ...
4
votes
4
answers
906
views
How to interpret / analyse code coverage results and provide suggestions for improvements?
Knowledge level
I am looking for a how-to for a beginner, not so much for a expert or consultant answer like "it depends".
Feel free to add the "it depends" parts nevertheless.
Question
How would ...
- 187
11
votes
3
answers
10k
views
Measuring code coverage in end-to-end tests?
I've been hearing about ideas for measuring code coverage in end-to-end tests (e.g., Selenium tests) and I really don't see a reason for that, even if this is technically feasible.
There's a concept ...
- 10.5k
6
votes
4
answers
4k
views
What to call a matrix with all possible combinations?
For example: The application show a list of results.
Now we have a new feature: The list can be filtered.
The user can use a search input field and a date range to filter the results.
To cover all ...
- 1,654
4
votes
2
answers
13k
views
What are basic metrics of coverage with functional UI automation testing
There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
- 79
2
votes
1
answer
1k
views
Combining coverage from unit tests and functional tests/Selenium
Has anyone had experience getting a combined code coverage measure across both unit tests and functional/UI automation tests? I'm in a Java stack with Cobertura, Jenkins and Ant. I can successfully ...
- 121