Questions tagged [coverage]

Coverage measures the amount of testing done of a certain type. It is always in relation to some kind of measure, for example: statement coverage, branch coverage, etc. (Not restricted to code coverage).

Filter by
Sorted by
Tagged with
0 votes
3 answers
59 views

Difference between Test Coverage AND code coverage?

My team asked me to measure the Test coverage percentage via a tool i choose ( how many tests from the app features are covered by automated testing ) , so i added the gitlab coverage badge and now i ...
user avatar
0 votes
0 answers
18 views

Understanding identified prime paths in the prime path coverage example given

I'm trying to understand this example in paper Code coverage and test automation. Please refer to the figure. Why is (n3, n4, n1, n3) a prime path, while (n3, n4, n1, n2) is not?
user avatar
0 votes
1 answer
75 views

Assertion coverage and assertions count in industry

I have recently found one of my test is verifying only 3 of 10 fields of entity modified by the system under test. I've added a couple of more assertions to the same tests. That obviously hasn't ...
user avatar
  • 10.4k
0 votes
0 answers
30 views

tool recommendation to get line coverage against Manual and Automated test cases (offline instrumentation)

Our team uses the traditional method of building new test cases based on the feature requirements and testing them (manually or through automation) and getting them reviewed by the dev and product ...
user avatar
1 vote
1 answer
671 views

How many more test cases are required to achieve provide 100% statement and 100% decision coverage?

You have designed test cases to provide 100% statement and 100% decision coverage for the following fragment of code. if width > length then biggest_dimension = width else biggest_dimension = ...
user avatar
0 votes
1 answer
3k views

Given the following fragment of code, how many tests are required for 100% decision coverage?

if width > length then biggest_dimension = width if height > width then biggest_dimension = height end_if else biggest_dimension = length if height > ...
user avatar
-1 votes
1 answer
135 views

What will be the statement coverage, decision coverage and branch coverage of these following problem?

I have been trying to get ISTQB certification and this is my first time with manual testing stuffs, I found it very interesting but can some please tell me how to find the statement coverage, decision ...
user avatar
1 vote
1 answer
26 views

Should cross-browser and cross-platform be performed for testing network calls from a website?

My team is implementing Adobe Analytics on a web site. We have three layers where it should be tested. Adobe Data Layer. The required variables and their values are added to an object handled by a ...
user avatar
  • 562
1 vote
4 answers
597 views

How to calculate condition coverage?

I am trying to prepare to test and I see the next exercise in internet: How many test cases are needed to achieve 100 % condition coverage? if ((temperature < 0) or (temperature > 100)) { ...
user avatar
  • 121
0 votes
1 answer
451 views

Code coverage tool for Python Web application tested by Java selenium tests

I have Web Application where the source code is in Python. All the regression tests are in Java. I wish to perform Code Coverage for the application. Please suggest a code coverage tool to instrument ...
user avatar
2 votes
6 answers
3k views

How can I measure the coverage of my E2E tests?

I'm looking for a way to measure the coverage of my end-to-end tests. I have some existing E2E tests already and I'm adding more test scenarios to it. But I would like to have a way to quantify the ...
user avatar
  • 131
0 votes
1 answer
70 views

How many test cases can I run if I'm using domain testing?

I'd like to understand what is domain testing, and how do we use it to calculate coverage (if possible)? My question is imagine I have 3 loops in series and I'm using domain testing approach how many ...
user avatar
2 votes
1 answer
133 views

Working just on branch or line coverage could prevent us from finding which defect?

Achieving branch coverage is possible but it doesn't mean complete testing. What kind of defect you can find with this technique? what kind of risk you could have with this technique? what possible ...
user avatar
-2 votes
5 answers
181 views

Can test case break after changes in lines of code that are not hit by the test case?

If I have a test case that passes on one version of the code and a change is made to some lines in the code that are not hit by this test case, is there a possibility that the test case fails after ...
user avatar
1 vote
1 answer
145 views

Code coverage in react webapp

I'm a little bit stuck with a task that I have been researching. It's about code coverage in a react webapp. I implemented a few unit tests using jest + enzyme. also some functional test, using ...
user avatar
1 vote
1 answer
1k views

Equivalent of code coverage for selenium test

I'm currently writing test using cucumber + selenium. I will also write tests for web services (using SoapUI) and my chief would like to have a quick and clear view of what fonctionnality/feature is ...
user avatar
5 votes
6 answers
1k views

How can 100% test coverage be "not enough to prove working code"?

It is known that 100% test/code coverage does not mean your code "works" as expected. What is generally meant by this statement and what use cases could demonstrate that 100% coverage is not enough?
user avatar
  • 11.4k
1 vote
0 answers
50 views

Code Coverage using Scala Automation Testing for JS web application

I'm looking if there's an existing application or tool that will run code coverage based on a scala implemented automation suite running against a Javascript web application. Our automation framework ...
user avatar
  • 11
2 votes
1 answer
2k views

How to get Code coverage via external rest assured API automation using jacoco?

I have a multi module application "Project A". This application is hosted in clustered app nodes using tomcat as web server. We are using Spring, Web Services as primary among many other technologies ...
user avatar
6 votes
4 answers
1k views

How would we know when we are over-testing?

I've recently heard the idea of over-testing for the first time while listening to the interview of the coverage.py maintainer on the Talk Python to Me podcast show. coverage.py has a new feature to ...
user avatar
  • 11.4k
2 votes
1 answer
2k views

ASTQB question: Statement Coverage and Decision Coverage with loop

I am learning ISTQB and encountering a question about Statement and Decision coverage in a sample exam of ASTQB org. Evaluate the following control flow diagram and determine the statement ...
user avatar
2 votes
1 answer
2k views

ISTQB question: Statement and Decision coverage

READ A READ B READ C IF C>A THEN IF C>B THEN PRINT "C must be smaller bla bla.." ELSE PRINT "Proceed to next stage" ENDIF ELSE PRINT "B CAN BE SMALLER THEN C" ENDIF Could someone explain to me ...
user avatar
4 votes
3 answers
123 views

Determine most depended-on code

Another title might be: determine strongest candidates for 100% test coverage. I'm looking for a tool that will display the methods/functions that are most depended on by my code base. To be clear, I'...
user avatar
  • 141
6 votes
4 answers
482 views

Can code coverage be used for Java tests that work against a Python code base?

Development stack is in Python (flask) and our automation suite(API) is coded in Java. Can we do code coverage and if Yes, which plugin to use?
user avatar
-3 votes
1 answer
4k views

How many test cases required to achieve 100 % statement coverage

1. if A > B 2. if A > C 3. Add A to X 4. End if 5. End if According to my understanding 2 test cases are required to achieve 100 % of the statement above. My reasons are: One statement ...
user avatar
1 vote
0 answers
531 views

Cobertura analysis reporting "[ERROR] SLF4J: Class path contains multiple SLF4J bindings."

Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact: [ERROR] SLF4J: Class path contains ...
user avatar
  • 269
3 votes
1 answer
2k views

How to merge different karma coverage html reports into single html file?

I am new to TDD. we have already executed the test cases through karma-coverage.. If the test case count increases, the code coverage took more time to complete the job. so i had switched into ...
user avatar
6 votes
1 answer
1k views

Why Phantomjs got crashed while running more test cases?

I have written 751 test cases in Jasmine JavaScript. 116 test cases for Mobile View and 645 test cases on Desktop view. While executing test cases, most of the times, test case execution was not ...
user avatar
2 votes
2 answers
58 views

Is running tests with coverage functionally the same as running without?

This is a follow-up to Is it a good practice to run functional tests with coverage? which made me confused a little bit. I was under the impression that typically a test run with enabled coverage ...
user avatar
  • 11.4k
6 votes
2 answers
295 views

Is it a good practice to run functional tests with coverage?

Does it make sense to run once in a while, say, on a weekly basis, integration/functional tests against special build to have a coverage report. If anyone here has some practical experience of using ...
user avatar
  • 351
1 vote
2 answers
6k views

ISTQB Foundation Level Paper 3, no. 37

How many test cases are necessary to cover all the possible sequences of statements (paths) for the following program fragment? if (condition 1) then statement 1 else statement 2 fi if ...
user avatar
1 vote
1 answer
41 views

How to document the paths of my windows service in an easy to read diagram?

I have a windows service that issues thousands of android ADB commands to devices, I plan to go through the source for it and document all possible scenarios/paths, there are a lot of if x do y ...
user avatar
  • 924
4 votes
2 answers
3k views

How should a Black-box Tester measure Test Coverage?

I work in Product based company as a QA/Test Engineer. For ex:I have been assigned a new project/enhancement that would be delivered to the clients in the next production release. The Business Analyst ...
user avatar
0 votes
1 answer
1k views

How should I go ahead and increase code coverage from functional tests report?

Currently, in our code base, we have unit tests written for each class and its classes coverage is close to 89%. Now, my task is to increase code coverage wrt functional tests which is about 56%. ...
user avatar
  • 101
8 votes
2 answers
12k views

Why do code coverage of integration test?

in my project I started code coverage for unit and integration test with gradle + jacoco. It's already working and generating reports. I saw a lot of questions and tutorials about how to do code ...
user avatar
3 votes
4 answers
122 views

Testing approaches with temporal delays

I am working with a system that has fairly complicated business logic. It has reasonably good unit, and integration tests. We recently ran into a bug which we had missed. This bug only became ...
user avatar
2 votes
1 answer
121 views

Comparing test coverage metrics to identify an increase/decrease after implementing automation

I would like to compare the levels of test coverage for projects before and after implementing an automation framework. I would like to know if there has been an increase or decrease in test coverage. ...
user avatar
2 votes
1 answer
787 views

Examples for LOC figures, of test suites, and software projects?

To learn what kind of "software" project my automated testing team faces (I consider test automation a certain kind of software project), I assessed the size of our automated (functional, GUI-focussed)...
user avatar
1 vote
1 answer
42 views

Identifying test coverage for item without detailed specification

I am working in a HW area. Recently I have been given a device to test (just hardware validation) but there is no detailed specification, just a block diagram where each block performs certain ...
user avatar
  • 223
7 votes
2 answers
624 views

C++ coverage tool for QA personnel

Background: Our QA organization is considering using NCover Collector to gather code coverage information for manual and automated GUI tests (this is a desktop application). NCover will only work on ...
user avatar
2 votes
2 answers
202 views

What non-structural coverage criteria are there?

There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications. ...
user avatar
2 votes
1 answer
784 views

Test coverage tool that shows call graph of untested new code from a merge

I'm looking for a test coverage tool that can show the call path/call graph of new untested code that came from a merge. Example: I have a git repo (on github or bitbucket) and a test suite that ...
user avatar
6 votes
3 answers
1k views

Measuring feature coverage with BDDs

I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement. My question is: do ...
user avatar
  • 191
0 votes
1 answer
319 views

Which tool can I use (as a tester) to track the code coverage for a web based application?

I am a QA Intern and we use Selenium Webdriver to test our web based application. We are provided with a server on which the build to be tested is deployed. I wish to know is there a tool that I can ...
user avatar
4 votes
4 answers
875 views

How to interpret / analyse code coverage results and provide suggestions for improvements?

Knowledge level I am looking for a how-to for a beginner, not so much for a expert or consultant answer like "it depends". Feel free to add the "it depends" parts nevertheless. Question How would ...
user avatar
  • 191
10 votes
3 answers
9k views

Measuring code coverage in end-to-end tests?

I've been hearing about ideas for measuring code coverage in end-to-end tests (e.g., Selenium tests) and I really don't see a reason for that, even if this is technically feasible. There's a concept ...
user avatar
  • 10.4k
6 votes
4 answers
4k views

What to call a matrix with all possible combinations?

For example: The application show a list of results. Now we have a new feature: The list can be filtered. The user can use a search input field and a date range to filter the results. To cover all ...
user avatar
  • 1,624
4 votes
2 answers
13k views

What are basic metrics of coverage with functional UI automation testing

There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
user avatar
2 votes
1 answer
1k views

Combining coverage from unit tests and functional tests/Selenium

Has anyone had experience getting a combined code coverage measure across both unit tests and functional/UI automation tests? I'm in a Java stack with Cobertura, Jenkins and Ant. I can successfully ...
user avatar
0 votes
2 answers
88 views

How to take the coverage report for Embedded Application Testing

I do system testing of various embedded software(Embedded C) which runs on a microcontroller. How to take a code coverage report in this case as we run the software on the micro and not on a pc? At ...
user avatar
  • 1