Questions tagged [coverage]

Coverage measures the amount of testing done of a certain type. It is always in relation to some kind of measure, for example: statement coverage, branch coverage, etc. (Not restricted to code coverage).

Filter by
Sorted by
Tagged with
1
vote
4answers
83 views

How to calculate condition coverage?

I am trying to prepare to test and I see the next exercise in internet: How many test cases are needed to achieve 100 % condition coverage? if ((temperature < 0) or (temperature > 100)) { ...
0
votes
1answer
57 views

Code coverage tool for Python Web application tested by Java selenium tests

I have Web Application where the source code is in Python. All the regression tests are in Java. I wish to perform Code Coverage for the application. Please suggest a code coverage tool to instrument ...
0
votes
4answers
214 views

How can I measure the coverage of my E2E tests?

I'm looking for a way to measure the coverage of my end-to-end tests. I have some existing E2E tests already and I'm adding more test scenarios to it. But I would like to have a way to quantify the ...
2
votes
1answer
2k views

How to get Code coverage via external rest assured API automation using jacoco?

I have a multi module application "Project A". This application is hosted in clustered app nodes using tomcat as web server. We are using Spring, Web Services as primary among many other technologies ...
0
votes
1answer
39 views

How many test cases can I run if I'm using domain testing?

I'd like to understand what is domain testing, and how do we use it to calculate coverage (if possible)? My question is imagine I have 3 loops in series and I'm using domain testing approach how many ...
2
votes
1answer
121 views

Working just on branch or line coverage could prevent us from finding which defect?

Achieving branch coverage is possible but it doesn't mean complete testing. What kind of defect you can find with this technique? what kind of risk you could have with this technique? what possible ...
6
votes
4answers
417 views

Can code coverage be used for Java tests that work against a Python code base?

Development stack is in Python (flask) and our automation suite(API) is coded in Java. Can we do code coverage and if Yes, which plugin to use?
1
vote
1answer
38 views

How to document the paths of my windows service in an easy to read diagram?

I have a windows service that issues thousands of android ADB commands to devices, I plan to go through the source for it and document all possible scenarios/paths, there are a lot of if x do y ...
-2
votes
5answers
80 views

Can test case break after changes in lines of code that are not hit by the test case?

If I have a test case that passes on one version of the code and a change is made to some lines in the code that are not hit by this test case, is there a possibility that the test case fails after ...
0
votes
1answer
232 views

Which tool can I use (as a tester) to track the code coverage for a web based application?

I am a QA Intern and we use Selenium Webdriver to test our web based application. We are provided with a server on which the build to be tested is deployed. I wish to know is there a tool that I can ...
4
votes
3answers
120 views

Determine most depended-on code

Another title might be: determine strongest candidates for 100% test coverage. I'm looking for a tool that will display the methods/functions that are most depended on by my code base. To be clear, I'...
7
votes
2answers
8k views

Why do code coverage of integration test?

in my project I started code coverage for unit and integration test with gradle + jacoco. It's already working and generating reports. I saw a lot of questions and tutorials about how to do code ...
10
votes
3answers
2k views

Python coverage and external executables

I have a project that has almost complete unit test coverage. There's only one statement that isn't covered and I can't work out a good way to do so. Say the project is called foo, I have foo/commands....
1
vote
1answer
81 views

Code coverage in react webapp

I'm a little bit stuck with a task that I have been researching. It's about code coverage in a react webapp. I implemented a few unit tests using jest + enzyme. also some functional test, using ...
1
vote
1answer
872 views

Equivalent of code coverage for selenium test

I'm currently writing test using cucumber + selenium. I will also write tests for web services (using SoapUI) and my chief would like to have a quick and clear view of what fonctionnality/feature is ...
5
votes
6answers
837 views

How can 100% test coverage be “not enough to prove working code”?

It is known that 100% test/code coverage does not mean your code "works" as expected. What is generally meant by this statement and what use cases could demonstrate that 100% coverage is not enough?
1
vote
0answers
35 views

Code Coverage using Scala Automation Testing for JS web application

I'm looking if there's an existing application or tool that will run code coverage based on a scala implemented automation suite running against a Javascript web application. Our automation framework ...
6
votes
4answers
536 views

How would we know when we are over-testing?

I've recently heard the idea of over-testing for the first time while listening to the interview of the coverage.py maintainer on the Talk Python to Me podcast show. coverage.py has a new feature to ...
2
votes
1answer
1k views

ASTQB question: Statement Coverage and Decision Coverage with loop

I am learning ISTQB and encountering a question about Statement and Decision coverage in a sample exam of ASTQB org. Evaluate the following control flow diagram and determine the statement ...
2
votes
1answer
1k views

ISTQB question: Statement and Decision coverage

READ A READ B READ C IF C>A THEN IF C>B THEN PRINT "C must be smaller bla bla.." ELSE PRINT "Proceed to next stage" ENDIF ELSE PRINT "B CAN BE SMALLER THEN C" ENDIF Could someone explain to me ...
6
votes
1answer
867 views

Why Phantomjs got crashed while running more test cases?

I have written 751 test cases in Jasmine JavaScript. 116 test cases for Mobile View and 645 test cases on Desktop view. While executing test cases, most of the times, test case execution was not ...
1
vote
2answers
2k views

ISTQB Foundation Level Paper 3, no. 37

How many test cases are necessary to cover all the possible sequences of statements (paths) for the following program fragment? if (condition 1) then statement 1 else statement 2 fi if ...
-3
votes
1answer
2k views

How many test cases required to achieve 100 % statement coverage

1. if A > B 2. if A > C 3. Add A to X 4. End if 5. End if According to my understanding 2 test cases are required to achieve 100 % of the statement above. My reasons are: One statement ...
1
vote
0answers
482 views

Cobertura analysis reporting “[ERROR] SLF4J: Class path contains multiple SLF4J bindings.”

Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact: [ERROR] SLF4J: Class path contains ...
3
votes
1answer
1k views

How to merge different karma coverage html reports into single html file?

I am new to TDD. we have already executed the test cases through karma-coverage.. If the test case count increases, the code coverage took more time to complete the job. so i had switched into ...
5
votes
1answer
14k views

How does Bullseye code coverage tool work?

I'm using Bullseye code coverage tool. It's great. I'm interested in knowing it's internal functioning. How does it actually work?
6
votes
2answers
260 views

Is it a good practice to run functional tests with coverage?

Does it make sense to run once in a while, say, on a weekly basis, integration/functional tests against special build to have a coverage report. If anyone here has some practical experience of using ...
6
votes
3answers
1k views

Measuring feature coverage with BDDs

I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement. My question is: do ...
2
votes
2answers
52 views

Is running tests with coverage functionally the same as running without?

This is a follow-up to Is it a good practice to run functional tests with coverage? which made me confused a little bit. I was under the impression that typically a test run with enabled coverage ...
4
votes
1answer
225 views

Does Emma provide true block coverage?

While trying to find the block coverage from Emma, I came across this curious observation. See the method below public double getBalance() { return this.balance; } The coverage summary from ...
4
votes
2answers
2k views

How should a Black-box Tester measure Test Coverage?

I work in Product based company as a QA/Test Engineer. For ex:I have been assigned a new project/enhancement that would be delivered to the clients in the next production release. The Business Analyst ...
0
votes
1answer
1k views

How should I go ahead and increase code coverage from functional tests report?

Currently, in our code base, we have unit tests written for each class and its classes coverage is close to 89%. Now, my task is to increase code coverage wrt functional tests which is about 56%. ...
3
votes
4answers
119 views

Testing approaches with temporal delays

I am working with a system that has fairly complicated business logic. It has reasonably good unit, and integration tests. We recently ran into a bug which we had missed. This bug only became ...
7
votes
2answers
576 views

C++ coverage tool for QA personnel

Background: Our QA organization is considering using NCover Collector to gather code coverage information for manual and automated GUI tests (this is a desktop application). NCover will only work on ...
2
votes
1answer
112 views

Comparing test coverage metrics to identify an increase/decrease after implementing automation

I would like to compare the levels of test coverage for projects before and after implementing an automation framework. I would like to know if there has been an increase or decrease in test coverage. ...
5
votes
6answers
3k views

Recommendations for code coverage tools?

I have a wishlist for code coverage tools and am wondering if people could recommend some tools that fulfill all or many of my wishes. I am starting my search for tools that work specifically with ....
2
votes
4answers
719 views

Is unit and component testing sufficient?

If you can test every line of [your product's] code via unit tests, wouldn't unit testing alone (theoretically) be sufficient? Are there other "necessary" benchmarks of proper test coverage other ...
2
votes
1answer
703 views

Examples for LOC figures, of test suites, and software projects?

To learn what kind of "software" project my automated testing team faces (I consider test automation a certain kind of software project), I assessed the size of our automated (functional, GUI-focussed)...
1
vote
1answer
35 views

Identifying test coverage for item without detailed specification

I am working in a HW area. Recently I have been given a device to test (just hardware validation) but there is no detailed specification, just a block diagram where each block performs certain ...
2
votes
1answer
692 views

Test coverage tool that shows call graph of untested new code from a merge

I'm looking for a test coverage tool that can show the call path/call graph of new untested code that came from a merge. Example: I have a git repo (on github or bitbucket) and a test suite that ...
2
votes
2answers
173 views

What non-structural coverage criteria are there?

There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications. ...
4
votes
4answers
766 views

How to interpret / analyse code coverage results and provide suggestions for improvements?

Knowledge level I am looking for a how-to for a beginner, not so much for a expert or consultant answer like "it depends". Feel free to add the "it depends" parts nevertheless. Question How would ...
12
votes
4answers
1k views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
0
votes
2answers
82 views

How to take the coverage report for Embedded Application Testing

I do system testing of various embedded software(Embedded C) which runs on a microcontroller. How to take a code coverage report in this case as we run the software on the micro and not on a pc? At ...
8
votes
3answers
7k views

Measuring code coverage in end-to-end tests?

I've been hearing about ideas for measuring code coverage in end-to-end tests (e.g., Selenium tests) and I really don't see a reason for that, even if this is technically feasible. There's a concept ...
3
votes
2answers
12k views

What are basic metrics of coverage with functional UI automation testing

There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
2
votes
1answer
1k views

Combining coverage from unit tests and functional tests/Selenium

Has anyone had experience getting a combined code coverage measure across both unit tests and functional/UI automation tests? I'm in a Java stack with Cobertura, Jenkins and Ant. I can successfully ...
4
votes
2answers
4k views

Code Coverage for Web Applications?

Does anyone have any experience using code coverage tools for web applications? I primarily work with Webdriver and JUnit, but I am not sure if we are covering all the possible cases. This may ...
6
votes
2answers
518 views

Tool to minimize tests number and maximize code coverage

I am currently undergoing black-box testing campaigns for applications that require file input in linux environments. For that I need sets of test files of different formats that can be used to be ...
8
votes
5answers
2k views

QA Methodology: Do you retest every change on a new build or only changed code?

I am leading a new QA team at my company and we are small (Myself and one other person). We are currently testing releases compiled by over 10 developers, so the ratio of developers to QA is skewed. ...