Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [coverage]

Coverage measures the amount of testing done of a certain type. It is always in relation to some kind of measure, for example: statement coverage, branch coverage, etc. (Not restricted to code coverage).

0
votes
0answers
9 views

Jacoco agent is not getting updated properly

We have used 0.7.9 version of jacoco-agent.jar in our app server to capture the code coverage through API testing. Earlier it used to capture at least something. Now its not getting updated. Please ...
0
votes
1answer
57 views

How to get Code coverage via external rest assured API automation using jacoco?

I have a multi module application "Project A". This application is hosted in clustered app nodes using tomcat as web server. We are using Spring, Web Services as primary among many other technologies ...
6
votes
4answers
247 views

How would we know when we are over-testing?

I've recently heard the idea of over-testing for the first time while listening to the interview of the coverage.py maintainer on the Talk Python to Me podcast show. coverage.py has a new feature to ...
2
votes
1answer
242 views

ASTQB question: Statement Coverage and Decision Coverage with loop

I am learning ISTQB and encountering a question about Statement and Decision coverage in a sample exam of ASTQB org. Evaluate the following control flow diagram and determine the statement ...
2
votes
1answer
236 views

ISTQB question: Statement and Decision coverage

READ A READ B READ C IF C>A THEN IF C>B THEN PRINT "C must be smaller bla bla.." ELSE PRINT "Proceed to next stage" ENDIF ELSE PRINT "B CAN BE SMALLER THEN C" ENDIF Could someone explain to me ...
3
votes
1answer
79 views

Determine most depended-on code

Another title might be: determine strongest candidates for 100% test coverage. I'm looking for a tool that will display the methods/functions that are most depended on by my code base. To be clear, I'...
3
votes
3answers
208 views

Can code coverage be used for Java tests that work against a Python code base?

Development stack is in Python (flask) and our automation suite(API) is coded in Java. Can we do code coverage and if Yes, which plugin to use?
-4
votes
1answer
728 views

How many test cases required to achieve 100 % statement coverage

1. if A > B 2. if A > C 3. Add A to X 4. End if 5. End if According to my understanding 2 test cases are required to achieve 100 % of the statement above. My reasons are: One statement ...
1
vote
0answers
282 views

Cobertura analysis reporting “[ERROR] SLF4J: Class path contains multiple SLF4J bindings.”

Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact: [ERROR] SLF4J: Class path contains ...
0
votes
0answers
339 views

Why I am getting code ELIFECYCLE Error in Test cases?

We have more than 2000 test cases in our source. To generate the code coverage in less time,I have implemented the parallel execution of test cases with npm-concurrently package and chrome headless ...
0
votes
0answers
48 views

Why the following Error generates “spawn call npm run coverage ENOENT” , if i Execute the code coverage?

We have more than 2000 test cases in our source. To generate the code coverage in less time,I have implemented the parallel execution of test cases with npm-concurrently package and chrome headless ...
4
votes
1answer
463 views

How to merge different karma coverage html reports into single html file?

I am new to TDD. we have already executed the test cases through karma-coverage.. If the test case count increases, the code coverage took more time to complete the job. so i had switched into ...
6
votes
1answer
398 views

Why Phantomjs got crashed while running more test cases?

I have written 751 test cases in Jasmine JavaScript. 116 test cases for Mobile View and 645 test cases on Desktop view. While executing test cases, most of the times, test case execution was not ...
2
votes
2answers
41 views

Is running tests with coverage functionally the same as running without?

This is a follow-up to Is it a good practice to run functional tests with coverage? which made me confused a little bit. I was under the impression that typically a test run with enabled coverage ...
6
votes
2answers
154 views

Is it a good practice to run functional tests with coverage?

Does it make sense to run once in a while, say, on a weekly basis, integration/functional tests against special build to have a coverage report. If anyone here has some practical experience of using ...
1
vote
2answers
786 views

ISTQB Foundation Level Paper 3, no. 37

How many test cases are necessary to cover all the possible sequences of statements (paths) for the following program fragment? if (condition 1) then statement 1 else statement 2 fi if ...
1
vote
0answers
30 views

How to document the paths of my windows service in an easy to read diagram?

I have a windows service that issues thousands of android ADB commands to devices, I plan to go through the source for it and document all possible scenarios/paths, there are a lot of if x do y ...
4
votes
2answers
1k views

How should a Black-box Tester measure Test Coverage?

I work in Product based company as a QA/Test Engineer. For ex:I have been assigned a new project/enhancement that would be delivered to the clients in the next production release. The Business Analyst ...
0
votes
1answer
809 views

How should I go ahead and increase code coverage from functional tests report?

Currently, in our code base, we have unit tests written for each class and its classes coverage is close to 89%. Now, my task is to increase code coverage wrt functional tests which is about 56%. ...
5
votes
2answers
4k views

Why do code coverage of integration test?

in my project I started code coverage for unit and integration test with gradle + jacoco. It's already working and generating reports. I saw a lot of questions and tutorials about how to do code ...
4
votes
4answers
115 views

Testing approaches with temporal delays

I am working with a system that has fairly complicated business logic. It has reasonably good unit, and integration tests. We recently ran into a bug which we had missed. This bug only became ...
3
votes
1answer
103 views

Comparing test coverage metrics to identify an increase/decrease after implementing automation

I would like to compare the levels of test coverage for projects before and after implementing an automation framework. I would like to know if there has been an increase or decrease in test coverage. ...
2
votes
1answer
486 views

Examples for LOC figures, of test suites, and software projects?

To learn what kind of "software" project my automated testing team faces (I consider test automation a certain kind of software project), I assessed the size of our automated (functional, GUI-focussed)...
1
vote
1answer
33 views

Identifying test coverage for item without detailed specification

I am working in a HW area. Recently I have been given a device to test (just hardware validation) but there is no detailed specification, just a block diagram where each block performs certain ...
7
votes
2answers
432 views

C++ coverage tool for QA personnel

Background: Our QA organization is considering using NCover Collector to gather code coverage information for manual and automated GUI tests (this is a desktop application). NCover will only work on ...
2
votes
2answers
165 views

What non-structural coverage criteria are there?

There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications. ...
2
votes
1answer
528 views

Test coverage tool that shows call graph of untested new code from a merge

I'm looking for a test coverage tool that can show the call path/call graph of new untested code that came from a merge. Example: I have a git repo (on github or bitbucket) and a test suite that ...
6
votes
3answers
799 views

Measuring feature coverage with BDDs

I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement. My question is: do ...
2
votes
4answers
494 views

How to interpret / analyse code coverage results and provide suggestions for improvements?

Knowledge level I am looking for a how-to for a beginner, not so much for a expert or consultant answer like "it depends". Feel free to add the "it depends" parts nevertheless. Question How would ...
6
votes
3answers
5k views

Measuring code coverage in end-to-end tests?

I've been hearing about ideas for measuring code coverage in end-to-end tests (e.g., Selenium tests) and I really don't see a reason for that, even if this is technically feasible. There's a concept ...
2
votes
2answers
10k views

What are basic metrics of coverage with functional UI automation testing

There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
2
votes
1answer
894 views

Combining coverage from unit tests and functional tests/Selenium

Has anyone had experience getting a combined code coverage measure across both unit tests and functional/UI automation tests? I'm in a Java stack with Cobertura, Jenkins and Ant. I can successfully ...
0
votes
2answers
77 views

How to take the coverage report for Embedded Application Testing

I do system testing of various embedded software(Embedded C) which runs on a microcontroller. How to take a code coverage report in this case as we run the software on the micro and not on a pc? At ...
4
votes
2answers
4k views

Code Coverage for Web Applications?

Does anyone have any experience using code coverage tools for web applications? I primarily work with Webdriver and JUnit, but I am not sure if we are covering all the possible cases. This may ...
6
votes
2answers
451 views

Tool to minimize tests number and maximize code coverage

I am currently undergoing black-box testing campaigns for applications that require file input in linux environments. For that I need sets of test files of different formats that can be used to be ...
4
votes
1answer
204 views

Does Emma provide true block coverage?

While trying to find the block coverage from Emma, I came across this curious observation. See the method below public double getBalance() { return this.balance; } The coverage summary from ...
8
votes
5answers
2k views

QA Methodology: Do you retest every change on a new build or only changed code?

I am leading a new QA team at my company and we are small (Myself and one other person). We are currently testing releases compiled by over 10 developers, so the ratio of developers to QA is skewed. ...
2
votes
4answers
375 views

Is unit and component testing sufficient?

If you can test every line of [your product's] code via unit tests, wouldn't unit testing alone (theoretically) be sufficient? Are there other "necessary" benchmarks of proper test coverage other ...
5
votes
6answers
2k views

Recommendations for code coverage tools?

I have a wishlist for code coverage tools and am wondering if people could recommend some tools that fulfill all or many of my wishes. I am starting my search for tools that work specifically with ....
2
votes
2answers
317 views

Dynamic whitebox testing and coverage metrics for Java systems?

What coverage measures/metrics are useful for unit testing and for integration testing of Java or other object-oriented systems? Context: We would like to establish a better test process. Our ...
5
votes
1answer
11k views

How does Bullseye code coverage tool work?

I'm using Bullseye code coverage tool. It's great. I'm interested in knowing it's internal functioning. How does it actually work?
1
vote
1answer
701 views

Quality Center: How to check if a test is already included in any requirement [closed]

How can I check that a specific Test Case is already included in any of the existing requirements? Currently I see no other way rather than going through all the requirements and trying to locate this ...
3
votes
1answer
1k views

What is a good code coverage tool for Ruby?

I would really like to see which bits of code/functionality I've missed testing in my application, which is a mix of Ruby and JQuery and Java applets. Years ago I used a nice code coverage tool for C ...
3
votes
4answers
1k views

Good resource on how to write dot net unit test cases?

I am looking for good resources on how to write good unit test cases in C#/Dot Net. Books, resources on the net or simply good advises. In particular the unit cases should give good code coverage and ...
8
votes
1answer
1k views

Continuous Integration and testing environment and configuration for Android

I am an Android developer but I am not satisfied with my testing and Continuous Integration environment and configuration. Someone could recommend me how to configure the best setup and workflow for ...
7
votes
4answers
273 views

Should coverage analysis be performed on test code?

I'm of the opinion that it should. Test code is meant to be deterministic. This means that 100% of it should be executed. If it's not 100% (and assuming the analysis tool isn't under-reporting), ...
8
votes
3answers
578 views

How should I test the output of image renderers thoroughly, efficiently and in a branchable way

I am trying to improve the tests for a bunch of renderers that generate 2D images, and I am looking for advice and ideas for testing that are both efficient and thorough but also branch friendly. All ...
5
votes
3answers
394 views

What types of testing are LEAST suited to using pairwise testing (and similar test design approaches)?

For those of you who have used pairwise test design methods (or similar combinatorial software testing methods) in an attempt to zero in on a manageable number of unusually powerful tests from among a ...
12
votes
4answers
1k views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
8
votes
2answers
1k views

Python coverage and external executables

I have a project that has almost complete unit test coverage. There's only one statement that isn't covered and I can't work out a good way to do so. Say the project is called foo, I have foo/commands....