Questions tagged [metrics]

Software Metrics are a measure of some property of a piece of software or its specifications.

Filter by
Sorted by
Tagged with
0 votes
5 answers
741 views

Do you categorize the root cause of bugs?

In order to have better view of the quality of defects, instead of measure using numbers of defects (which can be manipulated), can I measure the % of root cause. Example codes problems, missing use ...
user2201789's user avatar
0 votes
1 answer
31 views

What is best in class defect found distribution? [closed]

Can people share a general target they have for % bugs found internally based on this equation: <# defects found internally> / <# internal defects + # customer found defects> I realize ...
Bruce Hartman's user avatar
0 votes
2 answers
675 views

Defect Removal Efficiency confusion

I have read several articles by Capers Jones, who states that: Defect Detection Efficiency (DDE): percentage of defects found after release Defect Removal Efficiency (DRE): percentage of fixed ...
Alarias's user avatar
-1 votes
1 answer
22 views

Metric for reliability of a software system

According to Wikipedia it should be : But I am not sure what should the values be for t and e or how it can be calculated with values substituted. Any help navigating this would be appreciated.
lbrahim's user avatar
  • 99
2 votes
3 answers
907 views

Measuring integration test efficiency

We would like to shift quality left and motivate developers to write integration tests - both narrow and broad. The biggest challenge is to introduce metrics we could use for measuring the ...
HamoriZ's user avatar
  • 129
5 votes
1 answer
267 views

Types of metrics used in QA management

I've been software testing in and out of leadership roles for about 13 years now but the only really reporting or metrics I've done are basic bug reports, which, to be honest don't really show much. I'...
rocksteady84's user avatar
0 votes
1 answer
151 views

Is it possible to automatically aggregate / collect test results from different projects using Serenity BDD?

I use Serenity BDD in multiple maven projects. I would like to collect basic information (number of passed and failed cases, time of execution) from all project into one place - one HTML, CSV file, ...
matandked's user avatar
  • 153
2 votes
1 answer
147 views

How to calculate/ visualize a defect escape metric in Github?

Inside of our team we decided to start calculating/ visualising defect escape metrics (how many bugs are found before prod vs how many bugs are found in prod). We use Github to track our issues. Are ...
Anna's user avatar
  • 21
0 votes
2 answers
66 views

Software metrics before development

I'm working on a task to create a quality metrics for our development process. I have come across Test metrices and other size, complexity related metrices. But, I need to know if there's any metrics ...
user11702680's user avatar
2 votes
2 answers
84 views

Metrics that should be included in a software quality report

I am trying to "develop a formula" which will give me a number which will serve as an indicator of whether the overall quality of all tested items on a certain sprint is good enough so that ...
Marcio125's user avatar
1 vote
0 answers
232 views

How to correctly understand measureed JMeter PerfMon plugin CPU percentage metric?

I have question about JMeter PerfMon plugin which is measuring percentage use of CPU which my Dropwizard app is consuming. Important things to mention: Operating system is Linux Fedora 31 64-bit OS. ...
NikolaS's user avatar
  • 143
0 votes
1 answer
521 views

How can we apply the defect arrival rate to mesure the project evolution?

I wonder how can we apply the defect arrival rate to discover the progress in our testing projects from developers and testers side ? Is there a risk by applying such approach ?
Emna Ayadi's user avatar
2 votes
5 answers
527 views

Should testers estimate effort only for themselves

When estimating effort for a user story, is tester supposed to estimate only the testing effort or the whole team effort? If the story is technically challenging but relatively easy to test should I ...
Mate Mrše's user avatar
  • 4,119
30 votes
12 answers
9k views

Why are Fibonacci numbers used for estimating effort?

What is the reason for using Fibonacci numbers to estimate effort for Agile projects? I know this is not strictly testing related, but testers are still part of the planning and understanding of this ...
Mate Mrše's user avatar
  • 4,119
1 vote
3 answers
213 views

What are the proper metrics and methodologies for measuring how well a QA department is doing?

I'm trying propose meaningful changes to measure how well the QA department in our company is doing. I've gone through similar Stackexchange pages that go over measuring a teams/individual's ...
user6123723's user avatar
3 votes
2 answers
107 views

What is the correct unit of SpeedIndex?

According to this https://sites.google.com/a/webpagetest.org/docs/using-webpagetest/metrics/speed-index "The Speed Index is the average time at which visible parts of the page are displayed. It is ...
SlightlyKosumi's user avatar
5 votes
6 answers
1k views

Is it valuable to measure bug count per hour of dev time?

Recently a custom metric was presented to our team during a meeting about software quality. The metric was: number of found bugs divided by the sum of dev time (aggregated as team average and also ...
ventiseis's user avatar
  • 161
6 votes
3 answers
271 views

Telemetry for feature health

Not sure how opinion based my question is, but when you have a released (client facing) feature, how are you evaluating with telemetry if it's healthy? By healthy I mean users can interact with it (it'...
Dániel Nagy's user avatar
1 vote
1 answer
6k views

How to calculate defect leakage ratio

I have few doubts in the Defect leakage ratio calculation formula. I found one of the formula to calculate as below: CD=No. of Defects raise by customer after release DR=No. of Defects raised by ...
Sarada Akurathi's user avatar
1 vote
1 answer
314 views

How increasing appraisal costs decrease failure costs?

It is said that increase in the appraisal costs (i.e. costs spent for finding non-corfomances - testing, reviews) decreases the failure costs (that comprise of internal (fixing of bugs we found + ...
John V's user avatar
  • 627
3 votes
1 answer
126 views

Rework time to fix defects, Duration of the review process being product metrics?

So I am preparing for the ISTQB Advanced level exam, using a book from Rex Black. However, he mentiones (among others) that those are product metrics: Rework time to fix defects Duration of the ...
John V's user avatar
  • 627
9 votes
8 answers
488 views

How to establish better tracking of escaped bugs?

At my company, we don't have good tracking for escaped bugs (or awareness of in QA a lot of the time) once releases go to prod. When the users find bugs they have a tendency to go straight to the ...
LauraW's user avatar
  • 91
3 votes
2 answers
143 views

Showing system test coverage for customers/stakeholders in agile

I work for a software consultancy as a test analyst and was looking for some advice on testing in agile. Since my company moved agile, I think that testing has turned into mini iterations of ...
coltest123's user avatar
4 votes
2 answers
1k views

How machine learning can help in predicting defect prone modules in applications before testing?

I have looked and read in the internet that using static code analysis data, we can predict what modules in the application are defect prone. When I try to imagine of dataset,it is getting difficult ...
Jeshwanth P's user avatar
1 vote
2 answers
489 views

metrics in exploratory testing

I want to track and measure session based exploratory testing effectively. What are the main metrics used in session based exploratory testing to measure efforts, charters, bugs, opportunities and ...
meticulous_guy's user avatar
2 votes
0 answers
75 views

Dropwizard metric to send Gauge : Error: Override is not allowed when implementing an interface method

I'm trying the Dropwizard metrics as specified in their website. Below is the code: public class QueueManager { private final Queue queue; public QueueManager(MetricRegistry metrics, String ...
Dinesh's user avatar
  • 291
1 vote
1 answer
44 views

Tools to display test servers online/offline, db instance etc?

Is there anything in the market at present, where you can add a list of servers (Windows/IIS) perhaps with a database instance linked to them (SQL server), that can display a dashboard with which ...
symon's user avatar
  • 934
4 votes
2 answers
4k views

How should a Black-box Tester measure Test Coverage?

I work in Product based company as a QA/Test Engineer. For ex:I have been assigned a new project/enhancement that would be delivered to the clients in the next production release. The Business Analyst ...
user avatar
4 votes
3 answers
92 views

Whats the meaning of this 'Testing efficiency' number?

Looking for a way to measure the efficiency of software testing I came upon the following formula Testing Efficiency = (No. of defects Resolved / Total No. of Defects Submitted)* 100 from e.g. here. ...
Alex's user avatar
  • 461
1 vote
2 answers
904 views

Defect distribution equation explanation

I cannot figure out the logic behind the following formula: Defect distribution= (Total number of defects / Functional Area) * Phase * Status How can I multiply by phase and status? How would the ...
John V's user avatar
  • 627
2 votes
3 answers
2k views

What are the best metrics for evaluating a software QA team's performance? [duplicate]

What are the best metrics for evaluating a software QA team's performance? I am looking for metrics similar to the ones below: 1. Test Efficiency Test Efficiency = ((A-C) / (A+B))*100 A = ...
RecepC's user avatar
  • 61
2 votes
1 answer
126 views

Comparing test coverage metrics to identify an increase/decrease after implementing automation

I would like to compare the levels of test coverage for projects before and after implementing an automation framework. I would like to know if there has been an increase or decrease in test coverage. ...
Pilauricer's user avatar
3 votes
5 answers
356 views

Means of Quantification of QA impact

I am currently looking into methods to quantify the effect of QA on a team, be this in terms of overall productivity improvement or net effectiveness. In doing so I am evaluating various methods by ...
ECiurleo's user avatar
  • 2,043
5 votes
5 answers
24k views

How Agile/Scrum Teams estimate Testing Effort?

In Agile Testing, what are some of the most common estimation techniques with context to the QA process. What are story points?
user9983's user avatar
2 votes
1 answer
810 views

Examples for LOC figures, of test suites, and software projects?

To learn what kind of "software" project my automated testing team faces (I consider test automation a certain kind of software project), I assessed the size of our automated (functional, GUI-focussed)...
TheBlastOne's user avatar
1 vote
1 answer
178 views

IV&V relevant Quality metrics

We are in the IV&V phase of a web application, which is being developed and tested by a completely separate team. So, the client for which we are working has two vendors one which is developing ...
Dhiman's user avatar
  • 4,580
2 votes
2 answers
207 views

What non-structural coverage criteria are there?

There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications. ...
DaveBall aka user750378's user avatar
3 votes
0 answers
137 views

Response for a class (RFC) metric tools for PHP [closed]

Is there any tools to calculate Response for a class (RFC) metric for PHP? Both PhpMetrics and PHP Depend don't support it. RFC is related to Software Quality [3].
Irfandi D. Vendy's user avatar
5 votes
4 answers
191 views

How can I evaluate a 3rd party testing service?

The startup I work for is looking into outsourcing our manual testing to an unaffiliated testing lab called Applause (formerly uTest). Right now the Operations team is doing all the manual labor, and ...
hash_collision's user avatar
1 vote
1 answer
35 views

Quantifying change size in a deploy

In this presentation, slide 79 plots TTR and Lines of code changed http://www.slideshare.net/fullscreen/jallspaw/ops-metametrics-the-currency-you-pay-for-change/79 From what I've read, lines of code ...
user2827377's user avatar
6 votes
3 answers
1k views

Measuring feature coverage with BDDs

I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement. My question is: do ...
Marcin's user avatar
  • 191
1 vote
2 answers
156 views

Comparison metrics for a static analysis tool

I analyzing a static analysis tool. I have performed test on some samples apps and some real life apps. I have to write comparison metrics for both sets of apps. But I'm not clear about what are the ...
blackfyre's user avatar
  • 113
2 votes
2 answers
6k views

Use of Standard Deviation and Percentiles in performance testing

The following report is generated by Gatling (my favorite performance test tool). I am wondering how to make use of the standard deviation and percentile data that it produces. I am planning to use ...
Aravind R. Yarram's user avatar
4 votes
2 answers
13k views

What are basic metrics of coverage with functional UI automation testing

There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
user1829657's user avatar
2 votes
1 answer
97 views

Monitoring and Notifications on individual and custom integration test metrics

I'm looking for advice on what tools/frameworks are available for monitoring our integration tests in terms of: Monitoring individual test metrics (mostly time spent but also other metrics found in ...
soren.enemaerke's user avatar
4 votes
1 answer
361 views

How do I assess the testing process of a project?

I need to asses the efficiency/productivity of a project's testing process, which also uses SCRUM. How do I go about? Are there some peer-reviewed or well-known standard approachs to evaluate the ...
user7253's user avatar
4 votes
8 answers
7k views

What are the deliverables of the QA department?

The company I work for conducts quarterly performance reviews. As a member of our small QA team I've been ask to help define this process. A lot of what I do is identifying issues and collaborating ...
David Walz's user avatar
2 votes
3 answers
413 views

Technical debt report

I've been asked to create a report about the technical debt of an application, but I haven't receive further guidelines about its elaboration. I'll be assisted by Sonar code analysis tool. My main ...
Eduardo's user avatar
  • 93
1 vote
2 answers
557 views

Best practices for managing code duplication?

Code analyzers like Sonar provide a metric called "Code duplication". This metric is useful, since it shows when code needs to be factorized. Knowing that, what are the best pratices regarding this ...
merours's user avatar
  • 111
1 vote
2 answers
242 views

Java Unit Testing Completeness Indicator Tool?

I am talking about the real 'Test Completeness', not the traditional 'Code Coverage',because Code Coverage is not very helpful when people start asking for more accurate estimations. And by 'Test ...
Victor's user avatar
  • 111