Software Metrics are a measure of some property of a piece of software or its specifications.

learn more… | top users | synonyms

15
votes
5answers
4k views

What measures do you use to assess software quality?

Hopefully this isn't too subjective. I am curious to know what measures to use to assess the quality of a given software release. The measures would need to be applied to multiple different projects ...
14
votes
9answers
3k views

How do you calculate your return on investment on automated tests?

I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
14
votes
3answers
862 views

What are the best practices for error seeding

Where I work we use an offshore company to augment several internal departments. I work in the QA team, and concerns have been aired about the level of confidence we can have in the test work we have ...
11
votes
2answers
290 views

Measuring test performance when there is high variance

I am running single purpose performance tests on a daily basis. Currently, I run each test 3 times and average them out. But I get fluctuations from day to day which make it difficult to detect ...
10
votes
7answers
597 views

Should a salary bonus be based on bugs in released code or other metrics?

I've received a job offer recently with a significant portion of the pay based on yet to be determined "objective" performance metrics. We are supposed to sit down together after I've worked there ...
8
votes
5answers
4k views

What bug statistics are most useful? Why?

One of the managers at my company recently suggested that we should add a field in jira to track the number of times a bug gets reopened. I thought that it wasn't a very useful thing to keep track of ...
7
votes
4answers
2k views

How to QA the QA candidates… what should I look for in a QA person

I run a software development company, I am considering hiring a QA person, what are the traits I should look for in a candiate? And what are the traits I should avoid? (extra credit for how you can ...
7
votes
3answers
990 views

What are good metrics for a test team to use to start measuring their workload and ability to meet external deadlines?

The tester team where I work has a demanding customer base (we do business-to-business software, some of it ultimately public-facing, some business-facing), an application that's gone beyond anyone's ...
6
votes
8answers
19k views

What is a good KPI for software QA?

How can you measure the efficiency of the QA team? What KPIs would you set up?
5
votes
4answers
106 views

Is the return on investment of any particular kind of testing measurable?

It is easy to find claims about the benefit of different kinds of testing, particularly when the testing technique requires purchasing a product or spending money on consultants. Has anyone ever ...
5
votes
2answers
329 views

Examples and Best Practices for Seeding Defects?

Defect Seeding seems to be one of the few ways a development organization can tell how thorough an independent testing group is. I'm a fan of using metrics to help counter overconfidence biases, and ...
5
votes
2answers
141 views

References for resources used in test

I am looking for some references for the following statements: "The size of the test code code is/can be greater that the size of the product code" "The amount of resources spent on developing and ...
4
votes
8answers
2k views

What are the deliverables of the QA department?

The company I work for conducts quarterly performance reviews. As a member of our small QA team I've been ask to help define this process. A lot of what I do is identifying issues and collaborating ...
4
votes
1answer
616 views

Web Application Quality Metrics

Is there a defined list of web application quality metrics? I'm looking for a list of metrics like performance, reliability, usability, ... with a reliable source (w3c, ...). I want to describe how ...
4
votes
4answers
662 views

What kind of metrics can be used as an indicative of how well a piece of software meets its functional requirements?

For non-functional requirements as performance, one can find simple metrics to measure the software quality. If you want to know, for example, if your system's performance got better or worse after ...
4
votes
2answers
14k views

Calculate peak concurrent users on a website

I am looking at setting up some website load testing scripts and need some help in finding a formula to estimate how many concurrent users are browsing a website at peak times, based on common metrics ...
3
votes
1answer
157 views

How do I assess the testing process of a project?

I need to asses the efficiency/productivity of a project's testing process, which also uses SCRUM. How do I go about? Are there some peer-reviewed or well-known standard approachs to evaluate the ...
3
votes
6answers
719 views

Are metrics something important?

When I worked for a CMMI level 5 company, they used a predictive approach for almost all and for that same reason metrics were very important, they were the inputs for next projects. But now, I think ...
3
votes
3answers
941 views

Classification of typical software bugs

Does anyone have a good source that classifies typical bugs found, hopefully with examples? For instance, one could classify bugs as: User Interface Errors Error Handling bugs Boundary related ...
3
votes
4answers
81 views

How can I evaluate a 3rd party testing service?

The startup I work for is looking into outsourcing our manual testing to an unaffiliated testing lab called Applause (formerly uTest). Right now the Operations team is doing all the manual labor, and ...
2
votes
3answers
229 views

Is it common to track defects found during code reviews?

In "Applied Software Measurement" and "Code Complete" the authors state concrete numbers for removal efficiency of defects found during code reviews (formal, informal etc). Is it common to track ...
2
votes
1answer
601 views

Use of Standard Deviation and Percentiles in performance testing

The following report is generated by Gatling (my favorite performance test tool). I am wondering how to make use of the standard deviation and percentile data that it produces. I am planning to use ...
1
vote
2answers
64 views

What non-structural coverage criteria are there?

There are huge amounts of structural coverage criteria (see e.g. ISTQB-Standard or ISO26262-Standard), ranging from control-flow to data-flow coverage, applied to source code or to specifications. ...
1
vote
0answers
77 views

Attack surface metrics analyzer tool

I am trying to find a tool to measure vulnerability into my application ( each entry point and exit point into my application ) and then apply it to Manadhata's metrics I found Microsoft surface ...
1
vote
2answers
168 views

Java Unit Testing Completeness Indicator Tool?

I am talking about the real 'Test Completeness', not the traditional 'Code Coverage'´╝îbecause Code Coverage is not very helpful when people start asking for more accurate estimations. And by 'Test ...
0
votes
2answers
77 views

Technical debt report

I've been asked to create a report about the technical debt of an application, but I haven't receive farther guidelines about its elaboration. I'll be assisted by Sonar code analysis tool. My main ...
0
votes
2answers
128 views

Best practices for managing code duplication?

Code analyzers like Sonar provide a metric called "Code duplication". This metric is useful, since it shows when code needs to be factorized. Knowing that, what are the best pratices regarding this ...
0
votes
2answers
1k views

What are basic metrics of coverage with functional UI automation testing

There is web application product which is tested by test automation (selenium webdriver based test project in scope of the whole project) Client is asking what is the test coverage by automation of ...
0
votes
1answer
172 views

Functional requirements and release criteria [closed]

What are the pros and cons of putting functional requirements into release/exit/ship criteria?
0
votes
1answer
37 views

Monitoring and Notifications on individual and custom integration test metrics

I'm looking for advice on what tools/frameworks are available for monitoring our integration tests in terms of: Monitoring individual test metrics (mostly time spent but also other metrics found in ...
0
votes
1answer
25 views

IV&V relevant Quality metrics

We are in the IV&V phase of a web application, which is being developed and tested by a completely separate team. So, the client for which we are working has two vendors one which is developing ...
0
votes
0answers
13 views

Response for a class (RFC) metric tools for PHP

Is there any tools to calculate Response for a class (RFC) metric for PHP? Both PhpMetrics and PHP Depend don't support it. Thanks.
0
votes
1answer
24 views

Quantifying change size in a deploy

In this presentation, slide 79 plots TTR and Lines of code changed http://www.slideshare.net/fullscreen/jallspaw/ops-metametrics-the-currency-you-pay-for-change/79 From what I've read, lines of code ...
0
votes
0answers
33 views

Measuring feature coverage with BDDs

I'm looking for approaches to measuring feature coverage (however you want to define that), and how BDDs can help (or be a neutral, or even negative factor) in such measurement. My question is: do ...
0
votes
1answer
36 views

Comparison metrics for a static analysis tool

I analyzing a static analysis tool. I have performed test on some samples apps and some real life apps. I have to write comparison metrics for both sets of apps. But I'm not clear about what are the ...
-5
votes
1answer
626 views

What are the best practices in quality assurance process measurement? [closed]

How do you measure quality assurance and quality of products in your teams? What metrics do you use? What tools do you use?