Hot answers tagged

28 votes

Why are Fibonacci numbers used for estimating effort?

Fibonacci series is just one example for estimation efforts. Some teams also use series as below: 1, 2, 5, 8, 20, 40, 100, .... 1, 2, 4, 8, 16, 32, 64, .... The idea is to use an exponential ...
user avatar
  • 1,795
23 votes

Why are Fibonacci numbers used for estimating effort?

They reflect that the degree of uncertainty grows as you look further out and at bigger tasks with more dependencies. For example, today you can be reasonably confident about how much effort is needed ...
user avatar
11 votes
Accepted

Is it valuable to measure bug count per hour of dev time?

No It absolutely is not valuable to measure bug count per hour of dev time. It is especially bad to measure bug count per hour for individual devs. Devs on more complex or difficult code will ...
user avatar
  • 30.8k
7 votes

How to establish better tracking of escaped bugs?

This is process related - nothing you can solve as regular QA tester. Your QA manager need to talk to DEV manager how to improve communication between devs, QA and customers, and how to track relevant ...
user avatar
6 votes

Means of Quantification of QA impact

By the success of the company. Buy-in for QA will need to come from the top rather then the justification being looked for in data. You will, over time, be able to point to things like some major ...
user avatar
6 votes

Measuring integration test efficiency

We thought of some sort of limited coverage measurement - checking if collaboration points like app to database, app to external service are covered by tests. Most code coverage tools allow filtering ...
user avatar
  • 9,949
5 votes
Accepted

Why are Fibonacci numbers used for estimating effort?

Spoiler: No scientific reason. Fibonacci grows very fast, so people will have fewer options before reaching enormous values; thus it incentivizes breaking work down in smaller pieces. If the ...
user avatar
  • 9,949
5 votes

Why are Fibonacci numbers used for estimating effort?

Common estimating methods include numeric sizing as well like 1 to 10 or sizes like XS, S, M, L, XL, XXL, XXXL or Fibonacci sequence 1, 2, 3, 5, 8, 13, 21, 34, etc. The reason for using the Fibonacci ...
user avatar
5 votes

Types of metrics used in QA management

First of all, you need to define better what you want to measure. Imagine a sports team. One could say that "improving" means "winning more games" - and one could say that a ...
user avatar
  • 9,949
4 votes

How Agile/Scrum Teams estimate Testing Effort?

Agile teams are cross-functional teams. They estimate the work from design to delivery often on a story based level. This includes the testing work, since testing should be part of the definition of ...
user avatar
4 votes
Accepted

What are basic metrics of coverage with functional UI automation testing

Coverage is always coverage related to some model. This often gets skipped over, which leads to much confusion "you said you had 100% coverage so how come there's a bug?!" When you're looking at unit ...
user avatar
  • 5,115
4 votes

How should a Black-box Tester measure Test Coverage?

Black box approach in and of itself is specifically designed to come from the user perspective backwards. The difference between black box and white box testing is knowledge of the underlying code ...
user avatar
  • 1,663
4 votes

Whats the meaning of this 'Testing efficiency' number?

Test Efficiency is a measure of the relevance of the bugs being reported. A low efficiency would imply that the test team are reporting many bugs that aren't worth fixing. This is pretty limited, and ...
user avatar
  • 1,284
4 votes

Is it valuable to measure bug count per hour of dev time?

As Kate says NO The common term for kind of metric from those with experience is: A bad metric I'll go even further and say any kind of bug count is likely to be gamed The industry has done thngs like ...
user avatar
4 votes

Why are Fibonacci numbers used for estimating effort?

A notion I don't see in any of these answers is that in a simple 1-10 range, people can get bogged down in whether something is a 3 or is it really a 4? And what if another person thinks that it ...
user avatar
  • 41
3 votes

Whats the meaning of this 'Testing efficiency' number?

Testing efficiency, among other metrics, is a merely a guideline. It does not tell the whole picture, it has to be put into context in order to make some sense. It is more of an indication used by ...
user avatar
  • 9,720
3 votes
Accepted

How can I evaluate a 3rd party testing service?

I would suggest you look at their Device Fragmentation Scope of testing, (white box / black box) test aspects, App store testing, versioning, Security testing, memory usage and usage of best ...
user avatar
  • 2,726
3 votes

What non-structural coverage criteria are there?

There are the following types of test coverage criteria: structural criteria data criteria fault-model criteria requirements-based criteria criteria based on explicit test case specifications ...
user avatar
3 votes

Telemetry for feature health

Telemetry can't always pin point problems, but many times it can indicate the existence of a problem. If you expect some problems to occur you can sometimes add smarter telemetry and better analysis ...
user avatar
  • 6,945
3 votes

What are the proper metrics and methodologies for measuring how well a QA department is doing?

How many functional test cases have been automated - Regression Automation coverage by different teams. first you must have a requirements traceability matrix to check if all your test cases cover ...
user avatar
  • 121
3 votes

Why are Fibonacci numbers used for estimating effort?

Posted about this just recently. Reference to the original is at the bottom. Key Idea Suppose you want to know how long a task will take. You take a look at the problem and estimate that it will be ...
user avatar
3 votes

Why are Fibonacci numbers used for estimating effort?

This question is answered in a blog post by Jeff Sutherland (co-creator of Scrum). It's rooted in a US Department of Defense study on estimation. Rand researchers then studied the effect of the ...
user avatar
3 votes

Measuring integration test efficiency

Can you detail why you need those metrics? It sounds like you just want to have metrics - but do you have any plan with them afterwards? Personally, I'd first focus on getting the integration tests on ...
user avatar
  • 5,834
2 votes

What are basic metrics of coverage with functional UI automation testing

I would give them a percentage number of test cases automated of all test cases that can be automated. The key here is to develop the full list of test cases that "can" be automated. What test case ...
user avatar
2 votes
Accepted

Monitoring and Notifications on individual and custom integration test metrics

Sonar works well for this. We've been using it for about a year on a suite of products written in .NET. Monitoring metrics for individual tests is outside of the normal use case, but I believe it ...
user avatar
2 votes
Accepted

Examples for LOC figures, of test suites, and software projects?

So you need real-world examples of LOC metrics in a software sources and a test suite LOC volume, right? I can share some rough metrics for one real-world project. Never heard about representative ...
user avatar
2 votes
Accepted

Comparing test coverage metrics to identify an increase/decrease after implementing automation

Test coverage and implementation of automation framework are 2 different things. According to me they are not linked directly. Automation frameworks won't write the test scripts on their own. People ...
user avatar
2 votes

metrics in exploratory testing

According to James Bach on his SBTM page, the metrics you may gather from session reports are quoted below. Of course, sessions give you simple stats. You will need manage these into a meaningful ...
user avatar
  • 5,834
2 votes
Accepted

Tools to display test servers online/offline, db instance etc?

I've used Nagios Core for this before and it sounds ideal for your needs. It can easily monitor almost anything on a remote machine, such as Disk Space, CPU usage, Downtime, Memory usage, Database ...
user avatar
  • 163
2 votes

What are the best metrics for evaluating a software QA team's performance?

There is no best metric I've yet to meet a tester who wants to create invalid defects, miss defects, or raise defects that are later rejected. If this is happening a lot, the problem is probably not ...
user avatar
  • 30.8k

Only top scored, non community-wiki answers of a minimum length are eligible