Hot answers tagged

28 votes

Why are Fibonacci numbers used for estimating effort?

Fibonacci series is just one example for estimation efforts. Some teams also use series as below: 1, 2, 5, 8, 20, 40, 100, .... 1, 2, 4, 8, 16, 32, 64, .... The idea is to use an exponential ...
  • 1,815
23 votes

Why are Fibonacci numbers used for estimating effort?

They reflect that the degree of uncertainty grows as you look further out and at bigger tasks with more dependencies. For example, today you can be reasonably confident about how much effort is needed ...
11 votes
Accepted

Is it valuable to measure bug count per hour of dev time?

No It absolutely is not valuable to measure bug count per hour of dev time. It is especially bad to measure bug count per hour for individual devs. Devs on more complex or difficult code will ...
  • 31.2k
7 votes

How to establish better tracking of escaped bugs?

This is process related - nothing you can solve as regular QA tester. Your QA manager need to talk to DEV manager how to improve communication between devs, QA and customers, and how to track relevant ...
6 votes

Means of Quantification of QA impact

By the success of the company. Buy-in for QA will need to come from the top rather then the justification being looked for in data. You will, over time, be able to point to things like some major ...
6 votes

Why are Fibonacci numbers used for estimating effort?

Common estimating methods include numeric sizing as well like 1 to 10 or sizes like XS, S, M, L, XL, XXL, XXXL or Fibonacci sequence 1, 2, 3, 5, 8, 13, 21, 34, etc. The reason for using the Fibonacci ...
6 votes

Measuring integration test efficiency

We thought of some sort of limited coverage measurement - checking if collaboration points like app to database, app to external service are covered by tests. Most code coverage tools allow filtering ...
  • 10.2k
5 votes
Accepted

Why are Fibonacci numbers used for estimating effort?

Spoiler: No scientific reason. Fibonacci grows very fast, so people will have fewer options before reaching enormous values; thus it incentivizes breaking work down in smaller pieces. If the ...
  • 10.2k
5 votes

Why are Fibonacci numbers used for estimating effort?

A notion I don't see in any of these answers is that in a simple 1-10 range, people can get bogged down in whether something is a 3 or is it really a 4? And what if another person thinks that it ...
  • 51
5 votes

Types of metrics used in QA management

First of all, you need to define better what you want to measure. Imagine a sports team. One could say that "improving" means "winning more games" - and one could say that a ...
  • 10.2k
4 votes

How Agile/Scrum Teams estimate Testing Effort?

Agile teams are cross-functional teams. They estimate the work from design to delivery often on a story based level. This includes the testing work, since testing should be part of the definition of ...
4 votes

How should a Black-box Tester measure Test Coverage?

Black box approach in and of itself is specifically designed to come from the user perspective backwards. The difference between black box and white box testing is knowledge of the underlying code ...
  • 1,683
4 votes

Whats the meaning of this 'Testing efficiency' number?

Test Efficiency is a measure of the relevance of the bugs being reported. A low efficiency would imply that the test team are reporting many bugs that aren't worth fixing. This is pretty limited, and ...
  • 1,294
4 votes

Is it valuable to measure bug count per hour of dev time?

As Kate says NO The common term for kind of metric from those with experience is: A bad metric I'll go even further and say any kind of bug count is likely to be gamed The industry has done thngs like ...
3 votes

Whats the meaning of this 'Testing efficiency' number?

Testing efficiency, among other metrics, is a merely a guideline. It does not tell the whole picture, it has to be put into context in order to make some sense. It is more of an indication used by ...
  • 9,810
3 votes
Accepted

How can I evaluate a 3rd party testing service?

I would suggest you look at their Device Fragmentation Scope of testing, (white box / black box) test aspects, App store testing, versioning, Security testing, memory usage and usage of best ...
  • 2,756
3 votes

What non-structural coverage criteria are there?

There are the following types of test coverage criteria: structural criteria data criteria fault-model criteria requirements-based criteria criteria based on explicit test case specifications ...
3 votes

Telemetry for feature health

Telemetry can't always pin point problems, but many times it can indicate the existence of a problem. If you expect some problems to occur you can sometimes add smarter telemetry and better analysis ...
  • 7,040
3 votes

What are the proper metrics and methodologies for measuring how well a QA department is doing?

How many functional test cases have been automated - Regression Automation coverage by different teams. first you must have a requirements traceability matrix to check if all your test cases cover ...
  • 131
3 votes

Why are Fibonacci numbers used for estimating effort?

Posted about this just recently. Reference to the original is at the bottom. Key Idea Suppose you want to know how long a task will take. You take a look at the problem and estimate that it will be ...
3 votes

Why are Fibonacci numbers used for estimating effort?

This question is answered in a blog post by Jeff Sutherland (co-creator of Scrum). It's rooted in a US Department of Defense study on estimation. Rand researchers then studied the effect of the ...
3 votes

Measuring integration test efficiency

Can you detail why you need those metrics? It sounds like you just want to have metrics - but do you have any plan with them afterwards? Personally, I'd first focus on getting the integration tests on ...
  • 5,904
2 votes
Accepted

Examples for LOC figures, of test suites, and software projects?

So you need real-world examples of LOC metrics in a software sources and a test suite LOC volume, right? I can share some rough metrics for one real-world project. Never heard about representative ...
2 votes
Accepted

Comparing test coverage metrics to identify an increase/decrease after implementing automation

Test coverage and implementation of automation framework are 2 different things. According to me they are not linked directly. Automation frameworks won't write the test scripts on their own. People ...
2 votes

metrics in exploratory testing

According to James Bach on his SBTM page, the metrics you may gather from session reports are quoted below. Of course, sessions give you simple stats. You will need manage these into a meaningful ...
  • 5,904
2 votes
Accepted

Tools to display test servers online/offline, db instance etc?

I've used Nagios Core for this before and it sounds ideal for your needs. It can easily monitor almost anything on a remote machine, such as Disk Space, CPU usage, Downtime, Memory usage, Database ...
  • 173
2 votes

What are the best metrics for evaluating a software QA team's performance?

There is no best metric I've yet to meet a tester who wants to create invalid defects, miss defects, or raise defects that are later rejected. If this is happening a lot, the problem is probably not ...
  • 31.2k
2 votes

How to establish better tracking of escaped bugs?

Ideally when end users find a bug testers team is informed before developers. Then after it goes to developers because testers are to be blamed for leftover bugs :-). You should make some arrangement ...
  • 494
2 votes
Accepted

Telemetry for feature health

Summary: It's a reasonable concern but not one that I encounter in practice. Create smoke tests that are high level are assert that basic functionality, such as visiting the first page, work. These ...
2 votes

Is it valuable to measure bug count per hour of dev time?

No, The reasons are many. First, bugs are not quantifiable. You can't add them together and then infer amount of time spent. Secondly, bugs that may be very simple to fix, (maybe even just one ...
  • 106

Only top scored, non community-wiki answers of a minimum length are eligible