28
votes
Why are Fibonacci numbers used for estimating effort?
Fibonacci series is just one example for estimation efforts. Some teams also use series as below:
1, 2, 5, 8, 20, 40, 100, ....
1, 2, 4, 8, 16, 32, 64, ....
The idea is to use an exponential ...
- 1,815
23
votes
Why are Fibonacci numbers used for estimating effort?
They reflect that the degree of uncertainty grows as you look further out and at bigger tasks with more dependencies.
For example, today you can be reasonably confident about how much effort is needed ...
- 24.9k
11
votes
Accepted
Is it valuable to measure bug count per hour of dev time?
No
It absolutely is not valuable to measure bug count per hour of dev time. It is especially bad to measure bug count per hour for individual devs.
Devs on more complex or difficult code will ...
- 31.2k
7
votes
How to establish better tracking of escaped bugs?
This is process related - nothing you can solve as regular QA tester.
Your QA manager need to talk to DEV manager how to improve communication between devs, QA and customers, and how to track relevant ...
6
votes
Means of Quantification of QA impact
By the success of the company.
Buy-in for QA will need to come from the top rather then the justification being looked for in data.
You will, over time, be able to point to things like
some major ...
- 24.9k
6
votes
Why are Fibonacci numbers used for estimating effort?
Common estimating methods include numeric sizing as well like 1 to 10 or sizes like XS, S, M, L, XL, XXL, XXXL or Fibonacci sequence 1, 2, 3, 5, 8, 13, 21, 34, etc.
The reason for using the Fibonacci ...
- 5,603
6
votes
Measuring integration test efficiency
We thought of some sort of limited coverage measurement - checking if
collaboration points like app to database, app to external service are
covered by tests.
Most code coverage tools allow filtering ...
- 10.2k
5
votes
Accepted
Why are Fibonacci numbers used for estimating effort?
Spoiler: No scientific reason.
Fibonacci grows very fast, so people will have fewer options before reaching enormous values; thus it incentivizes breaking work down in smaller pieces.
If the ...
- 10.2k
5
votes
Why are Fibonacci numbers used for estimating effort?
A notion I don't see in any of these answers is that in a simple 1-10 range, people can get bogged down in whether something is a 3 or is it really a 4? And what if another person thinks that it ...
- 51
5
votes
Types of metrics used in QA management
First of all, you need to define better what you want to measure.
Imagine a sports team. One could say that "improving" means "winning more games" - and one could say that a ...
- 10.2k
4
votes
How Agile/Scrum Teams estimate Testing Effort?
Agile teams are cross-functional teams. They estimate the work from design to delivery often on a story based level. This includes the testing work, since testing should be part of the definition of ...
- 32.4k
4
votes
How should a Black-box Tester measure Test Coverage?
Black box approach in and of itself is specifically designed to come from the user perspective backwards. The difference between black box and white box testing is knowledge of the underlying code ...
- 1,683
4
votes
Whats the meaning of this 'Testing efficiency' number?
Test Efficiency is a measure of the relevance of the bugs being reported. A low efficiency would imply that the test team are reporting many bugs that aren't worth fixing. This is pretty limited, and ...
- 1,294
4
votes
Is it valuable to measure bug count per hour of dev time?
As Kate says NO
The common term for kind of metric from those with experience is:
A bad metric
I'll go even further and say any kind of bug count is likely to be gamed
The industry has done thngs like ...
- 24.9k
3
votes
Whats the meaning of this 'Testing efficiency' number?
Testing efficiency, among other metrics, is a merely a guideline. It does not tell the whole picture, it has to be put into context in order to make some sense.
It is more of an indication used by ...
- 9,810
3
votes
Accepted
How can I evaluate a 3rd party testing service?
I would suggest you look at their
Device Fragmentation
Scope of testing, (white box / black box) test aspects, App store testing, versioning, Security testing, memory usage and usage of best ...
- 2,756
3
votes
What non-structural coverage criteria are there?
There are the following types of test coverage criteria:
structural criteria
data criteria
fault-model criteria
requirements-based criteria
criteria based on explicit test case specifications
...
- 1,655
3
votes
Telemetry for feature health
Telemetry can't always pin point problems, but many times it can indicate the existence of a problem.
If you expect some problems to occur you can sometimes add smarter telemetry and better analysis ...
- 7,040
3
votes
What are the proper metrics and methodologies for measuring how well a QA department is doing?
How many functional test cases have been automated - Regression Automation coverage by different teams.
first you must have a requirements traceability matrix to check if all your test cases cover ...
- 131
3
votes
Why are Fibonacci numbers used for estimating effort?
Posted about this just recently. Reference to the original is at the bottom.
Key Idea
Suppose you want to know how long a task will take. You take a look at the problem and estimate that it will be ...
- 31
3
votes
Why are Fibonacci numbers used for estimating effort?
This question is answered in a blog post by Jeff Sutherland (co-creator of Scrum). It's rooted in a US Department of Defense study on estimation.
Rand researchers then studied the effect of the ...
3
votes
Measuring integration test efficiency
Can you detail why you need those metrics? It sounds like you just want to have metrics - but do you have any plan with them afterwards?
Personally, I'd first focus on getting the integration tests on ...
- 5,904
2
votes
Accepted
Examples for LOC figures, of test suites, and software projects?
So you need real-world examples of LOC metrics in a software sources and a test suite LOC volume, right? I can share some rough metrics for one real-world project. Never heard about representative ...
- 268
2
votes
Accepted
Comparing test coverage metrics to identify an increase/decrease after implementing automation
Test coverage and implementation of automation framework are 2 different things. According to me they are not linked directly.
Automation frameworks won't write the test scripts on their own. People ...
- 8,144
2
votes
metrics in exploratory testing
According to James Bach on his SBTM page, the metrics you may gather from session reports are quoted below.
Of course, sessions give you simple stats. You will need manage these into a meaningful ...
- 5,904
2
votes
Accepted
Tools to display test servers online/offline, db instance etc?
I've used Nagios Core for this before and it sounds ideal for your needs. It can easily monitor almost anything on a remote machine, such as Disk Space, CPU usage, Downtime, Memory usage, Database ...
- 173
2
votes
What are the best metrics for evaluating a software QA team's performance?
There is no best metric
I've yet to meet a tester who wants to create invalid defects, miss defects, or raise defects that are later rejected. If this is happening a lot, the problem is probably not ...
- 31.2k
2
votes
How to establish better tracking of escaped bugs?
Ideally when end users find a bug testers team is informed before developers. Then after it goes to developers because testers are to be blamed for leftover bugs :-). You should make some arrangement ...
- 494
2
votes
Accepted
Telemetry for feature health
Summary: It's a reasonable concern but not one that I encounter in practice.
Create smoke tests that are high level are assert that basic functionality, such as visiting the first page, work. These ...
- 24.9k
2
votes
Is it valuable to measure bug count per hour of dev time?
No,
The reasons are many. First, bugs are not quantifiable. You can't add them together and then infer amount of time spent. Secondly, bugs that may be very simple to fix, (maybe even just one ...
- 106
Only top scored, non community-wiki answers of a minimum length are eligible