Reputation
1,804
Top tag
Next privilege 2,000 Rep.
Access moderator tools
Badges
5 23
Newest
 Excavator
Impact
~32k people reached

Feb
19
comment How to make sure your test data are correct?
Bj, Well said. I especially like the high "insight per word ratio" of these sentences: "Of course a model is an abstraction of reality, and so your generated data is only as good as your model, your equivalent sets, and how you parameterize the use of those sets in your generator. Data generation can become quite complex and could also include weighting specific values, sequencing, etc."
Jan
27
comment How can I report coverage on an n-dimensional test matrix?
I've added some new screen shots of the green and red "Matrix Reports" because some testers like how they provide a clear summary coverage achieved as well as specific gaps in coverage that exist. (These views were not previously available).
Jan
21
comment What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?
devonps, I or one of my colleagues are in the classroom together with participants when we run these test design training sessions. If the testers struggle, we would encourage them to try out different approaches and ideas. Rarely do we need to do more than that. If we need to, we can gently guide participants in a direction that is likely to be fruitful.
Jan
21
comment What does “all triples” test suite means?
Chris, You're generally on the right track, but there are a couple subtle but significant inaccuracies in your answer: (1) "every value of every variable is included in at least three tests." - Not so. Rather, 3-way coverage means that every possible triplet of values appears in at least one test. (2) "The variables should be independent of one another." While I've seen this claim in multiple sources, it just isn't true in practice. In fact, combinatorial testing is often especially useful where variables are dependent (but extra care needs to be taken in modeling the System Under Test).
Dec
12
comment Statistical Testing Application on Screens and Nested Logic
I'm not really sure what the question means. As Kate suggests, more detail would be helpful. Could you provide a sample test scenario or two by way of example? Do you envision each test scenario each including all 3 screens being opened in different orders?
Jan
8
comment Approach to writing Manual Test cases/Scripts
Great answer Kate!
Nov
22
comment In performance testing, when have MFAT approaches been successfully applied (in addition to an OFAT approach)?
Sam, thanks for taking the time to write a nice, thoughtful answer! Reading lots of data and writing lots of data is a really nice, concrete example too.
Oct
26
comment Is there a guide or systematic way of writing test scenarios?
Laura, Great suggestion. I've updated my answer to include your improvement to it.
Oct
8
comment Techniques for test selection, give a large suite of test cases
Those articles are not about just any type of test generation; they're all about a specific type of test generation. Namely, generating tests in a systematic way so as to cover as much as possible in as few tests as possible. They are about minimizing the size of your test suite for a given scope. These approaches are extremely powerful and well-proven, yet they remain wildly underutilized in the software testing community. The test generation approaches described in the articles work equally well whether you have an existing set of tests or you're generating a new set from scratch.
Sep
27
comment Techniques for test selection, give a large suite of test cases
D.W., Kudos for trying to find actual empirical evidence! I would suggest these additional articles for you. They do a good job of explaining how test suite reduction techniques have been effectively put into practice: combinatorialtesting.com/clear-introductions-1
Sep
7
comment Capture screen during exploratory testing
Upvoted. If you want both a screen shot and a way to keep track of tester comments throughout an exploratory testing session, Rapid Reporter is truly fantastic. A very nice example of Rapid Reporter in action (with screen shots shown amidst a tester's comments about their developing thought process throughout the exploratory testing session) can be found here: testing.gershon.info/rapidreporter/pairingrr/AngryWeaselTheApp/…
Dec
7
comment What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?
Dan, I would prefer a game if possible to have some fun, get non-game testers out of their shells and out of their comfort zones a little bit. Part of the challenge I have in mind will be to "parameterize" user playing styles and possible user actions which is not a traditional test design technique most of them will be familiar with. Thanks.
Sep
24
comment Are state transition diagrams a good software testing technique
+1 Superb answer, Dale!
Jul
19
comment Can exploratory testing replace executing manual functional tests?
+1 for Chuck's suggestion, which I love. I am a HUGE proponent of running experiments and capturing data. Doing so helps people learn a lot. In the absence of actual data, opinions prevail. The opinions that prevail often belong to those with the loudest voices and/or are HIPPO's (the Highest Paid Person's Opinion). Experiment. A Google search for W. Edwards Deming and PDSA would pull up some interesting articles and blog posts on this topic.
May
25
comment What are the benefits of Block Testing?
+1 for a wonderfully clear explanation and an additional +1 if I could vote it up again for these great sentences that should be carved in stone: "In the end, the math doesn't really matter. The reason to measure coverage isn't to produce a number - it's to help you discover what areas of the code are not covered by your testing so you can determine if more testing is needed. In other words, coverage testing is a method of discovering new tests."
May
24
comment Is it worth investing much time into iteration testing?
Dustin, You wrote your own software to create 2-way and 3-way coverage?! Cool! You're a man after my own heart. It's a shame so few testers know about these powerful test design methods. Please check out our Hexawise test case design tool and let me know your feedback. My experience confirms your assertion that moving from 2-way (pairwise) to 3-way tests has a much lower ROI than the 2-way tests because you'll often quadruple the # of tests executed to get to 3-way coverage with a much lower number of new defects found per test as compared to the bugs per test ratio from the 2-way tests.
May
23
comment Alternatives to Session Tester for recording exploratory test session results
+1 Rapid Reporter is a great tool and Shmuel Gershon (who developed it) is excellent at the tricky balancing act of incorporating input from users without having that lead to a tool plagued by "feature bloat." The result is that Rapid Reporter is a very nice tool that is extremely easy to use that has the vast majority of the features most users are likely to want. In addition, it doesn't take up much room on your screen when you're testing.
May
20
comment When is it OK not to have dedicated testers/QA team?
Bruce, I disagree. Here is why: If the question were "I wonder when does the absence of dedicated quality assurance people does not lead to decreased quality of delivered software?"... I would agree with your point (and could accept the validity of your down vote). That was not the entire question however. The question begins: "It just came into my mind that there are no dedicated QAs in stackexchange team. Since they are indeed making an awesome product,..." Hence the references are, IMHO, extremely valid.
May
20
comment QTP vs Selenium
I strongly disagree that questions like this should be closed. I would MUCH rather see thoughtful analyses of the pro's and cons of tools (and other potentially decisive issues) aired and decide for myself which perspectives I find more compelling than have moderators conclude that participants are too immature to discuss the issues politely and rationally. If participants can't be trusted to discuss topics like this politely and rationally, the community has bigger issues to worry about.
May
20
comment How is Selenium different from other GUI automation tools?
Please don't close questions like these. Vote down vapid answers if you like but thoughtful answers to questions like these have the potential to be extremely useful to many people.