Take the 2-minute tour ×
Software Quality Assurance & Testing Stack Exchange is a question and answer site for software quality control experts, automation engineers, and software testers. It's 100% free, no registration required.

I am on a small team (3 developers and one UI person, no QA resource). We have a template that we maintain and use to put together small registration sites for a variety of external clients. I am the UI person, and tasked with making improvements to the template.

For the testing phase, we will make use of our team plus some internal business users that also work closely with our product. This has worked fine in the past, but this time the changes are more widespread than usual and I am worried the test coverage will be spotty without some kind of test plan. I need many browser/OS/device combinations tested.

My question: For each tester, should I assign depth or breadth?

Is it better to divide up the test plan so that tester01 tests all of the scenarios on one browser/platform, and tester02 the same scenarios on a different browser/platform? OR does it make more sense to have tester01 test a handful of scenarios on all browser/platforms, and tester02 different scenarios on all platforms?

share|improve this question
add comment

2 Answers 2

up vote 3 down vote accepted

As always, Depends!

On the following factors that I can think of:

  • The knowledge and expertise of the test group - Are all of them familiar with all features being tested? Are they all at the same level of expertise across your system? If the answer to both these questions is yes, then assigning each person to testing all the features on a dedicated browser might be an efficient way. This way they can test individual features as well be able to notice issues that span across the features or if a change to one feature results in an issue somewhere else in the application.

  • How do various features under test in your application relate to or depend on each other? - If there is a high level of modularization, there would be a benefit in dividing tests by features rather than by browser.

  • Time and priority - If time is constrained and you need all the features to be tested, something that might work is assign each tester to one or more browser and have them create a priority list of test cases. User A can concentrate of Set A of TC, while user B can concentrate on set B. This way each person does an in-depth testing for a particular set of test cases and a high level testing for rest of the cases. You can also go ahead and prioritize TC for a particular browser.

Will add more options as they come to my mind

share|improve this answer
    
The testing group all know the entire system. I will stick with assigning by browser/platform. Ancillary question: I like your suggestion about having each tester focus on different test cases. I am thinking if I have all test the most critical scenarios, I can give each person a different set of outlying test cases. Does that sound about right? I worry about the risk of missing things that only go wrong on one browser/platform. –  ph33nyx Apr 11 '13 at 14:05
    
Well, what I used to do is assign the testers their 'primary' set of cases that they take accountability for & the rest of the cases, they can take a look once they are done with their primary set of TCs. But make sure they understand their task is not limited to primary set. You can obviously tweak it as it works the best for you –  Suchit Parikh Apr 11 '13 at 16:33
add comment

To start with, what Suchit said.

Also, some other things to consider:

  • How knowledgeable are your internal business users - will they use the site the way they usually do, or will they try different things?
  • What level of detail will your testers and business users need? As a general rule, the more autonomous your testers, the more sense it makes to keep them in functional domains (e.g. Tester A does module 1 on all browsers, Tester 2 works with module 2 is better if you don't need to explicitly script all your steps, where it makes less difference for closely scripted testing)
  • You mentioned these are registration sites - is it feasible to give each tester/user a set of data and have one tester check that all the data reaches its destination (presumably a database) correctly?

Without knowing your business domain, I can't give advice on how to prioritise beyond that if you have data on your most commonly used platforms it makes sense to prioritize those: as always go for the 80/20 rule (the 20% that gets 80% of the use - or as close to that as you can get). If Windows 7 PC with Internet Explorer 9 is your biggest group of users, functionality and appearance on that combination would be your first priority target, and so on down the line.

I'd also suggest if you run short of time to look at focusing on later versions rather than older ones, and classes of device before breaking into specific devices (e.g. "android version X, phone" rather than "HTC One", "iOS tablet" rather than a specific iPad model)

share|improve this answer
    
The folks I will use for testing all know the entire system. They will be able to look at everything from UI to data. in the past, however, I have noticed that some of them have a tendency to test exactly what they are specifically asked to test. Thanks for asking about that, and for reminding me that the 80/20 applies here! I will make sure my more autonomous users are assigned the more critical platforms to test. –  ph33nyx Apr 11 '13 at 14:00
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.