Bj Rollison
  • Member for 10 years, 8 months
  • Last seen more than 7 years ago
What is meant by the term "Pesticide Paradox" in testing point of view?
4 votes

Boris Beizer wrote “Every method you use to prevent or find bugs leaves a residue of subtler bugs against which those methods are ineffectual.” In the most simple terms not every method or technique ...

View answer
What criteria do I apply to a highly complex development project to warrant getting "real world" data?
1 votes

Configuration testing is a common software testing challenge. Configuration matrices can help outline common customer configurations and potentially even help identify some 'interesting' combinations. ...

View answer
Open-source functional testing automation tools for testing Silverlight based applications
Accepted answer
3 votes

Take a look at the White APIs.

View answer
My team codes in one language, I want to test using another. What can go wrong?
4 votes

I am a big proponent of removing as many abstraction layers between my automated tests and the product code as possible. Ruby or other scripting languages may seem fine for now, but if your test ...

View answer
Should unit tests be executed as part of a build?
Accepted answer
17 votes

We run unit tests prior to check-in and rerun them as part of a larger test suite on each daily build (feature branch) and weekly build (main branch; multiple feature branches aggregated). Some ...

View answer
system testing and alpha testing
1 votes

I agree with user3557882. You are mixing metaphors. "System testing" was described by Boris Beizer in a model outlining of theoretical levels of testing (see Levels of Testing By contrast we have ...

View answer
Verifying an unlimited number of combinations
2 votes

First of all, this is NOT a combinatorial testing problem. Combinatorial tests are based on 2 or more input parameters that accept multiple argument values. In this case, you have a single argument ...

View answer
How to call a WinAPI function in QTP/UFT having a parameter that is a pointer to an application-defined callback function?
2 votes

Take a look at http://msdn.microsoft.com/en-us/library/windows/desktop/ms633494(v=vs.85).aspx, and http://www.pinvoke.net/default.aspx/user32/enumchildwindows.html This is a c# example, but you wrap ...

View answer
How much should a tester understand and rely on implementation details?
3 votes

There are many ways to answer your question. :) When I start testing something, I always initially approach it from a "black-box" perspective. From a black box perspective testers should not know or ...

View answer
Typical localization of bugs
4 votes

You can save yourself a lot of time by knowing more about your application. First, many of the issues dealing with currency formats, number formats, measurement system, long and short date formats, ...

View answer
Where should a test server be hosted?
2 votes

It really comes down to overall reliability and speed. If you can guarantee that you have 24/7 access to your 'test server' via the Internet, with guaranteed > 10Mbps download/upload speeds, and you ...

View answer
Give me some tips for testing Email client mobile application
Accepted answer
1 votes

Your question is rather vague. There are different types of email protocols, and your overall test strategy depends on which protocol(s) your client supports. But, some basic areas for testing email ...

View answer
What should I do with test flappers which cannot be fixed?
Accepted answer
4 votes

I assume by "flap" you mean the test is failing unreliably. Unreliable tests generate a lot of noise in the system, and are also costly. First, I look at the value of this test? Is this test really ...

View answer
How to test the field with different languages?
4 votes

The Babel tool will generate characters by language group, or multiple language groups. Typically, if you are seeing a � character, that usually indicates that you don't have a font capable of ...

View answer
How to categorize defects?
2 votes

Let's step back a moment and try to look at this from a different perspective. If your team is using a defect tracking database to track bug backlog, then we should agree that the primary purpose of ...

View answer
Question about usage of production data as test data
3 votes

There are several factors to consider when selecting test data. For example, if your 200TB of production data is essentially equivalent, then you could potentially calculate a statistical sample ...

View answer
When to use White box Testing in a software or a website?
8 votes

OK...now that a few folks have voiced their perspectives on "boxes" let me try to answer your question. I am going to assume that we agree that by 'white box' testing you are referring to the act of ...

View answer
BDD SpecFlow w/WatiN test during/after redirect
Accepted answer
3 votes

The insertion of Thread.Sleep() is typically indicative of a race condition in your test and your test is running out of sync with the thing is it testing. One suggestion may be to insert a polling ...

View answer
What are the advantages of CMMI over ISO 15504 (SPICE), and vice versa?
2 votes

I apologize for being a bit crass here, but if you are writing a paper to compare the process models and the only thing you came up with so far what amounts to cost, location of acceptance, and time ...

View answer
How to hide/block pop-up windows of my tests on Windows
4 votes

GUI automation is very tricky to say the least. As a general rule of thumb GUI automation demands that the automated test 'know' the machine state at all times. This means that we shouldn't assume ...

View answer
What are features of MS Visual Studio Coded UI Test framework that are not present in other tools?
Accepted answer
16 votes

To start let me be completely transparent and state that I do work at Microsoft. However, in my role I nor my team uses Coded UI, but I do teach the basics of coded UI in some of my classes. Rather ...

View answer
To mock or not to mock with 'Automated Acceptance Tests'
9 votes

I would agree with Laurent, and we have faced a very similar situation. Our team tests the APIs for data transport and parsing. The developer unit/component level tests were all against mock objects ...

View answer
Thoughts on pairwise testing
7 votes

Pairwise (or combinatorial) testing is a technique to help us systematically produce a subset of tests that test the combinations of variables for 2 (or more) parameters out of all possible ...

View answer
Selenium test case fails due to page load time
4 votes

A Sleep method is almost always the least acceptable way to synchronize an automated test. A better approach might be to register an event and check the event is raised when in the desired state, or ...

View answer
Are there standards describing the different processes for software QA on software that you buy/obtain?
2 votes

This link can provide you some guidance on IT requirements for regulatory compliance such as SOx, HIPPA, etc. http://www.metricstream.com/insights/IT_sys_val.htm

View answer
Format of the test report
Accepted answer
5 votes

Since you seem to imply that you already know what data you are going to report on, why not have data populated real time and accessible via the intranet? At MS all test results are available to ...

View answer
What real problems can "Testing Object-Oriented Systems" book be applied to?
Accepted answer
3 votes

I agree that this is a difficult read, and quite different than other books that walk you through specific testing techniques applied to a sample problem step-by-step. Binder wrote "This book is more ...

View answer
Functional requirements and release criteria
2 votes

In our organizations, functional requirements are usually too detailed to list each one as separate or specific release criteria. Functional requirements usually stem from user stories or scenarios, ...

View answer
How to include passed assertions in the Test NG test result report?
0 votes

First, I would try to explain to the customer an assertion is a Boolean condition; if the assertion isn't hit then it "passes." Or perhaps ask the customer if they want to "see" what condition each ...

View answer
How can I test a user story? Examples please?
7 votes

As ByteBuster indicated, user stories are a very high level description of a goal an actor or customer wants to achieve with the product, but doesn't detail exactly how that goal is going to be ...

View answer