6
votes
6answers
1k views

Internal Acceptance Test (not automated): How long should it take?

Given that each test environment is different, is there a general rule of thumb as to how long an internal manual acceptance test should take? Definitions / clarification: Where I came from, when we ...
6
votes
7answers
4k views

What are some good software QA community websites?

The SE sites specifically are about building a repository of information and not about community building or discussion. For those of us who want to build community as well as information, what are ...
13
votes
11answers
919 views

What are the forms of testing that testers commonly forget?

Today I re-realized the importance of sharing a screen with your users to see exactly what they're doing and the paths they are taking through your software. I always knew it was important but never ...
12
votes
9answers
1k views

Performance testing - a way in?

We have an a browser based application that is built on the Microsoft Stack, specifically .NET 3.5. It also uses Ajax, iframes, jQuery etc. At the moment we are just guessing at the concurrency ...
6
votes
9answers
575 views

How do I satisfy external auditors that automated tests are at least as effective as manual tests?

My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
5
votes
5answers
2k views

How do you approach a new project from a testing perspective?

I am preparing an initial test plan document for a new project. The project involves several layers of HW and software and requires mainly black box testing but also some level of grey box testing ...
12
votes
6answers
214 views

What techniques are available to determine which browsers to test?

When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?" I am not asking that question because it will soon become ...
2
votes
1answer
97 views

php undercontrol replacement

Actually php undercontrol seems to consume a lot of memory so I'm looking for replacement, in order to test a php application.
7
votes
2answers
393 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
26
votes
8answers
7k views

How do you prepare yourself for a testing position?

I'm a developer. Right now we don't have much in my firm in the way of testers. Whether I do it here, or go to a different firm, I'm very interested in becoming a full time tester. How would I prepare ...
13
votes
7answers
2k views

How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?

Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
4
votes
2answers
208 views

What the most efficient way of testing cross platform (i.e. iOS and Android) applications?

I work on several projects were the client wants basically the same application implemented in both iOS and Android. At the end of the day, you have to test both - they are distinct pieces of ...
6
votes
8answers
375 views

Is a distinction between “testing” and “checking” useful?

I've seen testers (Michael Bolton, mainly) make a distinction between "testing" (looking for defects using a variety of different methods) and "checking" (running a scenario and then verifying a set ...
11
votes
6answers
4k views

How do I convince management that we need a formal QA department?

At my firm, we don't really have a QA department. If you've followed some of my other questions you know essentially, we have no automated tests and our 'testers' are the analysts who design the ...
4
votes
2answers
535 views

How to version a RFT project

Version control for test assets is a no brainer, but dropping a Rational Functional Tester directly into VC hasn't been easy. Attempting to use a tool like Subversion with multiple users modifying ...
3
votes
2answers
133 views

testing embedded asymmetric multiprocessing system

I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
55
votes
12answers
7k views

What kind of testing should a developer do before passing a build to the QA team?

As a developer my knowledge of best QA practices, etc., are limited to know just enough to get me by writing unit tests, etc. From a tester's point of view, what testing procedures should the ...
4
votes
4answers
789 views

What kind of metrics can be used as an indicative of how well a piece of software meets its functional requirements?

For non-functional requirements as performance, one can find simple metrics to measure the software quality. If you want to know, for example, if your system's performance got better or worse after ...
7
votes
7answers
1k views

Why (& how) do Static and Dynamic testing complement each other

Why (& how) do Static and Dynamic testing complement each other?
4
votes
4answers
367 views

Do you test using VM, User Agent, MutlipleIE etc?

Since it is not possible to acquire all s/w and h/w under the sun, we often resort to using virtual machine, user agent, multiple IE etc. I have had instance when I did not find an application ...
17
votes
6answers
2k views

Software testing and QA podcasts

In a similar vein to the question blogs to follow to further learning, I would like to ask if there are any noteworthy testing podcasts? Searching in iTunes domes up pretty empty on the topic. I know ...
9
votes
11answers
2k views

How do you provide proper tests when there is little documentation

I've worked for companies that have little documentation for their applications, and most of it is probably comments in code. How is a person, who is placed in the quality assurance department, ...
4
votes
2answers
117 views

Approaches to Testing a Scientific Library

I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
2
votes
1answer
247 views

BDD with 3rd party services

I am developing a asp.net mvc site that depends deeply on a 3rd party web service. I would like to know what is the best approach to develop this site since the web service is not ready yet and I ...
13
votes
3answers
472 views

Testing interactions with external systems

I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example. On our online photo sharing application, we have, for example features which let ...
26
votes
7answers
1k views

What is meant by “Automated tests don't find new bugs”?

As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
5
votes
2answers
1k views

How can I run my Selenium 1 FF Profile in Selenium 2 C#?

So right now to run my Selenium 1 tests I use a custom Firefox Profile that sets when I launch my Selenium Server. Is there a way to properly set this profile to run in Selenium 2? I've tried setting ...
-2
votes
2answers
341 views

What would be a good test Orchestration tool for Python unit tests?

What comes to mind is Make, or build.xml, but I have not found a comprehensive Orchestration tool for python testing yet. Any suggestions?
10
votes
2answers
3k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
17
votes
3answers
52k views

A way to match on text using CSS locators

So I use xpath locators and slowly converting to CSS. I haven't found a way to do an exact match based on text. For example converting //a[text()='Log Out']. I know you can do css=a:contains('Log ...
15
votes
6answers
2k views

What factors should affect the ratio of QA/Test staff vs. App Developers

I've worked in a variety of environments with differing ratios of QA / SDET personnel vs. developers focused on building and maintaining application features. Is there such a thing as a "right" ...
17
votes
9answers
5k views

How do you calculate your return on investment on automated tests?

I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
10
votes
5answers
2k views

Android application testing

I have been working as Android developer and been presenting about Android testing with the main SDK tooling, Robotium and Robolectric and running builds on Hudson. It looks like there is a lot of ...
25
votes
11answers
2k views

Blogs to follow to further learning [closed]

I've tried my best to keep this question non-subjective so am not asking which blogs are definitively "the BEST" but instead am using the opportunity to just try to broaden my scope of reading around ...
4
votes
2answers
314 views

What data-driven techniques exist for determining that enough testing has been done?

I have seen some SQA groups use defect arrival or "discovery" rates in order to determine whether a piece of software is ready to be released. The idea is that the rate at which defects are uncovered ...
1
vote
2answers
363 views

Can external object repository be used with dynamic objects?

I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
8
votes
2answers
793 views

Testing NOSQL DB's like distributed Cassandra

Has anybody worked on testing Cassandra DB which is a NOSQL distributed DB? What are the important things to be taken into account while doing this?
4
votes
1answer
4k views

Looking for a valuable Mockito tutorial

I'm looking for a good Mockito tutorial. I found some things, but either they are incomplete (which means: if you need something a bit more complicated than the basics, forget it), or they are badly ...
11
votes
2answers
588 views

Maintaining automation framework for different browsers like IE and FF

How to maintain automation framework for different browsers like IE and FF? In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
13
votes
5answers
409 views

How often do you run long automated user acceptance tests?

Let's say you have product or project that is coming near to a next release and that has previous versions released a while ago and that has a big suite of automated user acceptance tests that just ...
7
votes
3answers
2k views

Attach to browser not spawned by Selenium2

One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
11
votes
4answers
840 views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
6
votes
3answers
493 views

Testing techniques repository?

I was wondering if there are any repositories or wikis of formal testing techniques - test design ideas, like pairwise or boundary. I couldn't find one so far. Thanks! Ahmet
18
votes
8answers
539 views

Security testing resources

Can anyone recommend any good security testing resources? Although I have a basic security skillset, I'd like to improve this. Some of the training I've seen online however seems kind of sketchy. ...
11
votes
4answers
351 views

Good resources for traditional testers adapting to an Agile environment

I haven't experienced a transition from waterfall to Agile myself - I worked for companies using Prince2, waterfall approaches to managing projects, and then I got a job working for a company using ...
6
votes
1answer
145 views

Alternatives to ISEB

I can see why the community can sort of look down on the ISEB exams (at least the Foundation - I haven't looked at the material for any of the others). So I got to wondering exactly what similar ...
15
votes
4answers
786 views

Where can I find information on getting started with Selenium 2?

Some background. I am a long time WatiN coder, and have been since I first looked at Selenium a few versions ago, and decided that it didn't meet my needs, and then went with WatiN. I now want to ...
4
votes
5answers
1k views

Business analysts commonly do testing work, should testers be involved in analysis work?

In my experience, Business Analysts (BA's) are commonly used to perform "happy path" testing when an application is developed. Should the reverse also be true with testers being (more) involved and ...
7
votes
1answer
604 views

Firefox (3.6) not loading Flash when running Selenium2 tests

I've seen several mentions of an issue when running tests in Firefox: the Flash player doesn't load the SWF if the browser window doesn't have focus. This causes sporadic test failures if the system ...
12
votes
2answers
341 views

Measuring test performance when there is high variance

I am running single purpose performance tests on a daily basis. Currently, I run each test 3 times and average them out. But I get fluctuations from day to day which make it difficult to detect ...

15 30 50 per page