8
votes
2answers
2k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
18
votes
7answers
2k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
5
votes
6answers
1k views

Internal Acceptance Test (not automated): How long should it take?

Given that each test environment is different, is there a general rule of thumb as to how long an internal manual acceptance test should take? Definitions / clarification: Where I came from, when we ...
9
votes
3answers
184 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
6
votes
2answers
438 views

In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?

With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
1
vote
3answers
459 views

reporting cumulative test results

Wondering if anybody else is using this way to report test results. Some of the projects in the company I work for report test results on a cumulative basis, meaning that a test that passed once is ...
3
votes
3answers
668 views

UAT involvement

This isn't really a question for me anymore, but, out of curiousity and to help a former co-worker. Before moving to Quality Assurance, I led a UAT team. This team was made up of former users, who ...
6
votes
1answer
583 views

Firefox (3.6) not loading Flash when running Selenium2 tests

I've seen several mentions of an issue when running tests in Firefox: the Flash player doesn't load the SWF if the browser window doesn't have focus. This causes sporadic test failures if the system ...
3
votes
1answer
1k views

Unable to click on City bubble on Google map using Selenium

I have been trying to click on City bubble on Google Map. So far I have tried following but none seems to work. Also notice the awkward locator available from map which is captured in Selenium IDE ...
12
votes
6answers
1k views

How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?

Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
48
votes
12answers
4k views

What kind of testing should a developer do before passing a build to the QA team?

As a developer my knowledge of best QA practices, etc., are limited to know just enough to get me by writing unit tests, etc. From a tester's point of view, what testing procedures should the ...
11
votes
4answers
374 views

Testing interactions with external systems

I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example. On our online photo sharing application, we have, for example features which let ...
4
votes
4answers
668 views

What kind of metrics can be used as an indicative of how well a piece of software meets its functional requirements?

For non-functional requirements as performance, one can find simple metrics to measure the software quality. If you want to know, for example, if your system's performance got better or worse after ...
4
votes
5answers
1k views

Business analysts commonly do testing work, should testers be involved in analysis work?

In my experience, Business Analysts (BA's) are commonly used to perform "happy path" testing when an application is developed. Should the reverse also be true with testers being (more) involved and ...
4
votes
2answers
199 views

What the most efficient way of testing cross platform (i.e. iOS and Android) applications?

I work on several projects were the client wants basically the same application implemented in both iOS and Android. At the end of the day, you have to test both - they are distinct pieces of ...
-2
votes
2answers
264 views

What would be a good test Orchestration tool for Python unit tests

what comes to mind is Make, or build.xml, but have not found a comprehensive Orchestration tool for python testing
3
votes
4answers
338 views

Do you test using VM, User Agent, MutlipleIE etc?

Since it is not possible to acquire all s/w and h/w under the sun, we often resort to using virtual machine, user agent, multiple IE etc. I have had instance when I did not find an application ...
3
votes
2answers
126 views

testing embedded asymmetric multiprocessing system

I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
3
votes
2answers
115 views

Approaches to Testing a Scientific Library

I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
3
votes
2answers
304 views

What data-driven techniques exist for determining that enough testing has been done?

I have seen some SQA groups use defect arrival or "discovery" rates in order to determine whether a piece of software is ready to be released. The idea is that the rate at which defects are uncovered ...
17
votes
7answers
1k views

Are your UI automated tests dependent or ordered?

While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
5
votes
2answers
841 views

Python coverage and external executables

I have a project that has almost complete unit test coverage. There's only one statement that isn't covered and I can't work out a good way to do so. Say the project is called foo, I have ...
1
vote
2answers
342 views

Can external object repository be used with dynamic objects?

I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
19
votes
6answers
746 views

How do you tell a programmer they're not testing their own code enough?

Suppose you're working with bright programmer, but every time you test the code you find a serious, obvious bugs. Things the programmer could have noticed if they did their own testing before checking ...
4
votes
5answers
391 views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
7
votes
2answers
655 views

Testing NOSQL DB's like distributed Cassandra

Has anybody worked on testing Cassandra DB which is a NOSQL distributed DB? What are the important things to be taken into account while doing this?
6
votes
3answers
2k views

Attach to browser not spawned by Selenium2

One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
9
votes
2answers
552 views

Maintaining automation framework for different browsers like IE and FF

How to maintain automation framework for different browsers like IE and FF? In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
12
votes
7answers
628 views

Should QA be able to code tests?

Having a development background, I am convinced that record and replay testing tools have their drawbacks, especially by making tests brittle. See Automated Testing != Record-Playback Tool for a good ...
9
votes
3answers
377 views

How to deal with testers who do more than test

In my firm, we don't have testers, exactly. We have analysts who translate business requirements into specifications. (Think the guy from Office Space, except these guys actually provide some value. ...
1
vote
1answer
502 views

How can I change the dates used in TFS 2010 SharePoint portal's burndown excel chart?

We have a TFS 2010 project (MSF Agile v5.0 template) project, the SSRS reports for burndown allow us to specify start and end dates for the current iteration, but the project portals excel charts ...
6
votes
2answers
4k views

QTP vs Selenium [closed]

I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
5
votes
3answers
3k views

Handling self-refreshing pages from selenium

I have been running into intermittent errors with some java selenium-rc tests which I think are related to a page which has an ajax poll and automatically refreshes when some condition is reached on ...
4
votes
4answers
187 views

Should testers be worried about Quality Assurance? [closed]

In some companies, the testers are expected to do Quality Assurance. In my opinion, this is not the way to go. Testers normally don't have the mandate to push things thorugh on a higher level. Because ...
4
votes
6answers
2k views

Can Selenium and Bromine 3 execute overnight and email the results

I would like to automate the testing with selenium - even when I am right now a beginner with automatic testing and especially selenium. Therefor I am working with Bromine 3 RC 2. Is there a way to ...
4
votes
3answers
426 views

Preparing for ISEB

I recently asked this question on a less active exchange and as a result didn't get the range of opinions I was after so am repeating it here. I've been working as a tester for the last 6 months (in ...
7
votes
1answer
364 views

How can I teach QTP to treat a control as another similar control?

I have a third party check box control in my AUT that QTP does not recognize. Is there a way to have QTP treat it as a regular .NET check box?
-5
votes
1answer
630 views

What are the best practices in quality assurance process measurement? [closed]

How do you measure quality assurance and quality of products in your teams? What metrics do you use? What tools do you use?
7
votes
4answers
1k views

Headless Functional Testing For Your JavaScript Web App?

JavaScript is everywhere right now. With the advent of jQuery and other associated JavaScript frameworks it's amazingly simple to add very powerful user interactions to web sites and web applications. ...
6
votes
2answers
258 views

When to start testing a solo project

I'm building myself a solo project. (Java backend, Java AWT frontend. No lectures about AWT vs swing vs *wt, please :-)) It's fairly straightforward Primary server - keeps user information Content ...

15 30 50 per page