Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

3
votes
4answers
372 views

testing Touchscreen driver

I am testing a touch screen driver for an embedded device. Unfortunately it is tightly coupled to the hardware so simulated data can't be pushed in real time in order to simulate real usage. Basic ...
5
votes
1answer
494 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
9
votes
4answers
534 views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
3
votes
3answers
151 views

Xml Diffing Best Practices

There's a lot of xml out there, and diffing it against canned data has helped me in the past. But there's a few things I find I need to do: Delete segments of the xml I don't care about ...
11
votes
5answers
333 views

How often do you run long automated user acceptance tests?

Let's say you have product or project that is coming near to a next release and that has previous versions released a while ago and that has a big suite of automated user acceptance tests that just ...
11
votes
4answers
199 views

If I didn't use TDD but want to transition to agile, should I go back and create those unit tests?

In an transitioning agile environment, if there was no Test Driven Development (no unit tests created), should you create unit tests to catch up on technical debt? And to what extent? Should they ...
3
votes
0answers
231 views

Fully qualify window path after upgrading to QTP 11?

After I upgraded from QTP 10 to 11, it required me to fully qualify my window paths using descriptive programming. For example, this sort of thing worked in QTP 10: ...
4
votes
2answers
458 views

how to implement a given logged in user role through UI automation?

As suggested on StackOverflow I am posting this question here as well. I am having trouble how to implement the Given step (with SpecFlow for example) of a logged in user role throught Web UI ...
12
votes
3answers
734 views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
2
votes
3answers
2k views

What are the best tools available to test performance of a MVC web site

I am new to QA. I need to find best tools available to test performance of a MVC web site. Please help me.
2
votes
4answers
755 views

Testing webservice engine: best practice

I am currently working in a web-service testing project. The web-service engine works on a large set of input data and returns some data that undergo a lot of calculations and filtering. The testing ...
2
votes
2answers
2k views

switching windows with Selenium2 and c# where popup window has same title as originating window

I've been attempting to figure this out for the past two days, unfortunately with no luck. I'm currently automating a scenario where a new window for a form is popped up from the main application ...
5
votes
2answers
343 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
6
votes
2answers
93 views

Is there a way to identify that a Disk is removable ?

On windows XP/7, is there a way to identify from a script (never mind the script language being used) that a disk is not a network or fixed drive?
6
votes
10answers
334 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
4
votes
2answers
5k views

How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation

I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
4
votes
7answers
816 views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
5
votes
3answers
360 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
1
vote
1answer
654 views

Questions on Developing TestNG based automation for Java based web services

• In case of .NET 2.0 ASMX you can post HTTP requests for the web service using HttpWebRequest and HttpWebResponse • Is this approach possible for java based web service as well, referring to ...
5
votes
1answer
989 views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
6
votes
9answers
414 views

How do I satisfy external auditors that automated tests are at least as effective as manual tests?

My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
3
votes
1answer
87 views

Multiple Assembly QA Systems?

I'm having difficulty deciding whether or not using multiple assemblies for a QA system is the right approach to take. Here are some important details: The underlying system is a single assembly ...
4
votes
2answers
330 views

match image with Selenium2

Not sure if I'm even asking this question correctly, however, here goes. I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
4
votes
2answers
263 views

Selenium test timing out

I am facing a strange issue with Selenium RC. I have a test which runs perfectly fine when I run my selenium server manually on the default port. The test passes in seconds. However since my tests are ...
4
votes
1answer
326 views

How to 'Mock' SVN

I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc. What's a good way to get me started in terms of mocking the subversion client and working directory ...
2
votes
2answers
879 views

How can I select a file to put into a file_field without using the absolute path with Watir / Ruby?

For example, consider the following script: require 'rubygems' require 'watir-webdriver' browser = Watir::Browser.new(:firefox) browser.goto("http://tinypic.com/") file = ...
6
votes
4answers
242 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
14
votes
7answers
2k views

Does automating your manual tests give you good automated tests?

I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
9
votes
2answers
2k views

What are some tools for fuzz testing?

Fuzz Testing as defined by Wikipedia is: a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer ...
5
votes
1answer
516 views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
4
votes
2answers
182 views

Is it worth investing much time into iteration testing?

I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
8
votes
2answers
2k views

How is Selenium different from other GUI automation tools?

I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
10
votes
8answers
274 views

Testing of automated scripts

How much testing of your automated scripts do people generally do? Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
21
votes
7answers
819 views

What is meant by “Automated tests don't find new bugs”?

As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
6
votes
4answers
2k views

Selenium2 assert questions

I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#. Although these may seem like simple questions, I've been searching for answers for ...
5
votes
2answers
361 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
6
votes
3answers
802 views

What are the trade-offs of using page objects instead of a collection of functions in UI automation?

I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...
8
votes
2answers
1k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
16
votes
7answers
1k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
9
votes
3answers
170 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
6
votes
2answers
387 views

In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?

With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
11
votes
6answers
953 views

How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?

Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
10
votes
4answers
293 views

Testing interactions with external systems

I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example. On our online photo sharing application, we have, for example features which let ...
-1
votes
2answers
199 views

What would be a good test Orchestration tool for Python unit tests

what comes to mind is Make, or build.xml, but have not found a comprehensive Orchestration tool for python testing
3
votes
2answers
122 views

testing embedded asymmetric multiprocessing system

I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
13
votes
8answers
2k views

How do you calculate your return on investment on automated tests?

I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
3
votes
2answers
112 views

Approaches to Testing a Scientific Library

I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
14
votes
7answers
685 views

Are your UI automated tests dependent or ordered?

While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
1
vote
2answers
285 views

Can external object repository be used with dynamic objects?

I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
4
votes
5answers
270 views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...