Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Under the right circumstances, it can allow for faster testing with fewer ...

learn more… | top users | synonyms (2)

3
votes
1answer
754 views

How to transfer Test Cases from one TFS2010 server to another

We have two TFS servers, one we use for testing the output of our developers, and one we use for testing features in TFS. The main problem with this is that it means I have to create new test cases to ...
3
votes
2answers
446 views

Creating a dummy database for automated functionality testing

I have a continuous integration build server (using Team City). When people check code in, I'd like to run a set of tests which run through a set of functional cases such as: Using an administrator ...
5
votes
1answer
100 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - ...
4
votes
4answers
202 views

Is there an industry-standard term for choosing which tests to run?

I have been searching for information on mapping tests to code changes but I haven't had any luck. I suspect that there is some industry standard term that would have better google-juice. Suppose you ...
1
vote
3answers
143 views

What is the best way to create an automated test that asserts the precision of a matrix processing algorithm?

I have and automated test that test an algorithm and the output of this test is the percentual precision of the algorithm. Currently our team is trying to make this algorithm more precise, as well as ...
3
votes
2answers
713 views

Open source deployment validation tool

Asked this on stackoverflow and earned myself the tumbleweed badge... Anyone here know of any? I'm looking for an Open source tool to help with deployment validation for mainly web based applications ...
7
votes
3answers
191 views

USB storage emulator

I need to emulate insertion and removal of SD cards to write tests. What is the best way/tool to implement it in .NET?
9
votes
2answers
767 views

Layered Architecture of Test Automation Software

I was introduced to a 5-layer-model for GUI test automation frameworks, that was considered common knowledge. But I would be interested in a source describing this model. The layers are the following: ...
2
votes
1answer
95 views

php undercontrol replacement

Actually php undercontrol seems to consume a lot of memory so I'm looking for replacement, in order to test a php application.
3
votes
2answers
73 views

Recycling publicly available tests?

What are the best ways to reuse existing tests for new things? For example, Java and C# (Mono) both have tests testing their implementations of Hashtable. If I write my own Hashtable (let's say for ...
2
votes
1answer
672 views

How to create Testcases and Validate the controls in Testcomplete

How should i validate my controls in Testcomplete by using the checkpoints. MY issue is i want that the user should insert only String in certain textboxes and if any numeric or special symbols are ...
9
votes
4answers
320 views

Test Automation for different Locale?

I have begun with automation for a product which is in one language and soon to be ported in another. The only good thing is - Test Automation is just begun. So there are two things which worry me - ...
5
votes
1answer
107 views

Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN

In my WatiN tests I am currently structuring the test like this: [TestMethod] public void Failed_Attempted_Login_Invalid_Combination() { using (var browser = new IE(baseUrl + "login.aspx")) { ...
4
votes
2answers
408 views

What's the most efficient way to run lots of tests?

Here's my current setup: Compile on teamcity Copy the dlls to 8 agents and run tests simaltaniousisly (via snapshot dependencies) Finally taper them in to a single 'publish' build configuration. ...
3
votes
4answers
407 views

testing Touchscreen driver

I am testing a touch screen driver for an embedded device. Unfortunately it is tightly coupled to the hardware so simulated data can't be pushed in real time in order to simulate real usage. Basic ...
5
votes
1answer
546 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
3
votes
3answers
155 views

Xml Diffing Best Practices

There's a lot of xml out there, and diffing it against canned data has helped me in the past. But there's a few things I find I need to do: Delete segments of the xml I don't care about ...
11
votes
5answers
347 views

How often do you run long automated user acceptance tests?

Let's say you have product or project that is coming near to a next release and that has previous versions released a while ago and that has a big suite of automated user acceptance tests that just ...
11
votes
4answers
210 views

If I didn't use TDD but want to transition to agile, should I go back and create those unit tests?

In an transitioning agile environment, if there was no Test Driven Development (no unit tests created), should you create unit tests to catch up on technical debt? And to what extent? Should they ...
3
votes
0answers
253 views

Fully qualify window path after upgrading to QTP 11?

After I upgraded from QTP 10 to 11, it required me to fully qualify my window paths using descriptive programming. For example, this sort of thing worked in QTP 10: ...
4
votes
2answers
538 views

how to implement a given logged in user role through UI automation?

As suggested on StackOverflow I am posting this question here as well. I am having trouble how to implement the Given step (with SpecFlow for example) of a logged in user role throught Web UI ...
14
votes
3answers
984 views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
2
votes
3answers
2k views

What are the best tools available to test performance of a MVC web site

I am new to QA. I need to find best tools available to test performance of a MVC web site. Please help me.
2
votes
4answers
863 views

Testing webservice engine: best practice

I am currently working in a web-service testing project. The web-service engine works on a large set of input data and returns some data that undergo a lot of calculations and filtering. The testing ...
2
votes
2answers
3k views

switching windows with Selenium2 and c# where popup window has same title as originating window

I've been attempting to figure this out for the past two days, unfortunately with no luck. I'm currently automating a scenario where a new window for a form is popped up from the main application ...
5
votes
2answers
395 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
6
votes
2answers
97 views

Is there a way to identify that a Disk is removable ?

On windows XP/7, is there a way to identify from a script (never mind the script language being used) that a disk is not a network or fixed drive?
6
votes
10answers
338 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
4
votes
7answers
1k views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
5
votes
2answers
376 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
1
vote
1answer
745 views

Questions on Developing TestNG based automation for Java based web services

• In case of .NET 2.0 ASMX you can post HTTP requests for the web service using HttpWebRequest and HttpWebResponse • Is this approach possible for java based web service as well, referring to ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
6
votes
9answers
453 views

How do I satisfy external auditors that automated tests are at least as effective as manual tests?

My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
3
votes
1answer
92 views

Multiple Assembly QA Systems?

I'm having difficulty deciding whether or not using multiple assemblies for a QA system is the right approach to take. Here are some important details: The underlying system is a single assembly ...
4
votes
2answers
345 views

match image with Selenium2

Not sure if I'm even asking this question correctly, however, here goes. I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
4
votes
2answers
281 views

Selenium test timing out

I am facing a strange issue with Selenium RC. I have a test which runs perfectly fine when I run my selenium server manually on the default port. The test passes in seconds. However since my tests are ...
4
votes
1answer
357 views

How to 'Mock' SVN

I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc. What's a good way to get me started in terms of mocking the subversion client and working directory ...
2
votes
2answers
1k views

How can I select a file to put into a file_field without using the absolute path with Watir / Ruby?

For example, consider the following script: require 'rubygems' require 'watir-webdriver' browser = Watir::Browser.new(:firefox) browser.goto("http://tinypic.com/") file = ...
6
votes
4answers
251 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
5
votes
1answer
809 views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
4
votes
2answers
192 views

Is it worth investing much time into iteration testing?

I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
8
votes
2answers
2k views

How is Selenium different from other GUI automation tools?

I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
10
votes
8answers
283 views

Testing of automated scripts

How much testing of your automated scripts do people generally do? Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
21
votes
7answers
968 views

What is meant by “Automated tests don't find new bugs”?

As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
6
votes
4answers
3k views

Selenium2 assert questions

I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#. Although these may seem like simple questions, I've been searching for answers for ...
5
votes
2answers
442 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
8
votes
2answers
2k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
17
votes
7answers
1k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
9
votes
3answers
178 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
6
votes
2answers
412 views

In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?

With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...