Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Under the right circumstances, it can allow for faster testing with fewer ...

learn more… | top users | synonyms (2)

6
votes
4answers
595 views

Future of DOM based UI testing

I work with Selenium for quite a while now and was very happy with it for some time. However recently, I get more and more projects where I see extensive use of JavaScript. For example webpages ...
6
votes
4answers
23k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
6
votes
5answers
1k views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory: http://compass.informatik.rwth-aachen.de/ws-slides/havelund.pdf I found the approach of log files ...
6
votes
3answers
2k views

Attach to browser not spawned by Selenium2

One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
6
votes
1answer
7k views

How to use Selenium's PageFactory annotations with dynamic loaded elements?

I'm rewriting some Selenium tests according to the page object design pattern taking advantage of Seleniums' annotations. My problem is that I have some html select elements whose option elements are ...
6
votes
1answer
591 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
6
votes
2answers
438 views

In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?

With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
6
votes
1answer
213 views

Is it possible to automate Silverlight in windowless mode?

Does anybody have an application under test (AUT) that uses a mixture of HTML and Silverlight controls, which they have successfully automated? My AUT web app has screens with a mixture of HTML and ...
6
votes
3answers
2k views

Automated testing of Oracle Forms

What is the best test automation tool you'd recommend for testing Oracle Forms and why? Assuming a Windows desktop environment.
6
votes
1answer
754 views

PageObjects: Aggregation/Composition vs Inheritance for nested components

I need to refactor my Selenium tests, and was wondering what the best design solution would be for a portal with a hierarchical page organization. We are using tiles, and we have defined a baselayout ...
5
votes
5answers
570 views

What are anti-patterns in test automation?

anti-pattern: There must be at least two key elements present to formally distinguish an actual anti-pattern from a simple bad habit, bad practice, or bad idea: A commonly used ...
5
votes
2answers
3k views

What is the difference between Software Test Engineer, Test Automation Engineer and Software Developer in Test (SDET)?

Software Test Engineer usualy performs “manual” testing (without spending time on automating and supporting the tests). Usually is responsible to find all (as more as possible) critical bugs in the ...
5
votes
5answers
804 views

What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?

In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
5
votes
3answers
515 views

Testing random number generation

I have a program which generates random numbers. How can I test if the random number generator is generating actual random numbers?
5
votes
5answers
428 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
5
votes
5answers
2k views

What are some good approaches to separating test data from test scripts?

We're working on test code (mainly UI tests with a few different tools). One thing that's really stumping me is how to best separate test data from test scripts. By test data, I mean values that get ...
5
votes
1answer
944 views

Your suggestions for writing reliable Web UI automation

Web UI automation is unreliable. I presume it is possible to increase the reliability of Web UI tests. One such advice would be to put an abstraction layer on top of your test that does actual DOM ...
5
votes
4answers
523 views

How much coding do you do in building automated tests

I come out of quite a few years as a software engineering, but now I'm completely focused on testing. Our team has been trying to expand our automated tests and, to me, this means a lot of coding. I ...
5
votes
1answer
2k views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
5
votes
6answers
5k views

Any personal experiences on EggPlant, cross platform and application automated testing tool?

As a cross platform, cross application automated testing system EggPlant looks too good to be true. Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
2answers
6k views

Solving “SeleneseTestCase is deprecated” issue

I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
5
votes
4answers
885 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
4answers
322 views

How to keep track of the features in a website for impact analysis?

I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
3answers
1k views

Is there a successful approach to automating security testing?

My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
5
votes
2answers
1k views

What could cause a “command failed” error when using the Word.Application object to compare two documents?

I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences. Sub CompareTest Dim wrdApp Dim ...
5
votes
2answers
278 views

What test generators do exist?

What tools exist to automatically generate test scripts (or test script templates) from a formal specification or a program's source code? EDIT: The background of this question is, that I’m ...
5
votes
2answers
442 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
5
votes
3answers
430 views

Controlling database state in Selenium UI Testing

We have a big test suit with around 300+ tests. Now a days we are manually restoring database and creating few Data Objects and hard coding some data to feed into the tests. However, there are a lot ...
5
votes
5answers
5k views

Testing Page Layout with webdriver

Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension(). Shouldn't these two methods be enough for testing ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
2answers
462 views

What's the most efficient way to run lots of tests?

Here's my current setup: Compile on teamcity Copy the dlls to 8 agents and run tests simaltaniousisly (via snapshot dependencies) Finally taper them in to a single 'publish' build configuration. ...
5
votes
2answers
1k views

Is drag-and-drop possible in watir-webdriver?

I would like to drag-and-drop one element to the position of another, triggered from within a watir-webdriver script. By "drag-and-drop" I mean picking up a draggable element and releasing it on ...
5
votes
4answers
324 views

What are good approaches to test dates?

Currently my team is writing some Selenium-based web tests using Java for our application. One major stumbling block has been centred around testing dates. To me, it seems too awkward to test dates in ...
5
votes
7answers
479 views

Recommend Automated test tools for cross platform including IE and .NET software

I'm working in an QA team. We do the automated work from the scratch. So many testing methods may be anti-pattern or disobey some discipline. We pay lots of effort on test web pages on our ...
5
votes
1answer
386 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
108 views

Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN

In my WatiN tests I am currently structuring the test like this: [TestMethod] public void Failed_Attempted_Login_Invalid_Combination() { using (var browser = new IE(baseUrl + "login.aspx")) { ...
5
votes
4answers
4k views

Selenium.click not working on some anchor elements

The application that am working on was recently revamped and as part of that a new JQuery calendar was introduced. I need to click on a link in the calendar to select the time and date. However, ...
5
votes
1answer
1k views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
5
votes
1answer
104 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - ...
5
votes
2answers
691 views

Testing Java or Silverlight plugins embedded in a page using Selenium?

We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
5
votes
4answers
4k views

Experiences with automation of hybrid mobile apps

I am looking into the UI test automation options for hybrid apps (Cordova PhoneGap) on both iOS and Android. So far I still struggle with finding any decent tool. I may consider proprietary product ...
5
votes
2answers
363 views

Can LDTP automate Qt-based applications?

We are building an application, which is based on Qt 4.8 on Windows. I have been looking for an automation tool which is cross-platform and should be able to automate my application. I have read a few ...
5
votes
2answers
1k views

Using Selenium Opera Driver doesn't start my test execution

I am able to open the Opera browser using Selenium Opera driver. But I am unable to navigate to any URL using: driver.get("www.google.com"); Opera driver starts and doesn't load the given link. -- ...
5
votes
2answers
2k views

Open-source/freeware testing tool for Set-Top Box

According to Wikipedia a set-top box (STB) is: an information appliance device that generally contains a tuner and connects to a television set and an external source of signal, turning the source ...
5
votes
1answer
831 views

RFT - very slow to add objects

I'm currently exploring RFT for my team. I have come across few issues (as per IBM help website, it's a known issue) with Java Scripting. Hence ditched it and now got .net scripting working with 2010 ...
5
votes
2answers
271 views

Recommended Generic profiling techniques for quality assurance on HTML integration

All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website. Are there ...
4
votes
7answers
1k views

Test Automation in Agile?

Since Agile is iterative and many test-last tools are record and playback-style, and therefore can't really be applied in an Agile environment, this brings up a few issues. the target for test is ...
4
votes
4answers
434 views

Is it necessary to verify databases for functional automation testing?

Currently, after every action that adds or changes data, we verify that that data was successfully added/changed in the database by querying the tables directly. I feel this is redundant because that ...
4
votes
5answers
3k views

Which language gives better career options: TCL or PERL?

I am an engineer with 1.5 years of experience in Test Automation in Perl. I am getting chance to work in TCL. I am little worried about my career growth. I don't know whether TCL also has the same ...
4
votes
7answers
1k views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...