Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

5
votes
5answers
1k views

What are some good approaches to separating test data from test scripts?

We're working on test code (mainly UI tests with a few different tools). One thing that's really stumping me is how to best separate test data from test scripts. By test data, I mean values that get ...
5
votes
4answers
2k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
5
votes
1answer
742 views

Your suggestions for writing reliable Web UI automation

Web UI automation is unreliable. I presume it is possible to increase the reliability of Web UI tests. One such advice would be to put an abstraction layer on top of your test that does actual DOM ...
5
votes
4answers
466 views

How much coding do you do in building automated tests

I come out of quite a few years as a software engineering, but now I'm completely focused on testing. Our team has been trying to expand our automated tests and, to me, this means a lot of coding. I ...
5
votes
4answers
3k views

Do you verify presence of text in your automated tests?

While automating multi locale application I had to stop using - assertTrue(selenium.isTextPresent("success text message")); where success text message would change for each locale. to - ...
5
votes
3answers
255 views

Is model-driven testing a viable technology for real applications yet?

Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
5
votes
1answer
1k views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
5
votes
6answers
3k views

Any personal experiences on EggPlant, cross platform and application automated testing tool?

As a cross platform, cross application automated testing system EggPlant looks too good to be true. Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
2answers
5k views

Solving “SeleneseTestCase is deprecated” issue

I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
5
votes
2answers
431 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
5
votes
2answers
374 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
5
votes
4answers
706 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
4answers
278 views

How to keep track of the features in a website for impact analysis?

I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
3answers
1k views

Is there a successful approach to automating security testing?

My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
5
votes
2answers
1k views

What could cause a “command failed” error when using the Word.Application object to compare two documents?

I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences. Sub CompareTest Dim wrdApp Dim ...
5
votes
2answers
247 views

What test generators do exist?

What tools exist to automatically generate test scripts (or test script templates) from a formal specification or a program's source code? EDIT: The background of this question is, that I’m ...
5
votes
2answers
382 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
5
votes
5answers
4k views

Testing Page Layout with webdriver

Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension(). Shouldn't these two methods be enough for testing ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
4answers
13k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
5
votes
4answers
210 views

What are good approaches to test dates?

Currently my team is writing some Selenium-based web tests using Java for our application. One major stumbling block has been centred around testing dates. To me, it seems too awkward to test dates in ...
5
votes
7answers
349 views

Recommend Automated test tools for cross platform including IE and .NET software

I'm working in an QA team. We do the automated work from the scratch. So many testing methods may be anti-pattern or disobey some discipline. We pay lots of effort on test web pages on our ...
5
votes
1answer
337 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
107 views

Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN

In my WatiN tests I am currently structuring the test like this: [TestMethod] public void Failed_Attempted_Login_Invalid_Combination() { using (var browser = new IE(baseUrl + "login.aspx")) { ...
5
votes
1answer
529 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
5
votes
4answers
4k views

Selenium.click not working on some anchor elements

The application that am working on was recently revamped and as part of that a new JQuery calendar was introduced. I need to click on a link in the calendar to select the time and date. However, ...
5
votes
1answer
729 views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
5
votes
1answer
98 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - ...
5
votes
2answers
565 views

Testing Java or Silverlight plugins embedded in a page using Selenium?

We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
5
votes
2answers
790 views

Using Selenium Opera Driver doesn't start my test execution

I am able to open the Opera browser using Selenium Opera driver. But I am unable to navigate to any URL using: driver.get("www.google.com"); Opera driver starts and doesn't load the given link. -- ...
5
votes
2answers
1k views

Open-source/freeware testing tool for Set-Top Box

According to Wikipedia a set-top box (STB) is: an information appliance device that generally contains a tuner and connects to a television set and an external source of signal, turning the source ...
5
votes
1answer
618 views

RFT - very slow to add objects

I'm currently exploring RFT for my team. I have come across few issues (as per IBM help website, it's a known issue) with Java Scripting. Hence ditched it and now got .net scripting working with 2010 ...
5
votes
2answers
267 views

Recommended Generic profiling techniques for quality assurance on HTML integration

All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website. Are there ...
5
votes
4answers
2k views

Experiences with automation of hybrid mobile apps

I am looking into the UI test automation options for hybrid apps (Cordova PhoneGap) on both iOS and Android. So far I still struggle with finding any decent tool. I may consider proprietary product ...
4
votes
7answers
1k views

Test Automation in Agile?

Since Agile is iterative and many test-last tools are record and playback-style, and therefore can't really be applied in an Agile environment, this brings up a few issues. the target for test is ...
4
votes
4answers
283 views

Is it necessary to verify databases for functional automation testing?

Currently, after every action that adds or changes data, we verify that that data was successfully added/changed in the database by querying the tables directly. I feel this is redundant because that ...
4
votes
5answers
2k views

Which language gives better career options: TCL or PERL?

I am an engineer with 1.5 years of experience in Test Automation in Perl. I am getting chance to work in TCL. I am little worried about my career growth. I don't know whether TCL also has the same ...
4
votes
7answers
999 views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
4
votes
3answers
351 views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
4
votes
3answers
461 views

Testing random number generation

I have a program which generates random numbers. How can I test if the random number generator is generating actual random numbers?
4
votes
3answers
3k views

What are the test cases or test scenarios for palindrome

In the interview, the employer asked me to write test cases or test scenarios to check the Palindrome of the word. I said one with positive test case and another with negative test cases. But employer ...
4
votes
5answers
166 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
3answers
207 views

Automation engineers- general purpose vs. dedicated

As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers. On the one hand software engineers, or programmers, can write great automation ...
4
votes
4answers
272 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
5answers
306 views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
4
votes
3answers
792 views

How do I automate “service-level” testing for a GUI app

I have extensive experience automating GUI testing with tools like TestComplete or Microsoft's CodedUI. However, I am trying to get out of the game of testing at the UI layer and instead would like to ...
4
votes
3answers
1k views

MS-SQL server sql test automation

I'm looking to create a batch of automated tests in SQL on MS-SQL server, these will include tests like - insert some records, call stored procedure, check certain conditions in various tables. There ...
4
votes
4answers
413 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
5answers
309 views

Do Academic Researchers in Automated Software Testing Believe All Testing Can Be 100% Automated?

While surfing today, I found this article on attitudes on automated software testing among academics and practitioners. Since I am currently an automated tester in industry, I agree with the ...
4
votes
2answers
841 views

What's the best approach to asserting values with automation testing test cases from complex business logic?

Suppose you have automation tests (my example uses Selenium) to assert complex business logic for a web site. What is the best way to assert that thousands of different test cases are outputting the ...