Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

5
votes
5answers
407 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
5
votes
4answers
2k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
5
votes
5answers
1k views

What are some good approaches to separating test data from test scripts?

We're working on test code (mainly UI tests with a few different tools). One thing that's really stumping me is how to best separate test data from test scripts. By test data, I mean values that get ...
5
votes
1answer
761 views

Your suggestions for writing reliable Web UI automation

Web UI automation is unreliable. I presume it is possible to increase the reliability of Web UI tests. One such advice would be to put an abstraction layer on top of your test that does actual DOM ...
5
votes
4answers
469 views

How much coding do you do in building automated tests

I come out of quite a few years as a software engineering, but now I'm completely focused on testing. Our team has been trying to expand our automated tests and, to me, this means a lot of coding. I ...
5
votes
4answers
3k views

Do you verify presence of text in your automated tests?

While automating multi locale application I had to stop using - assertTrue(selenium.isTextPresent("success text message")); where success text message would change for each locale. to - ...
5
votes
1answer
1k views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
5
votes
6answers
4k views

Any personal experiences on EggPlant, cross platform and application automated testing tool?

As a cross platform, cross application automated testing system EggPlant looks too good to be true. Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
2answers
5k views

Solving “SeleneseTestCase is deprecated” issue

I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
5
votes
2answers
437 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
5
votes
2answers
375 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
5
votes
4answers
717 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
4answers
279 views

How to keep track of the features in a website for impact analysis?

I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
3answers
1k views

Is there a successful approach to automating security testing?

My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
5
votes
2answers
1k views

What could cause a “command failed” error when using the Word.Application object to compare two documents?

I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences. Sub CompareTest Dim wrdApp Dim ...
5
votes
2answers
250 views

What test generators do exist?

What tools exist to automatically generate test scripts (or test script templates) from a formal specification or a program's source code? EDIT: The background of this question is, that I’m ...
5
votes
2answers
386 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
5
votes
5answers
4k views

Testing Page Layout with webdriver

Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension(). Shouldn't these two methods be enough for testing ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
4answers
14k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
5
votes
4answers
219 views

What are good approaches to test dates?

Currently my team is writing some Selenium-based web tests using Java for our application. One major stumbling block has been centred around testing dates. To me, it seems too awkward to test dates in ...
5
votes
7answers
356 views

Recommend Automated test tools for cross platform including IE and .NET software

I'm working in an QA team. We do the automated work from the scratch. So many testing methods may be anti-pattern or disobey some discipline. We pay lots of effort on test web pages on our ...
5
votes
1answer
339 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
107 views

Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN

In my WatiN tests I am currently structuring the test like this: [TestMethod] public void Failed_Attempted_Login_Invalid_Combination() { using (var browser = new IE(baseUrl + "login.aspx")) { ...
5
votes
1answer
538 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
5
votes
4answers
4k views

Selenium.click not working on some anchor elements

The application that am working on was recently revamped and as part of that a new JQuery calendar was introduced. I need to click on a link in the calendar to select the time and date. However, ...
5
votes
1answer
758 views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
5
votes
1answer
99 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - ...
5
votes
2answers
574 views

Testing Java or Silverlight plugins embedded in a page using Selenium?

We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
5
votes
4answers
2k views

Experiences with automation of hybrid mobile apps

I am looking into the UI test automation options for hybrid apps (Cordova PhoneGap) on both iOS and Android. So far I still struggle with finding any decent tool. I may consider proprietary product ...
5
votes
2answers
836 views

Using Selenium Opera Driver doesn't start my test execution

I am able to open the Opera browser using Selenium Opera driver. But I am unable to navigate to any URL using: driver.get("www.google.com"); Opera driver starts and doesn't load the given link. -- ...
5
votes
2answers
1k views

Open-source/freeware testing tool for Set-Top Box

According to Wikipedia a set-top box (STB) is: an information appliance device that generally contains a tuner and connects to a television set and an external source of signal, turning the source ...
5
votes
1answer
643 views

RFT - very slow to add objects

I'm currently exploring RFT for my team. I have come across few issues (as per IBM help website, it's a known issue) with Java Scripting. Hence ditched it and now got .net scripting working with 2010 ...
5
votes
2answers
269 views

Recommended Generic profiling techniques for quality assurance on HTML integration

All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website. Are there ...
4
votes
7answers
1k views

Test Automation in Agile?

Since Agile is iterative and many test-last tools are record and playback-style, and therefore can't really be applied in an Agile environment, this brings up a few issues. the target for test is ...
4
votes
4answers
298 views

Is it necessary to verify databases for functional automation testing?

Currently, after every action that adds or changes data, we verify that that data was successfully added/changed in the database by querying the tables directly. I feel this is redundant because that ...
4
votes
5answers
3k views

Which language gives better career options: TCL or PERL?

I am an engineer with 1.5 years of experience in Test Automation in Perl. I am getting chance to work in TCL. I am little worried about my career growth. I don't know whether TCL also has the same ...
4
votes
7answers
1k views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
4
votes
3answers
358 views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
4
votes
3answers
469 views

Testing random number generation

I have a program which generates random numbers. How can I test if the random number generator is generating actual random numbers?
4
votes
3answers
3k views

What are the test cases or test scenarios for palindrome

In the interview, the employer asked me to write test cases or test scenarios to check the Palindrome of the word. I said one with positive test case and another with negative test cases. But employer ...
4
votes
5answers
167 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
3answers
208 views

Automation engineers- general purpose vs. dedicated

As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers. On the one hand software engineers, or programmers, can write great automation ...
4
votes
4answers
273 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
5answers
309 views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
4
votes
3answers
854 views

How do I automate “service-level” testing for a GUI app

I have extensive experience automating GUI testing with tools like TestComplete or Microsoft's CodedUI. However, I am trying to get out of the game of testing at the UI layer and instead would like to ...
4
votes
3answers
1k views

MS-SQL server sql test automation

I'm looking to create a batch of automated tests in SQL on MS-SQL server, these will include tests like - insert some records, call stored procedure, check certain conditions in various tables. There ...
4
votes
3answers
97 views

Is it reasonable to use Selenium RC over WebDriver if the former seems more suitable for the task?

The tests I am doing are on IE8, which is used throughout the company, and doesn't look to be changing any time soon. After testing both pieces of software with the system, it seemed as though ...
4
votes
4answers
416 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
5answers
310 views

Do Academic Researchers in Automated Software Testing Believe All Testing Can Be 100% Automated?

While surfing today, I found this article on attitudes on automated software testing among academics and practitioners. Since I am currently an automated tester in industry, I agree with the ...