Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

5
votes
4answers
441 views

How much coding do you do in building automated tests

I come out of quite a few years as a software engineering, but now I'm completely focused on testing. Our team has been trying to expand our automated tests and, to me, this means a lot of coding. I ...
5
votes
4answers
3k views

Do you verify presence of text in your automated tests?

While automating multi locale application I had to stop using - assertTrue(selenium.isTextPresent("success text message")); where success text message would change for each locale. to - ...
5
votes
3answers
253 views

Is model-driven testing a viable technology for real applications yet?

Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
5
votes
1answer
1k views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
5
votes
6answers
3k views

Any personal experiences on EggPlant, cross platform and application automated testing tool?

As a cross platform, cross application automated testing system EggPlant looks too good to be true. Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
2answers
5k views

Solving “SeleneseTestCase is deprecated” issue

I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
5
votes
2answers
410 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
5
votes
4answers
667 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
2answers
363 views

How do I educate that it's not test automation framework?

The term "Test Automation Framework" is become a cliche in automated testing. I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
5
votes
4answers
257 views

How to keep track of the features in a website for impact analysis?

I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
3answers
1k views

Is there a successful approach to automating security testing?

My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
5
votes
2answers
1k views

What could cause a “command failed” error when using the Word.Application object to compare two documents?

I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences. Sub CompareTest Dim wrdApp Dim ...
5
votes
2answers
539 views

Behaviour Driven Development with JavaScript

Are there any approaches and tools for driving the development of JavaScript with BDD. I know that I can do this through the UI with tools like Selenium, but is there any tool that can allow this to ...
5
votes
2answers
238 views

What test generators do exist?

What tools exist to automatically generate test scripts (or test script templates) from a formal specification or a program's source code? EDIT: The background of this question is, that I’m ...
5
votes
2answers
367 views

Where should test fixture code live?

I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
5
votes
4answers
3k views

Testing Page Layout with webdriver

Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension(). Shouldn't these two methods be enough for testing ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
4answers
10k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
5
votes
4answers
185 views

What are good approaches to test dates?

Currently my team is writing some Selenium-based web tests using Java for our application. One major stumbling block has been centred around testing dates. To me, it seems too awkward to test dates in ...
5
votes
7answers
320 views

Recommend Automated test tools for cross platform including IE and .NET software

I'm working in an QA team. We do the automated work from the scratch. So many testing methods may be anti-pattern or disobey some discipline. We pay lots of effort on test web pages on our ...
5
votes
1answer
327 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
107 views

Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN

In my WatiN tests I am currently structuring the test like this: [TestMethod] public void Failed_Attempted_Login_Invalid_Combination() { using (var browser = new IE(baseUrl + "login.aspx")) { ...
5
votes
1answer
514 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
5
votes
1answer
621 views

How do I write a script to be executed by Hudson to automatically restart test environment machines?

I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
5
votes
1answer
97 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - ...
5
votes
2answers
530 views

Testing Java or Silverlight plugins embedded in a page using Selenium?

We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
5
votes
2answers
667 views

Using Selenium Opera Driver doesn't start my test execution

I am able to open the Opera browser using Selenium Opera driver. But I am unable to navigate to any URL using: driver.get("www.google.com"); Opera driver starts and doesn't load the given link. -- ...
5
votes
2answers
1k views

Open-source/freeware testing tool for Set-Top Box

According to Wikipedia a set-top box (STB) is: an information appliance device that generally contains a tuner and connects to a television set and an external source of signal, turning the source ...
5
votes
1answer
555 views

RFT - very slow to add objects

I'm currently exploring RFT for my team. I have come across few issues (as per IBM help website, it's a known issue) with Java Scripting. Hence ditched it and now got .net scripting working with 2010 ...
5
votes
2answers
265 views

Recommended Generic profiling techniques for quality assurance on HTML integration

All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website. Are there ...
4
votes
7answers
947 views

Test Automation in Agile?

Since Agile is iterative and many test-last tools are record and playback-style, and therefore can't really be applied in an Agile environment, this brings up a few issues. the target for test is ...
4
votes
4answers
243 views

Is it necessary to verify databases for functional automation testing?

Currently, after every action that adds or changes data, we verify that that data was successfully added/changed in the database by querying the tables directly. I feel this is redundant because that ...
4
votes
7answers
934 views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
4
votes
3answers
330 views

Automated testing: focusing on testing controls vs. workflow

I'm in charge of regression automation on my team, and I need to add some new tests into our regression. Before I get started, though, there's an issue I'm struggling with: where is the line between ...
4
votes
3answers
449 views

Testing random number generation

I have a program which generates random numbers. How can I test if the random number generator is generating actual random numbers?
4
votes
3answers
2k views

What are the test cases or test scenarios for palindrome

In the interview, the employer asked me to write test cases or test scenarios to check the Palindrome of the word. I said one with positive test case and another with negative test cases. But employer ...
4
votes
5answers
165 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
3answers
206 views

Automation engineers- general purpose vs. dedicated

As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers. On the one hand software engineers, or programmers, can write great automation ...
4
votes
4answers
270 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
5answers
294 views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
4
votes
3answers
619 views

How do I automate “service-level” testing for a GUI app

I have extensive experience automating GUI testing with tools like TestComplete or Microsoft's CodedUI. However, I am trying to get out of the game of testing at the UI layer and instead would like to ...
4
votes
3answers
1k views

MS-SQL server sql test automation

I'm looking to create a batch of automated tests in SQL on MS-SQL server, these will include tests like - insert some records, call stored procedure, check certain conditions in various tables. There ...
4
votes
4answers
405 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
5answers
299 views

Do Academic Researchers in Automated Software Testing Believe All Testing Can Be 100% Automated?

While surfing today, I found this article on attitudes on automated software testing among academics and practitioners. Since I am currently an automated tester in industry, I agree with the ...
4
votes
2answers
779 views

What's the best approach to asserting values with automation testing test cases from complex business logic?

Suppose you have automation tests (my example uses Selenium) to assert complex business logic for a web site. What is the best way to assert that thousands of different test cases are outputting the ...
4
votes
2answers
241 views

Test isolation and automation

We are using Selenium webservices for our automated functional testing . I have a test which tests creation of some objects. If I run the same test again, I need to make sure that each test has a ...
4
votes
3answers
10k views

List and role of different types of testing environments

There are numerous of different testing environments that I have come across with, and ALL of them seem pretty useful and helpful but which ones are necessary. For example ... I have seen: ...
4
votes
2answers
110 views

Fixed vs Dynamic AUT

We develop automated user interface tests. The application under test is quite complex and it can be configured by the user (the real user) in many ways. Our tests to be automated are quite complex as ...
4
votes
4answers
200 views

Is there an industry-standard term for choosing which tests to run?

I have been searching for information on mapping tests to code changes but I haven't had any luck. I suspect that there is some industry standard term that would have better google-juice. Suppose you ...
4
votes
1answer
345 views

How to 'Mock' SVN

I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc. What's a good way to get me started in terms of mocking the subversion client and working directory ...