Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

8
votes
4answers
3k views

Why Isn't SilkTest More Common?

The title says it all. I've been using SilkTest for about a year now in my current role. It wasn't my choice to use, and I've never used it, or even heard of it, before this role. There are definitely ...
8
votes
1answer
415 views

Tools for tracking automated tests

I have used STAF/STAX in the past, and liked the way that information was tracked in the tests. I'm currently investigating Technologies to tie together a few tools that use XML-RPC, and am ...
8
votes
2answers
1k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
7
votes
4answers
215 views

How can my team move away from record-and-playback when not everyone has scripting experience?

(Inspired by this question) My team is currently doing automated testing via our tool's record-and-playback function. I've read about the benefits of developing a more robust test solution via ...
7
votes
5answers
7k views

What are features of MS Visual Studio Coded UI Test framework that are not present in other tools?

I've recently started working at an organization that has no automated testing in place. They are migrating to Team Foundation Server for project management and source control, and use Visual Studio ...
7
votes
4answers
275 views

Good strategy for automated regression where initial state can't be guaranteed or predicted

The situation I need to start building automated regression for a very large web application with thousands of users. It is impossible to start from a known state, or even to be sure that data ...
7
votes
3answers
3k views

Good Watir or Watir-Webdriver tutorials/resources for new-to-automation testers?

There are at least two really good books for Selenium beginners, and quite a few courses/tutorials out there, as well as a lot of blogs. However, I haven't seen quite as much out there for Watir - ...
7
votes
5answers
505 views

Testing email generation

Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be ...
7
votes
3answers
187 views

USB storage emulator

I need to emulate insertion and removal of SD cards to write tests. What is the best way/tool to implement it in .NET?
7
votes
1answer
2k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
7
votes
1answer
682 views

Continuous Integration and testing environment and configuration for Android

I am an Android developer but I am not satisfied with my testing and Continuous Integration environment and configuration. Someone could recommend me how to configure the best setup and workflow for ...
7
votes
1answer
232 views

How have Guava unit tests been generated automatically?

Guava library for Java has unit test cases automatically generated: Guava has staggering numbers of unit tests: as of July 2012, the guava-tests package includes over 286,000 individual test ...
6
votes
10answers
334 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
6
votes
3answers
4k views

Is Selenium the right tool for browser compatibility testing?

I have been seeing a lot of customers pushing for browser compatibility testing using Selenium. Was wondering whether this is really necessary. The push is mostly due to Selenium grid supporting multi ...
6
votes
5answers
790 views

I want to enter the SQA field specifically automation

I am working hourly for low wage as a QA intern/tester. I want to learn more about this field. I have already graduated, so everything I have learned is self taught or learned somehow on the job. At ...
6
votes
7answers
412 views

Techniques for test selection, give a large suite of test cases

I have a huge collection of test cases (inputs). I'd like to select a small subset that's likely to catch most of the bugs. Are there any standard or known techniques in the testing literature for ...
6
votes
6answers
902 views

What are the advantages of automated user acceptance tests?

I'm completely new to this stuff, and for what I've seen it takes a while to get used to it. I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
6
votes
9answers
411 views

How do I satisfy external auditors that automated tests are at least as effective as manual tests?

My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
6
votes
2answers
2k views

Good resources/tutorials/tips for beginner doing automation?

I've just started automating all the tests our team has (~5000). I'm using Telerik Test Studio for the Silverlight automation. I have some tests written, but I'm quickly realizing that with each test ...
6
votes
7answers
371 views

Should tool generated test data be deleted during tear down in test automation?

I have seen this recommendation many times that tear down is supposed to clear test data which is created during tests. This is supposed to avoid interference with any future tests. For example ...
6
votes
2answers
93 views

Is there a way to identify that a Disk is removable ?

On windows XP/7, is there a way to identify from a script (never mind the script language being used) that a disk is not a network or fixed drive?
6
votes
4answers
241 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
6
votes
1answer
188 views

Building trust in automated front-end testing

I recently came across a Google Tech Talk during which the speakers seemed to stress that trust in a test suite is crucial to the overall software development process. Here the link. Can anyone share ...
6
votes
4answers
3k views

What are recommended scenarios to use Selenium Tests for?

My company is introducing BDD into our projects. Our customers have differents processes-cases wich also may fork at specific points. It is a mostly long and tedious work to test each case and each ...
6
votes
3answers
2k views

What aspects normally differ when developing automation framework in QTP VS Selenium

I have worked in Selenium. For developing Web UI Functional Test automation suite I considered below aspects Using TestNG Framework Using Page Object pattern XML based configuration Logging of ...
6
votes
2answers
3k views

QTP vs Selenium [closed]

I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
6
votes
4answers
2k views

Selenium2 assert questions

I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#. Although these may seem like simple questions, I've been searching for answers for ...
6
votes
4answers
2k views

what is the best way to write automated end to end user scenarios?

When automating user scenarios, we typically cover an end-to-end user flow. Unit testing recommends that each test method should be independant and only test one thing. But things are different in ...
6
votes
3answers
1k views

Attach to browser not spawned by Selenium2

One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
6
votes
3answers
1k views

Appium vs. AndroidDriver + IPhoneDriver in Mobile Automation Tests

I have been writing Selenium Browser automated tests and now I would like to begin writing mobile browser automated tests for Android and IPhone. I am deciding between the Appium framework and the ...
6
votes
3answers
793 views

What are the trade-offs of using page objects instead of a collection of functions in UI automation?

I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...
6
votes
2answers
386 views

In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?

With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
6
votes
2answers
1k views

Automated testing of Oracle Forms

What is the best test automation tool you'd recommend for testing Oracle Forms and why? Assuming a Windows desktop environment.
6
votes
1answer
542 views

PageObjects: Aggregation/Composition vs Inheritance for nested components

I need to refactor my Selenium tests, and was wondering what the best design solution would be for a portal with a hierarchical page organization. We are using tiles, and we have defined a baselayout ...
5
votes
2answers
809 views

What is the difference between Software Test Engineer, Test Automation Engineer and Software Developer in Test (SDET)?

Software Test Engineer usualy performs “manual” testing (without spending time on automating and supporting the tests). Usually is responsible to find all (as more as possible) critical bugs in the ...
5
votes
5answers
496 views

What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?

In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
5
votes
5answers
236 views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get ...
5
votes
5answers
351 views

Failed automated tests: how to distinguish known and newly introduced bugs?

Use case: Fitnesse is used for automated testing of the web site. SUT (software under test) contains a known bug. Say, we expect that web page contains "Changes saved successfully" string but this ...
5
votes
5answers
556 views

What are some good approaches to separating test data from test scripts?

We're working on test code (mainly UI tests with a few different tools). One thing that's really stumping me is how to best separate test data from test scripts. By test data, I mean values that get ...
5
votes
4answers
1k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
5
votes
4answers
392 views

How much coding do you do in building automated tests

I come out of quite a few years as a software engineering, but now I'm completely focused on testing. Our team has been trying to expand our automated tests and, to me, this means a lot of coding. I ...
5
votes
5answers
1k views

manual tester wanting to get into automation

So its been a year since I have been studying python, and just recently I started picking up webdriver. It was a long journey, and I am still pretty noob, but I finally understand how to use it lol. I ...
5
votes
4answers
2k views

Do you verify presence of text in your automated tests?

While automating multi locale application I had to stop using - assertTrue(selenium.isTextPresent("success text message")); where success text message would change for each locale. to - ...
5
votes
3answers
233 views

Is model-driven testing a viable technology for real applications yet?

Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
5
votes
1answer
695 views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
5
votes
6answers
2k views

Any personal experiences on EggPlant, cross platform and application automated testing tool?

As a cross platform, cross application automated testing system EggPlant looks too good to be true. Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
2answers
4k views

Solving “SeleneseTestCase is deprecated” issue

I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
5
votes
2answers
361 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
5
votes
4answers
595 views

Test case design standards- friend or foe?

Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
2answers
347 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...