Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.
3
votes
2answers
3k views
Solving “SeleneseTestCase is deprecated” issue
I'm working through the "Selenium Simplified" book just to really gain a solid understanding of Selenium and Java. I know the basics of Java, but this one is frustrating me. I must be missing some ...
4
votes
2answers
786 views
Is drag-and-drop possible in watir-webdriver?
I would like to drag-and-drop one element to the position of another, triggered from within a watir-webdriver script.
By "drag-and-drop" I mean picking up a draggable element and releasing it on ...
2
votes
2answers
2k views
switching windows with Selenium2 and c# where popup window has same title as originating window
I've been attempting to figure this out for the past two days, unfortunately with no luck. I'm currently automating a scenario where a new window for a form is popped up from the main application ...
11
votes
3answers
453 views
What's the recommended practice for separating unit tests from integration tests for automated testing?
On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
5
votes
2answers
256 views
Where should test fixture code live?
I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
7
votes
5answers
383 views
Testing email generation
Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be ...
3
votes
2answers
2k views
Looking for a test tool for Flash-based web applications. Any ideas?
I'm looking for a Selenium-like tool to test Flash-based web applications (specifically a guided interview with questions and form fields that the user navigates through to produce a document at the ...
6
votes
2answers
89 views
Is there a way to identify that a Disk is removable ?
On windows XP/7, is there a way to identify from a script (never mind the script language being used) that a disk is not a network or fixed drive?
7
votes
4answers
253 views
Should unit tests be executed as part of a build?
I worked at a company where unit tests ran as part of the build. The build failed if the unit tests failed. What are the benefits and disadvantages of that practice?
8
votes
10answers
1k views
Tools for testing iPhone apps
I was wondering if there any automation tools out there that can help with the process of testing an iPhone application on the device itself and not on a simulator.
Ideally, it would have simulating ...
6
votes
8answers
286 views
Bugs keep reappearing in our GUI software during development. How should this be addressed?
We have a software product has a lot of usability features, and we're constantly changing it. We have issues with things like persisting scroll position which seem to get fixed, but then are broken ...
3
votes
3answers
3k views
Running Selenium test on TFS
I am currently working on implementing UI tests of .NET web application using Selenium RC.
The tests are now coming together and I am beginning to look at how these will be incorporated into TFS. ...
6
votes
10answers
315 views
Should a test method test only one condition?
While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
6
votes
2answers
1k views
What aspects normally differ when developing automation framework in QTP VS Selenium
I have worked in Selenium. For developing Web UI Functional Test automation suite I considered below aspects
Using TestNG Framework
Using Page Object pattern
XML based configuration
Logging of ...
3
votes
4answers
300 views
testing Touchscreen driver
I am testing a touch screen driver for an embedded device. Unfortunately it is tightly coupled to the hardware so simulated data can't be pushed in real time in order to simulate real usage.
Basic ...
8
votes
9answers
6k views
Best free (or very cheap) automation tool for Windows GUI testing?
I used to use vTask Studio, but it seems they've abandoned it. No updates in almost a year.
9
votes
4answers
182 views
If I didn't use TDD but want to transition to agile, should I go back and create those unit tests?
In an transitioning agile environment, if there was no Test Driven Development (no unit tests created), should you create unit tests to catch up on technical debt? And to what extent? Should they ...
4
votes
2answers
4k views
How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation
I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
5
votes
2answers
386 views
Testing Java or Silverlight plugins embedded in a page using Selenium?
We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
1
vote
1answer
531 views
Questions on Developing TestNG based automation for Java based web services
•
In case of .NET 2.0 ASMX you can post HTTP requests for the web service using HttpWebRequest and HttpWebResponse
•
Is this approach possible for java based web service as well, referring to ...
5
votes
1answer
750 views
Automated tests performed on Google Chrome?
I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
4
votes
1answer
784 views
What could cause a “command failed” error when using the Word.Application object to compare two documents?
I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences.
Sub CompareTest
Dim wrdApp
Dim ...
14
votes
11answers
7k views
Under what circumstances is Sikuli better for test automation than Selenium or Watir?
The Sikuli website says:
Sikuli is a visual technology to automate and test graphical user
interfaces (GUI) using images (screenshots).
Under what circumstances is Sikuli a better technology ...
3
votes
1answer
81 views
Multiple Assembly QA Systems?
I'm having difficulty deciding whether or not using multiple assemblies for a QA system is the right approach to take. Here are some important details:
The underlying system is a single assembly ...
4
votes
7answers
598 views
is it appropriate to do exception handling for every single test method?
I suppose there is exception handling available in all high level language. And I often find test method written as -
public void testLogin()
try{
testCtrl.type("loginText", "loginName");
...
3
votes
1answer
249 views
Using FitNesse with .Net across multiple servers
My previous work involved writing embedded Linux code. We used a couple of the embedded devices in a test harness, a Linux PC and the Windows Perforce repository. The Linux PC ran an instance of ...
11
votes
6answers
697 views
In agile (Scrum) practices, where do I start with making Q&A (testing) more efficient if the team is transitioning from waterfall to agile?
My team has recently transitioned from the traditional waterfall method to practicing Scrum. Being the QA lead, really the only tester on a small team, how can I get the process more aligned with ...
4
votes
2answers
293 views
match image with Selenium2
Not sure if I'm even asking this question correctly, however, here goes.
I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
3
votes
2answers
238 views
Selenium test timing out
I am facing a strange issue with Selenium RC. I have a test which runs perfectly fine when I run my selenium server manually on the default port. The test passes in seconds. However since my tests are ...
4
votes
1answer
256 views
How to 'Mock' SVN
I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc.
What's a good way to get me started in terms of mocking the subversion client and working directory ...
9
votes
13answers
622 views
Should automated tests be efficient?
I've written and edited a bunch of automated GUI tests. In some cases, the tests are inefficient (eg to select an item from a list, instead of a clever search, a dialog is opened and starting fro the ...
7
votes
3answers
2k views
Good Watir or Watir-Webdriver tutorials/resources for new-to-automation testers?
There are at least two really good books for Selenium beginners, and quite a few courses/tutorials out there, as well as a lot of blogs.
However, I haven't seen quite as much out there for Watir - ...
6
votes
4answers
227 views
How do you design your test method/function
This question has been revolving on my mind from quite some time.
Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
4
votes
4answers
2k views
Selenium.click not working on some anchor elements
The application that am working on was recently revamped and as part of that a new JQuery calendar was introduced. I need to click on a link in the calendar to select the time and date. However, ...
5
votes
3answers
207 views
Is model-driven testing a viable technology for real applications yet?
Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
9
votes
11answers
1k views
What are good guidelines to determine when to automate a test?
When it comes to test automation, I use a very arbitrary method based on experience that 80% of all tests should be automated.
This has worked well in practice, but is based more on "voodo" than ...
2
votes
2answers
489 views
How can I select a file to put into a file_field without using the absolute path with Watir / Ruby?
For example, consider the following script:
require 'rubygems'
require 'watir-webdriver'
browser = Watir::Browser.new(:firefox)
browser.goto("http://tinypic.com/")
file = ...
2
votes
2answers
96 views
System for keeping track of regressions reported by RSpec
In a large set of tests written for RSpec there are some tests who are expected to fail (at least, for a couple more months). These known failures makes it difficult to sort through the results ...
14
votes
7answers
1k views
Does automating your manual tests give you good automated tests?
I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
4
votes
2answers
146 views
Is it worth investing much time into iteration testing?
I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
3
votes
1answer
2k views
Can the base-url be changed in the same browser session using Selenium RC?
Suppose I login to evernote.com using Selenium RC. Is it possible for me to change the base_url to google.com while staying on the same page. I do not want to open a new browser for google.com. When I ...
9
votes
2answers
1k views
What are some tools for fuzz testing?
Fuzz Testing as defined by Wikipedia is:
a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer ...
11
votes
8answers
5k views
Whether to choose Selenium over Watir or Lightweight Test Automation when testing web applications created using c sharp?
I am currently researching testing frameworks to test c sharp developed web applications. I have been leaning more towards the use of Selenium over Watir or Lightweight Test Automation but hesitant ...
5
votes
1answer
360 views
How do I write a script to be executed by Hudson to automatically restart test environment machines?
I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
8
votes
2answers
1k views
How is Selenium different from other GUI automation tools?
I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
5
votes
2answers
384 views
Behaviour Driven Development with JavaScript
Are there any approaches and tools for driving the development of JavaScript with BDD. I know that I can do this through the UI with tools like Selenium, but is there any tool that can allow this to ...
5
votes
2answers
262 views
What are the challenges around the integration of Manual and Automated Tests?
This is more a request for your professional opinion than a question...
We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
10
votes
4answers
935 views
What is the difference between “automated testing” and “automated regression testing”?
"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
10
votes
8answers
262 views
Testing of automated scripts
How much testing of your automated scripts do people generally do?
Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
8
votes
3answers
152 views
Testing Unfamiliar Software
One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
