Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.
4
votes
1answer
255 views
How to 'Mock' SVN
I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc.
What's a good way to get me started in terms of mocking the subversion client and working directory ...
2
votes
2answers
484 views
How can I select a file to put into a file_field without using the absolute path with Watir / Ruby?
For example, consider the following script:
require 'rubygems'
require 'watir-webdriver'
browser = Watir::Browser.new(:firefox)
browser.goto("http://tinypic.com/")
file = ...
6
votes
4answers
227 views
How do you design your test method/function
This question has been revolving on my mind from quite some time.
Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
14
votes
7answers
1k views
Does automating your manual tests give you good automated tests?
I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
9
votes
2answers
1k views
What are some tools for fuzz testing?
Fuzz Testing as defined by Wikipedia is:
a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer ...
5
votes
1answer
359 views
How do I write a script to be executed by Hudson to automatically restart test environment machines?
I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
4
votes
2answers
146 views
Is it worth investing much time into iteration testing?
I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
8
votes
2answers
1k views
How is Selenium different from other GUI automation tools?
I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
10
votes
8answers
262 views
Testing of automated scripts
How much testing of your automated scripts do people generally do?
Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
17
votes
7answers
657 views
What is meant by “Automated tests don't find new bugs”?
As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
6
votes
4answers
2k views
Selenium2 assert questions
I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#.
Although these may seem like simple questions, I've been searching for answers for ...
5
votes
2answers
262 views
What are the challenges around the integration of Manual and Automated Tests?
This is more a request for your professional opinion than a question...
We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
6
votes
3answers
455 views
What are the trade-offs of using page objects instead of a collection of functions in UI automation?
I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...
6
votes
2answers
731 views
Testing Distributed Systems
I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
14
votes
7answers
812 views
Has automated UI regression testing helped you in finding critical defects in system?
I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops).
Personally my automated tests have ...
8
votes
3answers
152 views
Testing Unfamiliar Software
One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
6
votes
2answers
357 views
In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?
With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
11
votes
6answers
782 views
How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?
Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
9
votes
4answers
213 views
Testing interactions with external systems
I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example.
On our online photo sharing application, we have, for example features which let ...
-1
votes
2answers
175 views
What would be a good test Orchestration tool for Python unit tests
what comes to mind is Make, or build.xml, but have not found a comprehensive Orchestration tool for python testing
3
votes
2answers
117 views
testing embedded asymmetric multiprocessing system
I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
13
votes
8answers
932 views
How do you calculate your return on investment on automated tests?
I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
3
votes
2answers
104 views
Approaches to Testing a Scientific Library
I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
13
votes
7answers
407 views
Are your UI automated tests dependent or ordered?
While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
1
vote
2answers
238 views
Can external object repository be used with dynamic objects?
I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
4
votes
5answers
219 views
Should end-to-end tests be self-contained?
I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
6
votes
3answers
1k views
Attach to browser not spawned by Selenium2
One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
9
votes
2answers
424 views
Maintaining automation framework for different browsers like IE and FF
How to maintain automation framework for different browsers like IE and FF?
In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
11
votes
7answers
460 views
Should QA be able to code tests?
Having a development background, I am convinced that record and replay testing tools have their drawbacks, especially by making tests brittle. See Automated Testing != Record-Playback Tool for a good ...
5
votes
5answers
619 views
What are the advantages of automated user acceptance tests?
I'm completely new to this stuff, and for what I've seen it takes a while to get used to it.
I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
12
votes
5answers
343 views
How to deal with automation naysayers?
In my team, there are a number of experienced QA people. I work mostly on developing tools to make the QA process easier for these guys, such as developing test automation.
The uptake has been slow, ...
6
votes
2answers
3k views
QTP vs Selenium [closed]
I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
