Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in ...
7
votes
3answers
175 views
USB storage emulator
I need to emulate insertion and removal of SD cards to write tests. What is the best way/tool to implement it in .NET?
7
votes
1answer
524 views
Continuous Integration and testing environment and configuration for Android
I am an Android developer but I am not satisfied with my testing and Continuous Integration environment and configuration.
Someone could recommend me how to configure the best setup and workflow for ...
7
votes
1answer
337 views
Test Automation for SAP
I'm evaluating a number of test automation framworks to implement on a SAP project.
Right now I'm looking at
Fitnesse, which we believe we can write some fixtures for, to call SAP
Green Hat, which ...
6
votes
10answers
314 views
Should a test method test only one condition?
While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
6
votes
8answers
286 views
Bugs keep reappearing in our GUI software during development. How should this be addressed?
We have a software product has a lot of usability features, and we're constantly changing it. We have issues with things like persisting scroll position which seem to get fixed, but then are broken ...
6
votes
4answers
187 views
How can my team move away from record-and-playback when not everyone has scripting experience?
(Inspired by this question)
My team is currently doing automated testing via our tool's record-and-playback function. I've read about the benefits of developing a more robust test solution via ...
6
votes
9answers
352 views
How do I satisfy external auditors that automated tests are at least as effective as manual tests?
My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
6
votes
7answers
247 views
Should tool generated test data be deleted during tear down in test automation?
I have seen this recommendation many times that tear down is supposed to clear test data which is created during tests. This is supposed to avoid interference with any future tests. For example ...
6
votes
2answers
89 views
Is there a way to identify that a Disk is removable ?
On windows XP/7, is there a way to identify from a script (never mind the script language being used) that a disk is not a network or fixed drive?
6
votes
4answers
227 views
How do you design your test method/function
This question has been revolving on my mind from quite some time.
Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
6
votes
2answers
3k views
QTP vs Selenium [closed]
I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
6
votes
4answers
2k views
Selenium2 assert questions
I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#.
Although these may seem like simple questions, I've been searching for answers for ...
6
votes
2answers
1k views
What aspects normally differ when developing automation framework in QTP VS Selenium
I have worked in Selenium. For developing Web UI Functional Test automation suite I considered below aspects
Using TestNG Framework
Using Page Object pattern
XML based configuration
Logging of ...
6
votes
3answers
1k views
Attach to browser not spawned by Selenium2
One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
6
votes
3answers
453 views
What are the trade-offs of using page objects instead of a collection of functions in UI automation?
I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...
6
votes
2answers
357 views
In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for “hand coded” scripts?
With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
6
votes
2answers
722 views
Automated testing of Oracle Forms
What is the best test automation tool you'd recommend for testing Oracle Forms and why? Assuming a Windows desktop environment.
6
votes
1answer
1k views
Is Selenium's LoadableComponent a good solution as test design pattern?
I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
6
votes
2answers
726 views
Testing Distributed Systems
I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
5
votes
5answers
205 views
How to deal with automated test cases that always fail?
I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get ...
5
votes
3answers
2k views
Is Selenium the right tool for browser compatibility testing?
I have been seeing a lot of customers pushing for browser compatibility testing using Selenium. Was wondering whether this is really necessary. The push is mostly due to Selenium grid supporting multi ...
5
votes
5answers
300 views
Failed automated tests: how to distinguish known and newly introduced bugs?
Use case: Fitnesse is used for automated testing of the web site.
SUT (software under test) contains a known bug. Say, we expect that web page contains "Changes saved successfully" string but this ...
5
votes
7answers
262 views
Techniques for test selection, give a large suite of test cases
I have a huge collection of test cases (inputs). I'd like to select a small subset that's likely to catch most of the bugs. Are there any standard or known techniques in the testing literature for ...
5
votes
5answers
616 views
What are the advantages of automated user acceptance tests?
I'm completely new to this stuff, and for what I've seen it takes a while to get used to it.
I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
5
votes
5answers
356 views
I want to enter the SQA field specifically automation
I am working hourly for low wage as a QA intern/tester. I want to learn more about this field. I have already graduated, so everything I have learned is self taught or learned somehow on the job. At ...
5
votes
4answers
1k views
Do you verify presence of text in your automated tests?
While automating multi locale application I had to stop using -
assertTrue(selenium.isTextPresent("success text message"));
where success text message would change for each locale.
to -
...
5
votes
3answers
207 views
Is model-driven testing a viable technology for real applications yet?
Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
5
votes
6answers
1k views
Any personal experiences on EggPlant, cross platform and application automated testing tool?
As a cross platform, cross application automated testing system EggPlant looks too good to be true.
Has anyone implemented a large automated testing project using it and what were your experiences?
5
votes
4answers
399 views
Test case design standards- friend or foe?
Currently we use an agile team based approach to testing, where each team is responsible for their specific area of a product. While we have found this to be effective and easily manageable, over ...
5
votes
4answers
156 views
How to keep track of the features in a website for impact analysis?
I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
3answers
268 views
How to avoid redundant tests
We are building an application using a completely test-driven approach. As developers, we are very familiar with unit tests but haven't been exposed to integrated / functional / acceptance tests. ...
5
votes
2answers
378 views
Behaviour Driven Development with JavaScript
Are there any approaches and tools for driving the development of JavaScript with BDD. I know that I can do this through the UI with tools like Selenium, but is there any tool that can allow this to ...
5
votes
2answers
261 views
What are the challenges around the integration of Manual and Automated Tests?
This is more a request for your professional opinion than a question...
We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
5
votes
2answers
173 views
What test generators do exist?
What tools exist to automatically generate test scripts (or test script templates) from a formal specification or a program's source code?
EDIT:
The background of this question is, that I’m ...
5
votes
4answers
793 views
what is the best way to write automated end to end user scenarios?
When automating user scenarios, we typically cover an end-to-end user flow.
Unit testing recommends that each test method should be independant and only test one thing.
But things are different in ...
5
votes
3answers
671 views
Is there a successful approach to automating security testing?
My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
5
votes
2answers
254 views
Where should test fixture code live?
I'm working in a primarily Windows / .NET system. I've written a test framework in C# that includes a test harness that runs fixtures (anything that implements the ITestFixture interface). These ...
5
votes
3answers
329 views
How do I educate that it's not test automation framework?
The term "Test Automation Framework" is become a cliche in automated testing.
I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
5
votes
4answers
167 views
How common is testing based on log files analysis?
Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory:
http://compass.informatik.rwth-aachen.de/ws-slides/havelund.pdf
I found the approach of log files ...
5
votes
1answer
746 views
Automated tests performed on Google Chrome?
I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
1answer
211 views
What are the tiers of testing that should be done on a large scale distributed system?
Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
93 views
Is there a good way to structure my test code so I don't have to duplicate tests for different browsers using WatiN
In my WatiN tests I am currently structuring the test like this:
[TestMethod]
public void Failed_Attempted_Login_Invalid_Combination()
{
using (var browser = new IE(baseUrl + "login.aspx"))
{
...
5
votes
1answer
4k views
How to use Selenium's PageFactory annotations with dynamic loaded elements?
I'm rewriting some Selenium tests according to the page object design pattern taking advantage of Seleniums' annotations. My problem is that I have some html select elements whose option elements are ...
5
votes
1answer
357 views
How do I write a script to be executed by Hudson to automatically restart test environment machines?
I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
5
votes
1answer
83 views
Automating form dealing with large number of element
This is more of test design question than pure Selenium question.
I have a form in my application and while following page object pattern I wrote a method which has many parameters -
...
5
votes
2answers
384 views
Testing Java or Silverlight plugins embedded in a page using Selenium?
We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
5
votes
0answers
105 views
How have Guava unit tests been generated automatically?
Guava library for Java has unit test cases automatically generated:
Guava has staggering numbers of unit tests: as of July 2012, the
guava-tests package includes over 286,000 individual test ...
4
votes
5answers
229 views
What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?
In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
4
votes
7answers
591 views
is it appropriate to do exception handling for every single test method?
I suppose there is exception handling available in all high level language. And I often find test method written as -
public void testLogin()
try{
testCtrl.type("loginText", "loginName");
...
4
votes
3answers
175 views
Automation engineers- general purpose vs. dedicated
As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers.
On the one hand software engineers, or programmers, can write great automation ...
