Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.
4
votes
5answers
237 views
What Are Some Unobvious Differences Between Testing a Web Application and a Desktop Application?
In the same flavour of this question, what are some unobvious differences between testing a web application and a desktop application? I've recently started looking at automating some GUI tests for a ...
4
votes
7answers
617 views
is it appropriate to do exception handling for every single test method?
I suppose there is exception handling available in all high level language. And I often find test method written as -
public void testLogin()
try{
testCtrl.type("loginText", "loginName");
...
4
votes
3answers
176 views
Automation engineers- general purpose vs. dedicated
As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers.
On the one hand software engineers, or programmers, can write great automation ...
4
votes
5answers
221 views
Should end-to-end tests be self-contained?
I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
4
votes
4answers
227 views
Where to focus testing? On integration level or unit level?
Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
5answers
299 views
What proportion of different types of software testing does your team use?
Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :)
I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
4
votes
4answers
333 views
Looking for open source, Java-based tool for performance testing
Goal:
I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https.
My findings:
...
4
votes
4answers
314 views
How to test the test scripts?
Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
3answers
151 views
How do I automate “service-level” testing for a GUI app
I have extensive experience automating GUI testing with tools like TestComplete or Microsoft's CodedUI. However, I am trying to get out of the game of testing at the UI layer and instead would like to ...
4
votes
2answers
682 views
Good resources/tutorials/tips for beginner doing automation?
I've just started automating all the tests our team has (~5000). I'm using Telerik Test Studio for the Silverlight automation. I have some tests written, but I'm quickly realizing that with each test ...
4
votes
5answers
249 views
Do Academic Researchers in Automated Software Testing Believe All Testing Can Be 100% Automated?
While surfing today, I found this article on attitudes on automated software testing among academics and practitioners. Since I am currently an automated tester in industry, I agree with the ...
4
votes
2answers
219 views
Test isolation and automation
We are using Selenium webservices for our automated functional testing .
I have a test which tests creation of some objects. If I run the same test again, I need to make sure that each test has a ...
4
votes
2answers
448 views
What's the best approach to asserting values with automation testing test cases from complex business logic?
Suppose you have automation tests (my example uses Selenium) to assert complex business logic for a web site. What is the best way to assert that thousands of different test cases are outputting the ...
4
votes
4answers
2k views
What are recommended scenarios to use Selenium Tests for?
My company is introducing BDD into our projects. Our customers have differents processes-cases wich also may fork at specific points. It is a mostly long and tedious work to test each case and each ...
4
votes
4answers
185 views
Is there an industry-standard term for choosing which tests to run?
I have been searching for information on mapping tests to code changes but I haven't had any luck. I suspect that there is some industry standard term that would have better google-juice.
Suppose you ...
4
votes
1answer
258 views
How to 'Mock' SVN
I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc.
What's a good way to get me started in terms of mocking the subversion client and working directory ...
4
votes
2answers
148 views
Is it worth investing much time into iteration testing?
I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
4
votes
2answers
208 views
How to make sure your test data are correct?
We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
4
votes
5answers
496 views
Statistics about Success of Test Automation
I'm looking for some statistical data on the success and failure of system test automation projects. I'm especially interested in the reasons of failed approaches. Can anyone help?
4
votes
1answer
809 views
What could cause a “command failed” error when using the Word.Application object to compare two documents?
I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences.
Sub CompareTest
Dim wrdApp
Dim ...
4
votes
2answers
4k views
How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation
I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
4
votes
4answers
416 views
How to add screen shot for pass status in UI Automation
Right now as per default setting I am able to get screen shot for failed status but not for pass, per as per the requirement I need to attach for pass as well.
Any one please suggest any framework or ...
4
votes
2answers
222 views
What's the most efficient way to run lots of tests?
Here's my current setup:
Compile on teamcity
Copy the dlls to 8 agents and run tests simaltaniousisly (via snapshot dependencies)
Finally taper them in to a single 'publish' build configuration.
...
4
votes
2answers
810 views
Is drag-and-drop possible in watir-webdriver?
I would like to drag-and-drop one element to the position of another, triggered from within a watir-webdriver script.
By "drag-and-drop" I mean picking up a draggable element and releasing it on ...
4
votes
2answers
296 views
match image with Selenium2
Not sure if I'm even asking this question correctly, however, here goes.
I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
4
votes
4answers
1k views
Testing Page Layout with webdriver
Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension().
Shouldn't these two methods be enough for testing ...
4
votes
3answers
1k views
Is Eggplant any good for image capture and image recognition?
As a software tester looking at different automated testing solutions, I need a tool that will interact with a heavily graphical interface such as a flash website or application.
I want the tool to ...
4
votes
4answers
637 views
What are the good free mouse and keyboard automation programs?
I know about autoit and about autohotkey but I am not sure that they are the same.
What other good automation programs are there?
Should I use different programs for automatic browser mouse clicks and ...
4
votes
2answers
273 views
Best practices to test PowerShell cmdlets?
What are the best practices to test PowerShell cmdlets? The cmdlets I'm testing are writting data into a DB.
I am currently using:
Pairwise to go through most of the combinations
Check that get == ...
4
votes
2answers
378 views
how to implement a given logged in user role through UI automation?
As suggested on StackOverflow I am posting this question here as well.
I am having trouble how to implement the Given step (with SpecFlow for example) of a logged in user role throught Web UI ...
4
votes
4answers
2k views
Selenium.click not working on some anchor elements
The application that am working on was recently revamped and as part of that a new JQuery calendar was introduced. I need to click on a link in the calendar to select the time and date. However, ...
4
votes
5answers
234 views
Recommendations for code coverage tools?
I have a wishlist for code coverage tools and am wondering if people could recommend some tools that fulfill all or many of my wishes. I am starting my search for tools that work specifically with ...
4
votes
1answer
131 views
Can I (in Eclipse/java) automate the logging of all enters and leaves into or out of all functions, including library ones?
While comparing the run of my wizard and a similar standard one, I have to check all entrances into all functions for both cases. Is there some tool that can automate the process? I can't do it by ...
4
votes
3answers
556 views
Does the latest version of QTP have something similar to Selenium Grid?
Does anyone know whether QTP supports parallel test execution on multiple browsers now? I am looking for something similar to Selenium Grid.
4
votes
2answers
193 views
Tool for Virtual machine Test Orchestration
What would be a good Orchestration tool for Triggering tests in Virtual Machine? Basically I want to trigger multiple parallel VM's to run automated tests. The tool should also have queuing mechanism.
...
4
votes
1answer
223 views
PHP: code instrumentation library to capture/record new unit test cases?
I have a library that seems to work as intended. I would like to add some instrumentation to the library to capture (some) current input and the result and save that as a test case. Is there a library ...
4
votes
3answers
163 views
Is there a commonly used functional test runner/reporter that is lightweight/simple?
Functional tests come in all shapes and sizes. Is there a class of lightweight, simple to use, tools that will discover, run and report on all tests found in a directory? I'm looking for something ...
4
votes
2answers
686 views
Writing automated tests for System.Web.HttpApplication
I am currently using Moq to write automated tests for System.Web.HttpApplication in C#:
public FakeHttpApplication CreateBaseMocks()
{
MockContext = new Mock<HttpContextBase>();
...
4
votes
1answer
184 views
Recommended Generic profiling techniques for quality assurance on HTML integration
All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website.
Are there ...
3
votes
5answers
1k views
Which language gives better career options: TCL or PERL?
I am an engineer with 1.5 years of experience in Test Automation in Perl. I am getting chance to work in TCL. I am little worried about my career growth. I don't know whether TCL also has the same ...
3
votes
6answers
298 views
Test Automation in Agile?
Since Agile is iterative and many test-last tools are record and playback-style, and therefore can't really be applied in an Agile environment, this brings up a few issues.
the target for test is ...
3
votes
3answers
858 views
What are the test cases or test scenarios for palindrome
In the interview, the employer asked me to write test cases or test scenarios to check the Palindrome of the word.
I said one with positive test case and another with negative test cases. But employer ...
3
votes
6answers
2k views
Is mail testing with selenium possible?
We have merely just had a kick off meeting for a new project that i am required to automate and ASAP. The project is essentially a "mailbox project",if you will,and i have no idea as to where to start ...
3
votes
6answers
347 views
What testing procedures/software would you recommend?
My office doesn't currently have any kind of automated testing or anything that runs on our web site updates prior to release. We really need something. I'm not entirely sure what options are ...
3
votes
4answers
275 views
manual tester wanting to get into automation
So its been a year since I have been studying python, and just recently I started picking up webdriver. It was a long journey, and I am still pretty noob, but I finally understand how to use it lol. I ...
3
votes
4answers
2k views
Downloading a file in Internet Explorer through Selenium
I have to automate a case in which I have to download an Excel file using Selenium IDE.I have done this in Firefox by using custom profile feature which automatically downloads file and saves it into ...
3
votes
1answer
335 views
Your suggestions for writing reliable Web UI automation
Web UI automation is unreliable. I presume it is possible to increase the reliability of Web UI tests. One such advice would be to put an abstraction layer on top of your test that does actual DOM ...
3
votes
4answers
496 views
Automating email verification feature of an application?
I'm helping to automate an new web application, part of this application requires email verification. What are the industry standards for automating the black hole known as "email"?
What I'm trying to ...
3
votes
4answers
210 views
How would I unit test these functions?
I have the following functions :
Get(ds,filename) - gets a file from a data source ds.
Put(ds,filename) - puts a file into a data source ds.
List(ds) - lists all files in data source ds.
...
3
votes
1answer
293 views
Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass
I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework.
When I run each test by itself, ...
