Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Under the right circumstances, it can allow for faster testing with fewer ...

learn more… | top users | synonyms (2)

4
votes
5answers
169 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
3answers
214 views

Automation engineers- general purpose vs. dedicated

As part of our recent recruiting effort we need to decide on the best approach for choosing automation engineers. On the one hand software engineers, or programmers, can write great automation ...
4
votes
4answers
280 views

Where to focus testing? On integration level or unit level?

Consider a modern web application that serves JSON through a REST API to a rich Javascript-based application with one or more single-page apps within it. Our own application is written using Angular ...
4
votes
3answers
1k views

How do I automate “service-level” testing for a GUI app

I have extensive experience automating GUI testing with tools like TestComplete or Microsoft's CodedUI. However, I am trying to get out of the game of testing at the UI layer and instead would like to ...
4
votes
3answers
2k views

MS-SQL server sql test automation

I'm looking to create a batch of automated tests in SQL on MS-SQL server, these will include tests like - insert some records, call stored procedure, check certain conditions in various tables. There ...
4
votes
3answers
114 views

Is it reasonable to use Selenium RC over WebDriver if the former seems more suitable for the task?

The tests I am doing are on IE8, which is used throughout the company, and doesn't look to be changing any time soon. After testing both pieces of software with the system, it seemed as though ...
4
votes
4answers
427 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
3answers
160 views

How do you test your unit-tests for false negatives?

How do you test your unit-tests for false negatives (tests that pass but should have failed). For example, I am writing a mission-critical class in JavaScript. To make sure every little nook and ...
4
votes
5answers
319 views

Do Academic Researchers in Automated Software Testing Believe All Testing Can Be 100% Automated?

While surfing today, I found this article on attitudes on automated software testing among academics and practitioners. Since I am currently an automated tester in industry, I agree with the ...
4
votes
2answers
1k views

What's the best approach to asserting values with automation testing test cases from complex business logic?

Suppose you have automation tests (my example uses Selenium) to assert complex business logic for a web site. What is the best way to assert that thousands of different test cases are outputting the ...
4
votes
2answers
250 views

Test isolation and automation

We are using Selenium webservices for our automated functional testing . I have a test which tests creation of some objects. If I run the same test again, I need to make sure that each test has a ...
4
votes
3answers
14k views

List and role of different types of testing environments

There are numerous of different testing environments that I have come across with, and ALL of them seem pretty useful and helpful but which ones are necessary. For example ... I have seen: ...
4
votes
2answers
115 views

Fixed vs Dynamic AUT

We develop automated user interface tests. The application under test is quite complex and it can be configured by the user (the real user) in many ways. Our tests to be automated are quite complex as ...
4
votes
4answers
205 views

Is there an industry-standard term for choosing which tests to run?

I have been searching for information on mapping tests to code changes but I haven't had any luck. I suspect that there is some industry standard term that would have better google-juice. Suppose you ...
4
votes
1answer
371 views

How to 'Mock' SVN

I am testing an app that does some subversion interactions, such as comitting, adding, stat, etc. What's a good way to get me started in terms of mocking the subversion client and working directory ...
4
votes
2answers
194 views

Is it worth investing much time into iteration testing?

I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
4
votes
2answers
280 views

Resources for test automation

I'm trying to learn more about test automation as it relates to the QA process and there just doesn't seem to be a lot of resources out there. For example, if I do a search for TestComplete (a tool ...
4
votes
5answers
907 views

Statistics about Success of Test Automation

I'm looking for some statistical data on the success and failure of system test automation projects. I'm especially interested in the reasons of failed approaches. Can anyone help?
4
votes
2answers
968 views

To mock or not to mock with 'Automated Acceptance Tests'

I have been reading alot about automated acceptance testing. However, I have not found any information about how to manage external dependencies. Let's say you have a web application that acts like a ...
4
votes
3answers
8k views

How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation

I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
4
votes
3answers
2k views

Is Eggplant any good for image capture and image recognition?

As a software tester looking at different automated testing solutions, I need a tool that will interact with a heavily graphical interface such as a flash website or application. I want the tool to ...
4
votes
5answers
862 views

How to add screen shot for pass status in UI Automation

Right now as per default setting I am able to get screen shot for failed status but not for pass, per as per the requirement I need to attach for pass as well. Any one please suggest any framework or ...
4
votes
2answers
354 views

match image with Selenium2

Not sure if I'm even asking this question correctly, however, here goes. I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
4
votes
4answers
301 views

Automation and bypassing Google No CAPTCHA reCAPTCHA

My client want to use Google's No CAPTCHA reCAPTCHA (NCRC) to prevent robots completing an application. QA have automated this process, but if the business introduce NCRC into the form, then this ...
4
votes
7answers
861 views

Manual QA looking to get into Automated Testing (no programming background)

I currently work at an ad agency as a Manual QA. I originally came in to act on the business side but kind of 'fell in to' the job. I do not have a programming background but I am very interested in ...
4
votes
4answers
532 views

What are the available multi platform test tools available for native mobile applications?

I'm trying to push my organisation into more modern ways of testing our mobile software, thus I'm trying to build a list of tools that I can use to present to my line manager and his bosses. By ...
4
votes
1answer
513 views

Automated Test Management: Running, Saving Results, Querying, etc

The team I am currently working with has a very large application to test (several custom programs, running in a distributed environment), and has built up a very large set of automated test cases for ...
4
votes
4answers
1k views

What are the good free mouse and keyboard automation programs?

I know about autoit and about autohotkey but I am not sure that they are the same. What other good automation programs are there? Should I use different programs for automatic browser mouse clicks and ...
4
votes
2answers
402 views

Best practices to test PowerShell cmdlets?

What are the best practices to test PowerShell cmdlets? The cmdlets I'm testing are writting data into a DB. I am currently using: Pairwise to go through most of the combinations Check that get == ...
4
votes
2answers
574 views

how to implement a given logged in user role through UI automation?

As suggested on StackOverflow I am posting this question here as well. I am having trouble how to implement the Given step (with SpecFlow for example) of a logged in user role throught Web UI ...
4
votes
2answers
287 views

Selenium test timing out

I am facing a strange issue with Selenium RC. I have a test which runs perfectly fine when I run my selenium server manually on the default port. The test passes in seconds. However since my tests are ...
4
votes
2answers
585 views

key points for choosing a framework in selenium webdriver - Java

My query is related to this Choosing framework type for selenium RC/Webdriver I am a beginner in Selenium and want to know how to select or choose a framework in Selenium Webdriver. What are the key ...
4
votes
2answers
1k views

How to build a Testing Virtual lab using VMs,Vagrant,Puppet,Chef etc

My team of testers and me have a big collection of functional tests (written in python and run with pytest). The thing is that all the tests are run on a single testing server, an ubuntu VPS with ...
4
votes
2answers
727 views

Running automated tests for Unity apps on iOS/Android devices?

I want to run automated tests for a game that I am developing with Unity. It runs on iOS and Android devices. As a first step we would like to Launch the game on device type X If the game loaded on ...
4
votes
6answers
961 views

Recommendations for code coverage tools?

I have a wishlist for code coverage tools and am wondering if people could recommend some tools that fulfill all or many of my wishes. I am starting my search for tools that work specifically with ...
4
votes
2answers
240 views

Can I (in Eclipse/java) automate the logging of all enters and leaves into or out of all functions, including library ones?

While comparing the run of my wizard and a similar standard one, I have to check all entrances into all functions for both cases. Is there some tool that can automate the process? I can't do it by ...
4
votes
3answers
948 views

Does the latest version of QTP have something similar to Selenium Grid?

Does anyone know whether QTP supports parallel test execution on multiple browsers now? I am looking for something similar to Selenium Grid.
4
votes
2answers
235 views

Tool for Virtual machine Test Orchestration

What would be a good Orchestration tool for Triggering tests in Virtual Machine? Basically I want to trigger multiple parallel VM's to run automated tests. The tool should also have queuing mechanism. ...
4
votes
2answers
80 views

Tool for automatic GUI testing of Gupta Windows applications?

I'm searching for (a) tool(s) to write and execute automatic GUI testing of Windows 7 applications written with Gupta Team Developer. We got "QTP" here but its main problem is that it can't identify ...
4
votes
2answers
328 views

Can LDTP automate Qt-based applications?

We are building an application, which is based on Qt 4.8 on Windows. I have been looking for an automation tool which is cross-platform and should be able to automate my application. I have read a few ...
4
votes
2answers
433 views

Mocking IVR system

I am new to automation testing and was looking for guidance on how I can mock or create a simulator for a IVR ( automated call system ). We have an application, which sends some user data to a third ...
4
votes
3answers
684 views

How do I simulate a right click using Selenium 2 and PHPUnit?

I am trying to execute a functional test using Selenium 2 and PHPUnit. In the class 'Selenium2TestCase.php', I found this code: class PHPUnit_Extensions_Selenium2TestCase_SessionCommand_Click ...
4
votes
1answer
317 views

PHP: code instrumentation library to capture/record new unit test cases?

I have a library that seems to work as intended. I would like to add some instrumentation to the library to capture (some) current input and the result and save that as a test case. Is there a library ...
4
votes
3answers
189 views

Is there a commonly used functional test runner/reporter that is lightweight/simple?

Functional tests come in all shapes and sizes. Is there a class of lightweight, simple to use, tools that will discover, run and report on all tests found in a directory? I'm looking for something ...
4
votes
2answers
1k views

Writing automated tests for System.Web.HttpApplication

I am currently using Moq to write automated tests for System.Web.HttpApplication in C#: public FakeHttpApplication CreateBaseMocks() { MockContext = new Mock<HttpContextBase>(); ...
3
votes
6answers
438 views

What do you need to be a great QA Analyst?

I have little to no experience about QA. I was moved within my company from another department nothing to do with IT. If you could tell me one thing that you would consider necessary for me to know, ...
3
votes
10answers
7k views

Is mail testing with selenium possible?

We have merely just had a kick off meeting for a new project that I am required to automate ASAP. The project is essentially a "mailbox project", if you will, and I have no idea as to where to start ...
3
votes
3answers
238 views

URL Verification software

I need to find a program that can take a list of url's and actually run them to see where they go. For example: Take - www.example.com and see if it goes to www.example.com (no error/redircts) or if ...
3
votes
4answers
16k views

Downloading a file in Internet Explorer through Selenium

I have to automate a case in which I have to download an Excel file using Selenium IDE.I have done this in Firefox by using custom profile feature which automatically downloads file and saves it into ...
3
votes
5answers
327 views

How to manage a lot of automated test cases

We are a team of 8 QA Analysts. We have automated more than 3,000 test cases for our application. As this number grows bigger and bigger, we are having issues controlling tests that are already ...