Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions.

learn more… | top users | synonyms (2)

6
votes
2answers
2k views

Good resources/tutorials/tips for beginner doing automation?

I've just started automating all the tests our team has (~5000). I'm using Telerik Test Studio for the Silverlight automation. I have some tests written, but I'm quickly realizing that with each test ...
5
votes
1answer
685 views

Your suggestions for writing reliable Web UI automation

Web UI automation is unreliable. I presume it is possible to increase the reliability of Web UI tests. One such advice would be to put an abstraction layer on top of your test that does actual DOM ...
10
votes
5answers
384 views

What Are Some Examples of Why Explicit Sleep Statements Are Bad

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
14
votes
2answers
861 views

Good resources for building a QA team

Our corporation has, up until this point, largely lacked a 'quality mentality' of any kind. From no testers, they went to two testers - but 5 or 6 product teams still rely on a mix of developer and ...
16
votes
14answers
11k views

Compare screenshots of rendered web pages

In my team, we use Selenium for automation of functional testing. We also do a lot of manual regression testing to make sure the appearance of the rendered web pages is ok. I would like to develop a ...
16
votes
7answers
824 views

Are your UI automated tests dependent or ordered?

While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
6
votes
7answers
518 views

Techniques for test selection, give a large suite of test cases

I have a huge collection of test cases (inputs). I'd like to select a small subset that's likely to catch most of the bugs. Are there any standard or known techniques in the testing literature for ...
6
votes
2answers
4k views

QTP vs Selenium [closed]

I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
5
votes
2answers
265 views

Recommended Generic profiling techniques for quality assurance on HTML integration

All of our software projects are web based and many include the production of HTML templates (example pages) that then need to be integrated into a working software system or website. Are there ...
3
votes
7answers
5k views

Is mail testing with selenium possible?

We have merely just had a kick off meeting for a new project that I am required to automate ASAP. The project is essentially a "mailbox project", if you will, and I have no idea as to where to start ...
4
votes
3answers
6k views

How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation

I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
3
votes
4answers
235 views

What tools work well for automating .NET 4.0 web sites using web forms with dynamic data?

What would be the best solution to accommodate automated testing of web forms with code-behind (.NET 4.0)? Specifically, we need a solution that can automate web form testing and handle dynamic data ...
2
votes
2answers
136 views

Strategies for automating testing on features that are only on certain environments

Say we have a dev environment, an integration, a pre-production and a production environment. We have features A-G that are on everything, while new feature H is on dev+int only, so far. We want to ...
1
vote
3answers
376 views

Where should I create a coded UI project?

Should Coded UI tests be within the solution that they are testing (similar to Unit Tests), or should they be contained in a separate, generic Coded UI solution that is built only once and executed ...
0
votes
4answers
359 views

Selenium - advantages and disadvantages of using Python vs C#

We currently have two teams. An automation team and also a web testing team. The automation team currently use Selenium and C# to automate tests on our web applications and legacy systems. As a ...
0
votes
3answers
84 views

How is Selenium RC different from Selenium Web driver and some good pointers for a naive beginner to learn to scripting please? Thanks!

I am a manual functional tester and I am keen on shifting my career from Manual testing to Automation testing using Selenium. What is the best way to begin with this goal of mine? Thanks!
10
votes
9answers
3k views

What is a good website to hack around using Selenium?

I want to learn Selenium, but I don't know what to code. Sure, I can throw Google some queries, I can fill out some forms, press buttons, find divs and links, etc. But I think this stuff is pretty ...
12
votes
7answers
2k views

Transition from all manual testing to automated testing

Right now my company only does manual testing. We've talked about starting some automated testing for a while but it hasn't taken off at all. It seems like automated testing would be a good way to ...
9
votes
10answers
20k views

Best free (or very cheap) automation tool for Windows GUI testing?

I used to use vTask Studio, but it seems they've abandoned it. No updates in almost a year.
17
votes
14answers
10k views

What programming languages are good for novice testers to learn?

I'm looking for a programming language to recommend to a friend considering teaching herself software testing. I have a friend who is interested in learning software testing, and I believe strongly ...
15
votes
7answers
2k views

Does automating your manual tests give you good automated tests?

I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
12
votes
5answers
2k views

What is the difference between “automated testing” and “automated regression testing”?

"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
9
votes
11answers
3k views

What are good guidelines to determine when to automate a test?

When it comes to test automation, I use a very arbitrary method based on experience that 80% of all tests should be automated. This has worked well in practice, but is based more on "voodo" than ...
12
votes
7answers
1k views

Is it realistic to try to hire someone who is a developer and a tester?

I've been trying to hire a tester for a few months without success. I really want to find someone who is both a tester and a developer, not because I want them to do two roles, but because the kind of ...
5
votes
4answers
2k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
5
votes
2answers
417 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
17
votes
7answers
1k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
14
votes
10answers
3k views

Can every test be done by automation?

Can every test be done by automation? Or is there anything that cannot be done by automation?
6
votes
5answers
2k views

Manual tester wanting to get into automation

So its been a year since I have been studying python, and just recently I started picking up webdriver. It was a long journey, and I am still pretty noob, but I finally understand how to use it lol. I ...
5
votes
1answer
327 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
5
votes
1answer
519 views

Test Automation Design Question

I am analyzing automation design for a web app UI Layer Web Service Layer DB Layer Intranet based app and limited user base My Approach for automation is Web Services layer Test automation ...
4
votes
3answers
2k views

Is Eggplant any good for image capture and image recognition?

As a software tester looking at different automated testing solutions, I need a tool that will interact with a heavily graphical interface such as a flash website or application. I want the tool to ...
5
votes
4answers
266 views

How to keep track of the features in a website for impact analysis?

I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
4
votes
3answers
2k views

What are the test cases or test scenarios for palindrome

In the interview, the employer asked me to write test cases or test scenarios to check the Palindrome of the word. I said one with positive test case and another with negative test cases. But employer ...
7
votes
1answer
2k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
7
votes
5answers
578 views

Testing email generation

Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be ...
5
votes
4answers
3k views

Do you verify presence of text in your automated tests?

While automating multi locale application I had to stop using - assertTrue(selenium.isTextPresent("success text message")); where success text message would change for each locale. to - ...
5
votes
3answers
253 views

Is model-driven testing a viable technology for real applications yet?

Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
4
votes
7answers
253 views

Manual QA looking to get into Automated Testing (no programming background)

I currently work at an ad agency as a Manual QA. I originally came in to act on the business side but kind of 'fell in to' the job. I do not have a programming background but I am very interested in ...
4
votes
4answers
409 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
2
votes
2answers
2k views

Help using Sensetalk (Eggplant's scripting language)

Sensetalk - Eggplant's scripting language, leaves a lot to be desired. I do not personally see why people feel the need to invent new languages all the time. The syntax is overly simplistic, and as ...
2
votes
3answers
1k views

Automate verification of emails being received

One of the applications that I have to do an enhancement to soon has a number of emails that are sent from the application. To the point of verification, I need to see the delivery failure ...
1
vote
1answer
196 views

Testing ExtJS UI with WebDriver

Our Web app is using ExtJS framework for rendering UI. However, ExtJS-rendered UI is hard to test automatically because: For most clickable elements, ExtJS uses generated ids like "ext-gen-345" ...
10
votes
5answers
223 views

What is best practice for test failures that have a low priority fix?

If I have a test that fails due to a known bug, but that bug is deemed lower priority to fix than other work, what should be done with the test? I can think of 2 options: Leave the test in the test ...
6
votes
5answers
702 views

Suite of automated tests - owned by devs or testers?

I'm working on a project that involves 4 developers and three QAers. I've tried to encourage the other devs to write tests for every new feature they have added, and we have built up a suite of ...
4
votes
3answers
451 views

Testing random number generation

I have a program which generates random numbers. How can I test if the random number generator is generating actual random numbers?
4
votes
2answers
341 views

match image with Selenium2

Not sure if I'm even asking this question correctly, however, here goes. I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
3
votes
1answer
244 views

Automated Web Testing against Sharepoint solutions in a windows development house

I'm researching which web browser automation tools is most suited to running functional user tests against SharePoint based solutions and potentially MVC based custom web parts at a later date. We are ...
3
votes
2answers
3k views

Looking for a test tool for Flash-based web applications. Any ideas?

I'm looking for a Selenium-like tool to test Flash-based web applications (specifically a guided interview with questions and form fields that the user navigates through to produce a document at the ...
3
votes
4answers
5k views

Running Selenium test on TFS

I am currently working on implementing UI tests of .NET web application using Selenium RC. The tests are now coming together and I am beginning to look at how these will be incorporated into TFS. ...