Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Under the right circumstances, it can allow for faster testing with fewer ...

learn more… | top users | synonyms (2)

10
votes
3answers
196 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
10
votes
4answers
1k views

Load testing tools vs. making your own

I've never needed to work with commercial load running tools before, as our test infrastructure is pretty immature here and I've used internal tools in the past. We're working on a .NET technology ...
10
votes
1answer
185 views

How do I tune the probabilities in a Markov chain based load test to produce specific hit rates?

I am writing a load test for a web application. I have a few month's worth of access logs that tell me relative hit rates of various URLs. However, the access logs do not contain enough information ...
10
votes
2answers
578 views

Maintaining automation framework for different browsers like IE and FF

How to maintain automation framework for different browsers like IE and FF? In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
10
votes
1answer
3k views

Is Selenium's LoadableComponent a good solution as test design pattern?

I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
9
votes
6answers
378 views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get ...
9
votes
3answers
9k views

Is Selenium the right tool for browser compatibility testing?

I have been seeing a lot of customers pushing for browser compatibility testing using Selenium. Was wondering whether this is really necessary. The push is mostly due to Selenium grid supporting multi ...
9
votes
5answers
14k views

What are some good open source UI Testing tools for testing Windows GUI?

I need a list of some good tools which are open source and meant for automating the UI testing of Windows GUI. Any help will certainly be appreciated.
9
votes
2answers
3k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
9
votes
1answer
565 views

Tools for tracking automated tests

I have used STAF/STAX in the past, and liked the way that information was tracked in the tests. I'm currently investigating Technologies to tie together a few tools that use XML-RPC, and am ...
8
votes
2answers
521 views

What are the challenges around the integration of Manual and Automated Tests?

This is more a request for your professional opinion than a question... We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
8
votes
2answers
3k views

How is Selenium different from other GUI automation tools?

I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
8
votes
5answers
5k views

Why Isn't SilkTest More Common?

The title says it all. I've been using SilkTest for about a year now in my current role. It wasn't my choice to use, and I've never used it, or even heard of it, before this role. There are definitely ...
8
votes
3answers
984 views

How to avoid redundant tests

We are building an application using a completely test-driven approach. As developers, we are very familiar with unit tests but haven't been exposed to integrated / functional / acceptance tests. ...
8
votes
3answers
296 views

Random test data: How to do it right?

Several months ago I started an experiment in test automation. Each test, before it starts, picks up random test data. For instance, when my test requires a user with administration privileges, I draw ...
7
votes
6answers
2k views

Is writing unit-tests difficult for me as a QA-engineer?

I currently work as a QA-engineer. Work a lot with java, selenium and test-automation. But, unit-tests are something the developers have been doing and something that I fear. Is it difficult? Do you ...
7
votes
4answers
244 views

How can my team move away from record-and-playback when not everyone has scripting experience?

(Inspired by this question) My team is currently doing automated testing via our tool's record-and-playback function. I've read about the benefits of developing a more robust test solution via ...
7
votes
4answers
252 views

Testing Automation: How effective is it to purchase automation scripts rather than developing in-house scripting capacity?

I recently moved into the Software Testing department of my organization.The business has little history of automating testing, and most software development and testing is conducted by third parties ...
7
votes
5answers
749 views

Why testing is not a stand alone activity

I am trying to understand the following concept - Testing is done parallel with other activities and thus it is not a stand alone activity, it is a complete process called STLC (Software ...
7
votes
5answers
515 views

Failed automated tests: how to distinguish known and newly introduced bugs?

Use case: Fitnesse is used for automated testing of the web site. SUT (software under test) contains a known bug. Say, we expect that web page contains "Changes saved successfully" string but this ...
7
votes
4answers
147 views

What should an automation tester create a script for?

I am a newbie in automation testing. The question that bothered me while creating scripts was: Is it only GUI testing or do we also have to create Integration automation scripts? What would be our ...
7
votes
2answers
4k views

Good resources/tutorials/tips for beginner doing automation?

I've just started automating all the tests our team has (~5000). I'm using Telerik Test Studio for the Silverlight automation. I have some tests written, but I'm quickly realizing that with each test ...
7
votes
3answers
4k views

Good Watir or Watir-Webdriver tutorials/resources for new-to-automation testers?

There are at least two really good books for Selenium beginners, and quite a few courses/tutorials out there, as well as a lot of blogs. However, I haven't seen quite as much out there for Watir - ...
7
votes
4answers
270 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
7
votes
5answers
179 views

Ownership of test automation

This is one of the challenge am facing with a new project. We are facing a difficult task in deciding and getting everyone on board as to who will handle ownership of test automation. I am aware ...
7
votes
5answers
920 views

Testing email generation

Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be ...
7
votes
4answers
586 views

Do you automate GUI testing and which tool do you use?

What kind of GUI automation tools or approaches do you know? GUI testing means by testing of appearance of the application under test: size, form, colour of the object etc. I know about GUI testing ...
7
votes
3answers
1k views

Controlling database state in Selenium UI Testing

We have a big test suite with around 300+ tests. Now a days we are manually restoring database and creating few Data Objects and hard coding some data to feed into the tests. However, there are a lot ...
7
votes
3answers
4k views

Appium vs. AndroidDriver + IPhoneDriver in Mobile Automation Tests

I have been writing Selenium Browser automated tests and now I would like to begin writing mobile browser automated tests for Android and IPhone. I am deciding between the Appium framework and the ...
7
votes
3answers
194 views

USB storage emulator

I need to emulate insertion and removal of SD cards to write tests. What is the best way/tool to implement it in .NET?
7
votes
2answers
522 views

What's the most efficient way to run lots of tests?

Here's my current setup: Compile on teamcity Copy the dlls to 8 agents and run tests simaltaniousisly (via snapshot dependencies) Finally taper them in to a single 'publish' build configuration. ...
7
votes
4answers
33k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
7
votes
5answers
2k views

How common is testing based on log files analysis?

Here is a document that outlines challenges and solutions of testing of Mars Science Laboratory: http://compass.informatik.rwth-aachen.de/ws-slides/havelund.pdf I found the approach of log files ...
7
votes
7answers
598 views

Recommend Automated test tools for cross platform including IE and .NET software

I'm working in an QA team. We do the automated work from the scratch. So many testing methods may be anti-pattern or disobey some discipline. We pay lots of effort on test web pages on our ...
7
votes
1answer
8k views

How to use Selenium's PageFactory annotations with dynamic loaded elements?

I'm rewriting some Selenium tests according to the page object design pattern taking advantage of Seleniums' annotations. My problem is that I have some html select elements whose option elements are ...
7
votes
1answer
235 views

Is it possible to automate Silverlight in windowless mode?

Does anybody have an application under test (AUT) that uses a mixture of HTML and Silverlight controls, which they have successfully automated? My AUT web app has screens with a mixture of HTML and ...
7
votes
2answers
362 views

How have Guava unit tests been generated automatically?

Guava library for Java has unit test cases automatically generated: Guava has staggering numbers of unit tests: as of July 2012, the guava-tests package includes over 286,000 individual test ...
7
votes
1answer
911 views

Continuous Integration and testing environment and configuration for Android

I am an Android developer but I am not satisfied with my testing and Continuous Integration environment and configuration. Someone could recommend me how to configure the best setup and workflow for ...
6
votes
10answers
365 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
6
votes
6answers
907 views

What are anti-patterns in test automation?

anti-pattern: There must be at least two key elements present to formally distinguish an actual anti-pattern from a simple bad habit, bad practice, or bad idea: A commonly used ...
6
votes
2answers
4k views

What is the difference between Software Test Engineer, Test Automation Engineer and Software Developer in Test (SDET)?

Software Test Engineer usualy performs “manual” testing (without spending time on automating and supporting the tests). Usually is responsible to find all (as more as possible) critical bugs in the ...
6
votes
5answers
1k views

Suite of automated tests - owned by devs or testers?

I'm working on a project that involves 4 developers and three QAers. I've tried to encourage the other devs to write tests for every new feature they have added, and we have built up a suite of ...
6
votes
5answers
2k views

I want to enter the SQA field specifically automation

I am working hourly for low wage as a QA intern/tester. I want to learn more about this field. I have already graduated, so everything I have learned is self taught or learned somehow on the job. At ...
6
votes
5answers
5k views

Manual tester wanting to get into automation

So its been a year since I have been studying python, and just recently I started picking up webdriver. It was a long journey, and I am still pretty noob, but I finally understand how to use it lol. I ...
6
votes
4answers
3k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
6
votes
7answers
903 views

Techniques for test selection, give a large suite of test cases

I have a huge collection of test cases (inputs). I'd like to select a small subset that's likely to catch most of the bugs. Are there any standard or known techniques in the testing literature for ...
6
votes
5answers
476 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
6
votes
6answers
2k views

What are the advantages of automated user acceptance tests?

I'm completely new to this stuff, and for what I've seen it takes a while to get used to it. I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
6
votes
8answers
256 views

What to do with Limited Time/Testers - What is most Important?

In an ideal world we'd have Acceptance Tests-->Unit Tests-->Integration Tests-->Test Plans and Automated GUI Tests (With Selenium or something). But where does it start to get cut out when you just ...
6
votes
9answers
549 views

How do I satisfy external auditors that automated tests are at least as effective as manual tests?

My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...