Questions tagged [automated-testing]
Use for questions involving problems with automated tests. Relevant for designing test automation, debugging test automation, automation tooling questions, and questions about when it is appropriate to automate. Questions regarding specific tools should tag those tools as well.
3,655
questions
2
votes
3
answers
219
views
System for keeping track of regressions reported by RSpec
In a large set of tests written for RSpec there are some tests who are expected to fail (at least, for a couple more months). These known failures makes it difficult to sort through the results ...
- 121
23
votes
7
answers
3k
views
Does automating your manual tests give you good automated tests?
I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
- 5,115
5
votes
2
answers
224
views
Is it worth investing much time into iteration testing?
I recently had a test assignment where I was testing a pretty well solidified API. The team started phase 1 by creating basic functional, boundary and error tests for each API call. It turned out to ...
- 297
3
votes
1
answer
14k
views
Can the base-url be changed in the same browser session using Selenium RC?
Suppose I login to evernote.com using Selenium RC. Is it possible for me to change the base_url to google.com while staying on the same page. I do not want to open a new browser for google.com. When I ...
- 1,116
17
votes
3
answers
10k
views
What are some tools for fuzz testing?
Fuzz Testing as defined by Wikipedia is:
a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer ...
- 1,057
12
votes
9
answers
14k
views
Whether to choose Selenium over Watir or Lightweight Test Automation when testing web applications created using C Sharp?
I am currently researching testing frameworks to test C Sharp developed web applications. I have been leaning more towards the use of Selenium over Watir or Lightweight Test Automation but hesitant ...
- 351
6
votes
1
answer
2k
views
How do I write a script to be executed by Hudson to automatically restart test environment machines?
I am working in a test environment where we need more than 10 machines, including VMs. The AUT is a Distributed Network type and uses Cassandra nosql DB. We are required to restart each of the ...
- 1,105
22
votes
5
answers
2k
views
What additional benefits does an software engineer bring to a QA position
I have noticed in the last few years that employers are now looking for QA/Developers (QA engineers that have been skilled developers).
I would like to know what others believe are the actually ...
- 618
9
votes
2
answers
4k
views
How is Selenium different from other GUI automation tools?
I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
- 101
7
votes
3
answers
607
views
Behaviour Driven Development with JavaScript
Are there any approaches and tools for driving the development of JavaScript with BDD. I know that I can do this through the UI with tools like Selenium, but is there any tool that can allow this to ...
- 2,930
14
votes
3
answers
850
views
What are the challenges around the integration of Manual and Automated Tests?
This is more a request for your professional opinion than a question...
We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
- 348
19
votes
5
answers
10k
views
What is the difference between "automated testing" and "automated regression testing"?
"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
- 2,637
16
votes
8
answers
416
views
Testing of automated scripts
How much testing of your automated scripts do people generally do?
Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
- 849
11
votes
3
answers
333
views
Testing Unfamiliar Software
One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
- 2,205
17
votes
5
answers
8k
views
What are the trade-offs of using page objects instead of a collection of functions in UI automation?
I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...
user246
11
votes
7
answers
2k
views
Should I try the evaluation version of HP Quality Center?
I'm trying to determine if I should spend some time working with a trial version of HP Quality Center. For a number of reasons, my time is very valuable to me right now both at work and in my ...
- 5,400
6
votes
2
answers
481
views
In TestComplete 8, what tasks are best suited for keyword tests and which ones are best suited for "hand coded" scripts?
With version 8 of the automated testing tool TestComplete, the vendor has introduced a new feature called "Keyword Tests" that provides a visual interface for creating automated UI tests without ...
- 2,637
3
votes
1
answer
3k
views
Testing drag-and-drop with Selenium 2 on Telerik controls
I need to automate drag and drop functionality with Telerik controls, I currently use WatiN for my automation (see related quesiton Testing drag-and-drop with Watin on Telerik controls
. I am ...
- 9,750
13
votes
9
answers
1k
views
Performance testing - a way in?
We have an a browser based application that is built on the Microsoft Stack, specifically .NET 3.5. It also uses Ajax, iframes, jQuery etc.
At the moment we are just guessing at the concurrency ...
- 131
7
votes
9
answers
2k
views
How do I satisfy external auditors that automated tests are at least as effective as manual tests?
My company is not an anti-automation place. In fact, one of the reasons they hired me was to bring in some expertise in test automation. The problem is that the current processes and procedures in ...
- 2,637
16
votes
4
answers
317
views
What techniques are available to determine which browsers to test?
When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?"
I am not asking that question because it will soon become ...
- 9,750
2
votes
1
answer
107
views
php undercontrol replacement
Actually php undercontrol seems to consume a lot of memory so I'm looking for replacement, in order to test a php application.
- 21
8
votes
2
answers
430
views
How do I educate that it's not test automation framework?
The term "Test Automation Framework" is become a cliche in automated testing.
I have come across circumstances during work when my colleagues developed some reusable methods/function for an ...
- 3,437
20
votes
9
answers
2k
views
How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?
Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
- 31.5k
3
votes
2
answers
154
views
testing embedded asymmetric multiprocessing system
I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
- 7,089
4
votes
2
answers
128
views
Approaches to Testing a Scientific Library
I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
- 2,205
15
votes
4
answers
2k
views
Testing interactions with external systems
I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example.
On our online photo sharing application, we have, for example features which let ...
- 488
38
votes
10
answers
5k
views
What is meant by "Automated tests don't find new bugs"?
As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
- 5,400
-2
votes
2
answers
691
views
What would be a good test Orchestration tool for Python unit tests?
What comes to mind is Make, or build.xml, but I have not found a comprehensive Orchestration tool for python testing yet.
Any suggestions?
- 97
12
votes
1
answer
7k
views
Testing Distributed Systems
I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
17
votes
9
answers
8k
views
How do you calculate your return on investment on automated tests?
I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
- 2,930
1
vote
2
answers
410
views
Can external object repository be used with dynamic objects?
I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
- 3,437
13
votes
2
answers
679
views
Maintaining automation framework for different browsers like IE and FF
How to maintain automation framework for different browsers like IE and FF?
In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
- 1,105
17
votes
6
answers
2k
views
How often do you run long automated user acceptance tests?
Let's say you have product or project that is coming near to a next release and that has previous versions released a while ago and that has a big suite of automated user acceptance tests that just ...
- 413
9
votes
3
answers
5k
views
Attach to browser not spawned by Selenium2
One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
- 6,116
12
votes
4
answers
2k
views
How can I report coverage on an n-dimensional test matrix?
I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
- 1,203
8
votes
3
answers
13k
views
Handling self-refreshing pages from selenium
I have been running into intermittent errors with some java selenium-rc tests which I think are related to a page which has an ajax poll and automatically refreshes when some condition is reached on ...
- 181
7
votes
2
answers
5k
views
QTP vs Selenium [closed]
I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools.
Have you worked with both ...
- 3,437
25
votes
8
answers
1k
views
How to deal with automation naysayers?
In my team, there are a number of experienced QA people. I work mostly on developing tools to make the QA process easier for these guys, such as developing test automation.
The uptake has been slow, ...
- 443
4
votes
8
answers
7k
views
Capturing screen shots in selenium tests
How do you use screen shot capture in selenium tests? If anyone is using, how effective do you find it ?
- 1,105
8
votes
6
answers
4k
views
What are the advantages of automated user acceptance tests?
I'm completely new to this stuff, and for what I've seen it takes a while to get used to it.
I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
- 413
7
votes
6
answers
2k
views
Should end-to-end tests be self-contained?
I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
- 617
16
votes
12
answers
3k
views
In house built testing tools
I've been having to deal with a lot of testing tools lately for testing tasks that should/must be automated. These include things like performance/load testing, webservice testing, vulnerability ...
- 6,116
16
votes
7
answers
1k
views
Should QA be able to code tests?
Having a development background, I am convinced that record and replay testing tools have their drawbacks, especially by making tests brittle. See Automated Testing != Record-Playback Tool for a good ...
- 617
7
votes
4
answers
4k
views
Selenium2 assert questions
I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#.
Although these may seem like simple questions, I've been searching for answers for ...
- 6,116
28
votes
7
answers
3k
views
Has automated UI regression testing helped you in finding critical defects in system?
I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
- 3,437
7
votes
6
answers
2k
views
Can Selenium and Bromine 3 execute overnight and email the results
I would like to automate the testing with selenium - even when I am right now a beginner with automatic testing and especially selenium. Therefor I am working with Bromine 3 RC 2.
Is there a way ...
- 173
21
votes
4
answers
5k
views
Tools for Python software testing
Similar to Tools for Server application testing, I'm looking for Python-related testing tools/software (as Python is my most frequently-used language).
33
votes
16
answers
23k
views
Can every test be done by automation?
Can every test be done by automation?
Or is there anything that cannot be done by automation?
- 455
23
votes
7
answers
5k
views
Are your UI automated tests dependent or ordered?
While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
- 3,437