Questions tagged [automated-testing]

Use for questions involving problems with automated tests. Relevant for designing test automation, debugging test automation, automation tooling questions, and questions about when it is appropriate to automate. Questions regarding specific tools should tag those tools as well.

Filter by
Sorted by
Tagged with
3
votes
2answers
146 views

testing embedded asymmetric multiprocessing system

I am testing an embedded system consisting of multiple processors working in different speeds, with different resources, all communicating through dedicated channels using a proprietary message ...
4
votes
2answers
126 views

Approaches to Testing a Scientific Library

I'm quite interested in the Scipy/Numpy project which is basically a Python scientific computation/numerical methods library. I'm also interested in testing. What are some good approaches for testing ...
15
votes
4answers
2k views

Testing interactions with external systems

I'm trying to find a way to test the interactions of our platform with external servers, like Twitter, for example. On our online photo sharing application, we have, for example features which let ...
37
votes
10answers
4k views

What is meant by “Automated tests don't find new bugs”?

As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
-2
votes
2answers
622 views

What would be a good test Orchestration tool for Python unit tests?

What comes to mind is Make, or build.xml, but I have not found a comprehensive Orchestration tool for python testing yet. Any suggestions?
12
votes
1answer
6k views

Testing Distributed Systems

I understand and practice most normal testing methodologies, however for systems with several distinct interacting processes testing obviously becomes a lot harder. Unit testing is often not possible, ...
17
votes
9answers
8k views

How do you calculate your return on investment on automated tests?

I've been looking at calculating the ROI on automated test on a project that I've been working on. However, I'm a little stuck when it comes to determining a good method for this. Simply counting the ...
1
vote
2answers
404 views

Can external object repository be used with dynamic objects?

I have heard as well as followed concept of keeping UI objects in external filed (xml or properties files in java). But there are times when I need to keep the objects with in test because I use them ...
13
votes
2answers
672 views

Maintaining automation framework for different browsers like IE and FF

How to maintain automation framework for different browsers like IE and FF? In my current set up, I maintain two different configuration properties files, one with xpath locators that FF supports ...
16
votes
6answers
2k views

How often do you run long automated user acceptance tests?

Let's say you have product or project that is coming near to a next release and that has previous versions released a while ago and that has a big suite of automated user acceptance tests that just ...
9
votes
3answers
5k views

Attach to browser not spawned by Selenium2

One of the things that I miss about WatiN is the ability to attach to browser instances that were not spawned by Selenium. In my last position, this was the whole reason why I used WatiN, as the ...
12
votes
4answers
1k views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
8
votes
3answers
12k views

Handling self-refreshing pages from selenium

I have been running into intermittent errors with some java selenium-rc tests which I think are related to a page which has an ajax poll and automatically refreshes when some condition is reached on ...
7
votes
2answers
5k views

QTP vs Selenium [closed]

I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both ...
25
votes
8answers
1k views

How to deal with automation naysayers?

In my team, there are a number of experienced QA people. I work mostly on developing tools to make the QA process easier for these guys, such as developing test automation. The uptake has been slow, ...
4
votes
8answers
7k views

Capturing screen shots in selenium tests

How do you use screen shot capture in selenium tests? If anyone is using, how effective do you find it ?
7
votes
6answers
4k views

What are the advantages of automated user acceptance tests?

I'm completely new to this stuff, and for what I've seen it takes a while to get used to it. I once tried, but felt I was spending way too much time just writing the tests, or just fixing them 'cause ...
7
votes
6answers
1k views

Should end-to-end tests be self-contained?

I am automating web UI tests using Selenium. These tests are written partly in the spirit of Unit tests, that is they try their best to leave the application in the same state in which they found it. ...
16
votes
12answers
3k views

In house built testing tools

I've been having to deal with a lot of testing tools lately for testing tasks that should/must be automated. These include things like performance/load testing, webservice testing, vulnerability ...
16
votes
7answers
1k views

Should QA be able to code tests?

Having a development background, I am convinced that record and replay testing tools have their drawbacks, especially by making tests brittle. See Automated Testing != Record-Playback Tool for a good ...
7
votes
4answers
4k views

Selenium2 assert questions

I've recently started converting my automation suites from WatiN to Selenium2. In both cases, I've been using C#. Although these may seem like simple questions, I've been searching for answers for ...
29
votes
7answers
3k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
7
votes
6answers
2k views

Can Selenium and Bromine 3 execute overnight and email the results

I would like to automate the testing with selenium - even when I am right now a beginner with automatic testing and especially selenium. Therefor I am working with Bromine 3 RC 2. Is there a way ...
21
votes
4answers
5k views

Tools for Python software testing

Similar to Tools for Server application testing, I'm looking for Python-related testing tools/software (as Python is my most frequently-used language).
32
votes
16answers
22k views

Can every test be done by automation?

Can every test be done by automation? Or is there anything that cannot be done by automation?
23
votes
7answers
4k views

Are your UI automated tests dependent or ordered?

While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
46
votes
11answers
3k views

Should programmers run automated tests written by QA?

Perhaps programmers have their own unit tests, perhaps as the result of doing Test-Driven Development. They run these tests very often; perhaps every few minutes, but at least a few times each day. ...
6
votes
2answers
3k views

Writing automated tests for System.Web.HttpApplication

I am currently using Moq to write automated tests for System.Web.HttpApplication in C#: public FakeHttpApplication CreateBaseMocks() { MockContext = new Mock<HttpContextBase>(); ...
50
votes
12answers
3k views

Building “slow to break” regression tests

I need to build a lot of regression tests for our product at work and I plan on using Selenium. I am concerned about building tests that will become quickly outdated and broken based on the fast pace ...
4
votes
3answers
1k views

Upgrade SilkTest automation scripts to work with IE9

We use SilkTest 2010 Open Agent to perform Automated Web Testing. Our scripts currently work on IE6 - IE8 and on Firefox 3.X. IE9 has changed modal boxes to unintrusive pop-ups at the bottom of ...
57
votes
18answers
10k views

What are some tools for testing Mobile web apps?

I'm thinking along the lines of a Firebug for the iPhone/iPad/Android/BB that can truly give more insight on the markup/scripts. Even when testing on the simulator/device, it's hard to truly simulate ...

1
64 65 66 67
68