All Questions

5
votes
3answers
193 views

What criteria do I apply to a highly complex development project to warrant getting “real world” data?

Both the product I used to work on and the one I'm working on now have a fairly large and complex matrix of possible configurations, work-flows, and data scenarios. The one product had, no joke, ...
5
votes
5answers
181 views

Writing tests to learn the code

My team is bringing on two new people - an intern and a full time. The intern has one semester to go, and the full time is fresh out of uni. After a two week training period, the plan management has ...
11
votes
12answers
3k views

Tools for testing iPhone apps

I was wondering if there any automation tools out there that can help with the process of testing an iPhone application on the device itself and not on a simulator. Ideally, it would have simulating ...
2
votes
2answers
247 views

How do you drive what testcases to write based on a large decision table?

I have constructed a large decision table based on the possible inputs I can have. My question is, how do I determine what test cases to write?
8
votes
8answers
403 views

Bugs keep reappearing in our GUI software during development. How should this be addressed?

We have a software product has a lot of usability features, and we're constantly changing it. We have issues with things like persisting scroll position which seem to get fixed, but then are broken ...
1
vote
1answer
233 views

Visual studio web performance testing for invalid input

I am trying to test an input field to make sure it is behaving correctly with invalid input. But when I try to insert text with quotes and add a validation rule for it, the test fails. It seems that I ...
3
votes
4answers
6k views

Running Selenium test on TFS

I am currently working on implementing UI tests of .NET web application using Selenium RC. The tests are now coming together and I am beginning to look at how these will be incorporated into TFS. ...
1
vote
2answers
184 views

Selenium Selenium.Core v1.1.4322 - XPath not working

I've got the following XPath expression's working in firebug, that returns the correct element(s): $x("(//input[@class='intervalInput timeInput'])") returns two elements. ...
6
votes
10answers
337 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
6
votes
3answers
2k views

What aspects normally differ when developing automation framework in QTP VS Selenium

I have worked in Selenium. For developing Web UI Functional Test automation suite I considered below aspects Using TestNG Framework Using Page Object pattern XML based configuration Logging of ...
3
votes
4answers
398 views

testing Touchscreen driver

I am testing a touch screen driver for an embedded device. Unfortunately it is tightly coupled to the hardware so simulated data can't be pushed in real time in order to simulate real usage. Basic ...
12
votes
4answers
2k views

Documenting Unit Tests

We follow a BDD approach to development, we have our testers creating scenarios from a specification, and these are then given to our developers before any work is started. However, we find that some ...
4
votes
5answers
2k views

Performance Testing a cloud application

What are the best approaches and what concerns are there about performance testing a web application that is hosted in the cloud?
4
votes
1answer
804 views

I Can't Shut Down My Selenium Instance (C# WebDriver, Gallio). I think I have a bug…

So, I have some code set up via Gallio, to start the selenium server before each test session, and shut it down when the session finishes (all tests have run). It starts the server fine, but I can't ...
23
votes
6answers
2k views

What goes in your definition of done (DoD) ?

In agile projects, we use the definition of done to ascertain when to consider a user story to be ready for acceptance (implemented and tested). In the project's DoD we have things like following ...
5
votes
2answers
141 views

References for resources used in test

I am looking for some references for the following statements: "The size of the test code code is/can be greater that the size of the product code" "The amount of resources spent on developing and ...
2
votes
2answers
99 views

Is it easier to write “correct” software in functional languages?

Functional languages like F# and Scala are becoming popular. Do these types of functional languages make it easier to write higher quality software that requires less testing. In other words, is it ...
4
votes
5answers
351 views

How does one set up a Private By-Invite Beta Site for Android Apps?

We're working on an Android game (a port) for a professional game studio. We have internal QA who've done a great job testing the app on multiple devices but we'd still like to expand feedback more ...
9
votes
10answers
21k views

Best free (or very cheap) automation tool for Windows GUI testing?

I used to use vTask Studio, but it seems they've abandoned it. No updates in almost a year.
7
votes
5answers
271 views

Workflow shortcut to meet the release deadline

When you design a test scenario or even when you run your tests and you stumble to lack of specifications from your marketing Dept. should you bypass them and take the initiative of making your own ...
11
votes
4answers
204 views

If I didn't use TDD but want to transition to agile, should I go back and create those unit tests?

In an transitioning agile environment, if there was no Test Driven Development (no unit tests created), should you create unit tests to catch up on technical debt? And to what extent? Should they ...
26
votes
16answers
7k views

Do ISTQB/ISEB Testing Certificates prove that someone can test?

I have passed the foundation level exam, and to be honest, I'm pretty sure that anyone could pass that exam with a couple of days of studying. My question is are these certificates really of value to ...
20
votes
11answers
2k views

Are code reviews considered part of QA?

I was having a discussion with a fellow developer and we were talking about QA practices. I was thinking that code review would be a QA practice because you're not making anything, but rather are ...
3
votes
4answers
1k views

How to deal with a dynamically populating list box with WatiN

I am looking for some suggestions on how to deal with a slight timing issue that I am having with two controls on a page. I have a list box that contains up to 10 items, however the contents of the ...
4
votes
3answers
6k views

How do I handle the login modal dialog created by onLoad in a WebDriver & Java based test automation

I am working on the test automation that uses WebDriver (Selenium 2) and Java. The AUT is web-based application. A modal dialog pops up that requires user authentication before the user can access ...
2
votes
3answers
137 views

Do I Need To Create Mock Classes For Every Class?

Let's say I have a system composed of three classes: A,B,C that share certain dependencies. To test A independently, I would need to create mock objects for B and C To test B independently, I would ...
2
votes
1answer
1k views

Unit Testing The Presenter (in an MVP Context) Using Mock Objects?

Below is some code which is just the simplest MVP project I could make. How can I unit test the presenter using mock objects? Does a mock object mean a completely made up object? In this case, the ...
5
votes
2answers
556 views

Testing Java or Silverlight plugins embedded in a page using Selenium?

We have a product that defaults to a Java plugin to upload files, and then Silverlight after that if Java's not installed. There is a third fallback of a HTML 4 + JavaScript uploader, but I'd like to ...
2
votes
1answer
354 views

Using Scala to build unit tests for Java?

The idea of using Scala to build unit tests for Java code has been thrown around. People are making the claim that Unit tests would be less effort to write because there's less boilerplate. In ...
8
votes
5answers
878 views

Test Strategy Documentation

What are the main points that should be included in a test strategy document for a particular project? I'm not looking at details but more from a high level overview. I would like to make it a brief ...
1
vote
1answer
723 views

Questions on Developing TestNG based automation for Java based web services

• In case of .NET 2.0 ASMX you can post HTTP requests for the web service using HttpWebRequest and HttpWebResponse • Is this approach possible for java based web service as well, referring to ...
5
votes
1answer
1k views

Automated tests performed on Google Chrome?

I've been using the Canary build (nightly build) of Chrome for a month now. So far the quality has been high and it has worked without any major issues. Can someone describe the automated testing ...
5
votes
2answers
1k views

What could cause a “command failed” error when using the Word.Application object to compare two documents?

I have two word documents that are a "result" of a test and an "expected result". I'm using the following code to compare the two and check for differences. Sub CompareTest Dim wrdApp Dim ...
4
votes
4answers
1k views

UI and Business Logic Testing, Am I Doing it Right? Should I Unit Test Anything Else?

Alright, so this is what I have right now. buttonMultiply_Click(object sender, EventArgs e){ Calculator c = new Calculator(); textBoxLog.Text = "Calculation underway..."; int value1 = ...
1
vote
4answers
138 views

Regression Testing Functionality Of Code In Button Press?

I have to run the code inside of my button_Click method to do regression testing, but since the method is private, I can't simply call it from my regression testing assembly. private void ...
6
votes
2answers
2k views

Any good open source test management tools ?

I am thinking of developing some test management tools, to sit alongside the open source automation tools that I currently use. Primarily for recording manual and automated tests, results and ...
7
votes
4answers
2k views

Testing cloud based applications

Is there any fundmental difference in the way applications/servies hosted on a cloud are to be tested vis-a-vis a traditional web based application ? It looks essentially the same to me except the way ...
18
votes
4answers
1k views

Developing Unit Tests While Refactoring Legacy Code?

I have a big code library that I need to refactor in order for it to fit more nicely together (one big problem is there aren't clear enough boundaries between each component). Since there will be ...
18
votes
13answers
14k views

Under what circumstances is Sikuli better for test automation than Selenium or Watir?

The Sikuli website says: Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots). Under what circumstances is Sikuli a better technology ...
3
votes
1answer
91 views

Multiple Assembly QA Systems?

I'm having difficulty deciding whether or not using multiple assemblies for a QA system is the right approach to take. Here are some important details: The underlying system is a single assembly ...
18
votes
8answers
4k views

Recommend a Good QA Book

What books are people reading that you would recommend. I've just finished up "Beautiful Testing" (which I would highly recommend) and need to pick up another book. I'm looking for something fairly ...
4
votes
7answers
974 views

is it appropriate to do exception handling for every single test method?

I suppose there is exception handling available in all high level language. And I often find test method written as - public void testLogin() try{ testCtrl.type("loginText", "loginName"); ...
6
votes
3answers
1k views

Recommendations for functional testing a WCF service

I need to do some functional testing on a component that exposes a small set of WCF endpoints. I'm still ramping up on WCF, so I'm hitting a bit of analysis paralysis trying to figure out the best way ...
4
votes
5answers
11k views

How should you interview for QA Automation positions?

A variant on the How should you interview for QA positions? I am interviewing candidates for an Automation position, we don't use commercial automation tools, but rather use a framework using mainly ...
3
votes
1answer
349 views

Using FitNesse with .Net across multiple servers

My previous work involved writing embedded Linux code. We used a couple of the embedded devices in a test harness, a Linux PC and the Windows Perforce repository. The Linux PC ran an instance of ...
12
votes
6answers
796 views

In agile (Scrum) practices, where do I start with making Q&A (testing) more efficient if the team is transitioning from waterfall to agile?

My team has recently transitioned from the traditional waterfall method to practicing Scrum. Being the QA lead, really the only tester on a small team, how can I get the process more aligned with ...
4
votes
2answers
341 views

match image with Selenium2

Not sure if I'm even asking this question correctly, however, here goes. I'm looking at validating images in an automation suite that I just started. I am currently validating the location via XPath ...
3
votes
1answer
715 views

Problems with escaping the equals sign in a Watir Robot argument

We're currently using the very lovely Robot Framework for our automation. Unfortunately, we've run into a hitch with the '=' character - we have a number of places in the app where we have a link to ...
7
votes
3answers
803 views

What are good metrics for a test team to use to start measuring their workload and ability to meet external deadlines?

The tester team where I work has a demanding customer base (we do business-to-business software, some of it ultimately public-facing, some business-facing), an application that's gone beyond anyone's ...
1
vote
4answers
301 views

Performance testing resources

Please share any good performance testing resources which you have come across in past or referred to while working or learning about performance testing.

15 30 50 per page