11
votes
2answers
256 views

Measuring test performance when there is high variance

I am running single purpose performance tests on a daily basis. Currently, I run each test 3 times and average them out. But I get fluctuations from day to day which make it difficult to detect ...
11
votes
3answers
3k views

What are some tools for fuzz testing?

Fuzz Testing as defined by Wikipedia is: a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer ...
11
votes
4answers
8k views

What are the best beginner tutorials for Selenium IDE

I have gone through the possible duplicate question,it was related to selenium webdriver . I am new to Selenium IDE tool. Could you please suggest me some best PDFs and sites with Selenium tutorials ...
11
votes
6answers
363 views

What online games (ideally with a bunch of glitches) would make for a good software testing training exercise?

I'll be giving a 3-day course on software test design later this month with lots of hands-on exercises. I'd like to include one or more exercises that would involve testing an online game for ...
10
votes
7answers
573 views

Should a salary bonus be based on bugs in released code or other metrics?

I've received a job offer recently with a significant portion of the pay based on yet to be determined "objective" performance metrics. We are supposed to sit down together after I've worked there ...
10
votes
9answers
871 views

Can someone be a good automated tester and be terrible programmer?

I'm currently working as an automated tester. Mostly I do GUI testing in SilkTest, which I like and think I'm fairly good at. Recently, I've been assigned a COM-testing project for our application's ...
10
votes
5answers
410 views

What Are Some Examples of Why Explicit Sleep Statements Are Bad

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
10
votes
7answers
2k views

Tools for Java software testing

I'm currently working(almost finishing) a Java project that consists on a server application and some client applications on the same network, that will communicate with the server only to request ...
10
votes
8answers
751 views

Typical localization bugs

We are now adding support for German, Spanish, French, Italian to our application. We've translated all strings and added a big margin for them in the UI. Now I am wondering what kind of bugs to ...
10
votes
9answers
5k views

What is a good website to hack around using Selenium?

I want to learn Selenium, but I don't know what to code. Sure, I can throw Google some queries, I can fill out some forms, press buttons, find divs and links, etc. But I think this stuff is pretty ...
10
votes
9answers
2k views

How can a Software Tester use “Out of the Box” thinking approach to find more bugs?

Well, I am a black-box tester and I don't think out of the box. I just think about happy paths, thus I want to improve. I always read that testers should have great critical, analytical skills and ...
10
votes
5answers
3k views

Resume and job seeking advice - career change from Development to Testing

I am a former senior software developer who is looking to get into testing, and I would like some advice on how to structure my resume, as well as any general tips on how best to look for work and ...
10
votes
11answers
664 views

Can someone offer suggestions for client based cross browser testing tools

I am looking for a tool that might allow my company to test a number of internal/private sites for browser compatability. I am particularly interested in being able to test IE, Firefox, Chrome and ...
10
votes
3answers
1k views

Writing test cases before implementation?

So currently at my company it is common practice to write test case high level steps before implementation. Myself and others find this to be a somewhat wasted effort. I often end up blowing away much ...
10
votes
8answers
283 views

Testing of automated scripts

How much testing of your automated scripts do people generally do? Is it best to treat the automated test suite as a separate project or part of the Agile development cycle of the product your are ...
10
votes
3answers
1k views

What is the Real Business Value of Software Testing in an IT Project?

I work as a manual tester on a big project. My project follows Agile methodology. I test a Web-based application. I sometimes ask myself, am I giving any value to the stakeholders? What is the Real ...
10
votes
7answers
11k views

How to test data migration procedure?

We are migrating our production data (DB and filesystem) from a fairly complex data model to another fairly complex data model. Migration process is given by the specification as a set of mapping ...
10
votes
6answers
2k views

How do I convince management that we need a formal QA department?

At my firm, we don't really have a QA department. If you've followed some of my other questions you know essentially, we have no automated tests and our 'testers' are the analysts who design the ...
10
votes
5answers
1k views

Will the new ISO/IEC 29119 Software Testing standard work with agile methodologies like Scrum?

I somehow stumbled across some references to the new ISO/IEC 29119 Software Testing standard that is currently draft stage (apparently). I have not seen the details of this new standard, however I ...
10
votes
4answers
1k views

Estimating a testing project

How do you estimate a testing project? What are the things to be take care of while estimating the time for a testing project ?
10
votes
5answers
12k views

How do you calculate the number of virtual concurrent users to use in a load test given data on actual site traffic?

When working on performance testing, one of the problems I've faced is trying to translate real-world web application traffic to simulated traffic. A practical example is for an eCommerce site. ...
10
votes
5answers
225 views

What is best practice for test failures that have a low priority fix?

If I have a test that fails due to a known bug, but that bug is deemed lower priority to fix than other work, what should be done with the test? I can think of 2 options: Leave the test in the test ...
10
votes
4answers
714 views

XSS/CSRF security testing

I'm a Java Automated tester for a website built with GWT. My bosses now want me to specialize in security testing. The problem is that nobody in the company knows anything about security testing, ...
10
votes
6answers
193 views

What techniques are available to determine which browsers to test?

When websites being deployed to the internet are about to go live, the age old question always comes up. "Which browsers should I test?" I am not asking that question because it will soon become ...
10
votes
4answers
2k views

Testing in Open Source Projects

This is a bit of a general question. I'm trying to practice my testing skills and perhaps get some better experience with manual testing mature applications. In particular, I'm interested in desktop ...
10
votes
3answers
2k views

How can I spoof HTTP request data while testing?

I'm testing a Windows desktop application, that requests data from a server during certain operations. I want to make sure the application can handle all possible responses, including bad ones. What ...
10
votes
5answers
288 views

Are testing conferences usually worth attending?

I'm considering asking my boss about sending me to STARWest, but I'm wondering if it's valuable enough for me to justify the expense to the company to him (there is no way I could afford to go on my ...
10
votes
8answers
20k views

Looking for an excellent example of using a spreadsheet for test case management

It is an unfortunate reality of our industry that many testers are stuck using a spreadsheet to manage their test cases. I wanted to ask (in a community wiki), what are some good techniques and ...
10
votes
9answers
2k views

Test Case Management Software

I currently write automated tests using WebDriver/Selenium 2 and utilize the Page Object model. I'd like to start documenting manual tests but our current process is only creating test cases in MS ...
10
votes
2answers
742 views

Test Automation for SAP

I'm evaluating a number of test automation framworks to implement on a SAP project. Right now I'm looking at Fitnesse, which we believe we can write some fixtures for, to call SAP Green Hat, which ...
10
votes
3answers
1k views

Is jQuery faster than CSS/Xpath selectors for IE 8.0 in Selenium1?

I am planning to run my existing Selenium 1.x tests in IE 8.0. After checking few blogs and reading this, I tried to run my tests using jQuery locators with the method mentioned here. My tests uses ...
9
votes
13answers
715 views

Should automated tests be efficient?

I've written and edited a bunch of automated GUI tests. In some cases, the tests are inefficient (eg to select an item from a list, instead of a clever search, a dialog is opened and starting fro the ...
9
votes
8answers
2k views

What is the difference between sanity and smoke testing?

When there is a new build we perform smoke testing,in few projects they call it as sanity testing.Can someone please elaborate on the difference between the both.
9
votes
11answers
3k views

What are good guidelines to determine when to automate a test?

When it comes to test automation, I use a very arbitrary method based on experience that 80% of all tests should be automated. This has worked well in practice, but is based more on "voodo" than ...
9
votes
6answers
1k views

Is adding IDs to everything standard practice when using Selenium?

My team is using Selenium WebDriver and the QA team is having the developers add IDs to almost everything. Is that normal or is Selenium flexible enough that tests can be written with the markup that ...
9
votes
6answers
484 views

How do you manage the expectations of the management that the QA team would find all the bugs in their owned feature?

In a QA team suppose someone finds a defect that doesn't belong to his own assigned feature area but actually belongs to my owned feature area. That person logs this defect in the tracking system. It ...
9
votes
7answers
2k views

Should I try the evaluation version of HP Quality Center?

I'm trying to determine if I should spend some time working with a trial version of HP Quality Center. For a number of reasons, my time is very valuable to me right now both at work and in my ...
9
votes
10answers
22k views

Best free (or very cheap) automation tool for Windows GUI testing?

I used to use vTask Studio, but it seems they've abandoned it. No updates in almost a year.
9
votes
4answers
565 views

How can I report coverage on an n-dimensional test matrix?

I have a test matrix for my product's installation, which is n-dimensional, where n is about 11 or 12 at this point. For instance, the OS is one dimension, and the DB is another, and the Reporting ...
9
votes
4answers
5k views

Why isn't Sahi more common?

So I was doing some website test automation research, I stumbled upon Sahi. Open source, setup was easy, API easy to understand, javascript, java, ruby support, notepad ++ plugin, etc. After trying ...
9
votes
4answers
441 views

Should unit tests be executed as part of a build?

I worked at a company where unit tests ran as part of the build. The build failed if the unit tests failed. What are the benefits and disadvantages of that practice?
9
votes
4answers
265 views

Good resources for traditional testers adapting to an Agile environment

I haven't experienced a transition from waterfall to Agile myself - I worked for companies using Prince2, waterfall approaches to managing projects, and then I got a job working for a company using ...
9
votes
5answers
11k views

What are features of MS Visual Studio Coded UI Test framework that are not present in other tools?

I've recently started working at an organization that has no automated testing in place. They are migrating to Team Foundation Server for project management and source control, and use Visual Studio ...
9
votes
2answers
759 views

Layered Architecture of Test Automation Software

I was introduced to a 5-layer-model for GUI test automation frameworks, that was considered common knowledge. But I would be interested in a source describing this model. The layers are the following: ...
9
votes
5answers
966 views

How to organize test documentation?

Testing process involves plenty of documentation. How to organize it, so that it is easy to get an information that is needed?
9
votes
4answers
316 views

Test Automation for different Locale?

I have begun with automation for a product which is in one language and soon to be ported in another. The only good thing is - Test Automation is just begun. So there are two things which worry me - ...
9
votes
3answers
178 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
9
votes
4answers
1k views

Load testing tools vs. making your own

I've never needed to work with commercial load running tools before, as our test infrastructure is pretty immature here and I've used internal tools in the past. We're working on a .NET technology ...
9
votes
3answers
347 views

How to deal with testers who do more than test

In my firm, we don't have testers, exactly. We have analysts who translate business requirements into specifications. (Think the guy from Office Space, except these guys actually provide some value. ...
9
votes
4answers
1k views

What are the trade-offs of using page objects instead of a collection of functions in UI automation?

I've been using Selenium off and on for the past two years. Recently I've been seeing more references to page objects. (I'm referring to page objects as an means of organizing UI automation code -- ...

15 30 50 per page