All Questions
6
votes
2answers
2k views
Any good open source test management tools ?
I am thinking of developing some test management tools, to sit alongside the open source automation tools that I currently use. Primarily for recording manual and automated tests, results and ...
3
votes
5answers
5k views
Load Testing, Selenium Vs Jmeter Vs other tools
I have been using Selenium/Webdriver for functional testing in a grid setup.
We are in the process of transitioning to a Solr based search service. I already have Solrmeter for load testing the ...
15
votes
6answers
496 views
How do you tell a programmer they're not testing their own code enough?
Suppose you're working with bright programmer, but every time you test the code you find a serious, obvious bugs. Things the programmer could have noticed if they did their own testing before checking ...
9
votes
4answers
520 views
XSS/CSRF security testing
I'm a Java Automated tester for a website built with GWT. My bosses now want me to specialize in security testing. The problem is that nobody in the company knows anything about security testing, ...
8
votes
1answer
868 views
Fundamental Requirements For an Entry Level QA Engineer
My intention is for this to be a Community Wiki. Being that I have not been granted the power to make this a Community Wiki, I ask that someone who does have the power make it one before it gets ...
7
votes
6answers
1k views
Going from Development into QA?
I'm an intermediate-senior developer who got burned out severely with programming last year and I've been exploring possibilities of a career change into Testing/QA (among others such as Technical ...
4
votes
5answers
2k views
How to plan security testing of a web application?
Security testing requires thinking out of the box, it noes not have clear test cases, and it is not repeatable, meaning running same set of actions over and over again will never assure security.
So ...
12
votes
5answers
216 views
Does anyone have a good list of steps for reducing a bug?
I recently ran into an almost-consistently reproducible bug that I was trying to reduce. At the time, I was tired and simply couldn't think of what to do next after about an hour of work (this bug ...
12
votes
10answers
1k views
Can every test be done by automation?
Can every test be done by automation?
Or is there anything that cannot be done by automation?
9
votes
5answers
5k views
How do you calculate the number of virtual concurrent users to use in a load test given data on actual site traffic?
When working on performance testing, one of the problems I've faced is trying to translate real-world web application traffic to simulated traffic.
A practical example is for an eCommerce site. ...
5
votes
1answer
444 views
Test Automation Design Question
I am analyzing automation design for a web app
UI Layer
Web Service Layer
DB Layer
Intranet based app and limited user base
My Approach for automation is
Web Services layer Test automation
...
5
votes
5answers
980 views
What is the difference between sanity and smoke testing?
When there is a new build we perform smoke testing,in few projects they call it as sanity testing.Can someone please elaborate on the difference between the both.
5
votes
2answers
269 views
What are the challenges around the integration of Manual and Automated Tests?
This is more a request for your professional opinion than a question...
We are seeing how test automation is spreading to more and more organizations. This in itself is a good thing, but at the same ...
4
votes
4answers
337 views
Looking for open source, Java-based tool for performance testing
Goal:
I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https.
My findings:
...
3
votes
5answers
247 views
Teaching Quality Assurance (QA) Methods
I'm in the process of trying to teach my team the ins and outs of Quality Assurance, but am running into some challenges distilling "QA" to its base elements.
I have many years of experience that ...
2
votes
3answers
2k views
What are some real world strategies for testing ETL and data warehouse applications
Does anyone have any advice to share on how to successfully test BIG ETL or data warehouse applications?
I have my own iteas of course, but there only appears to be one main article on line that ...
14
votes
7answers
833 views
Has automated UI regression testing helped you in finding critical defects in system?
I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops).
Personally my automated tests have ...
13
votes
4answers
471 views
What additional benefits does an QA /Developer engineer bring to a project
I have noticed in the last few years that employers are now looking for QA/Developers (QA engineers that have been skilled developers).
I would like to know what others believe are the actually ...
11
votes
4answers
315 views
What are some ways In which testing a mobile application is different from testing a PC application?
My company is considering offering an application for Android devices and iPhones. What are some of the challenges of testing a mobile application that are different from testing a PC application (or ...
10
votes
5answers
517 views
How to isolate a bug?
One of a tester's tasks is to isolate a bug. Narrowing a problem search space will help a developer to find the cause and fix it.
By isolating the bug I mean both finding the class of inputs that ...
10
votes
4answers
1k views
What is the difference between “automated testing” and “automated regression testing”?
"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
7
votes
9answers
410 views
Software testing: a first step to development?
I've been testing Ubuntu daily builds for QA since last month. I wasn't too confident in learning development yet, because I didn't feel familiar with encountering a bunch of code. But I want to ...
6
votes
2answers
3k views
QTP vs Selenium [closed]
I have largely worked with Selenium for front end automation. Looks like there is great market for QTP in this arena, especially when you could afford commercial tools. Have you worked with both QTP ...
5
votes
4answers
162 views
How to keep track of the features in a website for impact analysis?
I have been working for an ecommerce client for the last 6 years as manual and automation QA engineering. New features gets applied to our site once in 2 weeks. Whenever a redesign project comes up, ...
5
votes
1answer
218 views
What are the tiers of testing that should be done on a large scale distributed system?
Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
4
votes
3answers
1k views
Is Eggplant any good for image capture and image recognition?
As a software tester looking at different automated testing solutions, I need a tool that will interact with a heavily graphical interface such as a flash website or application.
I want the tool to ...
3
votes
1answer
186 views
What are the first steps a tester should perform when using combinational testing?
Hypothetically, lets assume that I am testing the "Search and compare flights" functionality of this website*, and I want to apply a combinational testing technique.
Where should a tester start this ...
3
votes
4answers
1k views
Running Selenium tests as a scheduled task
I'm trying to run a Selenium WebDriver script written in Python on a Windows 7 64-bit box as a scheduled task.
The test works pretty well when run as a batch file from the command prompt, but when ...
3
votes
3answers
4k views
A way to match on text using CSS locators
So I use xpath locators and slowly converting to CSS.
I haven't found a way to do an exact match based on text.
For example converting //a[text()='Log Out'].
I know you can do css=a:contains('Log ...
12
votes
6answers
892 views
What factors should affect the ratio of QA/Test staff vs. App Developers
I've worked in a variety of environments with differing ratios of QA / SDET personnel vs. developers focused on building and maintaining application features.
Is there such a thing as a "right" ...
7
votes
5answers
389 views
Testing email generation
Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be ...
7
votes
4answers
160 views
What do you do when you encounter overloaded terminology in your workspace?
I've been in many difference sized companies and in many different environments where we've used terms interchangably, Testing Terms, Development Terms and Process types have been overloaded in one ...
6
votes
1answer
1k views
Is Selenium's LoadableComponent a good solution as test design pattern?
I need to refactor my Selenium tests, and come across their LoadableComponent wiki page. I began trying to use it, though I couldn't really understand what is it good for. I took a look at their ...
5
votes
4answers
155 views
Is it fair to report a bug discovered during review without performing a test?
I'm QA with some programming experience, so I am able to debug and review the code of the system under test. I also often read the code to understand how to define request or what response should I ...
5
votes
5answers
628 views
Is there a guide or systematic way of writing test scenarios?
Are there best practices in coming up with effective test scenarios? Are there documented test scenarios that can be reused across different systems?
5
votes
4answers
1k views
Do you verify presence of text in your automated tests?
While automating multi locale application I had to stop using -
assertTrue(selenium.isTextPresent("success text message"));
where success text message would change for each locale.
to -
...
5
votes
3answers
150 views
What criteria do I apply to a highly complex development project to warrant getting “real world” data?
Both the product I used to work on and the one I'm working on now have a fairly large and complex matrix of possible configurations, work-flows, and data scenarios. The one product had, no joke, ...
5
votes
3answers
211 views
Is model-driven testing a viable technology for real applications yet?
Computer scientists are actively researching model-driven testing as a means of testing applications automatically. The papers I've read are interesting, but so far the modelling technology appears ...
5
votes
3answers
245 views
How should I test the output of image renderers thoroughly, efficiently and in a branchable way
I am trying to improve the tests for a bunch of renderers that generate 2D images, and I am looking for advice and ideas for testing that are both efficient and thorough but also branch friendly.
All ...
5
votes
1answer
110 views
Alternatives to ISEB
I can see why the community can sort of look down on the ISEB exams (at least the Foundation - I haven't looked at the material for any of the others). So I got to wondering exactly what similar ...
4
votes
4answers
314 views
How to test the test scripts?
Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
4
votes
5answers
295 views
Could I get a job by sending a list of bugs found in products of potential employer?
DISCLAIMER: I could not resist not to ask this question, although I know there is no single, objective answer. Please, delete it or turn it into community wiki.
As a potential employer, how would you ...
4
votes
8answers
3k views
How to test data migration procedure?
We are migrating our production data (DB and filesystem) from a fairly complex data model to another fairly complex data model. Migration process is given by the specification as a set of mapping ...
3
votes
3answers
362 views
What is the best way to handle minor intermittent automation failures during cross browser testing?
I run Web Driver (.Net version) with SpecFlow as my test driver on some fairly general Cross - Browser scenarios so I often am rerunning tests as I add new ones, or clean up old automation. On ...
3
votes
3answers
6k views
What is Selenium's default timeout for page loading?
I am using Selenium 2. I have loaded the page using Get command in WebDriver class which is in the package org.openqa.selenium. My question is that what is Selenium's default timeout for page loading?
...
3
votes
0answers
412 views
Selenium (RC) hangs when started from Python test
Fairly new to Selenium (but loving it). I'm running a single test in Python on Selenium RC. I've been running it multiple times a day for about 3 weeks. Now when I try to run it, it executes all the ...
2
votes
1answer
670 views
Inconsistent results when capturing javascript errors with WebDriver
I'm using a technique I found here, to capture javascript errors for testing purposes. It's a technique that is frequently recommended on Stack Overflow for those who need to catch JavaScript errors ...
2
votes
1answer
878 views
Help using Sensetalk (Eggplant's scripting language)
Sensetalk - Eggplant's scripting language, leaves a lot to be desired. I do not personally see why people feel the need to invent new languages all the time. The syntax is overly simplistic, and as ...
2
votes
3answers
452 views
Automate verification of emails being received
One of the applications that I have to do an enhancement to soon has a number of emails that are sent from the application. To the point of verification, I need to see the delivery failure ...
2
votes
1answer
745 views
testing RESTful webservice with kerberos authentication
I've been testing a RESTful webservice for the last little while using SoapUI. It's worked great until this week where a requirement was added that the web service must use kerberos authentication, ...
