Regression testing is looking for bugs in functionality that was previously working and may have "regressed" to a non-working state.

learn more… | top users | synonyms

35
votes
12answers
1k views

Building “slow to break” regression tests

I need to build a lot of regression tests for our product at work and I plan on using Selenium. I am concerned about building tests that will become quickly outdated and broken based on the fast pace ...
19
votes
7answers
2k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
18
votes
3answers
1k views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
15
votes
10answers
15k views

Fitting regression testing in a Agile/ Scrum development cycle

What is the best way to fit regression tests into a Agile/ Scrum development cycle? I've been working as the sole QA person in a 4 person Scrum team developing a new web client in jQuery. I am ...
13
votes
5answers
5k views

What is the difference between “automated testing” and “automated regression testing”?

"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
10
votes
13answers
780 views

Should automated tests be efficient?

I've written and edited a bunch of automated GUI tests. In some cases, the tests are inefficient (eg to select an item from a list, instead of a clever search, a dialog is opened and starting fro the ...
10
votes
8answers
482 views

Bugs keep reappearing in our GUI software during development. How should this be addressed?

We have a software product has a lot of usability features, and we're constantly changing it. We have issues with things like persisting scroll position which seem to get fixed, but then are broken ...
9
votes
6answers
378 views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get ...
7
votes
12answers
8k views

What is the difference between regression testing and re-testing?

I was asked this question in an interview recently. Just wanted to see what your opinions were on this...
6
votes
5answers
1k views

Suite of automated tests - owned by devs or testers?

I'm working on a project that involves 4 developers and three QAers. I've tried to encourage the other devs to write tests for every new feature they have added, and we have built up a suite of ...
6
votes
5answers
476 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
6
votes
3answers
1k views

How do you fit regression into Kanban?

This question was inspired by: Fitting regression testing in a Agile/ Scrum development cycle Two out of three answers there suggest a hardening sprint every couple of cycles. There's also mention ...
6
votes
2answers
92 views

A bug is fixed in Development environment but cannot be validated in Integration environment

As in many IT jobs we work with two environments: Integration: for QA Development: for developers. Is there a general rule of thumb on what to do when for a bug the developer says it is ok in ...
6
votes
5answers
639 views

What would be a good term for continuous testing post-deployment?

I'm thinking of live production sites here, where there is a continuous community or much content being updated, sort of like a newspaper site or community site (the one I work at is a healthcare ...
6
votes
1answer
440 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
6
votes
2answers
544 views

How do you test reports and analytic engines like BI/BW?

I'm working with several companies that are deploying SAP HANA (in memory appliance that compresses data from the DB and moves the entire structure into memory resulting in query times that are ~3600 ...
5
votes
3answers
442 views

How should I test the output of image renderers thoroughly, efficiently and in a branchable way

I am trying to improve the tests for a bunch of renderers that generate 2D images, and I am looking for advice and ideas for testing that are both efficient and thorough but also branch friendly. All ...
4
votes
5answers
174 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
5answers
97 views

What to test after code change in a single module? [closed]

In an application that is currently in production, one module of code is being modified. Is it necessary to re-test the whole application or is it enough to just test functionality associated with ...
4
votes
2answers
56 views

Regression testing console apps

I am wanting to set up some automated regression tests for some console apps. The apps are JSON transformers, so ideally what I'd like to do is pass the app some input files and compare the result to ...
4
votes
7answers
2k views

Visual Regression Testing

For testing the visual appearance of a website the use of tools like selenium (functional surface test) are not sufficient because it doesn´t check the visual appearance and/or the CSS-Code directly. ...
3
votes
7answers
8k views

When should I do regression testing during each sprint?

I am in a small Agile development team with no automated testing. We use Scrumwise to keep up with development. The above answers address the question with automated tests and hardening testing at the ...
3
votes
3answers
240 views

How does Boundary Value Analysis work?

In a flight reservation system, the number of available seats in each plane model is an input. A plane may have any positive number of available seats, up to the given capacity of the plane. Using ...
3
votes
4answers
331 views

Scope of regression testing

Had a question about what other folks do for regression testing. Let me lay out what we currently have and what I think it should be: We have smoke tests, which are just some minimum tests for build ...
3
votes
5answers
352 views

How important is it to test a build against a clean data set?

Our web application is complicated, as are most modern apps. Typically, at the end of a release cycle, we branch our code and perform a regression test on the code. Additionally, all new features are ...
3
votes
2answers
63 views

How would you call backward porting testing?

A real life example- Linux Kernel A feature B was tested and released, Linux Kernel A+1 feature B+1 was tested and released Now feature B+1 is ported back into Linux Kernel A How should I call the ...
3
votes
1answer
621 views

Regression testing for web services and SharePoint workflows - What should I research?

Apologies if this question has been addressed before or not relevant to this exchange. I did some initial searching and I've only recently discovered this area of stackexchange so I'm unsure of the ...
2
votes
6answers
2k views

How to test dynamic GPS location in mobile

How to test my application for gps location without travelling in real time ? Problem behind my query : I am in need to test a travel based application where your location will change according to ...
2
votes
4answers
821 views

Looking for a content-aware library for regression testing of PDF files

I'm doing some automated regression testing on a web application using Rational Functional Tester with Java. I need to test some PDF files produced by that application, comparing them with a "base" ...
2
votes
2answers
85 views

CSS visual regression - do I need to store screenshots in git repository?

There is a technique to check if something visually not broken in HTML and CSS markup - visual regression testing. We do following steps: Check everything is ok. Create a test "reference" (creating ...
2
votes
3answers
85 views

Regression Proposal for project with zero testing documentation

I recently started a project in which all testing has been done with zero documentation. I need to start creating a Regression suite and propose it to my manager. I have done regression testing ...
2
votes
3answers
163 views

System for keeping track of regressions reported by RSpec

In a large set of tests written for RSpec there are some tests who are expected to fail (at least, for a couple more months). These known failures makes it difficult to sort through the results ...
2
votes
4answers
520 views

Mirror a browser session

I am doing some regression testing (changes to underlying database structures) where I'm lucky enough to two separate environments which should contain the same data. What I'd like to do is open a ...
2
votes
1answer
103 views

Considerations for site audits and testing on IE9?

Now that Internet Explorer 9 has a growing market share (5.63% at time of writing, and closing in on IE7 fast), what are some of the major considerations for people wishing to test sites and web ...
1
vote
4answers
143 views

Regression Testing Functionality Of Code In Button Press?

I have to run the code inside of my button_Click method to do regression testing, but since the method is private, I can't simply call it from my regression testing assembly. private void ...
1
vote
7answers
996 views

Do you need to re-verify all bugs in the staging environment?

At my company the QA department will verify all of the bugs fixed in builds deployed to our QA environment. We might deploy like 10 or so builds over a few weeks and they verify that the bug fixes are ...
1
vote
3answers
103 views

Reducing the number of test users in automated regression runs?

I help maintain a very large automated regression test suite for java web applications. Because of the size of the suite, running the tests in parallel is a requirement. I need to reduce the number of ...
1
vote
3answers
144 views

Product To Manage Regression Test Suite

I am looking to manage my manual regression test suite in a more professional manner and in a way that helps my QA personnel do their jobs easier. As such I was looking for a product that can help out ...
1
vote
2answers
115 views

How can we do User acceptance testing Manually? [closed]

General User acceptance testing test cases of any application or software. Test cases of user acceptance testing like some of below: Add tab functionality in a form Shortcut keys of saving any form ...
1
vote
5answers
2k views

What type of testing is it when I am testing after bug fixes?

The definition of regression testing makes it seem that any testing after bug-fixing is supposed to be called regression testing. But in the case that after bug-changes I just want to make sure the ...
1
vote
1answer
664 views

Any good open source functional testing tool for java based Web Application [closed]

Any good open source functional testing tool for java based Web Application Regression Testing which require less coding effort Except Selenium Our Web application is only run in Google Chrome.
1
vote
1answer
56 views

What are good Regression Testing Tools? [closed]

Required Features: - Open Source - Can be used on Web Applications - Can be used on GUI's - Runs on Windows - Can simulate mouse movement - Can simulate keystrokes - Record and playback capable
1
vote
1answer
278 views

Automated GUI Testing of MFC/Dynamic HTML embedded Desktop Application

I am working on finding an automated testing tool for POC project at my organization. In past I have worked on automation of desktop and web application using Selenium,QTP, CodedUI.These tools are ...
1
vote
0answers
207 views

using Webdriver2 to control CEF3 portions of .NET project

We have a very large .NET project. This has been E2E/regression tested using QTP for 3 years. Eventually our AUT is moving to the WEB. This process is expected to take a couple of years, it will be ...
1
vote
0answers
195 views

Automated Regression Testing for SAP Web Intelligence Reports [closed]

Looking for a regression testing solution for SAP Web Intelligence Reporting that is fairly low maintenance. Wondering what others recommend for this and have used to accomplish this goal?
0
votes
3answers
1k views

Courses for non-IT people to study testing?

I am a non-IT student, but I want to enter into the IT world. Which courses do I have to study to get job in testing? What is the difference between QA tester and ISTQB tester? Which is the best ones? ...
0
votes
3answers
160 views

Advice required qa & testing

I have seen this question in forum before, still I am putting this, sorry for that. I have work experience of 5yrs in manual testing mobile applications. Basically I'm searching a new job with a good ...
0
votes
3answers
154 views

Fresh to Software SQA

I've been working in SQA field for a year now, and basically I used only black box methods. What advice can you give me to enhance my skills? Recently I have started learning Jmeter Apache for load ...
0
votes
1answer
2k views

Selenium training in C# or Java [closed]

I want to go for a Selenium training course but was bit confused whether should I go for Java or C#. I have been to a training session for C# earlier so as far as the concepts are concerned I do have ...
0
votes
3answers
168 views

Tools For Regression Testing [closed]

As part of our final year project we are planning to work on a efficient technique to improve the Regression testing phase.In most of the papers i've read they've used a Tool "DejaVu" to find out the ...