Questions tagged [regression-testing]

Regression testing is testing that is carried out on previously tested features, right after any change is introduced to this feature. The purpose of regression testing is to ensure the newly introduced change has not broken the feature it is introduced to.

Filter by
Sorted by
Tagged with
47
votes
12answers
2k views

Building “slow to break” regression tests

I need to build a lot of regression tests for our product at work and I plan on using Selenium. I am concerned about building tests that will become quickly outdated and broken based on the fast pace ...
28
votes
7answers
3k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
25
votes
10answers
31k views

Fitting regression testing in a Agile/ Scrum development cycle

What is the best way to fit regression tests into a Agile/ Scrum development cycle? I've been working as the sole QA person in a 4 person Scrum team developing a new web client in jQuery. I am ...
21
votes
3answers
2k views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
17
votes
5answers
9k views

What is the difference between “automated testing” and “automated regression testing”?

"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...
13
votes
9answers
798 views

Bugs keep reappearing in our GUI software during development. How should this be addressed?

We have a software product has a lot of usability features, and we're constantly changing it. We have issues with things like persisting scroll position which seem to get fixed, but then are broken ...
12
votes
13answers
906 views

Should automated tests be efficient?

I've written and edited a bunch of automated GUI tests. In some cases, the tests are inefficient (eg to select an item from a list, instead of a clever search, a dialog is opened and starting fro the ...
11
votes
7answers
2k views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get "...
11
votes
6answers
1k views

Retest whole system or just changes with regression tests

After regression tests are done, bugs are filed and fixed. A new release build is made with bug fixes. Should you re-run regression tests again on new build or is it enough to do only re-testing of ...
9
votes
6answers
5k views

My manager wants regression testing in the QA environment - how to communicate against that? [closed]

I think it is not a good idea because regression testing is carried out once you complete integration and sanity testing followed by system testing. I want to write an email stating that he is wrong ...
9
votes
8answers
787 views

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

Background: Following are not my assumptions or expectations but in my last couple of interactions with different project teams, I am seeing these patterns where it is expected (from testing by the ...
9
votes
5answers
933 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
9
votes
3answers
2k views

How do you fit regression into Kanban?

This question was inspired by: Fitting regression testing in a Agile/ Scrum development cycle Two out of three answers there suggest a hardening sprint every couple of cycles. There's also mention ...
9
votes
7answers
1k views

What would be a good term for continuous testing post-deployment?

I'm thinking of live production sites here, where there is a continuous community or much content being updated, sort of like a newspaper site or community site (the one I work at is a healthcare ...
8
votes
14answers
9k views

What is the difference between regression testing and re-testing? [closed]

I was asked this question in an interview recently. Just wanted to see what your opinions were on this...
8
votes
8answers
5k views

Visual Regression Testing

For testing the visual appearance of a website the use of tools like selenium (functional surface test) are not sufficient because it doesn´t check the visual appearance and/or the CSS-Code directly. ...
8
votes
3answers
589 views

How should I test the output of image renderers thoroughly, efficiently and in a branchable way

I am trying to improve the tests for a bunch of renderers that generate 2D images, and I am looking for advice and ideas for testing that are both efficient and thorough but also branch friendly. All ...
7
votes
5answers
2k views

Suite of automated tests - owned by devs or testers?

I'm working on a project that involves 4 developers and three QAers. I've tried to encourage the other devs to write tests for every new feature they have added, and we have built up a suite of ...
7
votes
5answers
978 views

How important is it to test a build against a clean data set?

Our web application is complicated, as are most modern apps. Typically, at the end of a release cycle, we branch our code and perform a regression test on the code. Additionally, all new features are ...
7
votes
1answer
926 views

What are the tiers of testing that should be done on a large scale distributed system?

Let's say you have a large distributed system in the cloud that's got dozens of developers working on it and actively adding code to. Your job is to make sure all of the quality gates are used and the ...
7
votes
3answers
2k views

How is regression testing tracked as part of a Sprint? Is it a user story or a task?

How is regression testing tracked as part of a Sprint? Is it a user story or a task? We always do regression testing as part of a sprint; however, there is question on whether we track as a task ...
7
votes
3answers
1k views

How do you test reports and analytic engines like BI/BW?

I'm working with several companies that are deploying SAP HANA (in memory appliance that compresses data from the DB and moves the entire structure into memory resulting in query times that are ~3600 ...
6
votes
5answers
273 views

Which kind of Manual Test cases should be automated for Regression Testing?

Automating each and every Test case would be futile. So which kind of Test cases should be automated so that more time is not spend on writing the automated test cases than actual manual testing of ...
6
votes
2answers
430 views

A bug is fixed in Development environment but cannot be validated in Integration environment

As in many IT jobs we work with two environments: Integration: for QA Development: for developers. Is there a general rule of thumb on what to do when for a bug the developer says it is ok in ...
6
votes
6answers
137 views

What are the common ways of testing the UI of a project while being Agile

I'm working at a startup company and feel like they get into a deadlock by testing UI in wrong ways. They are creating a brand new project from scratch with a new UI and this is how they perform ...
5
votes
7answers
10k views

How to test dynamic GPS location in mobile

How to test my application for gps location without travelling in real time ? Problem behind my query : I am in need to test a travel based application where your location will change according to ...
5
votes
5answers
184 views

What to test after code change in a single module? [closed]

In an application that is currently in production, one module of code is being modified. Is it necessary to re-test the whole application or is it enough to just test functionality associated with ...
5
votes
1answer
119 views

Testing webpage behind Great Firewall of China

I have a challange to tackle. We have webpage that will be used by Chinese customers, we need to make sure it works properly in China. Have you ever tested webpage that should work in China? What was ...
4
votes
5answers
190 views

Making sense of performance regressions

Imagine a situation in performance regression testing where commit A is very deleterious to page performance, but does not trigger a failure - it's just under the level required to do that. Commit B ...
4
votes
4answers
309 views

Product testing consumes more time for doing regression cycle

Currently, am doing product testing over past 2 years, we are giving our base product to the clients with their additional requirements for any new clients and also the version patch is updating for ...
4
votes
7answers
17k views

When should I do regression testing during each sprint?

I am in a small Agile development team with no automated testing. We use Scrumwise to keep up with development. The above answers address the question with automated tests and hardening testing at the ...
4
votes
6answers
8k views

How to identify regression tests?

How can we detect suitable regression test-cases in the full test suite to use whenever we receive new build? What are useful strategies to go about such a selection?
4
votes
4answers
177 views

Regression Testing Functionality Of Code In Button Press?

I have to run the code inside of my button_Click method to do regression testing, but since the method is private, I can't simply call it from my regression testing assembly. private void ...
4
votes
4answers
2k views

Scope of regression testing

Had a question about what other folks do for regression testing. Let me lay out what we currently have and what I think it should be: We have smoke tests, which are just some minimum tests for build ...
4
votes
5answers
7k views

How to run same test case of testng on 100 different URL/Domain?

I have one difficult scenario for automation testing. I want to run one test cases for 100 different URLs/Domain. Precondition : Script is generalize and running individuality properly. Use of ...
4
votes
2answers
121 views

KPI/ways to identify areas in need of testing

My Problem: I am in a situation where there is no immediate demand to test any feature (no new features in need of testing, or no new changes made) This makes it difficult to identify areas that are ...
4
votes
4answers
1k views

Looking for a content-aware library for regression testing of PDF files

I'm doing some automated regression testing on a web application using Rational Functional Tester with Java. I need to test some PDF files produced by that application, comparing them with a "base" ...
4
votes
2answers
75 views

How would you call backward porting testing?

A real life example- Linux Kernel A feature B was tested and released, Linux Kernel A+1 feature B+1 was tested and released Now feature B+1 is ported back into Linux Kernel A How should I call the ...
4
votes
2answers
124 views

Regression testing console apps

I am wanting to set up some automated regression tests for some console apps. The apps are JSON transformers, so ideally what I'd like to do is pass the app some input files and compare the result to ...
4
votes
2answers
821 views

When and how to do regression testing?

I am learning selenium. I am trying to get into more and more automation. Scenario (example): We are working in the agile. 2 weeks of sprint. We have a release after every 3 sprint. In our framework ...
4
votes
1answer
387 views

How to control CEF3 portions of .NET project using Webdriver2?

We have a very large .NET project. This has been E2E/regression tested using QTP for 3 years. Eventually our AUT is moving to the WEB. This process is expected to take a couple of years, it will be ...
3
votes
4answers
979 views

Is this a good re-testing strategy for Katalon Studio?

I asked a similar question on Katalon Studio forum, but it didn't get much traction: https://forum.katalon.com/discussion/comment/15556#Comment_15556 Anyway, in order to deal with test flakiness this ...
3
votes
3answers
196 views

Is defect driven test automation an good idea?

Defect driven Test automation: Test strategy in place to consider candidates for test automation primarily as earlier found and fixed defects in the application. With the thought process that it will ...
3
votes
4answers
1k views

Manual Regression Testing in Agile

We are working in agile methodology and one sprint contains only 10 days. In that time we need to develop the functionality and we need to test the application. How is it possible to do regression ...
3
votes
2answers
3k views

Selenium - SendKeys not completing data entry before moving to next field

I am trying to login to Gmail with two users. The data is exported from excel. Sometimes my test passes, but sometimes the first user login and logout processes successfully, but the second username ...
3
votes
5answers
11k views

What type of testing is it when I am testing after bug fixes?

The definition of regression testing makes it seem that any testing after bug-fixing is supposed to be called regression testing. But in the case that after bug-changes I just want to make sure the ...
3
votes
1answer
63 views

Supporting multiple versions of test scripts

We're running our own CI/performance tests system for some other team's software library as they've yet to decide on something beyond nightly tarballs and our requirements are much more stringent. Due ...
3
votes
1answer
200 views

Testing Strategy: Modular Test Cases

Currently, my company follows a modular test case approach, in the context of business workflow tests. In this approach, we have a lot of component-level test cases, that, by themselves, are not part ...
3
votes
1answer
48 views

Testing our native app on iOS Beta releases

We develop 3 apps in total, all on iOS and I'm running into serious time issues regarding the iOS Beta Releases (current release is iOS 11.2.5 Beta 2). We want to perform a full regression on all our ...
3
votes
1answer
4k views

Cron format, definition of H in .yml file [closed]

I am a beginner in software testing. I was going through the .yml file used to schedule the regression runs and came across this: schedule: "H 1 * * 1,4" I know about cron format, but what I can ...