Had a question about what other folks do for regression testing. Let me lay out what we currently have and what I think it should be:
- We have smoke tests, which are just some minimum tests for build verification.
- We have functional tests for features, which can be used to verify individual features coming into sprints. This tests individual features and not from the system perspective.
- We have a QA kind of test suite which tests the product, with and without failures. More customer like, if you will.
My confusion is, what should regression include?
I am thinking of the following:
Create component suites, out of both the set of feature tests for (2) and (3).
Initial regression would pick component tests based on what was changed, and run it for both feature and QA suites.
Once a week, run the full (2) and (3) suites, all components. Also use these suites for daily builds? Not sure what the difference is for you guys between whats tests run on daily jenkins build and QA automated regression testing when it comes to QA.
What do you guys for such situations?