10
votes
Accepted
Do you still need a Test Plan when adopting Continuous Delivery?
I don't see CI/CD as something different than non CI/CD process, tests are simply being run by a non human entity.
Do you need a test plan (or plan your tests) ? of course you do, you need to think ...
- 6,945
9
votes
Accepted
Tests in CI: Are API + Integration Tests the most suitable?
As already mentioned in your TechBeacon article, teams indeed often spend too much at the top of the test automation pyramid. In general, the pyramid is a good rule of thumb, but (as always) it ...
- 2,102
7
votes
Accepted
What to do with Limited Time/Testers - What is most Important?
The short version: Don't sweat on automation or test cases. Chances are you won't get time to build it because there's too much that has to be manually tested now. Instead focus on building light-...
- 30.8k
7
votes
What should a QA in software be worried about when a small configuration deployment is being pushed without testing?
It all depends on what you're configuring, and if the configuration mechanism itself was tested before.
If it's something small, like a timeout interval, number of retries, etc, then I'd agree it ...
- 1,030
7
votes
Is manual regression testing an technical debt for agile teams aiming for continuous delivery?
There are an awful lot of variables to consider here. But here are some points all the same.
Manual Testing vs Automated Testing This point alone is probably worthy of a book and is one of the most ...
- 484
7
votes
Do you still need a Test Plan when adopting Continuous Delivery?
Do you still need a Test Plan when using CI/CD?
YES you do. Because a test plan will tell you at least the thing that you did not specify in your question: how often do you plan to run the tests? ...
- 231
6
votes
Accepted
Is manual regression testing an technical debt for agile teams aiming for continuous delivery?
In my experience, when the lack of automated regression in a delivery pipeline becomes technical debt, you have exactly one option.
Treat automated regression tests as code and sprint on them the ...
- 30.8k
6
votes
Tests in CI: Are API + Integration Tests the most suitable?
Use the test pyramid as mentioned by Peter Masiar.
My contribution here is help answer the question of exactly how to decide the 20% and 80% figures that Peter mentions.
My approach to this is to ...
- 24.4k
5
votes
Integration Testing requires consecutive builds?
What do you think?
Should you eat one meal at a time and 2 to 3 meals a day?
Or
should you eat sufficient meals for 30 days at once and enjoy the remaining 29 days?
Keep things as simple as ...
- 6,890
5
votes
cross-OS automated testing
What you want is called an continuous integration (CI) server. A very popular one is called Jenkins (jenkins-ci.org), though there are others both open source and commercial.
You can configure it to ...
- 914
5
votes
Tests in CI: Are API + Integration Tests the most suitable?
Consider test pyramid. Using Pareto principle (also known as 80/20 rule), you can get 80% of benefits from testing by focusing on unit test with 20% of the effort. And 80% benefit of the remainder if ...
4
votes
Visual Regression Testing
The most efficient tool for testing the appearance of a website is still the human eye and brain.
That said, if you want or need to automate, image comparison is probably the least effective method ...
- 30.8k
4
votes
Accepted
Non-headless Automation Testing on CI Server?
The short answer: No, it is not crazy, as long as you take the proper precautions.
The longer answer:
There's nothing inherently wrong with running UI automation from a CI server. That said, there ...
- 30.8k
4
votes
Is manual regression testing an technical debt for agile teams aiming for continuous delivery?
It depends. Part of me is concerned with the tone of the question, to be honest. I'd be concerned that automated testing is being done to the detriment of manual testing, although some types of ...
- 3,290
3
votes
Selenium IDE and Selenese scripts in Continuous Integration
Selenium Builder is the evolution of the Selenium IDE. Its tooling page has a video (11 minutes) about using it with Travis-CI. Although I haven't watched it I expect it will answer most of your ...
3
votes
Scope of regression testing
Apologies in advance for a quick/simplistic answer - it's crunch time here!
My current client have automated around 80% of regression testing, the rest is done manually with an offshore team, where ...
- 2,442
3
votes
Is it a good practice to run functional tests with coverage?
First of all, coverage isn't coverage. There're several coverage criteria, but most used are:
Function coverage – Has each function (or subroutine) in the program been called?
Statement ...
- 2,102
3
votes
Difference between Integration Testing and Continuous Integration Testing
In a nutshell:
Continuous integration (CI): continuously integrate (small) software changes.
Continuous delivery (CD): continuously deliver these changes.
Continuous testing (CT): continuously test ...
- 2,102
3
votes
Accepted
Difference between Integration Testing and Continuous Integration Testing
Integration Testing
Integration testing is about taking the units of code developed with unit testing and combine them together into the desired system. It (can) also mean testing software by ...
- 24.4k
3
votes
Is manual regression testing an technical debt for agile teams aiming for continuous delivery?
Yes, I think you can group lack of test automation under technical debt.
We don't have time for test automation, so we do it manual
This sounds like "Deliberate" and "Reckless" on the Technical ...
3
votes
How does Continuous Integration add value to Automation Testing?
Continuous Integration
Let me explain in increasing levels of detail:
A place to run your tests.
A remote server that you can push code to that runs the automated tests
Continuous integration usually ...
- 24.4k
3
votes
How does Continuous Integration add value to Automation Testing?
Regression testing should be automated (not manual) and CI is very valuable tool for automated regression testing.
So I assume you already have automated regression tests, and you are considering if ...
3
votes
Automated tests in CI: same or different repo as SUT?
This is a great question and one that many organizations face.
I recommend keeping the test code and the application code together because this will, at the highest level, help keep (or perhaps '...
- 24.4k
3
votes
How is compatibility of business logic tested in microservices?
By the book, microservices business logic are independent from each other - built around business capabilities. This is achieved by defining bounded contexts (check it here, here, and here).
It means ...
- 9,949
2
votes
Accepted
Simple SSH/Git pull continuous integration?
There is still an open ticket to get the enhancement you want.
To elaborate on Adurbe's answer:
You could drop a .sh file onto your server and then call it via Bamboo. Check out this StackOverflow ...
- 4,030
2
votes
Automated tests with selenium must run in local environment or qa environment?
I think the Op is asking two questions:
If, in the version control system, the code in QA is tagged (or branched) separately from code in development, which version should you use with the Selenium ...
- 22.9k
2
votes
What to do with Limited Time/Testers - What is most Important?
Ouch. No, the old school sort of test plan doesn't make much sense in your context. The only reason I can see for doing them is if you had a contractual requirement with a client to deliver them.
...
- 5,115
2
votes
What to do with Limited Time/Testers - What is most Important?
You mentioned having a handle on testing, but wanting to know more about documentation in limited time scopes.
In that case, my advice would be to get into Jira or another bug-tracking software asap....
- 344
2
votes
Scope of regression testing
I asked a similar question awhile back. Perhaps the answers located here may also be of assistance as you evaluate what would be the best fit for your organization. Based on the feedback I received ...
- 1,270
2
votes
Scope of regression testing
When it comes time to complete a roll out we do the following. Its important to note this phase is ran on a previous version test template with no previous data. We are also in the process of pulling ...
- 374
Only top scored, non community-wiki answers of a minimum length are eligible