10 votes
Accepted

Do you still need a Test Plan when adopting Continuous Delivery?

I don't see CI/CD as something different than non CI/CD process, tests are simply being run by a non human entity. Do you need a test plan (or plan your tests) ? of course you do, you need to think ...
user avatar
  • 6,945
9 votes
Accepted

Tests in CI: Are API + Integration Tests the most suitable?

As already mentioned in your TechBeacon article, teams indeed often spend too much at the top of the test automation pyramid. In general, the pyramid is a good rule of thumb, but (as always) it ...
user avatar
  • 2,102
7 votes
Accepted

What to do with Limited Time/Testers - What is most Important?

The short version: Don't sweat on automation or test cases. Chances are you won't get time to build it because there's too much that has to be manually tested now. Instead focus on building light-...
user avatar
  • 30.8k
7 votes

What should a QA in software be worried about when a small configuration deployment is being pushed without testing?

It all depends on what you're configuring, and if the configuration mechanism itself was tested before. If it's something small, like a timeout interval, number of retries, etc, then I'd agree it ...
user avatar
  • 1,030
7 votes

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

There are an awful lot of variables to consider here. But here are some points all the same. Manual Testing vs Automated Testing This point alone is probably worthy of a book and is one of the most ...
user avatar
7 votes

Do you still need a Test Plan when adopting Continuous Delivery?

Do you still need a Test Plan when using CI/CD? YES you do. Because a test plan will tell you at least the thing that you did not specify in your question: how often do you plan to run the tests? ...
user avatar
  • 231
6 votes
Accepted

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

In my experience, when the lack of automated regression in a delivery pipeline becomes technical debt, you have exactly one option. Treat automated regression tests as code and sprint on them the ...
user avatar
  • 30.8k
6 votes

Tests in CI: Are API + Integration Tests the most suitable?

Use the test pyramid as mentioned by Peter Masiar. My contribution here is help answer the question of exactly how to decide the 20% and 80% figures that Peter mentions. My approach to this is to ...
user avatar
5 votes

Integration Testing requires consecutive builds?

What do you think? Should you eat one meal at a time and 2 to 3 meals a day? Or should you eat sufficient meals for 30 days at once and enjoy the remaining 29 days? Keep things as simple as ...
user avatar
5 votes

cross-OS automated testing

What you want is called an continuous integration (CI) server. A very popular one is called Jenkins (jenkins-ci.org), though there are others both open source and commercial. You can configure it to ...
user avatar
5 votes

Tests in CI: Are API + Integration Tests the most suitable?

Consider test pyramid. Using Pareto principle (also known as 80/20 rule), you can get 80% of benefits from testing by focusing on unit test with 20% of the effort. And 80% benefit of the remainder if ...
user avatar
4 votes

Visual Regression Testing

The most efficient tool for testing the appearance of a website is still the human eye and brain. That said, if you want or need to automate, image comparison is probably the least effective method ...
user avatar
  • 30.8k
4 votes
Accepted

Non-headless Automation Testing on CI Server?

The short answer: No, it is not crazy, as long as you take the proper precautions. The longer answer: There's nothing inherently wrong with running UI automation from a CI server. That said, there ...
user avatar
  • 30.8k
4 votes

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

It depends. Part of me is concerned with the tone of the question, to be honest. I'd be concerned that automated testing is being done to the detriment of manual testing, although some types of ...
user avatar
3 votes

Selenium IDE and Selenese scripts in Continuous Integration

Selenium Builder is the evolution of the Selenium IDE. Its tooling page has a video (11 minutes) about using it with Travis-CI. Although I haven't watched it I expect it will answer most of your ...
user avatar
3 votes

Scope of regression testing

Apologies in advance for a quick/simplistic answer - it's crunch time here! My current client have automated around 80% of regression testing, the rest is done manually with an offshore team, where ...
user avatar
  • 2,442
3 votes

Is it a good practice to run functional tests with coverage?

First of all, coverage isn't coverage. There're several coverage criteria, but most used are: Function coverage – Has each function (or subroutine) in the program been called? Statement ...
user avatar
  • 2,102
3 votes

Difference between Integration Testing and Continuous Integration Testing

In a nutshell: Continuous integration (CI): continuously integrate (small) software changes. Continuous delivery (CD): continuously deliver these changes. Continuous testing (CT): continuously test ...
user avatar
  • 2,102
3 votes
Accepted

Difference between Integration Testing and Continuous Integration Testing

Integration Testing Integration testing is about taking the units of code developed with unit testing and combine them together into the desired system. It (can) also mean testing software by ...
user avatar
3 votes

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

Yes, I think you can group lack of test automation under technical debt. We don't have time for test automation, so we do it manual This sounds like "Deliberate" and "Reckless" on the Technical ...
user avatar
3 votes

How does Continuous Integration add value to Automation Testing?

Continuous Integration Let me explain in increasing levels of detail: A place to run your tests. A remote server that you can push code to that runs the automated tests Continuous integration usually ...
user avatar
3 votes

How does Continuous Integration add value to Automation Testing?

Regression testing should be automated (not manual) and CI is very valuable tool for automated regression testing. So I assume you already have automated regression tests, and you are considering if ...
user avatar
3 votes

Automated tests in CI: same or different repo as SUT?

This is a great question and one that many organizations face. I recommend keeping the test code and the application code together because this will, at the highest level, help keep (or perhaps '...
user avatar
3 votes

How is compatibility of business logic tested in microservices?

By the book, microservices business logic are independent from each other - built around business capabilities. This is achieved by defining bounded contexts (check it here, here, and here). It means ...
user avatar
  • 9,949
2 votes
Accepted

Simple SSH/Git pull continuous integration?

There is still an open ticket to get the enhancement you want. To elaborate on Adurbe's answer: You could drop a .sh file onto your server and then call it via Bamboo. Check out this StackOverflow ...
user avatar
  • 4,030
2 votes

Automated tests with selenium must run in local environment or qa environment?

I think the Op is asking two questions: If, in the version control system, the code in QA is tagged (or branched) separately from code in development, which version should you use with the Selenium ...
user avatar
  • 22.9k
2 votes

What to do with Limited Time/Testers - What is most Important?

Ouch. No, the old school sort of test plan doesn't make much sense in your context. The only reason I can see for doing them is if you had a contractual requirement with a client to deliver them. ...
user avatar
  • 5,115
2 votes

What to do with Limited Time/Testers - What is most Important?

You mentioned having a handle on testing, but wanting to know more about documentation in limited time scopes. In that case, my advice would be to get into Jira or another bug-tracking software asap....
user avatar
2 votes

Scope of regression testing

I asked a similar question awhile back. Perhaps the answers located here may also be of assistance as you evaluate what would be the best fit for your organization. Based on the feedback I received ...
user avatar
2 votes

Scope of regression testing

When it comes time to complete a roll out we do the following. Its important to note this phase is ran on a previous version test template with no previous data. We are also in the process of pulling ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible