corsiKa
Moderator
  • Member for 10 years, 9 months
  • Last seen this week
Can every test be done by automation?
Accepted answer
53 votes

No. You can't automate everything. You can't automate people's reactions (emotions) to your software. You can't automate things you don't think of. (eh? eh?) You can't automate users' thought ...

View answer
Does simply running the code during development mean 'Testing'?
Accepted answer
33 votes

A test is an experiment. You have a hypothesis, which is normally governed by a specification, such as "When I enter a username and password that I know to be valid and click login, I am brought past ...

View answer
How do you tell a programmer they're not testing their own code enough?
26 votes

Disclaimer: I am approaching this as a programmer (who is here mostly to learn how to better interact with our testers.) It's important to remember that the developer has not always been told how to ...

View answer
What Are Some Examples of Why Explicitly Sleep Statements Are Bad?
Accepted answer
25 votes

A hard coded sleep statement is generally supposed to represent some sort of mocked delay in the application that doesn't exist during testing. The harmful aspect of this is that a hard coded value ...

View answer
What is the difference between "testing" and "quality assurance"?
23 votes

I would say it's best described that testing is a subset of QA. Your goal of testing is to ensure the functional requirements and metrics are met. This could be computational performance, clicks-per-...

View answer
What is the difference between "automated testing" and "automated regression testing"?
Accepted answer
19 votes

The truth is for a lot of people, there isn't a difference. A regression test is something that is going to check your test results against some requirements. Good examples of this are unit tests and ...

View answer
How to deal with automation naysayers?
Accepted answer
19 votes

I definitely feel your pain. As noted in a question I had (I'll link in a minute) I too work for a 10-digit revenue company, and our primary software has 0 automated tests for over a million lines of ...

View answer
What could a QA engineer do when a project is in an early stage?
Accepted answer
13 votes

If the product is at the MVP stage and your QA is just getting started, there's a problem. As a BA I saw this time and time again with dev vs QA where the dev team only got the BA to do testing when ...

View answer
Best guidelines for bug reporting?
10 votes

Here are a couple things that I look for in a bug report. Exact steps to reproduce. You might be able to get away with some slang, for example in our APP you can almost always press F1 to move to the ...

View answer
Measuring test performance when there is high variance
Accepted answer
10 votes

The first thing you need to do is isolate whatever could be messing with your system. Make it as independent as possible. The fewer background processes, extra hardware and software, and even network ...

View answer
Does DevOps really kill QA?
Accepted answer
9 votes

Simply put, no it hasn't. It might be changing some development shops, but not all, and even where it is changing it isn't killing anything. Or at least, it shouldn't be. First, let's be sure to ...

View answer
Testing interactions with external systems
Accepted answer
8 votes

One of the fundamentals of testing is isolation - how do you make your test environment as isolated as possible. When you're dealing with internal resources, this is fairly easy as you have complete ...

View answer
Suggestions for "Selling" TDD, and BDD to sceptical non engineering managers
Accepted answer
8 votes

One of the realities about corporate politics (I hate to say it, but it's a big part of our job) is that everyone wants to put out the image that they're open minded and willing to do what's best for ...

View answer
Using 'final' variables in Java Selenium tests
Accepted answer
7 votes

This is a standard programming practice intended to reduce bugs in code. As a refresher, the final modifier prevents a primitive variable or object reference variable from being reassigned. Thus, ...

View answer
How to organize a QA Process/Department?
7 votes

There are some major red flags here. You're only going to any testing after development is completely done? If this is development of a single feature, that's fine. If this is for an entire sprint ...

View answer
Can I get freelance QA (QA Lead or QA Manager) role through my sqa.stackexchange.com reputation?
7 votes

It depends on what you mean by "through" - obviously, this is not a job board. A quick check of Stack Overflow Jobs shows that companies are hiring people for QA roles though the network, and they'd ...

View answer
Dividing line for developers on cross browser testing before handing off to QA
Accepted answer
7 votes

TL DR: Establish a baseline, tinker, and react. In general developers should not worry too much about cross browser testing. Yes, it's a problem, and yes, they need to be aware of it, but I would keep ...

View answer
Testing Unfamiliar Software
Accepted answer
7 votes

There are two supporting features that are great for testers. Technical ability Domain knowledge Technical ability is more along the lines of "I'm testing a game, and I know graphics libraries. I'm ...

View answer
Should programmers run automated tests written by QA?
7 votes

I would make it automatic post-commit (via a trigger, or preferably a build system) that some kind of test is run. If the test is too extensive, then scale the post-commit test back to run in a ...

View answer
What is meant by "Automated tests don't find new bugs"?
6 votes

The theory behind it is that an automated test will only catch exactly what it tests for. Since someone had to code it manually, someone is aware of how it will fail. By this definition it's not a new ...

View answer
Does writing "Given" "When" "Then" BDD style test cases scale up to larger, end-to-end scenarios
Accepted answer
6 votes

I don't see why it wouldn't scale. It's conceptually simple (which naturally makes it self open to scalability.) I would be weary though - the more complex a test is, the less effective it is. If you ...

View answer
What criteria do I apply to a highly complex development project to warrant getting "real world" data?
Accepted answer
5 votes

On my team, the process is simple. We don't have automated tests, so pretty much all we get are using the real-world data, which is usually a week, month, or more out of date. It gets refreshed when ...

View answer
What needs to be tested besides compliance with functional requirements?
Accepted answer
5 votes

Personally, I think yes, but no. Yes in the sense that you need to make sure it's "good" in a common sense way. But once you've identified where it's not "good" you need to break down why into a ...

View answer
how do i make the case to management for QA to get a new android for testing the mobile platform?
5 votes

Don't take this the wrong way, but first make the case to us. You say you feel there is need for one; could you elaborate on this feeling? Get into specifics, and put them into your question. After ...

View answer
What are the advantages of automated user acceptance tests?
Accepted answer
5 votes

Anything that is automated should run the same way every time. When you're running it the same way every, single, time you are more likely to get results that compare to eachother. If you're relying ...

View answer
Impacts of BDD on QA Teams
4 votes

I could be off my footing here (and if I am, please let me know!), but from a QA perspective, everything that TDD is for automated tests, BDD is for manual tests. Now some of these 'manual tests' may ...

View answer
Capture screen during exploratory testing
4 votes

Back in high school we made movies playing games via a program called Fraps. I don't know if it exists anymore, but it might be worth looking in to. Don't ask how did we ever manage to convince our ...

View answer
Should automated tests be efficient?
4 votes

Scaling is always important to keep in mind. If you doubled the number of tests (which will happen eventually) to so now it goes up to 20 hours, would this be a problem? Maybe. You would start it at 5 ...

View answer
How can I report coverage on an n-dimensional test matrix?
4 votes

How to do it Let's let your dimensions' sizes be C1, C2 ... Cn where n is the number of dimensions. So, C1 might be 3 if your values are Windows, Mac, Linux (I'm sure you'd have different versions of ...

View answer
What's "Offline" in SDLC and when/why do we use test automation?
3 votes

I would have responded with a clarification of exactly what "offline" means. I can think of three possible definitions. Offline means disconnected from a network. If it is part of the requirements ...

View answer