Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [automated-testing]

Use for questions involving problems with automated tests. Relevant for designing test automation, debugging test automation, automation tooling questions, and questions about when it is appropriate to automate. Questions regarding specific tools should tag those tools as well.

58
votes
14answers
256k views

How to download a file using Selenium's WebDriver?

Basically I want to at least check that a download-able file exists / download link works and preferably get stuff like the file size too. Here's an example: link = self.browser....
55
votes
18answers
10k views

What are some tools for testing Mobile web apps?

I'm thinking along the lines of a Firebug for the iPhone/iPad/Android/BB that can truly give more insight on the markup/scripts. Even when testing on the simulator/device, it's hard to truly simulate ...
46
votes
12answers
2k views

Building “slow to break” regression tests

I need to build a lot of regression tests for our product at work and I plan on using Selenium. I am concerned about building tests that will become quickly outdated and broken based on the fast pace ...
43
votes
11answers
3k views

Should programmers run automated tests written by QA?

Perhaps programmers have their own unit tests, perhaps as the result of doing Test-Driven Development. They run these tests very often; perhaps every few minutes, but at least a few times each day. ...
41
votes
18answers
47k views

Compare screenshots of rendered web pages

In my team, we use Selenium for automation of functional testing. We also do a lot of manual regression testing to make sure the appearance of the rendered web pages is ok. I would like to develop a ...
40
votes
12answers
12k views

Can a Manual Tester survive in software industry without learning Automation?

I mean to say is that if I dislike coding and don't understand complex code , then will I be able to survive as a QA. Or do I need to learn test automation to grow position and pay in my career, as i ...
38
votes
4answers
9k views

Are Selenium functional tests reliable enough to be worthwhile?

I'm finding that regardless of how solid my tests scripts are, I still have tests that fail (falsely), even though they worked just fine before. I'm not talking about if markup changes (although that ...
35
votes
10answers
3k views

What is meant by “Automated tests don't find new bugs”?

As I understand it, this sentence means that automated tests don't find new bugs in existing code (though they might catch a new bug in new code that breaks old code). Is this correct? Or is this ...
33
votes
16answers
43k views

What programming languages are good for novice testers to learn?

I'm looking for a programming language to recommend to a friend considering teaching herself software testing. I have a friend who is interested in learning software testing, and I believe strongly ...
32
votes
16answers
8k views

What's the difference between a good test and a bad test?

Please don't burn me for this simple question. I know, it may be very simple but for me it's complicated. "A Good Test" or "A Bad Test" - every tester comes across these two terms. Sometimes it ...
32
votes
10answers
13k views

Why should a software QA engineer need to learn JavaScript?

I've seen in lot of job advertisements, companies asking for JavaScript knowledge for QA. So my questions are: What is the use of JavaScript for QA? If JavaScript is used for testing, what kind of ...
31
votes
16answers
16k views

Can every test be done by automation?

Can every test be done by automation? Or is there anything that cannot be done by automation?
29
votes
12answers
7k views

How to explain the concept of test automation to a team that only knows manual testing?

I have been working as a QA in our 9 developer team for about a year. Had lots of 'firsts' within the year between personal and professional life. I replaced a QA who only did manual testing and ...
28
votes
7answers
3k views

Has automated UI regression testing helped you in finding critical defects in system?

I have heard a lot of "abuse" about automated testing, especially UI bases automated tests. As UI is very fragile and prone to change (especially in agile shops). Personally my automated tests have ...
26
votes
13answers
94k views

How to fill CAPTCHA using Test automation?

How can I automate "Enter CAPTCHA" using Selenium WebDriver?
24
votes
16answers
37k views

Under what circumstances is Sikuli better for test automation than Selenium or Watir?

The Sikuli website says: Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots). Under what circumstances is Sikuli a better technology for ...
24
votes
6answers
1k views

How to deal with automation naysayers?

In my team, there are a number of experienced QA people. I work mostly on developing tools to make the QA process easier for these guys, such as developing test automation. The uptake has been slow, ...
24
votes
10answers
52k views

Chrome driver 2.28: “Chrome is being controlled by automated test software” notification. Can it be removed?

I have just updated my project with the latest chrome driver (2.28). When I run the browser through the driver, a yellow notification pops under the URL bar, saying "Chrome is being controlled by ...
23
votes
6answers
9k views

Mobile automation: Boss wants 100% coverage. How feasible is that?

Just started a new mobile automation role using react native for iOS. I'm not new to automation, but I am new to React Native (with detox and jest). The learning curve is slow, but we are getting ...
23
votes
13answers
33k views

What is a good website to hack around using Selenium?

I want to learn Selenium, but I don't know what to code. Sure, I can throw Google some queries, I can fill out some forms, press buttons, find divs and links, etc. But I think this stuff is pretty ...
23
votes
6answers
134k views

How do I work with dropdowns in Selenium Webdriver?

This is a canonical question, intended to provide a comprehensive answer to many related questions. I understand the basics of working with Selenium Webdriver; I can navigate to pages, click buttons, ...
23
votes
7answers
3k views

Are your UI automated tests dependent or ordered?

While writing UI automated tests, I've come across situations where test dependency looked like a must. For example, say I have two tests, where the second is dependent on the success of the first. I ...
23
votes
3answers
2k views

Good resources for building a QA team

Our corporation has, up until this point, largely lacked a 'quality mentality' of any kind. From no testers, they went to two testers - but 5 or 6 product teams still rely on a mix of developer and ...
23
votes
12answers
5k views

Test Result Management and Reporting tool

I'm looking for a some sort of management/reporting tool that collects the results of tests, stores them for reporting, then lets users generate reports based on those tests. We have numerous test ...
22
votes
16answers
6k views

Manual testing is better than Automation testing. Is that true?

With manual testing, you don't need to buy software automation tools or write scripts. Automated tests are robotic and don’t necessarily act as a real would user. On the other hand, manual testing ...
22
votes
9answers
1k views

Can someone be a good automated tester and be terrible programmer?

I'm currently working as an automated tester. Mostly I do GUI testing in SilkTest, which I like and think I'm fairly good at. Recently, I've been assigned a COM-testing project for our application's ...
22
votes
6answers
5k views

Is software testing different when we are dealing with game development?

I was reading this paper about the differences between software development in general and game development and the authors made some good points regarding software testing, pointing out, for instance,...
22
votes
7answers
94k views

Selenium: reuse existing browser session, instead of opening new windows?

This has been asked a million times on the web, but there's no clear cut answer. I tried "-browserSessionReuse" today without any luck; my tests keep spawning new browser windows. X:\QA\Automation\...
21
votes
5answers
2k views

What additional benefits does an software engineer bring to a QA position

I have noticed in the last few years that employers are now looking for QA/Developers (QA engineers that have been skilled developers). I would like to know what others believe are the actually ...
21
votes
6answers
10k views

What makes a good selenium locator?

When automating UI tests with Selenium, it is often not absolutely clear what method and what locator to use to locate an element. Some locators are less reliable, less readable than others. And, ...
21
votes
7answers
3k views

Does automating your manual tests give you good automated tests?

I notice that the tag wiki for the "automated testing" tag contains the following sentence: "Commonly, test automation involves automating a manual process already in place that uses a formalized ...
21
votes
4answers
4k views

Tools for Python software testing

Similar to Tools for Server application testing, I'm looking for Python-related testing tools/software (as Python is my most frequently-used language).
21
votes
3answers
2k views

What's the recommended practice for separating unit tests from integration tests for automated testing?

On a project I've been working on, we've been steadily increasing the code coverage through tests. Some of these tests were done as integration tests, and some as unit tests. The integration tests can ...
21
votes
8answers
53k views

What are some good open source UI Testing tools for testing Windows GUI?

I need a list of some good tools which are open source and meant for automating the UI testing of Windows GUI. Any help will certainly be appreciated.
20
votes
7answers
3k views

Transition from all manual testing to automated testing

Right now my company only does manual testing. We've talked about starting some automated testing for a while but it hasn't taken off at all. It seems like automated testing would be a good way to ...
20
votes
12answers
12k views

What are good guidelines to determine when to automate a test?

When it comes to test automation, I use a very arbitrary method based on experience that 80% of all tests should be automated. This has worked well in practice, but is based more on "voodo" than ...
19
votes
8answers
3k views

Is it realistic to try to hire someone who is a developer and a tester?

I've been trying to hire a tester for a few months without success. I really want to find someone who is both a tester and a developer, not because I want them to do two roles, but because the kind of ...
19
votes
9answers
2k views

Should application and automated test languages match?

If an application is written in a certain language, e.g. Python, Ruby, Clojure, etc. should Quality Engineers use the same language to write the tests? Should this be a decision that we can apply ...
19
votes
7answers
1k views

In agile (Scrum) practices, where do I start with making QA (testing) more efficient if the team is transitioning from waterfall to agile?

My team has recently transitioned from the traditional waterfall method to practicing Scrum. Being the QA lead, really the only tester on a small team, how can I get the process more aligned with ...
19
votes
4answers
53k views

How to Implement Page Object and Page Factory Pattern in Selenium Webdriver?

I am a beginner in learning selenium Webdriver. I am not able to understand how page object and factory models works and how it can be beneficial? Kindly help me explain it with detailed ...
19
votes
5answers
971 views

Are Exhaustive “Brute Force” UI Tests Worth It?

Lately I've been asked to write some automated GUI tests of the following style: Open the application Open ALL dialog boxes In each dialog check for ... Are these types of tests worthwhile? What ...
19
votes
14answers
6k views

Tools for testing iPhone apps

I was wondering if there any automation tools out there that can help with the process of testing an iPhone application on the device itself and not on a simulator. Ideally, it would have to simulate ...
18
votes
10answers
5k views

Can we replace everything with automation or do we need manual testing? [duplicate]

I have seen arguments that we should automate all our tests, and I have seen arguments that manual testing is necessary. I don't know which one to believe. Is it even possible to automate all tests? ...
18
votes
9answers
2k views

How do I convince someone who's bought the Record-Playback line that object oriented framework is essential?

Here's the basic setup - over a number of years the testing team at my workplace has developed a sophisticated (probably rather more complex than strictly necessary) object-oriented, data-driven ...
18
votes
5answers
9k views

How does one get started with web test automation using Selenium?

So I've been testing web based analytical software now for the past 4 years or so with mostly manual techniques. But for 2015, I've set myself the goal of getting setup and start writing automated ...
18
votes
5answers
104k views

Webdriver Check if Checkbox is Set and Set it if Not

I am learning Webdriver with JUnit by going through Alan Richardson's Selenium Simplified book and taking translating the exercises/tests from Selenium RC to Webdriver. So far, this has proven to be ...
18
votes
4answers
4k views

Screen Play vs Page Object pattern

I've recently stumbled upon Senenity/JS framework which advocates the Screen Play pattern, which was proposed as a better alternative to Page Objects. What are the key fundamental differences between ...
17
votes
8answers
3k views

Asking UI developers to adjust markup to improve automated tests

From time to time when doing test automation, a locator for the desired element is either too complicated, fragile or not readable. In cases like this, we ask developers to add IDs or other data-...
17
votes
5answers
1k views

What Are Some Examples of Why Explicitly Sleep Statements Are Bad?

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
17
votes
5answers
9k views

What is the difference between “automated testing” and “automated regression testing”?

"Automated Testing" as a term seems to have a number of different uses. For some, it means built in unit tests that, when a new build is run, execute to make sure code refactors have not broken ...