Questions tagged [automated-testing]

Use for questions involving problems with automated tests. Relevant for designing test automation, debugging test automation, automation tooling questions, and questions about when it is appropriate to automate. Questions regarding specific tools should tag those tools as well.

Filter by
Sorted by
Tagged with
12
votes
3answers
2k views

Is jQuery faster than CSS/Xpath selectors for IE 8.0 in Selenium1?

I am planning to run my existing Selenium 1.x tests in IE 8.0. After checking few blogs and reading this, I tried to run my tests using jQuery locators with the method mentioned here. My tests uses ...
11
votes
7answers
2k views

How to deal with automated test cases that always fail?

I'm facing a lot of automated GUI tests that fail one or more verifications during their run. All the failings points have been reported in our tracking system and they are known issues but get "...
11
votes
7answers
2k views

Should I try the evaluation version of HP Quality Center?

I'm trying to determine if I should spend some time working with a trial version of HP Quality Center. For a number of reasons, my time is very valuable to me right now both at work and in my ...
11
votes
5answers
3k views

How can I switch from manual testing to writing automation?

I am working hourly for low wage as a QA intern/tester. I want to learn more about this field. I have already graduated, so everything I have learned is self taught or learned somehow on the job. At ...
11
votes
5answers
4k views

Looking for open source, Java-based tool for performance testing

Goal: I have an enterprise application written in java to test for performance. I need to do it separately, so I will be basically simulating a user interaction over http/https. My findings: ...
11
votes
6answers
431 views

How can testers motivate developers to write unit tests?

Unit-testing, oftentimes, is thought of as a burden and not exciting at all - more code to write, configure and maintain which requires time which results into delays in delivering features or fixes. ...
11
votes
5answers
16k views

What are some good approaches to separating test data from test scripts?

We're working on test code (mainly UI tests with a few different tools). One thing that's really stumping me is how to best separate test data from test scripts. By test data, I mean values that get ...
11
votes
2answers
2k views

Layered Architecture of Test Automation Software

I was introduced to a 5-layer-model for GUI test automation frameworks, that was considered common knowledge. But I would be interested in a source describing this model. The layers are the following: ...
11
votes
5answers
8k views

AI Driven Testing (AI-DT) open source tools

I am new to AI Driven Testing (AI-DT). I've explored few tools like testim.io, endtest.io. Is any other open source tools are there to achieve this?
11
votes
3answers
2k views

Is there a successful approach to automating security testing?

My team uses a security testing tool called Burp Suite. We currently try to manually run it once a release. One of my tasks is to determine if/how we can make that into more of an automated process. ...
11
votes
4answers
999 views

Test Automation for different Locale?

I have begun with automation for a product which is in one language and soon to be ported in another. The only good thing is - Test Automation is just begun. So there are two things which worry me - ...
11
votes
3answers
263 views

Testing Unfamiliar Software

One thing I've picked up about testing software is to think about the software from the user perspective, and to sometimes "use" the software the way a "normal" user would. However, what if the ...
11
votes
3answers
8k views

Controlling database state in Selenium UI Testing

We have a big test suite with around 300+ tests. Now a days we are manually restoring database and creating few Data Objects and hard coding some data to feed into the tests. However, there are a lot ...
11
votes
4answers
2k views

Load testing tools vs. making your own

I've never needed to work with commercial load running tools before, as our test infrastructure is pretty immature here and I've used internal tools in the past. We're working on a .NET technology ...
11
votes
5answers
28k views

How to start a Selenium2 WebDriver window in background?

I have a series of Selenium2 test cases in C#/NUnit that are run sequentially. Each test case runs in a new instance of the WebDriver (and this is necessary) - which means that each time a new test ...
11
votes
1answer
740 views

Tools for tracking automated tests

I have used STAF/STAX in the past, and liked the way that information was tracked in the tests. I'm currently investigating Technologies to tie together a few tools that use XML-RPC, and am ...
10
votes
11answers
511 views

Should a test method test only one condition?

While writing automated test I come across situations when I include multiple verification points in one method but then I have also read/heard that one tests should make just one verification. Which ...
10
votes
8answers
4k views

Is writing unit tests difficult for me as a QA engineer?

I currently work as a QA engineer and work a lot with Java, Selenium and test automation. But, unit tests are something the developers have been doing and something that I fear. Is it difficult? Do ...
10
votes
2answers
18k views

What is the difference between Software Test Engineer, Test Automation Engineer and Software Developer in Test (SDET)?

Software Test Engineer usualy performs “manual” testing (without spending time on automating and supporting the tests). Usually is responsible to find all (as more as possible) critical bugs in the ...
10
votes
5answers
1k views

Can a proportionately scaled down testing environment find performance load issues?

At my company, we are working on ways to improve our testing of database changes, in our testing environment first. Since there are no resources to have a production like volume of data in servers ...
10
votes
9answers
2k views

Ideal size for a QA team

We've been growing as a company and with it the development, QA, DevOps and other teams. I could not help but notice that with each new addition to our QA team, our meetings are becoming longer and, ...
10
votes
5answers
2k views

How to stay motivated when you don’t like the products you’re testing?

I work in a very great team which are aware of testing and everyone is great to work with. But I have a problem though. I don't have the interest in the domain I am working. At the beginning, I had to ...
10
votes
4answers
3k views

Should unit tests be executed as part of a build?

I worked at a company where unit tests ran as part of the build. The build failed if the unit tests failed. What are the benefits and disadvantages of that practice?
10
votes
5answers
2k views

Is retrying failed tests good strategy to handle flaky tests?

Like many companies we have flaky tests in our test suites. Google has this problem as well: Unfortunately, across our entire corpus of tests, we see a continual rate of about 1.5% of all test runs ...
10
votes
4answers
321 views

How do you design your test method/function

This question has been revolving on my mind from quite some time. Do you develop one method for one test scenario or club similar scenarios in one method and develop automated tests for it. Both ...
10
votes
3answers
11k views

Why should we use javascript for UI test automation?

Background:JavaScript based automation frameworks heavily depends on asynchronous execution, promises, callbacks, anonymous functions, etc which are inherently complex and probably an overkill for a ...
10
votes
7answers
549 views

Most productive onboarding for a new tester

We've been going through onboarding procedures with multiple people that were becoming a part of our QA team throughout the history of our company. During these times we usually try to meet with a new ...
10
votes
5answers
131 views

How to handle “fake” unit tests that don’t really test anything?

I’m a part of a large software project which is supposed to use TDD. There are maybe 90 devs across the world. Upon review of tests for software components, I determined that a significant number of ...
10
votes
8answers
31k views

WebDriver Clicking button issue in IE 11

Have a suite of web-drivers tests that run in chrome and IE 10, but will not run in IE 11. The tests fail in IE-11 when clicking a button as the following action (a form popup) does not occur. I ...
10
votes
5answers
14k views

Testing Page Layout with webdriver

Has anyone tried to test the page layout of a website using webdriver? To be specific, using webelement.getPosition() and webelement.getDimension(). Shouldn't these two methods be enough for testing ...
10
votes
7answers
2k views

Testing email generation

Some applications generate emails. There may be multiple email formats based on the purpose of the message. The email may be destined for a single individual or a group. It may also be locale-...
10
votes
2answers
3k views

How to avoid flakey E2E selenium tests?

I'm under the impression that most of the E2E selenium tests are flakey. A major reason seems to be timing issues. Another one is that they often test against servers that are not controlled by the ...
10
votes
5answers
17k views

How best to test file download links using Selenium

On a website I am testing we have various links that download PDF files to the users computer. Our selenium suite runs nightly on bamboo, if we were to download the various files overnight it ...
10
votes
2answers
551 views

Detecting complicated CSS selectors

This is a follow-up to What makes a good selenium locator? Motivation I've been thinking about detecting the complexity of CSS selectors statically. The scope I'm working in is both test-automation ...
9
votes
5answers
2k views

Is it necessary to verify databases for functional automation testing?

Currently, after every action that adds or changes data, we verify that that data was successfully added/changed in the database by querying the tables directly. I feel this is redundant because that ...
9
votes
8answers
786 views

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

Background: Following are not my assumptions or expectations but in my last couple of interactions with different project teams, I am seeing these patterns where it is expected (from testing by the ...
9
votes
10answers
26k views

Is mail testing with selenium possible?

We have merely just had a kick off meeting for a new project that I am required to automate ASAP. The project is essentially a "mailbox project", if you will, and I have no idea as to where to start ...
9
votes
5answers
8k views

Manual tester wanting to get into automation

So its been a year since I have been studying python, and just recently I started picking up webdriver. It was a long journey, and I am still pretty noob, but I finally understand how to use it lol. I ...
9
votes
4answers
328 views

What should an automation tester create a script for?

I am a newbie in automation testing. The question that bothered me while creating scripts was: Is it only GUI testing or do we also have to create Integration automation scripts? What would be our ...
9
votes
5answers
1k views

Failed automated tests: how to distinguish known and newly introduced bugs?

Use case: Fitnesse is used for automated testing of the web site. SUT (software under test) contains a known bug. Say, we expect that web page contains "Changes saved successfully" string but this ...
9
votes
5answers
933 views

What proportion of different types of software testing does your team use?

Note: I've asked this over on SO and p.SE and it got closed. I'm not trying to game the system, just looking for a home :) I'm seeking a little "wisdom of crowds" estimation or a pointer to an ...
9
votes
4answers
520 views

How to test the test scripts?

Once an automation test is created, how do I test it and make sure the test does what its supposed to do? I can easily test the scenarios where test passes, but how to go about the ones that fails due ...
9
votes
7answers
2k views

Techniques for test selection, give a large suite of test cases

I have a huge collection of test cases (inputs). I'd like to select a small subset that's likely to catch most of the bugs. Are there any standard or known techniques in the testing literature for ...
9
votes
6answers
452 views

Ownership of test automation

This is one of the challenge am facing with a new project. We are facing a difficult task in deciding and getting everyone on board as to who will handle ownership of test automation. I am aware ...
9
votes
5answers
8k views

Test automation for microservices architecture

I am in charge of implementing QA processes and test automation for a project using microservices architecture. Project has one public api that makes some data available. So I will automate API tests....
9
votes
3answers
756 views

Where tools for automated UI test like selenium or Coded UI fits in Dev Ops cycle

My manager asked me to look into how we can utilize automated UI testing to gain productivity and help testers automate basic functionality of the system. I developed few test suites and cases using ...
9
votes
4answers
2k views

How to validate against texts overlapping each other using selenium?

I am writing automated test cases for a company. One interesting problem is that texts on a webpage overlap each other, is there anyway to validate against this?
9
votes
2answers
804 views

How to make sure your test data are correct?

We are doing integration tests where we simulate manually data coming from external systems to our application. Integration tests task has become bottleneck in our team, because preparing test data is ...
9
votes
2answers
3k views

How is Selenium different from other GUI automation tools?

I have used WatiN and WebAii but I have limited experience with Selenium. How does Selenium differ from these other tools?
9
votes
3answers
709 views

How do you know if you are writing high quality tests?

Inspired by Exercises on software testing We can learn to write automated tests and we can learn to do tdd and bdd but what tools / resources / guides are available to tell us if the actual tests we ...