Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [test-automation-framework]

A test automation framework provides a superstructure for automated tests. The superstructure may include APIs, coding practices, ways to structure and run the automated tests.

23
votes
6answers
9k views

Mobile automation: Boss wants 100% coverage. How feasible is that?

Just started a new mobile automation role using react native for iOS. I'm not new to automation, but I am new to React Native (with detox and jest). The learning curve is slow, but we are getting ...
18
votes
5answers
9k views

How does one get started with web test automation using Selenium?

So I've been testing web based analytical software now for the past 4 years or so with mostly manual techniques. But for 2015, I've set myself the goal of getting setup and start writing automated ...
17
votes
5answers
1k views

What Are Some Examples of Why Explicitly Sleep Statements Are Bad?

I've read various places that explicit sleep statements are a bad practice in automated tests, even if I've used them occasionally. They can be annoying (creating unnecessary waiting in tests) but I ...
12
votes
6answers
34k views

How should you interview for QA *Automation* positions?

A variant on the How should you interview for QA positions? I am interviewing candidates for an Automation position, we don't use commercial automation tools, but rather use a framework using mainly ...
12
votes
7answers
7k views

How to make selenium tests more stable?

I am using selenium tests to perform GUI-based system tests of non-public scientific use cases. Although I have build more-or-less a complete wrapper around the selenium module with functions to ...
12
votes
3answers
12k views

Automated tests pass every time when run individually, but when they are clumped into a test suite it's a toss up if the tests will pass

I have around 200 test classes for my web application at the moment. I use Selenium2/Webdriver and the tests are written in java, with TestNG used as my framework. When I run each test by itself, ...
11
votes
5answers
3k views

How can I switch from manual testing to writing automation?

I am working hourly for low wage as a QA intern/tester. I want to learn more about this field. I have already graduated, so everything I have learned is self taught or learned somehow on the job. At ...
11
votes
2answers
2k views

Layered Architecture of Test Automation Software

I was introduced to a 5-layer-model for GUI test automation frameworks, that was considered common knowledge. But I would be interested in a source describing this model. The layers are the following: ...
11
votes
1answer
733 views

Tools for tracking automated tests

I have used STAF/STAX in the past, and liked the way that information was tracked in the tests. I'm currently investigating Technologies to tie together a few tools that use XML-RPC, and am ...
11
votes
6answers
7k views

UI test automation tools for Windows Phone 8 metro apps?

Is there any UI test automation tool or framework exist that can automate Windows Phone 8 metro app?
10
votes
7answers
205 views

Version controlling for Test Automation code

Our DevOps team has come up with a concept that I (as a QA automation engineer) do not agree with. They are suggesting that the test automation code should also have versioning that is always ...
9
votes
5answers
1k views

Failed automated tests: how to distinguish known and newly introduced bugs?

Use case: Fitnesse is used for automated testing of the web site. SUT (software under test) contains a known bug. Say, we expect that web page contains "Changes saved successfully" string but this ...
9
votes
4answers
494 views

How to eliminate/reduce invalid failures in automation due to GUI changes?

I am into the automation of a web application using Selenium. I write test cases without hard-coding anything in the test cases. There were many invalid failures in the run due to GUI changes such as ...
9
votes
4answers
271 views

In Page Object pattern, aren't we creating over-specialized methods than generalized re-usable functions?

Background: In the Selenium UI automation we all have been using Page Objects pattern as the "Best Practice" for years. In Page Objects "methods" are tightly coupled to pages instead of generic ...
9
votes
3answers
705 views

How do you know if you are writing high quality tests?

Inspired by Exercises on software testing We can learn to write automated tests and we can learn to do tdd and bdd but what tools / resources / guides are available to tell us if the actual tests we ...
9
votes
2answers
6k views

key points for choosing a framework in selenium webdriver - Java

My query is related to this Choosing framework type for selenium RC/Webdriver I am a beginner in Selenium and want to know how to select or choose a framework in Selenium Webdriver. What are the key ...
9
votes
5answers
39k views

Selenium 2 element.click() is unreliable

I am using Selenium 2 2.16 build. I've been running into problems where I get a variable response to a click() call, where sometimes the click activates the behaviour behind the element (new page ...
8
votes
4answers
620 views

What to do when QA team has no test case documentation?

I just started working as a QA Automation Engineer to a certain company which provides ERP and CRM services. However, I recently discovered that they have no test case documentation for the testing ...
8
votes
3answers
1k views

API test automation: GUI tool vs programmatic approach?

We have a Rest API written in C# and I need to investigate a good approach to automate the tests. There are 2 ways to automate API tests: GUI tool (e.g. SoapUI) Programmatic approach, using some test ...
8
votes
2answers
24k views

How to extract a text from the screen using SIKULI?

I am using Sikuli to automate a mainframe screen, I need to copy a text on screen and use that as input to another screen. I cannot find any option on the SIKULI IDE to do the copy function. My ...
8
votes
1answer
1k views

Test Automation Design Question

I am analyzing automation design for an Intranet based web app with a limited user base: UI Layer Web Service Layer DB Layer My Approach for automation is: Web Services layer Test automation ...
7
votes
5answers
228 views

What are the tools that we can use to automate, before completion of the development?

I'm kind of new to software automation and I'm doing UI automation by using selenium webdriver. I have heard that there are some tools, that can automate a system before we get the UI of the system ...
7
votes
4answers
8k views

Is there any framework for UI automation testing for Unity3D?

Does anyone know any framework that is compatible/integrated with Unity3D? I'm interested in Unit, Integrated and UI testing.
7
votes
4answers
4k views

Is Eggplant any good for image capture and image recognition?

As a software tester looking at different automated testing solutions, I need a tool that will interact with a heavily graphical interface such as a flash website or application. I want the tool to ...
7
votes
2answers
5k views

Open-source/freeware testing tool for Set-Top Box

According to Wikipedia a set-top box (STB) is: an information appliance device that generally contains a tuner and connects to a television set and an external source of signal, turning the source ...
6
votes
3answers
5k views

MS-SQL server sql test automation

I'm looking to create a batch of automated tests in SQL on MS-SQL server, these will include tests like - insert some records, call stored procedure, check certain conditions in various tables. There ...
6
votes
3answers
630 views

Is page object a framework or design pattern?

Currently I'm using page object design pattern with testing.
6
votes
5answers
172 views

How does Continuous Integration add value to Automation Testing?

How do I gain the value from CI tools as an Automation Tester? What are the advantages to using such tools and how do they help me and the company in the development process ?
6
votes
7answers
6k views

How we can verify whether webpage is refreshed or not?

Suppose a webpage has a functionality, it refreshes the whole webpage after a fixed time interval and nothing changes on the webpage. How we can test this with automation?
6
votes
3answers
3k views

Use Page Object vs other models for Automation in Selenium Webdriver? [duplicate]

I have been doing automation testing since last 2 years and I am following below ways for any website and mobile application automation testing. Create Global Method class where I implement all test ...
6
votes
3answers
903 views

Test, Improve performance of WebDriver Automation framework

I have designed a hybrid(keywords and data in same excel sheet) framework using WebDriver+Java+TestNG+Maven. I am using PageFactory, Singleton Pattern . I am using different type of HTML locators in ...
6
votes
1answer
169 views

How would you convince someone that the Page Object Model pattern is important?

I'm looking for canonical answers explaining the importance and advantages of the Page Object Model design pattern, specifically answers that I could point to for people who claim the pattern is ...
6
votes
1answer
548 views

How can I set up concurrent execution on multiple devices using different test users? - Calabash

I have an automation suite for our native apps on Android and iOS created using Cucumber, Calabash, and Ruby. I'm utilizing a Page Object Pattern to allow for our project to be cross-platform. At ...
5
votes
5answers
5k views

Which language gives better career options: TCL or PERL?

I am an engineer with 1.5 years of experience in Test Automation in Perl. I am getting chance to work in TCL. I am little worried about my career growth. I don't know whether TCL also has the same ...
5
votes
4answers
1k views

How to choose page object design & structure

We had a discussion between several automation engineers on page object design, specifically about how many layers it should have and what are the responsibilities of the layers. I hope you guys could ...
5
votes
4answers
2k views

What tools work well for automating .NET 4.0 web sites using web forms with dynamic data?

What would be the best solution to accommodate automated testing of web forms with code-behind (.NET 4.0)? Specifically, we need a solution that can automate web form testing and handle dynamic data ...
5
votes
3answers
6k views

Python based test automation tools for desktop applications

I have some experience as a manual tester and at my current work our regression testing takes about 2 days. I am planning to start automating some of the test cases. I am looking at some of the free ...
5
votes
3answers
669 views

Generate test data in which format

What is the best approach to make test data configurable ? Through XML file or properties file or any other way. But must not be hard coded. What approach should be taken to run the same Test Suit ...
5
votes
3answers
294 views

What kind of testing is ApprovalTests.com doing and are there other similar frameworks?

I came across the ApprovalTests.com framework today and am curious how it would be classified. I am familiar with concepts of Unit Tests, functional tests, and user acceptance testing, but this seems ...
5
votes
1answer
90 views

What are the pitfalls or challenges of converting clickstream/user action logs into test scripts?

We keep having the idea of logging user actions at a detailed enough level to do things like track feature usage, identify common workflow errors, etc. If we had such detailed logging, it seems like ...
5
votes
2answers
59 views

In what cases are diffing result files better than using regular expressions when verifying test automated output

I'm trying to write a script/framework to automate testing of our program. I need to figure a way to verify/validate the results, either using regular expressions or diffing the results against a ...
5
votes
2answers
3k views

Selenium 2.0 Webdriver file structure for automation testing

My team uses Selenium 2.0/webdriver to test our enterprise web app. We've been learning and playing with webdriver commands for a while. Each team member has their own style to keep their script files....
5
votes
5answers
2k views

Page Object Design: Is there a Python equivalent to Ruby gems “site_prism” or “page_object”?

I'd like to know if there is a framework in Python which supports a clean way to define the Page Object Elements on a Page Object. The site_prism gem does it like so: class Home < SitePrism::Page ...
5
votes
1answer
128 views

Automating form dealing with large number of element

This is more of test design question than pure Selenium question. I have a form in my application and while following page object pattern I wrote a method which has many parameters - newMerchantPage....
4
votes
5answers
4k views

Selenium pros and cons

Selenium seems to be the mainstay in automated functional UI testing. But I'm wondering what peoples thoughts are on the pros and cons of using Selenium? Have any of you chosen another route for ...
4
votes
5answers
168 views

Test automation role: challenges beyond automated tests and frameworks?

Before asking the actual question, let me describe the current situation. The IT department consists of a few Scrum-like teams, with one or two software testers per team. Furthermore there are two ...
4
votes
6answers
5k views

How to manage test data in database

Background: I am setting up an automation framework Brand new project (i.e. no scripts) (clarification: brand new project as in everything is brand new, new db, new code, new automation, everything ...
4
votes
2answers
285 views

What good learning resources are there for testers who are new to Cucumber?

My team have recently decided to introduce Cucumber for our GUI automated checks. As it happens, we have people in the team who are very experienced with it, so I think we'll be fine, but it's made me ...
4
votes
6answers
8k views

How and why create an object repository (for element locators) in a Selenium project?

I have some questions about creating an Object Repository for a selenium project: 1) What are the main reasons that we create an Object Repository, as opposed to hard coding the element IDs in our ...
4
votes
2answers
390 views

Using a system test framework that handles test dependencies

To explain better, if test B depends on test A, then if test A fails, then test B should not be run and fail implicitly if test A produces some output, then it should be available for test B I can ...