Hot answers tagged test-automation-framework
12
The best place to start is over at http://www.thebraidytester.com/ where Michael Hunter describes the stack he built for testing Microsoft Expression in number of articles, papers and blog posts.
I have used this approach as the inspiration for my own watin based stack which is available at http://testingstax.codeplex.com
Essentially the framework breaks ...
11
For Test Automation purposes, it's always been my belief that once you know 2 scripting languages, you are in very good shape.
Being comfortable with 2 languages means you know how to automate, and that you know how to learn a new scripting language. As a hiring manager, I will be able to assume that you could easily pick up another new language as needed.
...
9
Your automated tests are currently set up to answer the question "What isn't working as expected?"
Now you want them to answer the question "What isn't working that I don't already know about?"
Your solution is to change the automated tests so that they account for the "known" bugs in one of two ways:
You could comment out the tests which find every ...
7
The programming language you pursue should be predicated on
The technology space you are most interested in (web, platform, mobile, etc)
The market trends in your area (e.g. what language skills are employers most looking for)
On a side note, I don't know why some people get so focused on a particular "programming langauge." Instead, I recommend ...
7
I suspect this is not a TestNG issue. I would start by trying to produce a minimal set of tests that, when run together, cause failures. After that, I would explore these possibilities:
Inter-test interaction changes test-application interaction: It is possible that interaction between your tests changes how your test interactions with your application. ...
6
There's The Secret Ninja Cucumber Scrolls from Gojko - I started off with this
http://cuke4ninja.com/
I'm currently reading The Cucumber Book from Matt Wynne
http://pragprog.com/book/hwcuc/the-cucumber-book
The RSpec book might also be useful
and a bunch of resources here
http://mikbe.tk/2011/03/05/learning-cucumber-rspec/
( I have no experience with ...
6
You've got quite a few questions in your one question, but overall it sounds like what you want answered is: How can I learn to write automation so I can switch from a 100% manual testing role into a role that involves writing automation. I'll get to answering that one, but first...
Honestly, if you are already manually testing in your current position, ...
4
The setUp method is just a place to put code that needs to run before every test. It sounds to me as if you feel compelled to use it but do not believe it meets your needs. Judging from your description, driver.get(URL) belongs in the individual tests, not in the setUp method.
Alternatively, you could structure your tests as two suites: one with a setUp ...
4
Yes. The Page Object pattern is a good technique, and is the logical conclusion you are working towards already by extracting reused logic into methods. With this pattern, you create a model of every page in your UI. These page models are the only part of your program that know anything about your UI. Then, if the home page title changes, you just update ...
4
It sounds as if you try to avoid duplication in your automated tests. That is a good practice to follow, not only in automation but in programming in general.
For static strings, you might consider using property files instead of Java classes, especially if there are literally thousands of such values.
Finally, you might ask yourself whether you are ...
3
Another approach that might help with the portability is to run you SQL from an application test harness. If you use the SQL inline with this you have the ability to take the exe to any installation and just run it. To expand on using a testing framework there are several really good articles on Simple Talk about Unit testing sql code. They are good ...
3
SoapUI can be used to verify workflows, but so far, I've only been able to get it to work when they are ordered correctly. I've since discovered that it was much to write these tests programmatically (C#, Java). This allows for you to customize your workflow to how you need.
For your third question, although typically you would want to run it as an ...
3
Approvaltests.com calls them unit tests, so I'm not going to argue :) Although I'm not sure why you are looking for a hard definition. It's taking the value from unit tests, adding readable output and screenshoting them. Kinda a neat process that could be used for UAT and forces dev's to use TDD. Tools that I would consider similar are Cucumber, jBehave, ...
3
Let's get things straight. Unit Tests are different from SQA Test Cases that have been automated. How?
Unit Tests are the developers responsibility because it mainly involves knowing whether their work, in this case a software unit (where unit testing comes from), is correct and complete with the ability to repeatedly check it when they make changes. It is ...
2
Well, I don't know your AUT that well. I have designed two automation frameworks (one using Selenium, one using Squish) and both followed the same general 3-layered architecture:
Bottom layer: "Support" API for using the underlying mechanism (Selenium/Squish/etc.)
Domain-specific layer: For using the AUT
Test layer: Actual tests to drive the AUT
I've found ...
2
I always like to break things up into groups of related information. For instance, if I have a user class I might break that up into a few smaller classes: LoginCredentials, ProfileInfo, Settings, etc, but I would still usually have a top level User class that contains these sub classes.
One thing I would certainly recommend would be to pass in a merchant ...
2
There is a concept called the 'Golden Master' testing which is what approval tests uses, and tries to automate.
The reason that the concept is orthogonal to Unit Tests, functional tests, and user acceptance
is that all of these are still doing verification by asserting against primitive values.
All tests have 2 parts:
1) do
2) verify
The real difference ...
2
Michael Hunters automation stack http://www.thebraidytester.com/stack.html is a good reference.
I've also blogged about a similar approach here in a series of blogpost.
http://elusivebug.blogspot.com/2009/05/test-automation-approach-object.html
2
Is the purpose of the test to verify 'page titles' or are you using page titles to validate state?
If purpose is to verify page title match, then I would say automation is probably not optimum solution even if there are many 'page titles' to validate.
If purpose is to verify state (e.g. to sync test), then you might consider doing a partial string match ...
2
It should be noted there is a FOSS alternative to Eggplant: Sikuli. We have teams that use both in our organization. I would not claim Sikuli is as powerful or up to the level of Eggplant, but if your needs are relatively simple it is worth a look. Also it is simply a Java library, so it can be integrated with other tools quite easily. We use Jython ...
2
I have not used Fitnesse, but I have dealt with the same problem. I think there are two related but distinct issues: handling long-term bugs, and identifying new failures.
Handling long-term bugs
If a test fails because of a known bug (an expected failure), and you know the bug will not be fixed any time soon, you may want to take that into account when ...
2
Anytime ordinal position values for x,y coordinates or indexes are used in a test script there is a high probability of failure. Not only will the test throw a false positive if the object is moved, but also consider different screen resolutons, and different devices. In general ordinal values for objects is generallly not a good practice in robust test ...
2
I've used log4j. Development of log4j seems to have gone dormant.
These days I use the Simple Logging Facade for Java (SLF4j) API, with logback as the implementation. Selenium internally uses another logging API and implementation (Apache commons logging, I think), but SLF4j offers mechanisms to reroute those other logging calls through your chosen SLF4j ...
2
Welcome to SQA, Nitesh.
In my market, what you tested and how you tested it would be at least as relevant as what programming language you used. I think having a variety of experiences will be more useful to you than specializing in one thing. However, your market might be different. For example, if you work in short-term contracting projects, ...
2
Visual Studio 2010 has some built in tools for unit testing SQL server. This article is a good read: http://blogs.msdn.com/b/atverma/archive/2010/07/28/how-to-unit-test-sql-server-2008-database-using-visual-studio-2010.aspx
I know that Red-Gate also has some good tools for testing SQL server, especially around comparing tables or results of queries from ...
2
Welcome to SQA, Jacob. First of all, it is understandable that a low-wage intern would want to find a higher-wage job. It is certainly possible to make a decent living as a manual tester. You said you are looking for a new job but are having trouble getting calls back. When I graduated from college, I had no idea what was important in a resume. If you ...
2
First of all I would recommend to read about the Testing Pyramid (if you do not know it yet); in a nutshell, do not create more than 10% GUI Tests.
Furthermore, I recommend these two articles from Gojko Adzic:Ui Testing without shooting yourself and Effective User Interface Testing
In our current project we (unfortunately) have a lot of GUI Tests. What ...
2
When in a pinch, I've done some testing with Microsoft's WcfTestClient. It will build out a barebones gui for you based on the service meta-data. Another option that I've seen recommended often, but never tried myself, is wcfstorm.
Sam is right though, depending on how complex the requests are, good options can be Fiddler, WFetch, and the like.
In the ...
1
I am running different test tools to check witch one is the best for me.
So far i testet, Monkey Talk, KIF, Calabash and UI Automation from Apple.
The easiest and best tool so far is the UIAutomation, it es very easy to use, has every thing i need so far.
The only thing i miss is cross platform support.
MonkeyTalk seems to be the closest to Automation but it ...
1
I'm currently building tests using the UI Automation tool found in Instruments. You can do both things that you are looking for. You can record tests and it allows you print the element tree and the names of those elements in the application. The tests are written in javascript and you can use the editor of your choice. When recording a test, the code will ...
Only top voted, non community-wiki answers of a minimum length are eligible
