Tag Info

Hot answers tagged

9

Your automated tests are currently set up to answer the question "What isn't working as expected?" Now you want them to answer the question "What isn't working that I don't already know about?" Your solution is to change the automated tests so that they account for the "known" bugs in one of two ways: You could comment out the tests which find every ...


2

Answer to: "...that will allow a non-programmer to automate functional tests." Your answer misses a key point of the question. – Brian Reindel Brian, test automation is programming the automated tests, isn’t it? Those keywords, like go_to_the_catalog() can be implemented by developers, and can be used by “non-programmers” later. It is not so hard ...


2

A very big problem is that we are wasting a lot of time to find and learn the tool instead of just do what you want in “pure” language. DSL is a set of subroutines that just have a specific name for your domain and do some domain-specific stuff. You can create such procedures/functions/methods whatever on any languages of you’ve chosen. You can create ...


2

Seems that you want to have a tool which can translate requirements/test cases (written by business people with no experience in programming) into executable code. In our practice FitNesse is not that tool. We started with FitNesse, and keep maintaining existing tests and even adding new when feasible, but these tests are written by developers, not business ...


2

Overview Robot framework is an excellent choice that meets all of your goals. Robot can be used for UI tests (via selenium), REST and SOAP service tests, database tests, and just about any other type of acceptance test. You can even use robot tests to improve your manual testing process. Robot is keyword driven Robot is keyword-driven, which makes it very ...


2

I am using bug-workarounds to handle those “long-term” bugs in the test automation. My workflow is following: Create a bug in the bug-tracker. For instance its id is BUG10666 Create a Boolean constant with bug id in its name: const bool is_ BUG10666_fixed = false; All the constants for bugs should be placed in a separate file. Use the workaround to make ...


2

I have not used Fitnesse, but I have dealt with the same problem. I think there are two related but distinct issues: handling long-term bugs, and identifying new failures. Handling long-term bugs If a test fails because of a known bug (an expected failure), and you know the bug will not be fixed any time soon, you may want to take that into account when ...


2

Have you tried using the fitness-editor plugin for Eclipse? If your team maintain the fitness source alongside the project source code using some sort of version control, Eclipse will also let you manage the changes and commits more effectively. Theres also a plugin for intelij (fitnesse4idea) and for the particularlly adventurous a syntax highligher ...


1

I used to use Fitnium when I was doing work with Fitnesse and WebDriver early on, I found it did not scale well for the types of tests I was doing but it may work for you. I was testing a Login and Registration system, the pages used a lot of JSON and I had issues getting the timing right so the pages would load with the right drop downs or complete the ...


1

For web based applications I think Selenium WebDriver should also be considered as testing tool for SAP application as most of the SAP applications are web based. This is one of the best open source web testing framework available and online support from WebDriver users is awesome.


1

When you say service layer what exactly do you mean? Fitnesse is composed of two components - Fitnesse tables and the fixtures. So you should be able to test any system at which ever layer you want. Back end service layer testing(Example: webservice testing, database testing) Front end testing - There are a few Fitnesse projects to do it - Selenesse , ...


1

Selenium/Python is what we use and are very happy with it. Re #1: You can write tests in pure Python (without Selenium) to test rest/DB and run them using same test runner. Test are just python programs using Selenium libraries or whatever else you need. And there are libraries for anything I ever needed. Re #2: Python is famously easy to read. Our own ...


1

great tool for SAP could be Tosca test Suite, just a bit more expensive than others. Nothing what SAP guys can't bear. In advance there is a great Test data management and easiest automation I ever seen. When you reconsider the sustainability of automated tests in continuous development (scripts in other automated tools should be often repaired or rewritten, ...


1

Specflow and Fitnesse approach the process of testing in two different ways. The process of passing inputs into your tests is very much a way of exploring the functionality of what the system can do. BDD however is all about defining scenarios that define exactly what the system should do. As a result, I would susggest the execution pattern for these ...


1

I've been using SpecFlow, C#, NUnit and WebDriver to handle much of this. I write all of my tests within Visual Studio and use PowerShell to check source out, compile and start the tests to check my site and services. This gives it a nice framework feel, and once the updated Build System is complete I can add my tests into the build system, my PowerShell ...


1

My guess is that your element is not present. the Click() method using the Firefox driver doesn't work like ClickAndWait in the Selenium IDE. You must explicitly do an implicit wait before you click on something. My guess is that you had 2 clicks right in a row, and it's failing on the second click because that element doesn't exist yet, because the first ...


1

If you are using a custom framework and a custom reporting/logging mechanism its possible to develop some additional logic around 'failed but known tests'. Once your automation scripts find a 'failed test', custom reporting algorithm should doing a look-up from a 'known issues' list. If the failure is present in your known issues list, then your reporting ...


1

In addition to the ones Dan mentioned, take a look at: Robot Framework, a free open-source tool with a Selenium library. Twist, an Eclipse-based commercial tool from ThoughtWorks, with Selenium support built in.


1

FitNesse has not received the levels of adoption that other open source testing tools have. FitNesse pre-dates the use of Behaviour Driven Development tools and frameworks (Cucumber, Specflow, RSpec). Whilst there are no doubt users of FitNesse who will love it, I have personally found the wiki-html table-esque keyword driven style in practice does not lend ...


1

I too have found Fitnesse to be a bit clunky compared with some of the more 'modern' BDD tools around. With regard to using Selenium and Fitnesse, take a look at the Xebium plugin. It was written by a Dutch company for their use and is freely available on Github. I have not used Xebium on a project, but did use the Selenium IDE plugin to export recorded ...


1

Actually there is a project on GitHub called Selenesse with this aim: Selenesse is the modern bridge between FitNesse and Selenium.


1

I have never used Fitnesse, but here is what I gleaned from the documentation. Fitnesse is a tool for organizing and running tests. You write fixtures to translate Fitnesse's representation of a test into an actual action that tests something (e.g. an call into an application API). You could write fixtures that call the Selenium API. That is how ...


1

Unfortunately I do not know of any plugin which will do what you ask. However, you could use the tags option by adding a top level page to the wiki that you can choose to run tests from. One final idea would be to use something like Selenium IDE or iMacros to run each suite. Not really a permanent solution, but perhaps enough to keep you going until one ...


1

One solution to your dilemma is to export the results into a spreadsheet after a run and use macros/formulae to compare outputs. On the test history page choose file > save as in your browser and choose single page (not whole site) Open that file in excel I usually use text to columns using the dot as the delimiter You can then use the result column to ...



Only top voted, non community-wiki answers of a minimum length are eligible