Selenium IDE with Selblocks: jump to next var if got an error

Question

I have a script which get vars from XML with Selblocks plugin. This script make registrations to events on a website. The XML contains the URLs of the events and the names and passwords for Users. So I have ~100 events with 100 names & passwords. There are about 8-9 steps from login to confirmation & logout.

If there any problem with the User (e.g. user has to add any extra information about him (phone number, billing address etc.)) I get an error than the Element (Next button) has not found. When I got the error the script got a failed status and stop.

I want to achieve that the script continues after that error. E.g. if my 3rd User couldn't register to event I will get only 2 executed registrations but maybe all of the another Users are good.

How can I solve this problem? How can I ensure to skip the failed registration and skip to the next var? Are there any solutions with Selblocks? Anyway is it possible?

Answer 1

You have to implement test cycles as you are doing data-driven testing.

I recommend to you not to expect the test will pass every time. You will have to implement checkpoints, using sequences of storeElementPresent to a variable, compare if the variable is "true" with if and store the test cycle result to the javascript array, or report results by echo-ing to the log file.

Log file then can be filtered by tail + grep Linux bash commands and some special text in echo, for example "Report: TestCycle". Add some Test-cycle name to your XML file and echoing the test result.

Additionally, some data should fail the test, and you will like to test negative cases. So you would like to add expected results of the checkpoint or whole test cycle to your XML file. Test Case is then passed, when each test cycle and/or each checkpoint finished as expected.

Please be aware, that SelBlocks have no support yet for Selenium 3 and could stop working in newer versions of Firefox. If this will change in the future, please alert me.

Reply Extended

So you SHOULD expect an error for each step and script should behave according to what really happen.

You will use following Selblocks commands:

• forXML
• echo
• goto
• storeElementPresent | variablename
• storeElementVisible | variablename
• gotoIf | !storedVars['variableName']
• If | storedVars['variableName'] - endIf
• verifyEval | storedVars['variableName'] | true

please study their syntax and usage.

Update2:

It was useful on the end of the test cycle to evaluate if the cycle was "passed" or "failed" and therefore I implemented on the end the evaluation part, where all stored variables touching the process control was evaluated, for example:

• verifyEval | storedVars['part1Present'] | true
• verifyEval | !storedVars['errorPart1Present'] | true
• verifyEval | storedVars['part2Present'] | true