Hot answers tagged

6

There are several ways you can work with this situation. No-work - let the tests for the new feature fail until the feature is migrated to the staging environments. This can be an option if the tests don't block builds or aren't reporting directly to management. "smart" detection - as Dale suggested, use some coding to detect whether the feature is ...


4

As always, it depends. If there are regulatory requirements, results need to be kept for as long as the regulations state. Otherwise, it's a business decision. 1. How long does your team keep test results? In my experience this depends on a number of factors. I've been in places where test results for new development would be kept indefinitely, but test ...


3

Use JUnit to handle the running of the tests from the Jenkins server. Use JDBC to query the DB for new rows. Change up the Tomcat servers so they send logging events back to the Jenkins serverJUnit test. You'll need to write a little socket listener for the JUnit test to gather the Tomcat events (Writing an LoggingEvent listener isn't hard. I'm not ...


3

Resolved this by using JMeter's Duration Assertion as a child to the HTTP Request I wanted to time setting the Duration to Assert in milliseconds to the longest time allowable and Appy to as Main sample only. When this time is exceded the assert fails and the test gets marked as failed. PAGEUNDERTESTTIMEOUTMS would be set in User Defined Variables or one ...


2

The Selenium IRC channel provided a hint. The browser was starting to launch, but Selenium never got a reply. After some fiddling, I was able to remote desktop into the account selenium + tomcat ran as and manually launched a grid job. Chrome was trying to setup a second desktop shortcut and do some initial first launch housecleaning. I also had to relax ...


2

Perhaps you can either automatically detect whether the feature is installed, or manually create some kind of test configuration file appropriate to each environment. Then use that information to deselect tests that are not appropriate to the configuration.


2

I accomplished a similar thing by running the SoapUI tests within the Maven Build http://www.soapui.org/test-automation/maven/maven-2-x.html one of the outputs is "junitReport : Turns on creation of JUnit-reports, (true/false)" which will then let you use any of of the million JUnit graphing tools. Hope that helps in finding your solution


2

Despite the fact the question is about Jenkins results - I'll add my own 5 cents, but regarding results of manual testing - some of the following points may be as well useful: As stated in other answers, results of intermediate builds are valuable within several months OR current project stage, therefore our usual practice is to keep these within current ...


2

Selenium Builder is the evolution of the Selenium IDE. Its tooling page has a video (11 minutes) about using it with Travis-CI. Although I haven't watched it I expect it will answer most of your questions. To simplify test building (for non developers) I would suggest using something like Cucumber or another BDD framework, you can then make a lot of ...


2

You do not need Eclipse, Jenkins, or TestNG to scrape a website. Ask a software developer to help you package Selenium, your Java code, and any other necessary resources into an executable Jar file. If you can't find any developers, try Googling for "executable Jar file". Your executable Jar file will require a main class. If you are accustomed to ...


1

Parameter 'folderName' is required by @Configuration on method setUp_HerveLeger but has not been marked @Optional or defined It says it right in the exception description. You need to define a parameter in you're TestNG XML file or provide an optional value. @Parameters("folderName") public void setUp(@Optional("Insert folder name here or leave empty") ...


1

I am new here, I cannot comment. I am assuming you are using maven surefire plugin, If so you can pass in any particular test name in maven goal mvn -Dtest={your-test} test If not, you can edit question with some details/may be part of pom.xml and maven goal from jenkins.


1

Your error indicates that your batch file is throwing an unhandled exception. Likely this is something like "element not found". Your log files will tell you more.


1

I would setup a Jenkins free-style job and execute the java based Se Interpreter from a shell-script task Setup free-style Jenkins build Schedule build with github with the git-plugin to run job on each commit Add a shell-script that runs the Se Interpeter in the build and make sure it has a correct exit code to fail/success the run or see this question ...


1

Selenese scripts generated by IDE are HTML without parameters, unlike traditional scripting/programming. What programming language is main language in your organization? Python is very easy to learn and has good Selenium bindings. Also, learning general programming language (Python) could be interesting career-enhancing move for your testers (so they ...


1

If your team members don't have much development experience and you would like to use Selenium Webdriver for your automation tests I highly recommend taking a look at Robot Framework. Robot Framework is a generic framework to which you can easily plug in external libraries and script your automation tests using keywords. There is Selenium Library which ...


1

You probably want to follow the Jenkins tutorial. Here is a good one. http://www.vogella.com/tutorials/Jenkins/article.html


1

You should be able to configure a job to watch the app repository and trigger a run when the app repository changes. It will be easier to configure if the company's application is managed through the same Jenkins server as your testing suite (depending on your source control system one Jenkins server can handle multiple source control repositories), but ...


1

I would suggest you use some kind of XSD to transform the current XML into one that aggregates the same errors and maybe puts a count in there so it will say something like error X occurred 700 times. That is all I can suggest for the information given.


1

The real answer is that you need to keep test results for as long as they are useful. Storage is cheap, so don't let that be the driver behind how long you keep any test artifact. But determining how long results can be of use depends on a lot of company and project-specific conditions. We tend to keep functional results only for the duration of the ...


1

I feel like this is a polling question rather than a SE-type question, but if not.... 1) We keep them for two weeks at my current role, but at other companies several years. 2) Rarely have I needed something more than a couple of days really as I run daily automation tests, but I have found it useful a couple of times when a test has been failing for ages, ...


1

You can fork test tasks from your build tool, whatever it is. With Maven, its called "surefire plugin", with Gradle, you just set "maxParallelTasks" in your test task, with TestNG, you use the thread count like @Aruna suggested. It all depends on what you are using to execute your tests. When selenium tests are forked, then multiple sessions are opened ...


1

When the computer locks, the main screen is showing the login buttons, the Sikuli tests cannot see the application anymore. You need to disable the locking. Since you have to lock the physical machine I think your only option is to install a virtual machine on a physical machine. That way you can have the physical machine locked and the virtual-machine ...


1

It doesn't look like the Android/Android Emulator plugin for Jenkins has that feature or something similar, You could try using the Jenkins VirtualBox Plugin or VBoxTool get the instance running and set up your tests to execute from there More info on how to configure the VirtualBox Plugin can be found in another question What is the correct way to ...


1

I used maven sure fire report plugin and this question and the answer explains how i did it. http://stackoverflow.com/questions/29671601/maven-sure-fire-plugin-report-empty


1

How can I find that the input is constant when its a complex piece of code like UI of web-page (like a hash?) Depending on how you use Jenkins, there may be a build number associated with the test. You can look for code changes associated with that build. How can I Get that input data from Jenkins or other place? For UI automation of web-sites ...


1

We are using Xvfb in our Continuous Integration environment and it is working great. It's no problem to take screenshots from Selenium for later analysis when errors are found. We have found no problems with this solution, rather a great advantage to be able to use virtual servers to spawn massively parallel tests against installations of the software.


1

Figured it out. The host IP in the VM configuration window in Jenkins has to be the IPv4 address of the host-only adapter (in this case, 192.168.120.1). I also changed the host port in the port forwarding rule from 3022 to 22. For historical reference, the username and password fields (which appear when the "Advanced" button under the "Host" field in the ...


1

This is a known bug, documented here. It appears you can get around the issue (at least enough to get back into the GUI to revert the change) by deleting the $JENKINS_HOME/plugins/maven-plugin.jpi.pinned file. Standard rules about backing things up still apply.


1

You might be able to do something by swapping out the login shell from /bin/sh to /usr/local/someLoginCheck script so that when users use the ssh remote it checks the job name or some other environment variable set in the job. For example, at the top of the users script: #!/usr/local/someLoginCheck a650ef01ddcf4e1bfb68ee0af5566170 Another option would be ...



Only top voted, non community-wiki answers of a minimum length are eligible