Questions tagged [jenkins]
Jenkins is an open-source continuous integration tool written in Java. Forked from Hudson after a dispute with Oracle.
151
questions
13
votes
2
answers
25k
views
Jenkins: is there a way to fail a build if it takes more than X time?
I am looking for a way to fail a build if it will take more than X time (be it absolute (5 minutes -- example) or relative (10% more than the average of the last 5 builds -- example).
Is there any ...
- 337
11
votes
5
answers
30k
views
How best to test file download links using Selenium
On a website I am testing we have various links that download PDF files to the users computer.
Our selenium suite runs nightly on bamboo, if we were to download the various files overnight it ...
- 2,043
8
votes
2
answers
12k
views
What is the correct way to configure the VirtualBox plugin on Jenkins?
I am trying to get the VirtualBox plugin working with Jenkins. My plan is then to hook up the Selenium plugin as well and get a grid running on the VirtualBox cloud. When I follow the instructions on ...
- 171
8
votes
4
answers
6k
views
Running tests in parallel using Jenkins Grid plugin
I have Jenkins 1.499 running Watir-Webdriver tests on a Windows 2008 (64bit) server alongside the Grid 2 standalone server (and Jenkins Selenium Grid plugin).
I can run my tests through the ...
- 81
7
votes
2
answers
4k
views
How to run tests in parallel using Robot Framework Maven plugin?
I'm using the Robot Framework Maven plugin to execute my Robot Framework scripts. I'm using this plugin because some of my keywords are implemented in Java and packaged inside an external library.
I ...
- 201
6
votes
5
answers
266
views
How does Continuous Integration add value to Automation Testing?
How do I gain the value from CI tools as an Automation Tester?
What are the advantages to using such tools and how do they help me and the company in the development process ?
user15122
5
votes
4
answers
2k
views
How long should test results be kept?
We've got Jenkins jobs running Unit Tests, Integration Tests, JMeter Tests, and Selenium Tests. Given my choice I'ld keep all these test results forever, but maybe that is excessive.
How long does ...
- 305
5
votes
3
answers
602
views
Automated tests in CI: same or different repo as SUT?
I'm currently writing API and UI automated tests for a website. My goal is to plug these tests in the CI workflow (Jenkins is used in this organization). The workflow would be: if there's a new commit ...
- 179
5
votes
2
answers
286
views
JUnit-friendly framework for production monitoring
My team deploys code to production every week or so. We have a large set of post-deployment validations, e.g.:
New log lines are appended to Tomcat log (ssh to machine, tail -f the log)
Database ...
- 153
5
votes
4
answers
13k
views
Is there a Jenkins plugin that visualises SoapUI test results by giving you a graphical report?
I'm basically looking for something like this, but for SoapUI:
SoapUI displays results in a really nice way in it's GUI. Any chance of getting something similar for/when it runs on Jenkins?
- 291
5
votes
1
answer
1k
views
How to run a TestNG project located on Github from Jenkins?
I know how to configure batch file to run my TestNG project on local from Jenkins. But how to configure batch file command on Jenkins to run it from Git ?
- 331
5
votes
1
answer
169
views
How to aggregate similar test failures in Jenkins?
How to aggregate similar test failures in Jenkins?
We use Jenkins and every once in a while we'll get hundreds (700+ at the moment) of failures when testing against Oracle. Most of them are a ...
- 305
5
votes
2
answers
737
views
Validate Quality Cobol code - Jenkins, Sonarqube/SonarLint and Rational/Topaz?
In my work as a tester, I was asked to find a solution to validate the quality of Cobol code. For that I was asked to investigate Jenkins, Sonarqube/SonarLint and Rational/Topaz.
Starting point - I ...
- 51
4
votes
1
answer
11k
views
How to push my JMeter project to Github and run it via pipeline from Jenkins
I have a .jmx file and I run it in NON-GUI mode on my local machine.
I'd like to push my project to Github and run it via pipeline from Jenkins.
How can I do that?
Do I need to push the whole JMeter ...
- 65
4
votes
2
answers
743
views
Strategies for automating testing on features that are only on certain environments
Say we have a dev environment, an integration, a pre-production and a production environment.
We have features A-G that are on everything, while new feature H is on dev+int only, so far.
We want to ...
- 1,223
4
votes
1
answer
12k
views
Cron format, definition of H in .yml file [closed]
I am a beginner in software testing.
I was going through the .yml file used to schedule the regression runs and came across this:
schedule: "H 1 * * 1,4"
I know about cron format, but what I can ...
4
votes
2
answers
959
views
Headless browser testing using X virtual frame buffer
My current setup is using Jenkins as my CI environment, which has some ubuntu server nodes to execute the end to end browser tests on some amazon EC2 machines using selenium 2.
I am wondering if ...
- 141
4
votes
1
answer
15k
views
Is there a way to make Jenkins display test results graphically in a job column? [closed]
I've spent a while trying to get my Jenkins view to show the information I want about my test jobs, however I can't find a way to concisely display test results graphically. I am currently using ...
- 141
4
votes
1
answer
2k
views
Remote deployment on WAS using websphere deployer plugin of jenkins
I want to deploy an application on websphere application server(8.5.5) from Jenkins using websphere deployer plugin. I have attached the two required jars. I can telnet the WAS server from jenkins ...
- 885
4
votes
0
answers
3k
views
Jenkins Build Is Hanging
We are using Jenkins for continuous integration. I have already created a Jenkins job for running all my robot framework automation test scripts & Everything was absolutely working fine.
But now,...
4
votes
0
answers
848
views
Jenkins stops getting my unit test output from xcodebuild [closed]
I've got Jenkins set up to build my application test target and execute tests in the iOS simulator like this answer says. When I execute the build in Jenkins, the iOS simulator launches and runs all ...
- 141
3
votes
3
answers
4k
views
Selenium IDE and Selenese scripts in Continuous Integration
Apologies if this is not the forum for such a generic question.
As our organisation moves to an Agile project methodology, we need to be able to rapidly automate applications as they are built up ...
- 383
3
votes
1
answer
4k
views
What should I enter in Username & Password fields for recently installed Jenkins setup?
Team,
I have just installed Jenkins on one of my machine. In between due to some other activity, I moved few min away. When I returned I observed my Jenkins page asking me Username & Password.
...
- 2,766
3
votes
1
answer
1k
views
How to see ongoing progress of my Selenium tests run in NUnit on Jenkins?
I am running my tests in Selenium using NUnit and Jenkins and it takes more then 2 hours to run all tests.
I want to see the progress of the tests for monitoring if everything is OK like a team city ...
3
votes
2
answers
8k
views
Can I force a Jenkins job to report a successful TestNG test even when the suite has failures?
Can I force a Jenkins job to report a successful TestNG test even when the suite has failures?
I have a test suite with 100 tests and I want to report a success in Jenkins if there are 3 or fewer ...
- 913
3
votes
1
answer
162
views
Can we tell Jenkins to execute half of my test in a one slave and other half in another slave machine
Is there any way to set up a Jenkins job where it will execute part of the test cases in a Node A and other part of the tests in Node B.
Technically, I need to reduce my test executing time executing ...
- 2,141
3
votes
1
answer
6k
views
Unable to run cucumber tests from command line
I know this is the most common question but sorry I am posting this again as I tried all the solutions but couldn't solve the issue,
Problem: I am unable to run my cucumber tests through maven and ...
- 99
3
votes
2
answers
3k
views
Best way to set up selenium grid node using Jenkins as hub?
This is a an open-ended question, and if there's a better place to post it just let me know.
I have a large amount of selenium tests that I want to run using Jenkins. Currently, I have Jenkins ...
- 161
3
votes
1
answer
8k
views
The jenkins build fails when any testng test case fails. How to make it so that the build succeeds when all test-cases are run regardless of result? [closed]
In my Test Automation, when we execute the TestNg Suite XML then whenever any test case fails the Jenkins Build also fails.
But I require that the TestNG report shows the proper result, either Pass ...
- 141
3
votes
1
answer
2k
views
Can I execute selenium test cases in a real browser with Jenkins Selenium and Maven
I am working on selenium project with Jenkins + Maven + Selenium + TestNG
I have following questions.
Can I execute selenium test cases in Jenkins by launching browsers?
Currently it gets executed ...
- 1,516
3
votes
4
answers
19k
views
How to run TestNG failed test cases in Jenkins for Maven project?
I am new to Jenkins and I have configured it on my Windows PC. I have to run failed test cases twice before considering that they are failing. I am using TestNG and Selenium Webdriver for writing test ...
- 885
3
votes
0
answers
616
views
SonarQube: Auto assign issues doesn't work
Currently, I have an integration between GIT, Jenkins and SonarQube as described in this pseudo workflow:
commit----> AWS CodeCommit (GIT) <-> Jenkins <-> SonarQube Scanner for Maven &...
- 31
3
votes
1
answer
104
views
A single Selenuim test fails under jenkins [closed]
When I run my Selenium test suite under Jenkins a test fails.
If I run the same test suite from the command prompt they all pass.
When running from the command prompt, I'm in the Jenkins worskpace. ...
- 33
3
votes
0
answers
448
views
How to configure Selenium+GitHub+Jenkins [closed]
I was trying to configure Selenium+GitHub+Jenkins but unable to do it, I was able to configure selenium and Jenkins but not with GitHub.
We need to build in same workspace where is my code if not, ...
- 167
2
votes
2
answers
244
views
TestRails and Jenkins integration - getting main method not found when running API files without main method
I wrote a TestRails.java class with a main method that uses TestRails JAVA API Binding classes. I’m trying to compile and run it in the Jenkins build shell section. Is this not the way I’m suppose to ...
2
votes
3
answers
4k
views
Selenium Test Suite fails to execute in Jenkins but works correctly on local machine
I have been struggling with this issue for some time and maybe someone from here has come across it and might provide me with any suggestions or solutions.
I have a fully working Test Framework with ...
2
votes
1
answer
1k
views
Is it possible to integrate Bamboo and Jenkins with TestRail
My company is currently using Bamboo and Jenkins for our build CI (depending on project) and we're moving into using TestRail for our test case management as Zephyr wasn't providing the necessary ...
- 423
2
votes
2
answers
6k
views
Testcase fails in Jenkins but passes locally via testNG.xml in IDE
I've come across a strange problem when I execute my testcases via testNG.xml they are fine and passed but whenever I execute the same testcase in Jenkins I got the following exception
Element is not ...
- 327
2
votes
3
answers
1k
views
Marking build as unstable if tests are skipped
I use tests checking their preconditions with
assumeThat(preconditionX, isSatisfied());
that throws SkipException when not satisfied. As a result I have 2 of 73 tests skipped while build in Jenkins ...
- 10.5k
2
votes
2
answers
3k
views
How to automatically rerun failed TestNG tests on Jenkins and update the final results to pass if retries passes?
How to automatically rerun failed TestNG tests on Jenkins and update the final results to pass if retries passes?
Description:
I have two tests that ran. Test1 passed, but Test2 failed then on retry ...
2
votes
1
answer
1k
views
Multiple TestNG Reports to one Report
Currently I have 20+ Test Suite which run as individual Job in jenkins. This will generate respective testng report on the nodes that it ran (index.html). can i consolidate all the 20+ reports into ...
- 23
2
votes
1
answer
2k
views
Jenkins: failing builds on warnings
I've been reading the book "Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Addison-Wesley Signature Series (Fowler))"
And these paragraphs ...
- 269
2
votes
1
answer
2k
views
Attaching screenshots to JUnit test reports
We run our tests on Jenkins using Protractor generating a JUnit XML test report via JUnitXmlReporter from jasmine-reporters.
Is it possible to attach screenshots, with the current state of an ...
- 11.4k
2
votes
2
answers
115
views
UI Test framework from the ground up
I have explored some test automation tools and I thought I'd go with WebDriverJS (Selenium/JavaScript using Node.js) with Mocha as the test framework.
I have been able to write out scripts that do ...
- 63
2
votes
2
answers
5k
views
jenkins build when a change is pushed to another repository
I'm sure that this happens frequently. My testing suite is a separate repository from the company's main app. I wanted to know If there's a way to run the suite when a change is pushed to repository ...
- 163
2
votes
2
answers
906
views
Use Android VirtualBox Instead of Emulator for Jenkins
I want to configure my Android Jenkins projects to run a Virtualbox AndroVM instance. I have the Virtualbox/Jenkins plugin but I don't see how to run the the VBox instance in the job, only have ...
- 123
2
votes
2
answers
237
views
Tests fail when triggered through jenkins
I have upgraded my test suite to latest selenium, Firefox, and geckodriver. When I run the tests locally they work fine, when I run them on a remote box executing the command in the remote box they ...
- 31
2
votes
1
answer
11k
views
“org.openqa.selenium.WebDriverException: unknown error: Chrome failed to start: exited abnormally” issue on jenkins(openshift) chrome node
I've been trying to run selenium codes over Jenkins (server/openshift). There is chrome node in the jenkins machine for Test Automation - Selenium. I'm getting this error:
org.openqa.selenium....
- 121
2
votes
2
answers
2k
views
Jenkins slave is not accessing chrome in GUI
I have my selenium automation script running in chrome and it is running through Jenkins. I have two machines in Jenkins, one master, and one slave, both of them are Windows 7.
While running in ...
- 526
2
votes
2
answers
2k
views
Maximizing Chrome Window size in Jenkins for Protractor Tests
We are in the process of setting up Jenkins for our testing projects and we are facing a huge challenge for browser window size. The app we are testing is a Progressing app so with the default screen ...
- 123