Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [continuous-integration]

Continuous Integration, aka CI refers to the development practice of integrating work from team members frequently, but is also sometimes used as shorthand for the automated build systems that support that practice.

0
votes
2answers
37 views

Continuous Integration Selenium Webdriver with Azure

I have created a Selenium Webdriver C# script for login module of my app and it's running on my local machine. Now the things is What is continuous integration. As per my knowledge we can build, ...
0
votes
0answers
21 views

Test (no regression) and Migration Strategy with ASp.Net Core, EF Core, Mysql

We have a project that should take about 18 months to go through different developping steps (3 major one). We are at the end of step one. It is using ASP.Net Core to build a Web API with a mysql ...
1
vote
3answers
38 views

When nightly testing integrations with external systems, how should random failures of the external system be handled?

Our product can integrate with a variety of external systems. We support 5 different databases for storing business data, 5 different version control repositories, 5 different bug trackers,... We also ...
0
votes
2answers
318 views

Compare a screenshot with saved image on Devops build server

Background When releasing a C# MVC website through Devops release management the bundling failed. This caused the CSS file not to load on the released website, causing the UI to render incorrectly. ...
0
votes
0answers
36 views

Jenkins Server url-Unable to perform Google oauth authentication

I am running selenium scripts from Jenkins server configured at [http://****.****.com:8080/]. The script reads data from google spreadsheet and execute the testcases. For which I used google oauth for ...
0
votes
0answers
16 views

Jenkins Job vs Jenkins Pipeline

BACKGROUND : We have one Selenium automation project which is shared in BitBucket repository. Project is maven project. we have 10 testng.xml files for all modules OVERVIEW: Now we want to trigger ...
0
votes
0answers
327 views

Is it possible to pass testng.xml and test name as single parameter in Jenkins?

I have below testng.xml file : <test name="Product_Listing_Page" enabled="true"> <parameter name="scenario.file.loc" value="scenarios/plp.bdd"></parameter> <groups> ...
1
vote
0answers
138 views

How to integrate GitLab and Codecov safely?

When trying to sign up as a GitLab user on Codecov they request full admin access to my entire account. That is just not going to happen, so is there a way to set it up safely without hosting my own ...
1
vote
0answers
73 views

Future-proofing Performance Test Scripts across environments for Continuous Integration - using LoadRunner and Jenkins

Here is the AUT workflow across environments: Code moves (and gets stable) from dev > QA > Stage > Prod Data moves (and gets dirtied) from Prod > Stage > QA > dev We have ...
0
votes
1answer
532 views

No files displaying (.log and .jtl files) in jenkins Workspace post running a JMeter jmx script via jenkins?

Running a JMeter script via Jenkins with Performance plugin via Windows batch command as: cd C:/apache-jmeter-4.0/apache-jmeter-4.0/bin jmeter -n -t C:/Users/Administrator/Desktop/JMeter/Suite.jmx -l ...
1
vote
1answer
59 views

I am new to automation. I am researching on how can I create a Jenkins pipeline to build image in docker container?

Its a TDD environment and I wanted to create a Jenkins file through code which different teams can pull in their projects and start writing tests.
0
votes
2answers
72 views

Integration testing a website with no public API

I have recently been reading about the test pyramid and how integration testing fits into the grand scheme of things, when it comes to web services, with regards to API testing. QUESTION: Does API ...
10
votes
3answers
2k views

Tests in CI: Are API + Integration Tests the most suitable?

In my experience, automated GUI tests may take too long for a build of Jenkins (even parallelized) and may demand a lot of maintenance. On the other hand API + Integration tests are way faster, do not ...
6
votes
5answers
172 views

How does Continuous Integration add value to Automation Testing?

How do I gain the value from CI tools as an Automation Tester? What are the advantages to using such tools and how do they help me and the company in the development process ?
2
votes
0answers
309 views

SonarQube: Auto assign issues doesn't work

Currently, I have an integration between GIT, Jenkins and SonarQube as described in this pseudo workflow: commit----> AWS CodeCommit (GIT) <-> Jenkins <-> SonarQube Scanner for Maven &...
4
votes
1answer
59 views

Supporting multiple versions of test scripts

We're running our own CI/performance tests system for some other team's software library as they've yet to decide on something beyond nightly tarballs and our requirements are much more stringent. Due ...
1
vote
2answers
56 views

Behat tests take over an hour to run

We have a test suite of around 60 feature files, 135 scenarios, 1800 steps. We currently use the free 100 builds on semaphoreCI which occasionally successfully runs all of the tests, but quite often ...
1
vote
0answers
19 views

Cloud platform for CI Test Automation Lab setup with Windows 10 or 7 OS

We have an on-premise test automation lab where we monitor all our applications (Web Applications and Web Services)through CI Jenkins jobs. Machines in the lab have either Windows 10 or Windows 7 OS. ...
1
vote
2answers
511 views

Suggestions to integrate Selenium testing suite into TeamCity or any other CI?

The title may not have been worded correctly but basically here is what I am having trouble researching / figuring out: What I have: A full set of automated tests written in C# Selenium that tests ...
2
votes
0answers
79 views

Regarding the Build job in jenkins

When I am running maven goal in Jenkins which runs soap tests which are developed using groovy, whenever there is a test failure then all the other tests are failed without any test execution from job....
1
vote
0answers
330 views

Cobertura analysis reporting “[ERROR] SLF4J: Class path contains multiple SLF4J bindings.”

Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact: [ERROR] SLF4J: Class path contains ...
0
votes
2answers
51 views

How to schedule to run all unit tests?

I need to manage executing all unit tests on build server. Is there any idea about when is proper to run all of the unit tests on the build server. There are too many of them, and it will take hours ...
1
vote
0answers
104 views

How to perform continuous Integration using Jenkins? [closed]

I've the basic idea about the Continuous Integration using Jenkins like- basic project setup, setting up source code management bit-bucket and build the project. I have done this so far and following ...
9
votes
8answers
754 views

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

Background: Following are not my assumptions or expectations but in my last couple of interactions with different project teams, I am seeing these patterns where it is expected (from testing by the ...
3
votes
1answer
759 views

Jenkins: failing builds on warnings

I've been reading the book "Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Addison-Wesley Signature Series (Fowler))" And these paragraphs drew my ...
1
vote
0answers
399 views

Jenkins HTML Publisher - Provide dynamic folder name to Path in HTML Publisher Plugin

I am generating an extent report every time my regression suite runs. The project folder structure is ProjectFolder/Results. I am running the regression suite from Jenkins job. So whenever the ...
3
votes
1answer
224 views

Non-headless Automation Testing on CI Server?

So im in a bit of a conundrum. I have a Rails project which i've written Automated tests for in Capybara using ChromeDriver/Selenium. It works great, but is quite long. I also have headless chrome ...
0
votes
2answers
482 views

How to couple JMeter with Jenkins?

I'm trying to setup Jenkins on my laptop to run JMeter scripts. I have setup the job on the localhost also added the plugin required in JMeter. My window batch command looks like: C:\apache-jmeter-3....
2
votes
1answer
36 views

Multiple pull request reviewers from different timezones

Our QA team is not a large one, but consists of full or partially remote, full or part time team members which, as it currently stands, live in different countries and in different timezones. We are ...
5
votes
2answers
114 views

When to mark a build as failed?

Currently, we do a lot of things when there is a application build job triggered (the trigger can be manual, or there is a commit to the develop/trunk branch, or there is a Pull Request created or ...
4
votes
2answers
870 views

Difference between Integration Testing and Continuous Integration Testing

In my college, I learned about Integration testing in which we combine the whole code together and then test it at once after we are done with unit testing. A few days back, I heard about Jenkins, ...
2
votes
2answers
42 views

Manage UI Tests with each branch

Well, we are currently working on three branches: dev, staging, and master My UI tests are running on continued integration pointing only to the dev branch and to the dev application as well. The ...
9
votes
4answers
264 views

What should a QA in software be worried about when a small configuration deployment is being pushed without testing?

In my limited experience, configuration changes (small 1-3 line changes to a project config file), either completely break the program or do not seem to bring noticeable changes to the user-experience....
6
votes
2answers
183 views

Is it a good practice to run functional tests with coverage?

Does it make sense to run once in a while, say, on a weekly basis, integration/functional tests against special build to have a coverage report. If anyone here has some practical experience of using ...
3
votes
2answers
868 views

Functional/Black Box tests automation library on Python

Summary: I have to test embedded software which runs on qemu virtual machine or on real device and can write its output to stdout. So I can check the state of software only by parsing stdout. To ...
6
votes
2answers
71 views

Version labels in continuous integration teams

How do people handle version labels while performing manual testing when working in a continuous integration environments. In Jira there is a ‘releases’ feature that allows a version to be assigned to ...
3
votes
2answers
153 views

CI for Selenium Project

I am not fully sure how to fully build Continuous Integration for Selenium project, so I would like to ask the following: Is it true that the only difference between a Maven project and a Java ...
4
votes
1answer
3k views

How do I automate front-end testing for a web app with Javascript?

I am introducing myself to devops engineering and I'm stuck on "how to automate testing for web applications". I consider that backend and api test automation are relatively simple and the concept is ...
0
votes
1answer
70 views

Legacy Code Testing with Jenkins on PHP

We are trying to integrate pull request based testing into our legacy code and the problem is there are lot of errors and warnings needs to be fixed. So, our first step is while merging new branches ...
3
votes
4answers
222 views

Selenium tests as a part of a build stage in a continuous integration pipeline

There is a statement from microsoft documentation about Selenium testing in a continuous integration pipeline: To include the Selenium test as part of a build, the source code must be in version ...
1
vote
1answer
457 views

Cobertura integration (for reports) should be integrated in Jenkins or SonarQube? [closed]

I would like to integrate Cobertura in order to have reports for each build but I do not know what is the best place to integrated it. Cobertura integration (for reports) should be integrated in ...
2
votes
2answers
536 views

Validate Quality Cobol code - Jenkins, Sonarqube/SonarLint and Rational/Topaz?

In my work as a tester I was asked to find a solution to validate the quality of Cobol code. For that I was asked to investigate Jenkins, Sonarqube/SonarLint and Rational/Topaz. Starting point - I ...
1
vote
1answer
436 views

Java + Selenium : What all best practices are & How to implement for executing test cases in Selenium

From the knowledge I have acquired while doing automation with other tools, I want to ask about specifics of doing that in Selenium (with Java). Questions: I remember watching a video on Junit where ...
0
votes
1answer
222 views

Stopping Test Servers on Gitlab CI?

I posted this on SO, but figured it might be more appropriate here since it's an actual testing question. I have a CI.yaml file (For Gitlab CI) that builds our Rails app and runs integration (Rspec/...
1
vote
1answer
4k views

How to run a specific test case from a suite in jenkins

I have 120 test cases and I execute all these test cases through a pom.xml (maven) file in jenkins. Now if I want to execute just one of these 120 test cases, how can I do that? Is there any way to ...
2
votes
1answer
649 views

How to move from test automation to devops? [duplicate]

I have a background as a developer, but have been working on test automation here in the UK for the last years. I work a lot with Java, Webdriver and Jenkins/continuous deivery - but I am very ...
1
vote
0answers
632 views

Integrate SoapUI with TeamCity - TeamCity waiting on a condition

I am trying to integrate SoapUI with TeamCity. I have a working MSBuild file (works fine on the TC server when lauched via the UI or command line), but when running the build from TeamCity it hangs ...
2
votes
2answers
160 views

CSS visual regression - do I need to store screenshots in git repository?

There is a technique to check if something visually not broken in HTML and CSS markup - visual regression testing. We do following steps: Check everything is ok. Create a test "reference" (creating *...
4
votes
1answer
324 views

Running unit tests on production build?

In one of the projects I am involved with, the team is running a continuous integration/continuous deployment and in development they have a bunch of unit tests as part of the nightly builds. When ...
0
votes
1answer
384 views

Is there any tool to automate test for installers (WiX or InstallShield)

I was wondering if there is a way to define tests (something like unit test) for installers, specifically installers made in WiX and InstallShield.