Questions tagged [continuous-integration]

Continuous Integration, aka CI refers to the development practice of integrating work from team members frequently, but is also sometimes used as shorthand for the automated build systems that support that practice.

Filter by
Sorted by
Tagged with
0 votes
1 answer
30 views

Cannot see Jmter in Influxdb measurement

I was trying to interact jmeter and influx db but getting as ERROR o.a.j.v.b.i.HttpMetricsSender: Error writing metrics to influxDB Url: http://localhost:8086/api/v2/write?org=ITM&bucket=JMter, ...
Bhaskara Reddy Dwarampudi's user avatar
0 votes
1 answer
29 views

As part of JMeter WEB DRIVER(Selenium Scripts) Integration With Azure Pipeline but Application is not running at Azure Pipeline

Pushed the JMeter Selenium Scripts into Azure GIT Repository, created the pipeline and run the pipeline. Agents added are: JMeter, Command Line, Publish pipeline artifact and publish and download ...
Bhaskara Reddy Dwarampudi's user avatar
3 votes
1 answer
404 views

Contract testing with separate frontend and backend repos

We are using a code pipeline for our CI-CD. Front-end and back-end are separate repositories. We run cypress end-to-end tests on the deployment of both frontend and backend. The code gets merged from ...
systemdebt's user avatar
1 vote
1 answer
37 views

How is compatibility of business logic tested in microservices?

Each microservice is tested and deployed independently from other microservices. To guarantee the compatibility of API the Consumer-Driven Contracts approach is used. But how is the compatibility of ...
Daniel's user avatar
  • 149
0 votes
1 answer
69 views

Sorting out automated testing in CI pipeline and getting conflicting information related to building, unit testing and Docker images

I seem to get a unique response for every person that I ask, or every article that I read, which is just confusing me even more. Basically, I'm trying to setup automated testing in the CI pipeline ...
cjones's user avatar
  • 129
0 votes
1 answer
59 views

Where do we create end-to-end tests for a new feature?

Let's suppose a developer begins working on a new feature. They create a new branch. The team also has a CI server where they build and test new features. While the developer is writing code, QA-...
Daniel's user avatar
  • 149
4 votes
2 answers
1k views

End to end application tests when separate repo for the front-end and back-end tests

We have separate repos for the backend and the front end. The backend which is just microservices has its unit tests(jest), microservice integration tests(jest), and microservice end-to-end tests(jest)...
systemdebt's user avatar
1 vote
0 answers
86 views

What are some good practices to reduce test redundancy across environments in deployment pipeline?

Background: In an agile team, working on complex front end application relying on heavy backend (implementing complex business logic) where new features are being released in a pipeline which goes ...
Vishal Aggarwal's user avatar
0 votes
0 answers
159 views

What is your setup for running nightly automated web driver tests

There seem to be three predominant setups for running automated tests. The company invested in a selenium grid that is always available and the nightly tests run against them. The CI will build a ...
rails4sandeep's user avatar
-1 votes
2 answers
80 views

Efficient way to setup Jenkins for Automation Project

I have configured Jenkins server on windows computer. The systems has below configurations: OS : Windows 10 Processor : intel i3 processor RAM : 16GB 500GB hard disk The problem is recently the ...
NarendraR's user avatar
  • 1,573
2 votes
2 answers
934 views

where to put cypress tests?

I am new to Cypress and trying to find the best practices for where to store our tests. I see there seems to be plenty of resources for how to organize folders to setup fixtures, tests, plugins, etc. ...
JD D's user avatar
  • 121
5 votes
3 answers
660 views

Automated tests in CI: same or different repo as SUT?

I'm currently writing API and UI automated tests for a website. My goal is to plug these tests in the CI workflow (Jenkins is used in this organization). The workflow would be: if there's a new commit ...
Y-B Cause's user avatar
  • 179
-3 votes
1 answer
2k views

Running Jmeter tests in Teamcity CI/CD as automation tests

I want to add Jmeter tests as build steps in TeamCity CI Deployment server. If tests fail, build will not complete. Please advise in details. I am currently using Jmeter for testing a Rest API ...
QA-Tester's user avatar
0 votes
0 answers
109 views

Triggering ALM test sets (UFT tests) in Jenkins Unix slave

We have a Jenkins Unix slave through which builds are scheduled in different testing environments. Objective: To schedule a job in Jenkins unix slave to trigger 2 ALM test sets (containing 30 UFT test ...
UFT's user avatar
  • 13
1 vote
0 answers
43 views

Integrating Firebase deployment and github repo with selenium tests

I have been writing UI tests with Selenium for my friend's web app that's hosted on Google's Firebase. I was wondering if there's any way to integrate my existing test repository (maven project on ...
oompaloompa's user avatar
0 votes
1 answer
40 views

Quickest route to a CI solution?

We use the following tools internally Visual Studio/TFS on-premise for Source Control and as an ALM TeamCity to build nuget packages and binaries Octopus Deploy to deploy the nuget packages to ...
spikey_richie's user avatar
2 votes
1 answer
171 views

Integrating Protractor to Octopus deployment (CI/CD Integration)

I have a batch file with below content: %1 %2 --params.validFile=%3 --params.invalidFile=%4 I am starting it through power shell script: $path= "<filePath>\start.bat" $...
PDHide's user avatar
  • 11.1k
10 votes
4 answers
2k views

Do you still need a Test Plan when adopting Continuous Delivery?

As a test manager, I need to review a Test Plan for the upcoming release. I also need to review the test results. The tests are both automated and manual. As an organization, we would like to move to ...
Tarski's user avatar
  • 211
2 votes
2 answers
92 views

Is there any tool to determine if a test is flaky?

I'm thinking about a new approach to include autotests to CI/CD pipeline and my thought is to determine if a test is flaky before they are in pipeline. In this case, the only way to do that is to ...
Orkhan M.'s user avatar
1 vote
2 answers
80 views

What is Travis CI usage beyond unit tests and UI tests?

I'm learning iOS development, and started learning Travis CI. Currently, I have it testing unit tests and UI tests, I understand how this can be helpful for a team working on the same project, but ...
Joe's user avatar
  • 121
-1 votes
1 answer
249 views

xUnit equivalents for performance testing

Good evening everyone. I'm wondering if there are libraries in any programming languages that can generate load/performance tests. I'm picturing a test script that would fit in next to the ...
ewhiting's user avatar
  • 103
-1 votes
1 answer
37 views

Legal test (on pre-producten Stage) slows down deliveries. How can I structure or accelerate this process?

In the course of, among other things, legal test procedures in the staging area, we have integrated a further step, namely pre-production, in which our lawyers check the texts of the pages to be ...
Mornon's user avatar
  • 1,107
1 vote
1 answer
93 views

Non-functional test, in which CI test step is it best to use?

Within the Continious Integration stages, within this staging development, it is clear to everyone what is to be done where. Unitest in development, sonar if required, or RESTAPI testing via SoapUI. ...
Mornon's user avatar
  • 1,107
0 votes
1 answer
1k views

From a .side file to a GitLab CI/CD pipeline step?

Is there a way to add a GitLab CI pipeline step that launches a Selenium test which is coded in a Selenium IDE file (.side) ?
ThCollignon's user avatar
0 votes
2 answers
1k views

Continuous Integration Selenium Webdriver with Azure

I have created a Selenium Webdriver C# script for login module of my app and it's running on my local machine. Now the things is What is continuous integration. As per my knowledge we can build, ...
Muneeb Akhtar's user avatar
1 vote
3 answers
54 views

When nightly testing integrations with external systems, how should random failures of the external system be handled?

Our product can integrate with a variety of external systems. We support 5 different databases for storing business data, 5 different version control repositories, 5 different bug trackers,... We also ...
Nzall's user avatar
  • 485
0 votes
2 answers
3k views

Compare a screenshot with saved image on Devops build server

Background When releasing a C# MVC website through Devops release management the bundling failed. This caused the CSS file not to load on the released website, causing the UI to render incorrectly. ...
j9070749's user avatar
  • 103
0 votes
0 answers
1k views

Is it possible to pass testng.xml and test name as single parameter in Jenkins?

I have below testng.xml file : <test name="Product_Listing_Page" enabled="true"> <parameter name="scenario.file.loc" value="scenarios/plp.bdd"></parameter> <groups> ...
NarendraR's user avatar
  • 1,573
1 vote
0 answers
201 views

How to integrate GitLab and Codecov safely?

When trying to sign up as a GitLab user on Codecov they request full admin access to my entire account. That is just not going to happen, so is there a way to set it up safely without hosting my own ...
l0b0's user avatar
  • 468
1 vote
1 answer
173 views

Future-proofing Performance Test Scripts across environments for Continuous Integration - using LoadRunner and Jenkins

Here is the AUT workflow across environments: Code moves (and gets stable) from dev > QA > Stage > Prod Data moves (and gets dirtied) from Prod > Stage > QA > dev We have ...
petwolfe's user avatar
  • 409
0 votes
1 answer
2k views

No files displaying (.log and .jtl files) in jenkins Workspace post running a JMeter jmx script via jenkins?

Running a JMeter script via Jenkins with Performance plugin via Windows batch command as: cd C:/apache-jmeter-4.0/apache-jmeter-4.0/bin jmeter -n -t C:/Users/Administrator/Desktop/JMeter/Suite.jmx -l ...
Rohan Kalia's user avatar
1 vote
1 answer
75 views

I am new to automation. I am researching on how can I create a Jenkins pipeline to build image in docker container?

Its a TDD environment and I wanted to create a Jenkins file through code which different teams can pull in their projects and start writing tests.
Meenakshi's user avatar
0 votes
2 answers
411 views

Integration testing a website with no public API

I have recently been reading about the test pyramid and how integration testing fits into the grand scheme of things, when it comes to web services, with regards to API testing. QUESTION: Does API ...
Jonnyboy's user avatar
  • 127
10 votes
4 answers
3k views

Tests in CI: Are API + Integration Tests the most suitable?

In my experience, automated GUI tests may take too long for a build of Jenkins (even parallelized) and may demand a lot of maintenance. On the other hand API + Integration tests are way faster, do not ...
Roberto de Toledo's user avatar
6 votes
5 answers
270 views

How does Continuous Integration add value to Automation Testing?

How do I gain the value from CI tools as an Automation Tester? What are the advantages to using such tools and how do they help me and the company in the development process ?
user avatar
3 votes
0 answers
624 views

SonarQube: Auto assign issues doesn't work

Currently, I have an integration between GIT, Jenkins and SonarQube as described in this pseudo workflow: commit----> AWS CodeCommit (GIT) <-> Jenkins <-> SonarQube Scanner for Maven &...
Pedro Riffo's user avatar
3 votes
1 answer
162 views

Supporting multiple versions of test scripts

We're running our own CI/performance tests system for some other team's software library as they've yet to decide on something beyond nightly tarballs and our requirements are much more stringent. Due ...
doubles_in_seattle's user avatar
1 vote
2 answers
676 views

Behat tests take over an hour to run

We have a test suite of around 60 feature files, 135 scenarios, 1800 steps. We currently use the free 100 builds on semaphoreCI which occasionally successfully runs all of the tests, but quite often ...
Adam Copley's user avatar
1 vote
0 answers
34 views

Cloud platform for CI Test Automation Lab setup with Windows 10 or 7 OS

We have an on-premise test automation lab where we monitor all our applications (Web Applications and Web Services) through CI Jenkins jobs. Machines in the lab have either Windows 10 or Windows 7 OS. ...
user30610's user avatar
1 vote
2 answers
844 views

Suggestions to integrate Selenium testing suite into TeamCity or any other CI?

The title may not have been worded correctly but basically here is what I am having trouble researching / figuring out: What I have: A full set of automated tests written in C# Selenium that tests ...
David Ko's user avatar
2 votes
1 answer
130 views

Regarding the Build job in jenkins

When I am running maven goal in Jenkins which runs soap tests which are developed using groovy, whenever there is a test failure then all the other tests are failed without any test execution from job....
SHASHAVALI LADDU's user avatar
1 vote
0 answers
550 views

Cobertura analysis reporting "[ERROR] SLF4J: Class path contains multiple SLF4J bindings."

Cobertura is reporting that there are multiple SLF4J bindings in the classpath, actually both related to different versions of the logback-classic artifact: [ERROR] SLF4J: Class path contains ...
gvasquez's user avatar
  • 269
0 votes
2 answers
190 views

How to schedule to run all unit tests?

I need to manage executing all unit tests on build server. Is there any idea about when is proper to run all of the unit tests on the build server. There are too many of them, and it will take hours ...
Polymorphic's user avatar
1 vote
0 answers
127 views

How to perform continuous Integration using Jenkins? [closed]

I've the basic idea about the Continuous Integration using Jenkins like- basic project setup, setting up source code management bit-bucket and build the project. I have done this so far and following ...
NarendraR's user avatar
  • 1,573
9 votes
8 answers
1k views

Is manual regression testing an technical debt for agile teams aiming for continuous delivery?

Background: Following are not my assumptions or expectations but in my last couple of interactions with different project teams, I am seeing these patterns where it is expected (from testing by the ...
Vishal Aggarwal's user avatar
2 votes
1 answer
2k views

Jenkins: failing builds on warnings

I've been reading the book "Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation (Addison-Wesley Signature Series (Fowler))" And these paragraphs ...
gvasquez's user avatar
  • 269
2 votes
1 answer
2k views

Jenkins HTML Publisher - Provide dynamic folder name to Path in HTML Publisher Plugin

I am generating an extent report every time my regression suite runs. The project folder structure is ProjectFolder/Results. I am running the regression suite from Jenkins job. So whenever the ...
user2356679's user avatar
3 votes
1 answer
639 views

Non-headless Automation Testing on CI Server?

So im in a bit of a conundrum. I have a Rails project which i've written Automated tests for in Capybara using ChromeDriver/Selenium. It works great, but is quite long. I also have headless chrome ...
Mercfh's user avatar
  • 1,736
0 votes
2 answers
1k views

How to couple JMeter with Jenkins?

I'm trying to setup Jenkins on my laptop to run JMeter scripts. I have setup the job on the localhost also added the plugin required in JMeter. My window batch command looks like: C:\apache-jmeter-3....
Rohan Kalia's user avatar
2 votes
1 answer
68 views

Multiple pull request reviewers from different timezones

Our QA team is not a large one, but consists of full or partially remote, full or part time team members which, as it currently stands, live in different countries and in different timezones. We are ...
alecxe's user avatar
  • 11.4k