Continuous Integration, aka CI refers to the development practice of integrating work from team members frequently, but is also sometimes used as shorthand for the automated build systems that support that practice.

learn more… | top users | synonyms

7
votes
3answers
12k views

Selenium Tests run in the background when TeamCity CI is run as a Windows service

Our test suite is written in Python and makes use of the WebDriver Python bindings. We are looking into moving to TeamCity for continuous integration. The setup I have in mind is a build triggered for ...
7
votes
1answer
923 views

Continuous Integration and testing environment and configuration for Android

I am an Android developer but I am not satisfied with my testing and Continuous Integration environment and configuration. Someone could recommend me how to configure the best setup and workflow for ...
6
votes
8answers
266 views

What to do with Limited Time/Testers - What is most Important?

In an ideal world we'd have Acceptance Tests-->Unit Tests-->Integration Tests-->Test Plans and Automated GUI Tests (With Selenium or something). But where does it start to get cut out when you just ...
5
votes
7answers
3k views

Visual Regression Testing

For testing the visual appearance of a website the use of tools like selenium (functional surface test) are not sufficient because it doesn´t check the visual appearance and/or the CSS-Code directly. ...
5
votes
1answer
2k views

xcodebuild does not run any unit tests when launched from console

My first question here so please bear with me. It may be off topic, if so - close the question. I have setup Jenkins with git and Xcode plugins so that I would be able to build an iOS project on CI ...
4
votes
1answer
71 views

Running unit tests on production build?

In one of the projects I am involved with, the team is running a continuous integration/continuous deployment and in development they have a bunch of unit tests as part of the nightly builds. When ...
4
votes
2answers
8k views

What is the correct way to configure the VirtualBox plugin on Jenkins?

I am trying to get the VirtualBox plugin working with Jenkins. My plan is then to hook up the Selenium plugin as well and get a grid running on the VirtualBox cloud. When I follow the instructions on ...
4
votes
0answers
536 views

Jenkins stops getting my unit test output from xcodebuild [closed]

I've got Jenkins set up to build my application test target and execute tests in the iOS simulator like this answer says. When I execute the build in Jenkins, the iOS simulator launches and runs all ...
3
votes
4answers
556 views

Scope of regression testing

Had a question about what other folks do for regression testing. Let me lay out what we currently have and what I think it should be: We have smoke tests, which are just some minimum tests for build ...
3
votes
3answers
2k views

Selenium IDE and Selenese scripts in Continuous Integration

Apologies if this is not the forum for such a generic question. As our organisation moves to an Agile project methodology, we need to be able to rapidly automate applications as they are built up ...
3
votes
1answer
2k views

Trying to understand what Travis CI does and when it should be used

I am very new to Git and I am planning to contribute to some open-source project on GitHub after discovering a small error in it. Upon forking it and fixing the error, I purposed a pull request and I ...
3
votes
2answers
986 views

Open source deployment validation tool

Asked this on stackoverflow and earned myself the tumbleweed badge... Anyone here know of any? I'm looking for an Open source tool to help with deployment validation for mainly web based applications ...
2
votes
2answers
89 views

cross-OS automated testing

First, please leave your stones down: I am a windows-oriented developer and I have very limited knowledge in testing tools world - especially in those that works on multiple platforms. I have been ...
2
votes
4answers
189 views

Automatically only run the fast tests?

Christmas List: Manually I nark tests as being in category "long running". I'm lazy and don't want people to have to do this. Are there any testing or CI frameworks out there that can run only ...
2
votes
1answer
93 views

How to move from test automation to devops? [duplicate]

I have a background as a developer, but have been working on test automation here in the UK for the last years. I work a lot with Java, Webdriver and Jenkins/continuous deivery - but I am very ...
2
votes
2answers
1k views

Include Watir test cases in a Continuous Integration system

Did anyone succeed deploying Watir test cases to a continuous integration system such as Team City or Hudson? I'm trying to find a way to have the test scripts executed and have the results generated ...
2
votes
2answers
92 views

CSS visual regression - do I need to store screenshots in git repository?

There is a technique to check if something visually not broken in HTML and CSS markup - visual regression testing. We do following steps: Check everything is ok. Create a test "reference" (creating ...
2
votes
1answer
176 views

Automated testing in cloud

I have a Windows application using OpenGL and automated E2E test environment based on Sikuli framework. Tests run locally and are not available outside of my company network. As we have two different ...
2
votes
3answers
314 views

Best practices to organize the automated tests in a continuous delivery world [closed]

I am trying to organize my automated tests in the source control [ GIT] - mostly Jprofiler/Jmeter, Selenium and SOAP tests. What are the industry standards for organizing/managing the Automated ...
2
votes
1answer
340 views

Combining coverage from unit tests and functional tests/Selenium

Has anyone had experience getting a combined code coverage measure across both unit tests and functional/UI automation tests? I'm in a Java stack with Cobertura, Jenkins and Ant. I can successfully ...
2
votes
1answer
803 views

Configuring a framework using Selenium Builder, GitHub and Jenkins

Ok, so I have posted a couple of other questions here that have been unclear so, apologies for another along similar lines. I am a little further along now but am still blocked from progressing. I ...
2
votes
1answer
104 views

Test automation for .NET / Java Project relying on app container

I am looking to a testing / continuous integration tool which can help me with the following: 1) Inside a Maven project, allow me to run a JUnit test case that, using some API, deploy an application ...
1
vote
7answers
1k views

Do you need to re-verify all bugs in the staging environment?

At my company the QA department will verify all of the bugs fixed in builds deployed to our QA environment. We might deploy like 10 or so builds over a few weeks and they verify that the bug fixes are ...
1
vote
2answers
59 views

Integration Testing requires consecutive builds?

If I have several code-level integration tests, and my integration strategy is to integrate the components in a bottom-up manner, should I perform a build for each integration level of the modules? Or ...
1
vote
2answers
197 views

Simple SSH/Git pull continuous integration?

I'm trying to set up Atlassian Bamboo trying to get a minimal build plan off the ground. Our current set up is pretty basic. We have several projects that we git clone onto either a stage or a prod ...
1
vote
1answer
122 views

How to run a specific test case from a suite in jenkins

I have 120 test cases and I execute all these test cases through a pom.xml (maven) file in jenkins. Now if I want to execute just one of these 120 test cases, how can I do that? Is there any way to ...
1
vote
2answers
66 views

OS X hypervisor for software tests

I am setting up an OS X (build and) test environment for a open source project with a big C codebase. It shall be a Mavericks host on a Mac mini, which has a virtual machine with Snow Leopard. Both ...
1
vote
0answers
104 views

Integrate SoapUI with TeamCity - TeamCity waiting on a condition

I am trying to integrate SoapUI with TeamCity. I have a working MSBuild file (works fine on the TC server when lauched via the UI or command line), but when running the build from TeamCity it hangs ...
1
vote
1answer
125 views

How to set up stages within test plan to use the same build_dir on Atlassian Bamboo?

I have a few libraries that needs to be tested under multiple versions of python. I have defined each library as a plan. For each plan I have two stages: Setup (Source Code Checkout + "make install"...
1
vote
1answer
546 views

Remote deployment on WAS using websphere deployer plugin of jenkins

I want to deploy an application on websphere application server(8.5.5) from Jenkins using websphere deployer plugin. I have attached the two required jars. I can telnet the WAS server from jenkins ...
0
votes
2answers
63 views

Where should a test server be hosted?

Should a test server be hosted locally or on the internet ? What are the pros/cons? I have seen people do both. What is best practice?
0
votes
2answers
341 views

Training recommendations for Continuous Integration and TestComplete

At my company we use a lot of custom built tools, our Continuous Integration is also custom built and my job is it to drive the development further and to implement automated tests in TestComplete for ...
0
votes
1answer
92 views

Is there any tool to automate test for installers (WiX or InstallShield)

I was wondering if there is a way to define tests (something like unit test) for installers, specifically installers made in WiX and InstallShield.
0
votes
1answer
259 views

Automated tests with selenium must run in local environment or qa environment?

I have a application that have 3 differents environment(development, qa and production) that are integrated with jenkins, my doubt is, where's the better environment to run automated tests development ...
0
votes
2answers
149 views

How to automatically break Unit Tests when their related Requirements change (before any code change)

The shop I work for has recently switched to Agile/Scrum software development. We've started logging User Stories, and defining their scope with Acceptance Criteria. So, we have Features defined ...
0
votes
2answers
384 views

Suggestions for continuous integration, test and deploy infrastructure for a Ruby on Rails application in Amazon EC2 cloud

I would like to know everyone's opinion on the best tools for setting up a continuous integration, test and deploy infrastructure for a Ruby on Rails web application API in the Amazon EC2 cloud and ...
0
votes
1answer
420 views

Run the test JS and PHP in parallel via CircleCI

I use circle to run JS and PHP test (Protractor/ Phpunit). I would like use parallelism to win time but i don't know configure the parallelism. I activate the parallelism in the circle parameters (2 ...
0
votes
0answers
9 views

Stopping Test Servers on Gitlab CI?

I posted this on SO, but figured it might be more appropriate here since it's an actual testing question. I have a CI.yaml file (For Gitlab CI) that builds our Rails app and runs integration (Rspec/...
0
votes
0answers
57 views

How do I get Jenkins to poll a Subversion server successfully when I keep getting an SVNAuthenticationException E170001?

I have a Jenkins ver. 1.650 server configured to poll a (quite old) Subversion server. The Jenkins machine seems to have Subversion Plug-in 2.5.7 installed. I was able to do an initial copy of the ...
0
votes
1answer
139 views

How to build iOS app for Seetest

I am trying to find out how to build (compile, prepare, process ...) an app for Seetest, so that it can be tested on devices without adding them to the Apple Developer Portal. I know how to build an ...