Hot answers tagged

6

The short version: Don't sweat on automation or test cases. Chances are you won't get time to build it because there's too much that has to be manually tested now. Instead focus on building light-weight, easy to maintain documentation of the key elements of the software you're testing. The longer version: This is my world. I'm the sole tester in a team of ...


5

What do you think? Should you eat one meal at a time and 2 to 3 meals a day? Or should you eat sufficient meals for 30 days at once and enjoy the remaining 29 days? Keep things as simple as possible! Combining everything and testing it all at once may make things too complicated to handle...


4

As a general rule, retesting in the staging environment is done more as an integration/sanity test than a full retest because the QA environment will likely have different code (due to other changes that aren't being pushed to the staging environment yet). The usual considerations are: The staging environment is kept as close to production as possible, ...


4

Welcome to SQA, I think you've got a few questions going on, so I'll try and answer them in sections. Whats Travis/Continous Integration Travis-CI is one of a number of build automation tools that help developers understand if their application is working by building, testing and reporting on the build sequences the developer has configured. Frequently ...


4

What you want is called an continuous integration (CI) server. A very popular one is called Jenkins (jenkins-ci.org), though there are others both open source and commercial. You can configure it to watch for checkins, and to build a project. If the build succeeds, it can trigger tests to be run. If the tests pass, you can trigger other jobs such as ...


3

If you are talking about unit tests I would consider moving the long running tests to a different test suite. If they are taking a long time they probably aren't unit tests and should not be treated as such. These tests should be moved to the location where you run integration tests. If that's not what your looking for you could also look into running ...


3

The most efficient tool for testing the appearance of a website is still the human eye and brain. That said, if you want or need to automate, image comparison is probably the least effective method because even with fuzzy logic it can generate far too many false positives. All it takes is a change in hardware (a different monitor or video card - this will ...


3

Generally I would consider some of the key requirements for an entry level position to be background as a developer experience with OO such as Java practical experience with automation familiarity with CI and Jenkins enthusiasm about devops In other words, you are already qualified. If you wish to have a more mid-level or senior position then you will ...


2

A quick Google shows plenty of people doing this, including This page from WatirMelon ( if you dont know of this site could be worth your while reading it, lots of good stuff on it ) and an example of using ci_reporter is here


2

According to this blog post it is not possible to run tests from xcodebuild but there is a work around. This problem exists for xcode 4.0 - 4.3, I'm not sure about 4.4


2

Similar question posted on Software Testing Club Robotium looks like it help fulfill some of your needs? (props to Stephen Janaway)


2

You want to know why they do this and or if it is justified. It is difficult to answer without knowing more about the project length, product, technology and deployment environment and the acceptable defect goals. For instance there could be a number of valid reasons. It may be the exact same code, but the deployment process may be unreliable. It may also ...


2

If you're looking for TestComplete training, you probably want to look at the SmartBear website (http://www.smartbear.com). They have a number of webinars available at any time. There's also more intense training available: http://smartbear.com/products/qa-tools/automated-testing-tools/features/training-certification/ I've never done any of the training ...


2

We use Jenkins to orchestrate our CI and Continuous Delivery. This training course looks pretty good: http://www.cloudbees.com/training.cb


2

It really comes down to overall reliability and speed. If you can guarantee that you have 24/7 access to your 'test server' via the Internet, with guaranteed > 10Mbps download/upload speeds, and you can protect 100% from external attacks (e.g. DoS) then the Internet might be the way to go. But, if you are like most of the world that experiences ...


2

It should be hosted where everyone who needs to test can access it. Important is that everyone can test in isolation, you don't want different processes or users interfering with each others tests runs. As you tagged this question with "continuous integration" I would like to add that for automated tests I love to spin up a test environment from scratch so ...


2

Selenium Builder is the evolution of the Selenium IDE. Its tooling page has a video (11 minutes) about using it with Travis-CI. Although I haven't watched it I expect it will answer most of your questions. To simplify test building (for non developers) I would suggest using something like Cucumber or another BDD framework, you can then make a lot of ...


2

In recent versions of Windows, Microsoft decided to give services their own hidden desktop, and so even if you check "interact with desktop" and running as current user, the service still is referring to a hidden background desktop. There is no way to change this, as Microsoft did this on purpose. So, for example, to run Selenium tests from a executor, you ...


2

Have you considered using a free (or paid depending on your circumstances) Amazon EC2 account?


2

I think the Op is asking two questions: If, in the version control system, the code in QA is tagged (or branched) separately from code in development, which version should you use with the Selenium tests? Where should the Selenium tests run: on the developer's desktop or in the QA environment? I don't have enough organization/business/technology ...


2

There is still an open ticket to get the enhancement you want. To elaborate on Adurbe's answer: You could drop a .sh file onto your server and then call it via Bamboo. Check out this StackOverflow question and look over the answers to find what will be best for you.


2

Apologies in advance for a quick/simplistic answer - it's crunch time here! My current client have automated around 80% of regression testing, the rest is done manually with an offshore team, where the basic rule of thumb is: "If you change B, test A and C" i.e., everything around the change - there's no point in your regression team (or the automated ...


2

When it comes time to complete a roll out we do the following. Its important to note this phase is ran on a previous version test template with no previous data. We are also in the process of pulling a portion of our regression suite to automation. Shallow exploratory. Test basic navigation and control functionality per page. Deep Exploratory. Similar to ...


2

Ouch. No, the old school sort of test plan doesn't make much sense in your context. The only reason I can see for doing them is if you had a contractual requirement with a client to deliver them. Will anyone read them except you? (If no - then stop doing them now!) If you re-read them, what do you use them for? To remind you of how to do something (is it ...


2

You could try TestComplete - I believe we use it to test installation here. Essentially you're just testing driving another windows application: if the environment can let you check registry entries and file content then so much the better (I don't work in TC at the moment and can't recall). AutoIT could do it (I have used AutoIT a lot).


2

I would only run the tests on a code change, better on each code change and not just in the night. You want to know which code change broke what test. In your case this would mean when you branch the code to a production version (which is a sort of code change) you run all the tests one more time and that is it. Only when you hot-fix the production code you ...


1

I would go with VirtualBox for a couple of reasons. First, it's free. Second, it integrates incredibly well with Vagrant which allows you to script the provisioning of your build boxes from scratch. Granted, you won't want to reprovision the build boxes often but should something weird happen, you'll be able to get back to a known state very quickly (...


1

I would setup a Jenkins free-style job and execute the java based Se Interpreter from a shell-script task Setup free-style Jenkins build Schedule build with github with the git-plugin to run job on each commit Add a shell-script that runs the Se Interpeter in the build and make sure it has a correct exit code to fail/success the run or see this question ...


1

Selenese scripts generated by IDE are HTML without parameters, unlike traditional scripting/programming. What programming language is main language in your organization? Python is very easy to learn and has good Selenium bindings. Also, learning general programming language (Python) could be interesting career-enhancing move for your testers (so they ...


1

If your team members don't have much development experience and you would like to use Selenium Webdriver for your automation tests I highly recommend taking a look at Robot Framework. Robot Framework is a generic framework to which you can easily plug in external libraries and script your automation tests using keywords. There is Selenium Library which ...



Only top voted, non community-wiki answers of a minimum length are eligible