I'm researching Test Case Management tools for my company. I'd love to hear pros and cons of your favorites and why

Question

I'm currently researching test case management tools for my company; I'd like to give my development team visibility into what the testing status is, and also I'd like to have some accountability regarding regression testing. We are small shop and need a tool to help manage mostly manual test cases, but eventually would like to do more functional automation. Currently, we are looking at TestRail, QMetry, Zehpyr, and QAComplete amount others. I'm looking for some good feedback regarding these tools. Please tell me your pros and cons and why?

Answer 1

Why not Testlink?

Pros:

1. Every needed function present
2. Possible to add additional fields
3. Possible to manage test-cases related to different projects, test-plans
4. Possible to manage different versions of test-cases
5. Possible to assign test-cases to tester for execution
6. Possible to connect to bug-tracking tools (e.g. mantis, JIRA)
7. Possible to connect to Selenium tests execution
8. Automatic metrics, reports
9. Free, open source

Cons:

1. Design
2. Not easy to import existing test cases (at least as it was for our team)
3. No custom report designer tool

Answer 2

I would like to recommend TestCollab, as this is one of the easiest Test Case Management Systems. With a user friendly interface, it brings a bouquet of features including :

• Support for agile methodologies
• Easier integration with popular bug trackers been used in the industry for development project's requirement management, automatic reporting of bugs encountered during test runs, automatic updation of reported bugs' status when test is marked as passed in TestCollab. Bi-directional integration supported for JIRA and Redmine
• Universal integration with test case automation tools
• Unlimited projects, test cases and test executions
• In-built requirements management along with coverage and traceability analysis
• Re-usability of test case steps, test cases and test suites
• Quicker adaptability with custom fields
• Easy test plan definition with a support for multiple configurations to make the test executions possible in different environments
• Collaboration with all your team members
• Dashboard and reports to keep a hawk eye over the projects as they progress
• Deployable on any popular platform - Windows, Linux or Mac
• Easy migration from other Test Case Management tools with support for XML, CSV and Excel formats for data portability
• There is a flexibility of choosing either hosted plans (SaaS), or self hosted ones according to your needs.

To further explore the features at offer, visit http://testcollab.com/tour

You can also try TestCollab for free by visiting http://testcollab.com/trial

Disclaimer: I work for Test Collab as a QA professional

Answer 3

Of the tools you mentioned I have experience about Testrail.

Pros: Straightforward approach. Quick to start to use. Stores test cases well. Cons: Less features to pick relevant test cases to re-run, no issue management. ( We wanted integrated issue management as it makes easier to see where the issues are regarding test cases and to pick test casea to be re-run )

We ended up in using Meliora Testlab and so at the moment if know this tool best. Pros: We use the tool to store the requirements / use cases. The test design from requirements is done really well. User interface Filter for picking right test cases tags! We use tags for grouping test and issues. Support: they have been helpful Cons: Basic reports show what they should, but I miss HP:s dynamic reports to report ANYTHING. The tool has version field but not the concept of releases.

Anyway, the tools offer free trials so try them out, you will find what you need!

Answer 4

I recommend you TestLink. It is opensource, very easy to use and complete. You can link it to integration server as Jenkins. For me it is the most efficient opensource tool. http://testlink.org/

From what i remember, you have a free plugin in Jira for test management. Unfortunately, it is not so user friendly the display is bad. It is a bit complex to use for what we expect from a test management tool.

If your need is for a big project and you have budget you can try for a HP product.

http://www8.hp.com/us/en/software-solutions/application-lifecycle-management.html

Answer 5

So, for full disclosure, I work for SmartBear Software and have used our product QAComplete, along with a few others (some mentioned above).

Like some have said above, it all depends on what you're doing and your budget as to what tool will work best for you.

I can speak for QAComplete and tell you that the biggest selling point for it is that its traceability feature works well and it integrates with popular bug tracking tools, source control, and test automation suites. Essentially, It is a hub for your manual and automated tests that can allow everyone working in the SDLC to access and comment.

That being said, what exactly are you looking for in a test management tool? What is most important to you?

Answer 6

I have evaluated testrail, spiratest earlier. My analysis is available in link http://sqlandsiva.blogspot.sg/2010/08/evaluating-test-case-management-tool.html http://sqlandsiva.blogspot.com/2014/10/testrail-tcm-tool.html

Testrail I can share my learning's if any questions. Good Reading Notes I referred / collected for evaluating test case management tools

• http://sysgears.com/articles/tools-battle-spiratest-testrail-and-testlodge/
• http://www.lloydrodenconsultancy.com/files/Cheap%20and%20Free%20Tools.xls
• http://www.gerbenvanadrichem.com/quality-assurance/testcase-managementmy-favorite-tools/

Answer 7

I think it is worth to check PractiTest. You can also read more about this tool here Alternatives to HP Quality Center for small business

Answer 8

Here is a list of free test management tool. Ignore the title, lol. It is for test management tool https://alternativeto.net/list/23274/free-and-open-source-team-collaboration-software

Answer 9

Just to update this topic, here is one more tool worth checking. TestCaseLab - testcaselab.com

Detailed review is here Manage Test Cases using TestCaseLab Test Case Management Tool.

TestCaseLab is a brand new great tool for manual QA engineers. It allows you to follow most of the testing activities: creating test cases, categorizing them, gathering them in test plan and starting test runs.

Nice pack of available features and integration possibilities wrapped into the ultimate design. One of the most affordable and lowest pricing plans among other competitors!

Answer 10

Zephyr as a plugin for JIRA is a good test case management tool.

It helps in creation and execution of test case cycles, cloning and interlinking of test cases, and their filtered viewing, besides facilitating attachment of screenshots to the ticket. Zephyr also facilitates reporting of test metrics via test summary, pie charts and graphs.

However, there is no facility in Zephyr to list all the test cases which are linked to the same issue. Also, it cannot handle historical reporting of test cases across successive versions.

This article effectively sums up the pros and cons of Zephyr for JIRA. Test Management in JIRA using Zephyr.

Answer 11

ZenTao

Pros:

Test case library for global cases in systems in different products or projects

Test suite case for the same functionality or the same user story

Test request for running test cases many times and get the results by test report

Test cases could be categorized by modules, submodules are supported

Bugs could be directly reported during running cases

Cases should be written based on user stories

Bugs are based on builds, builds are linked with user stories

CI/CD available by Jenkins integration

Code repository could be synced from your github/svn repository to do code review

Free, open source version, self-hosted available

Email/webhook notification

Cons:

Mobile App almost useless