I'm currently researching test case management tools for my company; I'd like to give my development team visibility into what the testing status is, and also I'd like to have some accountability regarding regression testing. We are small shop and need a tool to help manage mostly manual test cases, but eventually would like to do more functional automation. Currently, we are looking at TestRail, QMetry, Zehpyr, and QAComplete amount others. I'm looking for some good feedback regarding these tools. Please tell me your pros and cons and why?
-
1I guess it's off topic to ask if you've considered not using 'test cases'? What are you trying to 'manage' with them?– Phil KirkhamOct 7, 2014 at 17:47
-
I'd like to give my development team visibility into what the testing status is. Also I'd like to have some accountability regarding regression testing. Better ideas?!– snowmom475Oct 9, 2014 at 18:26
-
1Mindmaps, lo-fi test radiators can show more than 'test case count'. What do you mean 'accountability'?– Phil KirkhamOct 10, 2014 at 2:51
-
1What are mindmaps and lo-fi test radiators? I'm always interested in learning new things. I don't even know what those are. I guess by accountability I mean tracking and reporting on responsibility for testing and tractability for requirement coverage. Does that make sense? Thanks for your advice, I appreciate the help!– snowmom475Oct 10, 2014 at 20:33
11 Answers
Why not Testlink?
Pros:
- Every needed function present
- Possible to add additional fields
- Possible to manage test-cases related to different projects, test-plans
- Possible to manage different versions of test-cases
- Possible to assign test-cases to tester for execution
- Possible to connect to bug-tracking tools (e.g. mantis, JIRA)
- Possible to connect to Selenium tests execution
- Automatic metrics, reports
- Free, open source
Cons:
- Design
- Not easy to import existing test cases (at least as it was for our team)
- No custom report designer tool
I would like to recommend TestCollab, as this is one of the easiest Test Case Management Systems. With a user friendly interface, it brings a bouquet of features including :
- Support for agile methodologies
- Easier integration with popular bug trackers been used in the industry for development project's requirement management, automatic reporting of bugs encountered during test runs, automatic updation of reported bugs' status when test is marked as passed in TestCollab. Bi-directional integration supported for JIRA and Redmine
- Universal integration with test case automation tools
- Unlimited projects, test cases and test executions
- In-built requirements management along with coverage and traceability analysis
- Re-usability of test case steps, test cases and test suites
- Quicker adaptability with custom fields
- Easy test plan definition with a support for multiple configurations to make the test executions possible in different environments
- Collaboration with all your team members
- Dashboard and reports to keep a hawk eye over the projects as they progress
- Deployable on any popular platform - Windows, Linux or Mac
- Easy migration from other Test Case Management tools with support for XML, CSV and Excel formats for data portability
- There is a flexibility of choosing either hosted plans (SaaS), or self hosted ones according to your needs.
To further explore the features at offer, visit http://testcollab.com/tour
You can also try TestCollab for free by visiting http://testcollab.com/trial
Disclaimer: I work for Test Collab as a QA professional
-
3This sounds a lot like an advertisement for the application. If you have any affiliation with the company, you need to say so. If you're simply a satisfied user, you should say that.– Kate Paulk ♦Oct 16, 2014 at 16:49
Of the tools you mentioned I have experience about Testrail.
Pros: Straightforward approach. Quick to start to use. Stores test cases well. Cons: Less features to pick relevant test cases to re-run, no issue management. ( We wanted integrated issue management as it makes easier to see where the issues are regarding test cases and to pick test casea to be re-run )
We ended up in using Meliora Testlab and so at the moment if know this tool best. Pros: We use the tool to store the requirements / use cases. The test design from requirements is done really well. User interface Filter for picking right test cases tags! We use tags for grouping test and issues. Support: they have been helpful Cons: Basic reports show what they should, but I miss HP:s dynamic reports to report ANYTHING. The tool has version field but not the concept of releases.
Anyway, the tools offer free trials so try them out, you will find what you need!
I recommend you TestLink.
It is opensource, very easy to use and complete.
You can link it to integration server as Jenkins.
For me it is the most efficient opensource tool.
http://testlink.org/
From what i remember, you have a free plugin in Jira for test management. Unfortunately, it is not so user friendly the display is bad. It is a bit complex to use for what we expect from a test management tool.
If your need is for a big project and you have budget you can try for a HP product.
http://www8.hp.com/us/en/software-solutions/application-lifecycle-management.html
So, for full disclosure, I work for SmartBear Software and have used our product QAComplete, along with a few others (some mentioned above).
Like some have said above, it all depends on what you're doing and your budget as to what tool will work best for you.
I can speak for QAComplete and tell you that the biggest selling point for it is that its traceability feature works well and it integrates with popular bug tracking tools, source control, and test automation suites. Essentially, It is a hub for your manual and automated tests that can allow everyone working in the SDLC to access and comment.
That being said, what exactly are you looking for in a test management tool? What is most important to you?
I have evaluated testrail, spiratest earlier. My analysis is available in link http://sqlandsiva.blogspot.sg/2010/08/evaluating-test-case-management-tool.html http://sqlandsiva.blogspot.com/2014/10/testrail-tcm-tool.html
Testrail I can share my learning's if any questions. Good Reading Notes I referred / collected for evaluating test case management tools
I think it is worth to check PractiTest. You can also read more about this tool here Alternatives to HP Quality Center for small business
-
Philip, could you please edit this answer to give more information - as it stands, your answer does not add much to the existing answers.– Kate Paulk ♦Aug 31, 2016 at 11:38
-
Kate, thanks for your question. I recommend PractiTest as a test management tool due to different parameters: 1. this tool allows to control the entire testing process smoothly. 2. It has great integration solutions. 3. Customizable fields, filters and metrics. 4. 24/7 support– PhilipJan 4, 2017 at 14:16
Here is a list of free test management tool. Ignore the title, lol. It is for test management tool https://alternativeto.net/list/23274/free-and-open-source-team-collaboration-software
Just to update this topic, here is one more tool worth checking. TestCaseLab - testcaselab.com
Detailed review is here Manage Test Cases using TestCaseLab Test Case Management Tool.
TestCaseLab is a brand new great tool for manual QA engineers. It allows you to follow most of the testing activities: creating test cases, categorizing them, gathering them in test plan and starting test runs.
Nice pack of available features and integration possibilities wrapped into the ultimate design. One of the most affordable and lowest pricing plans among other competitors!
-
4This sounds a lot like an advertisement. If you have any affiliation with the company, you need to say so. If you're simply a satisfied user, you should say that.– dvnielApr 11, 2019 at 7:39
Zephyr as a plugin for JIRA is a good test case management tool.
It helps in creation and execution of test case cycles, cloning and interlinking of test cases, and their filtered viewing, besides facilitating attachment of screenshots to the ticket. Zephyr also facilitates reporting of test metrics via test summary, pie charts and graphs.
However, there is no facility in Zephyr to list all the test cases which are linked to the same issue. Also, it cannot handle historical reporting of test cases across successive versions.
This article effectively sums up the pros and cons of Zephyr for JIRA. Test Management in JIRA using Zephyr.
ZenTao
Pros:
Test case library for global cases in systems in different products or projects
Test suite case for the same functionality or the same user story
Test request for running test cases many times and get the results by test report
Test cases could be categorized by modules, submodules are supported
Bugs could be directly reported during running cases
Cases should be written based on user stories
Bugs are based on builds, builds are linked with user stories
CI/CD available by Jenkins integration
Code repository could be synced from your github/svn repository to do code review
Free, open source version, self-hosted available
Email/webhook notification
Cons:
Mobile App almost useless
-
1This sounds a lot like an advertisement. If you have any affiliation with the company, you need to say so... and I'm guessing you are, as the link you've provided is an affiliate link.– dvnielFeb 5, 2021 at 14:13