7

We are thinking of implementing a test management tool for our test cases which are currently in Excel sheets. So far we have zeroed in on these three tools. Some of the features we are looking for are:

  • integration with JIRA
  • ability to import existing test cases from Excel sheets
  • cost effective
  • ability to integrate automated tests
  • quality of the JIRA plugin
  • in case of Zephyr and Testrail, is it advisable to use the JIRA plugin only without using their enterprise service?

It would be good if someone could provide a Matrix Comparison for these tools based on these features.

2

We are using the Jira addin with locally running TestRail without any issues. What I like about Test Rail is the ease of use. We went from install to all QA team using it in a few weeks. Also Gurock respond very quickly to development requests.

Mark Smith

1

We use TestRail.

  • Integration with JIRA. We just started using this, I've linked many tickets to my test cases. I haven't had bugs linked yet, but it seems like it will be useful for 'more information' and not a goto.
  • ability to import existing test cases from Excel sheets. There is an import function. Somehow I don't see this being easy depending on how your sheets are setup.
  • cost effective. We compared with Zephyr and didn't see an advantage cost wise with either. We have about 12 people on QA and about ~120 total at the company.
  • ability to integrate automated tests. We have one project running an automation suite that updates TestRail. So far it's pretty nice. As long as your tests are up to date, you can get a nice little report.
  • quality of the JIRA plugin. Nothing awesome, but I didn't feel like Zephyr was incredible either.
  • in case of Zephyr and Testrail, is it advisable to use the JIRA plugin only without using their enterprise service? As far as TestRail goes, I would use their cloud service. However I don't have experience setting it up locally etc.
  • Thanks. Can TestRail Jira plugin be used without using their cloud service? – WebDriver Mar 15 '16 at 2:34
  • I assume it can. But I don't know, we didn't use the JIRA integration when we had the local testrail. – Matthew Wolfe Mar 15 '16 at 13:09
1

Dennis from TestRail here. I thought it might be useful to know why we have many teams regularly migrating from basic JIRA add-ons to TestRail and there are various reasons teams migrate to or choose TestRail.

TestRail offers the best of both worlds: a fully featured test management application that provides all the features needed for teams to be effective and productive. And at the same time we have a rich JIRA add-on integration to view linked results, test cases and reports inside JIRA. TestRail is the only application offering this kind of combination, and because of this we have a lot of teams switching to TestRail every week.

We also have many teams migrating from the various available basic JIRA add-ons, as they usually don't support even very basic features required for teams to be productive that you can find in a full test management tool (e.g. very basic things like grouping tests in sections, maintaining test orders, reusing tests easily, running tests against different platforms such as browsers/OS/platform configurations, rich automation APIs, forecast reports etc). E.g. TestRail's FastTrack interface alone helps teams save a lot of time every week:

You can learn more about other features why teams switch here, so you can use this for a comparison matrix you mentioned, as well as our rich JIRA integration that supports full coverage between requirements/use cases in JIRA, test cases and test results in TestRail, as well as defects/issues in JIRA:

TestRail is also in the very unique position that we fully support both JIRA Server and JIRA Cloud, and TestRail was even featured for this on the Atlassian/JIRA blog:

I hope this helps!

  • 1
    The only problem with this solution is TestRail requires a log in to TestRail to view the reports, dashboards, and linked tests cases within Jira. This is a challenge if non-QA folks want to see these things and you can't spring for additional licenses (at $25/pop which isn't cheap for smaller companies). – Emmanuel F. Mar 26 '18 at 17:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.