TestRail

Vorteile

It's very easy to use, with different kind of configurarions and customizations.

Nachteile

The tests scenarios are not versioned. There's not possibility to see previous changes or have different versions of them.

Vorteile

Easy and simple way to build a QA process, plus it's web-based, easy to admin, and has a simple UX that even our QA co-ops can follow for manual test. Has scaled well with our team.

Nachteile

Not much to not like. Works as advertised but doesn't seem to tie easily into automated testing, maybe that could be an add on in future.

Vorteile

This was very easy software to use. We used the cloud version. We were able to quickly setup Test Plans and cases with reports to watch how we were doing quality wise. The printed versions and online print versions of test cases were very useful.

Nachteile

The export wasn't as good as I hoped. It lost all the images we had stored in each of the test cases.

Vorteile

This tool helped me in keeping a track of each and every QA activity.

The best part is the Reporting feature that how much time was spent on which feature or test case

Also the extended support using API helped in integrating with the automation framework

Nachteile

The price is too high.

I am planning to buy some more licenses but the price is very high

Vorteile

TestRail allows us to manage our test cases with great Jira integration.

Nachteile

Some of the admin was a bit cumbersome when we first started such that there wasn't a good split between the person that administers the accounts and who pays for it.

Vorteile

After several years in QA and using TestLink and other tools finally I was able to convince management to use TestRail. That was a game changer - easy to use for manual testing, integration with our automation flow and integration with JIRA saved us a lot of work days.

Nachteile

Sometimes I've experienced issue with JIRA integration (we were using Microsoft Active Directory and password to JIRA was changing each month)

Vorteile

Easy to use, simple and straightforward api's to plug into with good documentation. Love this system to use with both manual and automation.

Nachteile

Running test runs are sometimes a pain but you can still manage.

Vorteile

TestRail has a nice UI. With the provided templates it is easy to quickly get test cases written. We use it most for regression test suites and it has been a valuable tool for quickly getting our web application regression tested prior to delivery. The quick reporting (via a pie chart) of tests completed/passed/failed gives feedback as to how the team is performing.

Nachteile

One of the items we wanted to use was the Jira integration. However, due to our corporate policies and firewall issues, we are not able to integrate. We use the cloud version of Jira. This is not the fault of the TestRail integration piece but was a con for our us.

Vorteile

An intuitive tool that help to create a test case in an easy and pleasant way

Nachteile

Importing Test Cases from csv could be easier

Vorteile

Jira-Integration is very good
API works fine and is well documented

Nachteile

No special support for BDD ( Behaviour Driven Development)

Vorteile

The product is constantly developing.
A lot of functionalities - API, test structure, reports, bug integrations, milestones, etc.
Ease of use.
Customizability.
Integration with other software (e.g. Jira, Cypress, etc.)

Nachteile

Minor bugs.
Quite a high price.
Rather plain design (not really intuitive)

Vorteile

1. Ability to create test plans and test case for multiple features at once. 2. Ability to configure test cases in combination for different environments and browsers, OS etc. 3. Ability to present detailed reports to stakeholder and management. 4. Integration with Jira eases the need to map to a user story. 5. The test plan hierarchy helps to create test cases easily and it helps reduce redundancy between test cases. 6. Very easy to navigate using the user interface. 6. Ability to lock a test plan where it can no further be modified.
7. Able to run test cases in multiple environment and check the run history. 8. Able to download and email reports to management.

Nachteile

Searching for a past completed story is difficult unless to navigate from Jira. Marking a test case run as passed has too many steps involved. Id love if it has ability to record screen as well as attaching screenshot to a test step/ I'd also love if I can pass/fail each step of a test case and not the test case as a whole.

Vorteile

The best thing about TestRail is their REST API. Thanks to it we were able to easily implement its integration with our test automation framework. In particular we were able to map test exucution statuses to TestRail test case statuses and allow updating them easily for test reruns. Second good thing is reports they allow to generate. That's what our managers wanted.

Nachteile

Sometimes UI is not intuitive. For instance, it took a while to figure out how to change test cases status in bulk.

Vorteile

Being able to create a set of tests and then use that document multiple times is critical. It allows me to manage tests and assign to other people. It is a great tool for managing automation tests and allowing me to monitor results

Nachteile

The UI can sometimes be difficult to navigate around. There is no easy way to get to the head of a project or a test run

Vorteile

i have using this tool for my every day test execution before this i was using our own company proprietary tool and then we switched to TestRail as we switched to agile methodology. i have found this quite useful in agile environment. it is scalabe and can be customised accordingly to suite the customer/test requirement.
it is now integrated to our companies other tools like JIRA(bug tracker tool),github,automated test suites, bitbucket etc and many others and is working flawlessly. Reports generation and tracking the various result is quite simple and have real time insights for these with this tool. We can easily link our test cases, requirements, use cases and stores using this.
Really its a great tool with so many functionalities and i love it. it increase the team collaboration in a great way

Vorteile

The user interface for Testrail is excellent. Viewing your test cases and their status is a super easy experience. Everything is laid out for you.

Nachteile

As with many testing tools we have used, the initial set up takes some time. However, after a few weeks of set up, we have more than made up for any slow periods. Our testing efficiency has skyrocketed since.

Vorteile

Versatile allows you to start projects in multiple styles of SDLC agile to waterfall

Customizations are plenty - if you can code you can extend it

Nachteile

the fact that you have to code to extend - the reporting tools out of the box are lacking

Vorteile

We use it TestRails as a host for our Manual regression suite and report our selenium tests results too using the testrails API. Works very nice.

Nachteile

Out company uses TFS and integration with TFS is not very good. The best we can do is link a failed test to a TFS dev task, and it only goes 1 way.

Vorteile

Ease of use is pretty good. Able to recreate Test Plans pretty easily.

Nachteile

Search function should have been a bit more inclusive. Not able to search in multiple projects.
Defects management is something else that Test Rail could do better.

Vorteile

TestRail helps to manage the test runs and test plan in much simpler way. Adding or changing test plan is allowed during execution is a huge plus.

Nachteile

Unable to recover deleted test cases, as once I accidentally deleted a test suite when I was trying to delete a test plan.
Also bulk option to mark test cases Pass / Failed / Blocked is not possible
Don't know if there is a option to link Jira test cases.

Vorteile

the process is very easy for writing test cases about a feature in development and assigning the same to the relevant story.
Also, a user can assign and link multiple bugs to the same story which will be mapped with JIRA.

Nachteile

Test rail is very comprehensive in nature and has various options to generate reports but the velocity chart and RTM can be improved.

Vorteile

Easy to write test cases and manage test cases.
Adding screenshots for each and every step.
Linking other test with the test cases.

Nachteile

I have used test link and switched to testrail.There is nothing much to say about it, it is a great tool to manage tests.
Filtering was bit hard for me initially when started to use the tool.

Vorteile

Once you have got used to the terminology and the way TestRail works, it's an extremely easy use and powerful tool for testing. We use it on an almost daily basis and never come across any issues.

Nachteile

Learning the terminology and the way things work together takes a little time. Also, it appears to be developer by a small team and it takes a long time for features to make it to users, even those requested by a large number of people on their website.

Vorteile

For me the biggest advantage of using TestRail was its JIRA integration. Ability to create, edit and manage testcases as well as testsuites is amazing

Nachteile

Eventhough this check almost all the right boxes, i was never a fan of the reports generation feature. This could have been implemented better with customisation features. Also, the pricing is a bot harsh for individual users.

Vorteile

Testrail is a good product for QA and PM to track the the testing progress

Nachteile

They give us percentage of testing progress, summary test report, easy to report about the testing result.

Vorteile

Although some functions should be clearly left for more experienced workers, new employees should have no problems with filling the test cases. They need a few minutes to get used to the UI, but in general it easy to learn.

Nachteile

Not being able to delete some of the elements I added (admin status was needed). Blocking this for elements added by other users would be justified, but if I make a mistake, I should be able to fix it myself.

Vorteile

easy to use, very intuitive interface, quick sharing of testcases/runs with colleagues

Nachteile

If I have to offer a point of criticism it's the navigation between some parts of the software can be finicky at times and not logic to my mind but that's entirely a personal opinion.

Vorteile

The test suites and test case structure were good and easy to navigate.

Nachteile

The small tiny bugs that appeared every day and bothered our work. Things like the inability to open a screenshot in full-screen with 1 click.. To do that I had to open it on a new browser tab which was very annoying. And plenty of other similar issues that were arising day by day. This was the reason for switching to another test management system.

Vorteile

Test rail is very easy to use from creating the test plan to creating test runs.We can easily pull test cases as per our requirements and execute them as a test run.

Nachteile

Test results uploads of videos is comparatively slow.Scree capture and voice recording features should also be there

Vorteile

the people want it.

Nachteile

Nothing works correctly, many security-issues, support is like a chatbot but isn't.

Vorteile

I enjoyed using the free trial (non enterprise) version. I think it one of the best test case management tools out there. Simple in use, intuitive, functional.

Nachteile

I didn't encounter any major issues with TestRail.

Vorteile

Effective test case managment:- TestRail provides a highly customizable test case management system. You can create test suites, parts, and cases to suit the unique needs of your project. Easy to use:-Test cases using TestRail are efficient and simple. The ability to add test results, comments, and attachments directly from the interface simplifies the testing process.

Nachteile

There should be option for comments or chat to communicate within TestRail for communication amongst team.

Vorteile

I loved it before it was sold. It was solid, easy to use, and made our work flow simple and efficient. That is no longer the case

Nachteile

Since it was bought out, it is now horrific. Test data disappears or is inaccessible. Test runs disappear. EVERY single release is extremely buggy. And knowing that, they still continue to push the release in waves to other customers instead of fixing high priority issues first. Tickets are opened and we get the canned "we're working on it" but rarely are bugs fixed correctly the first time (if at all). We have had months of work disappear with a single release. We've had things break where we were unable to access our tests for days or even weeks at a time. I went from convincing my entire company to join in to use this product, to now only having 3 of us left who will touch it. It's just sad how far it has fallen.

Vorteile

Its very good for managing test cases modules wise. And provides API also yo integrate with your automation code.

Nachteile

Cost wise its very high. Integration with jira not providing that much of features as compare to Xray.

Vorteile

TestRail offers advanced reporting and analytics features that are highly useful for testers. The tool can generate a range of reports, including progress reports, test coverage reports, and defect trend reports, among others. These reports can be used to track testing progress and identify areas for improvement, helping testers to make more informed decisions and work more efficiently.

Nachteile

TestRail's support options can be limited. While the tool does offer documentation and a community forum, users may find it difficult to get support in a timely manner, particularly for more complex issues.

Vorteile

Very well organized, I like how parametrized testing is made easy with plenty of functionality. During the period we tested it, it was stable and we had little to no issues in using it.

Nachteile

It should be more flexible in terms of securing and organizing test assets and testware in general. We also found it has a steep learning curve if you are not tech savvy.

Vorteile

I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal.
Integration with Jira is excellent, although some room for improvement.

Nachteile

Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal.
Trying to duplicate cases can be tedious, let's say you have a lot of cases, trying to copy paste them in to various projects is a lot of hassle, it is surprising they have not addressed issues like this after so many years.

Vorteile

First of all, TestRail is an extremely smarter way to track and maintain test cases than using Excel. I like how easy it is to create new projects, create custom fields, create test runs, and generate good looking reports to submit to your managers. The GUI takes a little bit to get used to, but once you get a hand of all of the key-shortcuts moving around the application is easy!

Nachteile

My least favorite part about this software is the JIRA plug in. In order to see the linked test cases from TestRail in JIRA, you need to have a TestRail account. In my company only the testing team had TestRail accounts, while the rest of R&D didn't. While it was helpful for me as a tester to see the linked test cases on a JIRA bug, when we started off with TestRail we had assumed everyone in the R&D department would be able to see this information so we could be more transparent in our testing. My company was not willing to pay for 100 TestRail accounts, so this was a bummer. If yours is then TestRail might be right for you!

Vorteile

For me the best thing about TestRail is the visual representation of the test results in the form of graphs, This gives me a quick and easy idea about the stability of the tested software, another thing that is very useful is the format of test suites and test runs.

Nachteile

I think importing testcases from excel can be made a little easier with better mapping and easy uploads.

Vorteile

-TestRail provides easy management of test-suites, test-cases, test-runs. Easy management for maintaining agile methodology in the project.
-Feature to export/import files for test-cases from xml, csv and xls files.
-The provision to define milestones can be useful for maintaining release-wise goals.
-The User can define the expected duration and priority for a test-case.
- The representation and reporting are the best part of this software, the user can see the progress of the test-run in various formats as pie-chart.

Nachteile

- Test results should be editable as required in some cases.

Vorteile

It can cover all of my needs in the entire test life cycle, it's very customizable - I've been adding a lot of my own custom fields to test case templates, for instance. It supports adding shared steps to make your tests more concise, lot of reporting options, milestones, test planning. Pretty much everything a tester needs.

Nachteile

I would like to see an option to add data parameters for my tests.

Vorteile

- This is the receipt of real-time test results (creating reports on completely different criteria: Defect Summary, Comparison for Cases, test results for projects / components, etc.)
- This is an easy organization and convenient tracking of the load of the testing department (the ability to fully customize the "working dashboard" of the QA department)

- Easy installation, deployment and support
- "Communication" with the Jira (this is very convenient for regression and autotests)
- easy to receive reports on the launch of test suites
- beautiful and understandable reports and diagrams- This is an effective management of test cases, plans and test cycles (creating / storing / editing test scenarios, managing test plans, launching test cycles, entering test results)
- User-friendly interface (clear, simple, customizable)
- Effective management of the following scenario: "technical requirements -> test cases -> overview -> test suite -> test cycle -> results"
- convenient storage of test scenarios
- This is a significant improvement in the quality of testing (a clear description of test scenarios, their reviews, correlation with requirements, division into areas - all this makes it possible to evaluate both the completeness of coverage by functional tests, and is necessary material for the entire project team)

Nachteile

As one of the drawbacks - until recently, Test Report system was poorly implemented reporting system: scant results on test-wounds, lack of customization of reports, etc.

Vorteile

Easy to set up and understand. Does not require a lot of in-depth config to hit the ground running.

Nachteile

They have not added new features and improved the product in a very long time. It's only incremental updates and fixes.

Vorteile

The ease of use for maintaining, connecting and sharing test cases are unrivaled. The platform is so feature rich every time I think of a feature I want to request they already have it!

Nachteile

Takes a good amount of time to spin up a valuable framework. I think this can be mitigated by some test case best practices or maybe a super-user demo within the platform.

Vorteile

- Intuitive UI system that allows you yo easily organize test suites, test runs, and projects.
- Sync logged bugs to the test cases you're testing for transparency.
- Reporting and the ability to estimate testing allows for you to gather more information easily.

Nachteile

- It can be quite expensive for small teams, but it's well worth it.
- Creating test cases in TestRail is pretty tedious (which is why I typically just import them).
- Reporting system is a little complicated to understand and utilize effectively.

Vorteile

TestRail's simple UI and functionality is straight forward. Easy for people to jump in and use the tool, assuming that the tool fits Dev/QA's team workflow and method of usage. For the administrator, access is easily manageable, and provides multiple categories for restricting access and defining user roles within the organization.

Nachteile

TestRail is no different than other test management systems, beside the front end and UI benefits. TestRail is good for teams who initiate test planning, test case creation, and management specific to older QA management styles. When introducing continuous integration testing into a development/QA' teams methodology, this is where TestRail needs improvement . TestRail does not do a good job logging individual test runs for historic tracking, DB backend cannot handle the data that is pushed to the system, and we often have to delete DB records to help with performance and lookup. Usually without these backend hacks, the system performs very poorly and is slow. TestRail may be good for teams that have not adopted advanced development and QA practices, but if teams want to integrate CI testing with test cases and suites within TestRail this is where we find it to fail.

Vorteile

Compared to other test case management systems TestRail is relatively easy to set up and configure and maintain. The online documentation is readily available, concise and thorough with useful links to further information. The UI is familiar enough to users of other commonly used test management systems that they don't take long to feel comfortable with TestRail, making implementation and adoption easier. The vendor support is quick and helpful.

Nachteile

It would be helpful to have more examples of how to realize the effectiveness of Milestones versus Test Runs and creating Test Case Templates. All of these are configurable within the UI however it takes a lot of trial and error to find how to make use of these features to best effect. Fields can be customized but some of the choices for required fields seems unnecessary, such as "Estimate" for test case. Adding the option to enter a "Description" or "How to Use This Field" for custom fields would be a useful addition as well.

Vorteile

Great product allowing us to keep history of our testing and specifically regression testing of our software development team

Nachteile

Find some reporting can be difficult, but in general it is a great tool for managing our regression testing test cases, and ensuring that they have all been run.

Vorteile

I'm using this tool everyday at my work, create test cases, tracking their status, and also create different reports to see the status. This tool works fast, has good user friendly design, by tracking results you can get an email notification.

Nachteile

Didn't find any drawbacks its really fast and convenient in using, also help to keep all info in one place.

Vorteile

I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility!
Another thing I like a lot are the UI Scripts, where you can customize the instance adding in or removing features and functionality. They are very powerful and super useful for us.

Nachteile

It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library.

I also do not like the way you add and remove tests from a run. It is a bit awkward and hard to see exactly what tests you're adding and removing.