Try our new research platform with insights from 80,000+ expert users

SmartBear TestComplete vs TestRail comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

SmartBear TestComplete
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
76
Ranking in other categories
Functional Testing Tools (9th), Regression Testing Tools (5th), Test Automation Tools (6th)
TestRail
Average Rating
8.0
Reviews Sentiment
7.3
Number of Reviews
22
Ranking in other categories
Test Management Tools (2nd)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. SmartBear TestComplete is designed for Test Automation Tools and holds a mindshare of 5.9%, down 7.4% compared to last year.
TestRail, on the other hand, focuses on Test Management Tools, holds 12.2% mindshare, down 13.4% since last year.
Test Automation Tools
Test Management Tools
 

Featured Reviews

Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.
StuartBarker - PeerSpot reviewer
A tool that provides effective test management and real-time reporting capabilities
I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"You can record your actions and play them back later."
"Selenium integration."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"It allows us to test both desktop and web applications."
"The integration with various tools is important."
"The database checkpoints detect problems which are difficult for a human resource to find."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"This is a user friendly solution."
"The integration with Jira and the ability for extra configurations are the most valuable features."
"The feature that I have found most valuable is the dashboard."
"I use the solution for test management."
"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
 

Cons

"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"There could be API interfaces with this tool."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The learning curve of the solution's user interface is a little high for new users."
"The pricing is the constraint."
"Headless testing would be a big improvement."
"The solution’s customer support should be improved."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"Better prediction of text."
"I've encountered at some point, some difficulties on the administration side, but I don't remember exactly what they were."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
 

Pricing and Cost Advice

"The license price for a physical machine is cheap, and for virtual machine, it is very expensive."
"Our ROI is about $10,000 a year."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
"The solution's licensing cost has increased because it has moved to some new SLM-based licenses."
"The solution's pricing is too high."
"My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."
"Its price is definitely not more. If they introduce automation, they can charge more."
"The solution is quite reasonably priced for what it offers and offers a monthly subscription model."
"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."
"My advice to others is to shop around for the best deal. Some options out there are free in cyberspace."
"The product is not much expensive."
"Pricing for small teams seems correct with respect to competitors."
"I give the price a five out of ten."
"The product has a reasonable price in terms of the features."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
845,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
20%
Manufacturing Company
13%
Financial Services Firm
12%
Government
7%
Computer Software Company
20%
Financial Services Firm
10%
Manufacturing Company
10%
Insurance Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I don't know much about the pricing, however, I think it's cheaper.
What needs improvement with SmartBear TestComplete?
The recording function, when using Python, could be improved, as it does not work well in recording testing.
 

Also Known As

No data available
TestRail by Gurock
 

Overview

 

Sample Customers

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Find out what your peers are saying about SmartBear TestComplete vs. TestRail and other solutions. Updated: April 2023.
845,406 professionals have used our research since 2012.