No more typing reviews! Try our Samantha, our new voice AI agent.

IBM DevOps Test UI vs Katalon Studio comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Jun 3, 2026

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Regression Testing Tools
11th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Functional Testing Tools (23rd)
Katalon Studio
Ranking in Regression Testing Tools
3rd
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
56
Ranking in other categories
API Testing Tools (4th), Test Automation Tools (3rd)
 

Mindshare comparison

As of November 2026, in the Regression Testing Tools category, the mindshare of IBM DevOps Test UI is 3.1%, up from 2.2% compared to the previous year. The mindshare of Katalon Studio is 5.3%, down from 13.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools Mindshare Distribution
ProductMindshare (%)
Katalon Studio5.3%
IBM DevOps Test UI3.1%
Other91.6%
Regression Testing Tools
 

Featured Reviews

HZ
Lead Systems Tester at Government of Ontario, Canada
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
TM
Quality Automation Specialist at SymphonyAI
Fast UI automation has reduced regression effort and has improved tester onboarding
The best features Katalon Studio offers include how even a manual tester can use it with built-in keywords and recording features. A framework does not need to be built from scratch, unlike other tools. Katalon Studio provides an out-of-the-box automation framework, which allows quick starts, and its built-in keywords and record and playback functionality make it easier for manual testers transitioning to automation. Additionally, the object repository simplifies test creation and makes maintenance more manageable. The test suite and execution profiles also allow easy test organization for environment-specific execution, and the built-in reports provide ready-to-share insights with the team. If I had to select one standout feature, the framework setup stands out as the best feature, as it makes starting automation quickly and straightforwardly without heavy setup. Katalon Studio has positively impacted my organization by helping the team reduce manual regression effort and improve release confidence by catching UI issues earlier. It positively impacted the company by speeding up test execution and allowing faster feedback before releases, which reduces last-minute defects. The quick setup of the framework enabled the team to start automation faster, improving overall QA productivity without increasing team size. Additionally, automated regression tests maintained consistent test coverage and reduced the risk of repetitive manual reports, which overall helped Katalon Studio reduce manual regression effort, improve test consistency, and provide faster feedback to the team, enhancing release quality.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is 100% compatible with all sorts of database integrations and is compatible with all types of open source TFT-based applications, which makes it a great product to have."
"Test automation is most valuable because it saves a lot of time."
"As it is built on Ellipse/Java and costs less than other tools, it is recommended."
"The most valuable feature is the UI component tester."
"The most valuable feature is the UI component tester, which analyzes the changes in UI elements and allows me to automatically adapt and change my automation testing."
"It helps in automation by using better object recognition as compared to other tools in the market."
"By automating regression test suites using this product, we were able to show time savings of more than 1200 hours in less than ONE year."
"IBM Rational Functional Tester is very contextual."
"Video capture on failure is a must have. A picture is worth a thousand words. A video is worth a thousand pictures (literally)."
"The recording feature of this product is very valuable for our testing purposes."
"The best feature is the split up between test cases and the test object, which allows us to easily change an error."
"The most valuable feature of Katalon Studio is the ease of use of the solution."
"The most valuable feature is its automation security capabilities."
"Katalon Studio has positively impacted my organization because I have noticed that I can save more than 50% of our time automating test cases."
"The solution is easy to learn."
"When the company started to use Katalon Studio, the time in testing was very fast, it was more focused on the principal items, for example, the regression test and the integration test were more efficient and faster."
 

Cons

"With version 8.5 we faced workspace crash issues frequently."
"If in the future there is no support for mobile applications, then we will be using it less."
"The object repository used for identifying objects can be made better. It has been noticed that the RFT tool is unable to identify some objects, due to which we are unable to add them to the object repository."
"It does not fully justify being a paid tool, and it needs improvement."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"The latest version has increased load time before testing can be run."
"If you look at today's current context, I wouldn't recommend RFT because there are far more advanced solutions and products available."
"I've seen that our clients are not truly aware of the power behind Katalon."
"I can say that in my company, we struggle a lot with iOS automation."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux."
"It would be helpful to have an automatic save feature."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"Improvements are needed, particularly regarding desktop application recording and playback, which should be more flexible and not limited to relying solely on .exe files installed on the system."
"Restricted choice for scripting language (just Groovy)."
"There could be many improvements, however, I have not noted them down at this moment."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
"I am using the free version."
"The product is affordable. It has an average and competitive pricing compared to other vendors."
"This product is freeware, so there is no charge for using it."
"The pricing is good. It is the market average."
"The prices are very high."
"Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost."
"There is no cost for setup or licensing."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
920,769 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Outsourcing Company
19%
Manufacturing Company
13%
Financial Services Firm
10%
Construction Company
8%
Financial Services Firm
13%
Manufacturing Company
11%
Outsourcing Company
9%
Computer Software Company
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise3
Large Enterprise5
By reviewers
Company SizeCount
Small Business21
Midsize Enterprise14
Large Enterprise25
 

Questions from the Community

Ask a question
Earn 20 points
What is your experience regarding pricing and costs for Katalon Studio?
Pricing felt reasonable for the features provided, especially considering the time saved during the automation setup and execution. From a user perspective, Katalon Studio offers good value, partic...
What needs improvement with Katalon Studio?
I feel nothing needs improvement for Katalon Studio, as it is already the best in the industry, providing the best enhancement for users. Katalon Studio is already top-notch with no need to improve.
What is your primary use case for Katalon Studio?
My main use case for Katalon Studio is to work on many projects, and my tester has four years of experience in testing, which allows me to specialize in functional testing, regression, web, and mob...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about IBM DevOps Test UI vs. Katalon Studio and other solutions. Updated: September 2026.
920,769 professionals have used our research since 2012.