No more typing reviews! Try our Samantha, our new voice AI agent.

Digital.ai Continuous Testing vs Katalon Studio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Digital.ai Continuous Testing
Ranking in Test Automation Tools
10th
Average Rating
7.6
Reviews Sentiment
4.9
Number of Reviews
7
Ranking in other categories
Mobile App Testing Tools (3rd), AI-Augmented Software-Testing Tools (3rd)
Katalon Studio
Ranking in Test Automation Tools
2nd
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
56
Ranking in other categories
Regression Testing Tools (2nd), API Testing Tools (4th)
 

Mindshare comparison

As of May 2026, in the Test Automation Tools category, the mindshare of Digital.ai Continuous Testing is 1.3%, up from 0.4% compared to the previous year. The mindshare of Katalon Studio is 4.5%, down from 9.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools Mindshare Distribution
ProductMindshare (%)
Katalon Studio4.5%
Digital.ai Continuous Testing1.3%
Other94.2%
Test Automation Tools
 

Featured Reviews

Mampi Bhattacharya - PeerSpot reviewer
Developer at a tech vendor with 10,001+ employees
Continuous testing has accelerated daily releases and now provides faster, richer debugging insights
Digital.ai Continuous Testing could be better in certain areas, and I can share my experience-based view on what can be frustrating. One issue is device availability and queue delays during peak CI hours. Sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines. Improvements are needed in smarter auto-scaling of device pools and better priority-based scheduling. Additionally, execution speed variability occurs; the same test sometimes runs fast and sometimes slow, depending on device load and network latency, making results less predictable. More stable execution environments and better performance isolation per session would help. Furthermore, debugging can still be indirect; even with logs or videos, I do not fully control the device as I would with local debugging, making it hard to pause and inspect live states or reproduce edge-case issues locally. More interactive debugging and improved local reproduction tools are necessary. Cost versus usage efficiency is another area of concern, as device cloud usage can be expensive and we sometimes have idle or inefficient tests that waste money. Improvements in usage analytics and cost optimization suggestions for smart test selection to run only impacted tests are areas where I believe Digital.ai Continuous Testing could improve.
Ramanagowda Hullur - PeerSpot reviewer
Senior Automation Engineer at Stryker
Recording limitations and remote access challenges have affected desktop application testing
Katalon Studio has proven effective in our deliverables, particularly in designing the framework where other tools typically require coding in client libraries such as Python or Java. With Katalon Studio, there is no such complexity, allowing us to organize projects modularly based on folder structures without needing to write separate code. The self-healing feature for web application automation and its built-in CI/CD ecosystem integration eliminates the need for external tools for pipeline setup. Katalon Studio excels in CI/CD integration, providing an inbuilt ecosystem without the need for external setup, and it features a postings structure along with keyword and library availability. Newcomers to the team can easily adapt to the setup or project structure, which contributes to its popularity, along with its low-code or no-code capability that allows for a comprehensive platform supporting web, mobile, API, and desktop automation. The self-healing mechanism for test cases autonomously identifies issues with locators and ensures they continue functioning, which is impressive, along with the robust object repository. Katalon Studio has significantly aided our team, especially when clients expect deliveries for CI/CD integration that requires automation test scripts to run on a daily schedule. The self-healing feature automatically identifies available locators for elements in the DOM, ensuring that test cases remain functional. Katalon Studio has positively impacted our organization by facilitating faster delivery when clients have urgent requirements. We can deliver quickly based on urgency due to the features Katalon Studio provides. This has led to significant reductions in time spent on framework configuration, designing, and training individuals who are unfamiliar with the tool, helping us save both time and costs.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Experitest is one of the only companies to offer a real device on the cloud to perform testing. They also provide quality documentations that help you navigate and maximize the solution."
"The most valuable part of Experitest is the number of real devices on which the test is run."
"Digital.ai Continuous Testing has had a pretty positive impact on the organization, especially in terms of speed and reliability."
"The most useful feature for me is Mobile Studio. It has a UI where I can click on elements, and it generates a script for me. Mobile Studio can generate code from testing steps. I'm using Python with it."
"The most valuable part of Experitest is the number of real devices on which the test is run."
"Digital.ai Continuous Testing has positively impacted my organization with massive reductions in testing time, enabling us to cut our regression cycle from two to three days down to two to three hours, transition from weekly releases to nearly daily deployments, and reduce production defects by 30 to 50% while significantly improving debugging efficiency and overall team productivity."
"I have seen a clear positive ROI after implementing Digital.ai Continuous Testing, especially in terms of time saving, faster release cycle, and improved efficiency."
"Digital.ai Continuous Testing has had a very positive impact in terms of efficiency and quality."
"The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
"The automation is very fast and you don't need to be overly proficient in coding."
"Katalon Studio is powerful and yet easy-to-use, and even in comparison to Selenium, which we were using previously, it is a little bit more simple from a user's standpoint."
"Katalon Studio has positively impacted my organization because I have noticed that I can save more than 50% of our time automating test cases."
"We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
"The most valuable feature of Katalon Studio is that everything can be managed from one platform."
"It's very user-friendly and convenient."
"The tool has a good record and playback feature for functionality, which saves time when creating automated tests."
 

Cons

"One challenge is that the initial setup and integration with CI/CD pipelines can sometimes be a bit complex, especially for teams new to automation."
"Digital.ai Continuous Testing is a strong platform, but there are a few areas where it could be improved to make the experience even better."
"Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times."
"I have been automating tests for many years on many things but not on mobile devices. The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before. I spent the first two weeks just getting it started. It would be good to have some video explanation of how to use it on your devices and get started. Their online documentation is quite good and extensive, but it would be quite good to have some end-to-end examples demonstrated."
"I would also like to see more videos and descriptions that could make installation more efficient."
"The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before."
"The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I submit a ticket to technical support, but they often have to fix it in the next version."
"Device availability and queue delays during peak CI hours are an issue; sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines."
"Extending the certification validity, especially after the trial period, would be beneficial."
"It should start working on Silverlight automation."
"It should be faster while executing, and there are some defects, like choosing the new device with the test case."
"It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code."
"Now, we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"The integration process with Jira should be enhanced and facilitated."
 

Pricing and Cost Advice

"The price is reasonable for our company, but I'm not the decision-maker."
"We make monthly payments. The cost is dependent on the number of devices we intend to support."
"It is quite fairly priced, but it really depends on your budget. It is somewhere in the mid-range of products. It is not free and it is not QGP that nearly costs a whole house. You pay for the number of users who require access to execute the tests."
"The prices are very high."
"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
"Katalon Studio is an expensive tool."
"The cost of Katalon Studio is expensive but it is less than some of the other solutions, such as Micro Focus UFT or SmartBear TestComplete. The cost is the main reason we are using Katalon Studio."
"We are using the free version. We plan on getting a paid version because there is a limitation in terms of the number of users. We want to maximize it."
"The tool is affordable."
"There is no cost for setup or licensing."
"I am using the free version."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
893,221 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
University
17%
Outsourcing Company
14%
Financial Services Firm
12%
Computer Software Company
11%
Financial Services Firm
15%
Computer Software Company
12%
Manufacturing Company
10%
Healthcare Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business4
Midsize Enterprise2
Large Enterprise2
By reviewers
Company SizeCount
Small Business21
Midsize Enterprise14
Large Enterprise25
 

Questions from the Community

What is your experience regarding pricing and costs for Digital.ai Continuous Testing?
The price is reasonable for our company, but I'm not the decision-maker.
What needs improvement with Digital.ai Continuous Testing?
Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times. One thing I noticed is that the initial setup and configuration can feel complex, especia...
What is your primary use case for Digital.ai Continuous Testing?
The main use case for Digital.ai Continuous Testing has been automating test execution as part of the CI/CD pipeline, especially for ensuring builds are stable before the release. For example, I us...
What is your experience regarding pricing and costs for Katalon Studio?
Pricing felt reasonable for the features provided, especially considering the time saved during the automation setup and execution. From a user perspective, Katalon Studio offers good value, partic...
What needs improvement with Katalon Studio?
I feel nothing needs improvement for Katalon Studio, as it is already the best in the industry, providing the best enhancement for users. Katalon Studio is already top-notch with no need to improve.
What is your primary use case for Katalon Studio?
My main use case for Katalon Studio is to work on many projects, and my tester has four years of experience in testing, which allows me to specialize in functional testing, regression, web, and mob...
 

Also Known As

Experitest Seetest, Experitest
No data available
 

Overview

 

Sample Customers

Samsung, American Express, Barclays, China Mobile, Citi, Cisco, McAfee
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about Digital.ai Continuous Testing vs. Katalon Studio and other solutions. Updated: April 2026.
893,221 professionals have used our research since 2012.