Testim Reviews

As a Quality Engineering leader, I'm responsible for testing our 20-25 applications. Manual testing is becoming increasingly challenging due to their growing scope and complexity.

We've been automating testing for 7-8 years, starting with open-source tools. However, their steep learning curve and programming requirements hindered many of my non-technical testers.

After evaluating options like Testim, we piloted it on one application. Now, over 90% of our applications leverage this platform, enabling more efficient and comprehensive testing.

Testim has a specific feature called a smart locator. Anyone experienced in test automation knows this is one of the most complex parts of developing automated scripts. The Testim feature automatically finds the locators, which helps us build stable test scripts. Stable scripts are crucial for receiving faster and more reliable feedback. I have also seen reduced maintenance due to smart locators, as it automatically finds locators for us even with minor application changes.

More advanced AI-based features and features on the API side would help us create better end-to-end test suites.

I have used it for almost five and a half years.

The solution is stable. However, in the last couple of months, I have experienced some downtime where the grid wasn't working. That said, 95% of the time, it is pretty stable.

Scripts can be scaled faster by adding data driven capability and shared steps. In-built grid helps with test execution across platforms.

One of my favorite features is the live chat on their dashboard. Anytime my team members have a question or if their script is failing, they start the chat, and an agent is always available to help. They assist with technical items and other blockers. If they are unable to help, they escalate issues to their internal technical team.

Positive

I started with open-source tooling, using some of the free tools available, however, many required strong programming knowledge.

I evaluated it along with other similar tools in the market.

Before diving into this tool, it's highly recommended to have a basic understanding of Selenium and JavaScript. The company provides excellent training courses for free, and I strongly suggest completing them beforehand to prevent any initial frustration.

One of the standout aspects of this tool, based on my experience with other platforms, is their exceptional customer support.

Overall, I'd give the product a 9 out of 10 rating.

We use Testim to automate our testing scripts. I am part of the testing team for a corporate bank in the US, which is my client. We work on building their product, and Testim is used to automate the scripts since it is a low-code automation platform.

The feature I like most about Testim is the record and playback capability, which does not require writing a lot of code. This feature is advantageous for automation without needing extensive coding knowledge.

There is currently no room for improvement that I can identify as of now.

I have been using Testim for close to two years now.

In my experience, we have not faced any breakdowns with Testim.

We can easily scale up our nodes with Testim.

Their support team is very good. During the initial days, when our company reached out to their team, they were all responsive and provided good support.

Positive

When we use other tools like Selenium, we have to know the basic scripts. Testim provides an advantage as it allows automation without extensive scripting knowledge, which makes it a great starting point.

The initial setup is very easy. Testim is cloud-based, so we don't have to install a lot of software.

Testim is a great place to start learning automation. Even if we don't have scripting knowledge, we can start automating with Testim, and from there, we can improve our skills.

I'd rate the solution nine out of ten.

Our company has Testim as a policy administrator system for insurance. My company specifically uses the tool for implementations for our customers, where we need to automate our test cases.

The tool has obviously reduced our company's testing time, and we have moved from manual to automated processes. Our company uses Testim to build a regression patch.

The tool provides a level of confidence to its customers since it runs patch regression testing, because of which the customers know that the releases my company does every month are done after the testing phase is completed while ensuring that existing systems in an environment don't break down.

The best thing our company can do with Testim is run multiple test cases, store them, and run them at any point during an implementation, which reduces our overall delivery time.

There are a few minor areas where improvements are required, but they are not something that I can discuss at a high level. I will have to ask the team that uses Testim since they can give a better response to what requires improvement in the product. I only manage the team that uses Testim. I cannot be exactly described as an end user of the tool.

There were some issues in the product's initial setup phase in regard to the area of documentation since it wasn't very easy to understand everything mentioned in it. There were some trial and error methods our company had to deal with while using the product's documentation, after which we were able to get through the setup phase. I want the documentation to have more information to help users with the setup process.

I want the product to be more scalable in the future.

I have been using Testim for a year. I use the solution as an end user in my company. I use the paid version of the solution.

It is a highly stable solution. Stability-wise, I rate the solution an eight to nine out of ten. Our company hasn't had any issues with stability.

Scalability-wise, I rate the solution a six to seven out of ten.

I think that in our company, we had a different plan previously related to the product. Our company then moved to the product's plan that allows for unlimited users to operate on the product, so it falls under the category of unlimited plan offered by the tool. My company is okay with the pricing plan offered by the tool after we moved to an unlimited user and unlimited plan. Initially, it was challenging to use the tool with the number of runs or the number of users we had.

The tool is used by 10 to 15 users in our company who are involved in teams that take care of the testing and DevOps part.

My company uses the tool once every few days.

There would be an increase in the use of the solution in my company, especially considering that we may have to deal with an increase in the number of implementations. For every new customer our company deals with, new patches are generated, and new deployments have to be done. As my company deals in cloud-based SaaS multi-tenant platforms, there are monthly releases of our company's products, a time period during which my organization needs Testim. The frequency of running Testim will increase because it will run different tenants.

The DevOps team in my company deals with the technical support of the solution. Whenever a ticket was raised with the support team, they were able to resolve our issues related to the product quickly.

I rate the technical support a nine out of ten.

Positive

I rate the product's initial setup phase a seven to eight on a scale of one to ten, where one is a difficult setup phase, and ten is an easy setup phase. The product's initial setup phase was easy.

The solution is deployed on the cloud services offered under Azure.

The solution can be deployed in a couple of days.

Only one person who works as an automation tester is required to take care of the deployment of the product.

Our organization's in-house team took care of the product's deployment phase.

The tool offers a fixed pricing model for our company.

In a partial capacity, only one person is required to take care of the maintenance of the product.

Testim is a good tool that has worked for my company. The tool makes perfect sense when it comes to its ability to manage my company's use cases and scenarios. My company is happy with Testim.

Those who plan to buy the solution should consider whether the tool suits their use cases or not. The tool's potential users should also consider the volume of test cases they plan to run and how much of those are reusable, especially for patch regression testing.

I rate the overall tool a nine out of ten.

We use the solution to test our applications and projects. We also use it for integration testing.

The product is easy to use. We can also record the sessions. When an element is not found, it shares a screenshot with us. It visually notifies us where the script broke down. The network quality is very good.

I get a little bit confused while creating new branches. When I create a new branch and run the script on another branch, I am confused about whether my script is saved in the current or previous branch. Some notifications are missing from the system side.

I have been using the solution for one year.

The product is stable. We do not face any issues.

It is easy to scale the solution. Our clients are medium-sized organizations.

The support team is good. Whenever I have any concerns, the support personnel replies quickly. The team is very responsive. I receive support when I raise a concern.

When I raise a technical query, the support team asks me to wait so that they can connect me to the technical team. It takes 30 minutes to an hour to connect with the technical team.

Positive

The product is very easy to install.

The deployment takes around 10 to 15 minutes. The process for installation and configuration is not hectic. About 10 to 15 engineers and architects are required to deploy the product. Only three to four people, including the senior software analyst and automation test engineer, are required for maintenance. They test the application and run the project.

The product is worth the money. It is very effective. It saves us costs and increases our productivity.

The solution is not expensive. I rate the pricing a two out of ten. We pay a monthly licensing fee. There are no additional costs associated with the product.

We use the latest version of the product. We have a license to use the solution. If I use a slow network, then I face some errors. When the network is really fast, then everything is good. Sometimes I have to use my phone network. Overall, I rate the product a nine out of ten.

We use it for web application testing for about 9 different products and some applications that have multiple API calls. We have successfully used the API validations to enter or set values using the API and confirmed those results in the UI and exports. We use test data within the Java Script editor and we use the Command Line Interface (CLI) and scheduler to vary the combination of users for some of our test suites. We have recently added accessibility testing to those customer-facing web applications as part of our releases.

We are able to quickly train and onboard new testers by getting them certified on Testim's certification training, which enables our Testers to understand how Testim works. That training makes it easier for them to work on and troubleshoot our existing regression suites for our web applications. This enables them to learn and start to envision tests for new features for existing applications. 

The ability to add shared steps across scripts and edit them improved our ability to create and edit scripts.

The new accessibility features allow us to set standards across products and use existing scripts for testing. 

The REST API features allowed integrated testing for select products to quickly make calls and test the UIs with API calls while the CLI allows us to matrix the grid function across browsers.  

We also use the scheduler to trigger runs when environments are expected to be available so we do not need to manually trigger regressions. Shared steps allow testers to leverage repeated steps across tests.

The accessibility reporting features could be more robust to be reported at the script level and allow users to map down to the step level.  

Some lists have values that are returned in different orders and once captured within a validation, the sort order can change. Is there a way for Testim to ignore the sort order and validate the list?  

Sharing steps across projects would be helpful for teams as some products are similar in features and configurations, so sharing steps upfront instead of recording them would benefit our teams. 

I've been using the solution for 3 years.

We have metrics reported from Testim where we have about 600 code changes within our tests out of 4,000 - that should not affect our test results.

We have been able to scale new scripts each month with no issue and have been running 200 tests monthly for over 2 years

The Testim technical support is very responsive and worked with a specific team member on the First Databank side to answer hard technical questions and took enhancement requests as needed. 

We were also included in their TDK beta program to implement beta applications before other customers if we chose to do so.

Rational Robot was used many years ago and we dropped it as the pixel compares were awful and the pricing was bad.

The initial setup was straightforward and we were able to start recording scripts on Day 1. Once we were given access to the software, we recorded a sample script and had the team working on sample scripts for demo purposes the same day in order to compare software packages.

We implemented directly with the Testim Implementation Team and they were able to answer questions and worked with us each month to keep us on track for projects.

The solution offers strong name recognition and code-free automation. 

Updates are easy and forgiving on slow UI responses. 

You can generate videos for defect reporting. 

There are Baseline/Result screenshot comparisons.

I'd advise users to take advantage of the Implementation meetings, monthly discussions, and pro licensing.

Yes, we looked at SmartBear's TestComplete.

Be advised that the Chrome browser is the primary tool for Testim, however, it is fine.

We primarily use the solution for business E2E testing, as it is fast and reliable, easy to maintain, and allows for the involvement of QA as well as Dev and BA.

Testim helps us in many areas. QA can automate tests in any given sprint as well, without giving much effort.

The automating smoke and regression tests have become easier and handier and manual efforts are saved.

The record and playback are great features. It's also easy to automate the use case.

There are common properties between multiple elements that we should be able to edit - such as 'when this step fails,'  'when to run this step,' and 'override timeout'. I should be able to update these properties if I select multiple elements. 

e.g. I added multiple validations on a single page, now i want to override the time out for all the validations. currently i have to select each element and check the 'override timeout', what is expected is I will select all the validations and change timeout for all at once.

I've been using the solution for about a year.

I have always used open-source automation tools with involves programming knowledge. it has lots of pain areas, like locator management, env setup, browser updating, et cetera.

Testim removes all these pain points. QA can concentrate on use cases and suite creation. It saves time.

We use the solution for test cases. 

The tool's most valuable feature is the recently added AI feature. 

Testim sometimes fails due to stability issues. It doesn't always work consistently, especially after running multiple tests.

I have been using the product for a year. 

I rate the product's stability a seven out of ten. 

I rate Testim's scalability a ten out of ten. 

The tool's deployment is easy. 

I rate the overall product a nine out of ten. You must thoroughly check scripts, as sometimes failures can occur due to locator issues. As for challenges, Testim has helped overcome multiple and repetitive scenarios. 

We use the product for automation testing. It helps us maintain the complex codes and scripts written in Java.

The product’s most valuable feature is simplicity, focusing on recording and playback without extensive coding. Testim introduces three services covering validation steps, eliminating the necessity to write complex code.

The product's areas of improvement include pricing considerations and additional features related to visual testing and PDF handling. At present, the ability to capture screenshots for specific screen elements is currently not included and requires integration with a third-party tool for the same. Also, it is complicated to work with PDF files in new windows. We have to download the file for validation purposes. They could provide these features in-built, reducing the need for users to register custom code.

We have been using Testim for a year.

I rate the platform’s stability a seven out of ten.

I rate the platform’s scalability a nine out of ten.

The technical support team is responsive via email, and the level of assistance depends on the pricing plan. If there are inquiries related to cybersecurity solutions, the support is more proactive and helpful. When it comes to more general support services, there are certain limitations. We have to search for solutions within community forums or groups.

Neutral

We have explored different testing tools before considering Testim. We conducted trials with various tools, including Visualpath. Despite trying several options, we found that Testim aligns with our requirements. Comparing Testim to Functionalize, it may not be significantly better, but it meets our needs adequately.

The initial setup is easy. However, only a few documents and tutorials are available explaining the steps. It takes a few weeks to complete. I rate the process a seven out of ten.

I rate the product’s pricing an eight out of ten compared to other tools.

In the CI/CD pipeline, Testim is integrated using third-party integration tools. The AI capabilities have medium complexity considering test maintenance efforts. The analytics and reporting tools are integrated with an inbuilt reporting tab. They provide metrics over specific durations, such as the last seven days or the last month. Through these reports, we gain insights into the test progress, including the number of tests passed and failed. We can integrate it with Jira. At present, we have integrated it with CI/CD pipelines for utilizing API functionality.

I rate it a seven out of ten.

We primarily use the product for testing our web app.

It enabled us to cover our app in end-to-end tests very quickly with quality results.

The pre-defined tests are a great help, specifically the custom JS test that allows us to be able to use custom code to test complicated elements or scenarios.

The UI could use a better design with a better user experience in mind, for instance - instead of going in and out of the editor every time I want to view test data for a test, I could just view the test data in the table, or the ability to copy steps through tests.

Reports are looking good but missing a lot of information and customization options. for example - ability to create custom reports for a specific test/suite/plan for a specific time range, or seeing additional information about failed tests in the report without entering the editor (see comment above).

User actions should not be limited (e.g. not being able to delete shared steps, only being able to hide them).

I have used the solution for about a year at this point.

The product is very stable. Tests are running as expected and yield the expected result (when there are no bugs).

The solution is good for the beginning, however, once your application grows in features, complexity and scale, you will need more tests, runs, and plans, which all cost more to have.

Technical support offers pretty good response times and good service.

I did not use another solution before this product.

The initial setup is very straightforward. It takes a very short time to learn how to use the product and set everything up.

I handled the entire implementation in-house (myself).

I can't speak to any specific ROI.

I'm not in charge of costs. That said, it seems like a fair price for the product. It is totally worth every penny.

I am not aware of my company looking at other options before choosing this product.

We primarily use the solution for end-to-end UI tests on a complex web platform. (in an environment based on AWS cloud).

The stability has been great. We can add stable tests very easily and improve our automation coverage. This allows us to deploy a new version into production every few days with minimum manual labor.

In addition, we added Testim to our CI flow. It allows us to test only tasks that already passed sanity tests. 

The most valuable feature is the base algorithm that allows the test to keep passing when we have small changes in the elements or in the UI (test, not break for no reason).

The API testing integration is a bit lacking and can be improved. Also, if the product will allow testing of mobile apps (native) that would be great.

I have used the solution for 5 years.