What is our primary use case?
Our use cases are mainly from different domains for mobility solutions. It is also for HR and eCommerce.
How has it helped my organization?
We implemented more than 200 test cases for critically defined processes.
It helps us understand the end-to-end scenario and how it can be divided into multiple subprocesses. Those sub processes can be used whenever required. Based on that, we design automation scripts, then reuse them wherever required.
The solution has enabled us to find defects since it is a test automation tool. However, irrespective of the tool used, we are testing to find defects. Thus, it has found defects in our projects.
What is most valuable?
Certify is a codeless automation tool with scripts that are easy to maintain. Since it doesn't use any coding language, a person (who is unaware of any language) can directly deploy just by training him/her on how the tool works. So, if a person is well aware of at least basic programming knowledge, it can then be deployed by providing basic training.
For SAP, we have many use cases. Certify is helping us to automate things, which is really awesome. The time spent to automate is less when compared with other tools.
What needs improvement?
Initially, there were challenges because there is a concept called XF definitions, where each application type, e.g., the vendor and workflow, has to provide these XF definitions. Last year, these XF definitions were not provided. However, whenever we face any issues, we have to raise a support case, then they update the XF definitions in our enrollment. This year, they improved that and have the last XF definitions for SAP Fiori updated as of February 2021.
For integration, projects are usually agile. The customers are looking for integration with CI/CD tools, like Jenkins, Jira, Xray, Zephyr, etc. There is no clear documentation on how to integrate Certify with these tools. Also, we didn't receive the required support when needed. Worksoft used to have webinars on this, but those webinars used to be on after the integration was established and how the integration works, not on how to create an integration.
They should come up with a solution on how to do the integration. Jenkins, Jira, and Certify should be the same in every company. The only thing required is the pipeline code required to integrate Jenkins, Jira, and Certify if they make it available for everyone. Also, if an expert team could help customers to integrate, then that would really help our customers a lot.
As part of our weekly regression, we wanted to use Execution Manager. However, from 2017 until March 2021, Execution Manager was not working as expected in our enrollment. It could have been better. If Execution Manager had worked well, then we could have doubled our productivity. Unfortunately, it had problems.
For how long have I used the solution?
We have been using the solution since May 2017.
What do I think about the stability of the solution?
The stability of the solution depends on how good the Configuration of your environment is. We haven't faced any issues w.r.t the stability and performance. So we can say the solution works good.
What do I think about the scalability of the solution?
We have increased the number of tests that we run based on customer requirements.
How are customer service and support?
Sometimes, the support engineers will be unaware of the solution for which a support case has been raised. Their competency or knowledge on the tool could be improved. When calling them, they will see the problem but need a senior engineer who will not be available. We will then be forced to have a second meeting. Waiting for meetings and solutions can be really hard for us because we can't deliver to our customers.
But since last some moths, Customer Support has improved as they conduct bi-weekly follow-up meetings to address our pain areas and expedite the solution for the Support cases which are open.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
Compared to our previous solution, Worksoft Certify reduces our test maintenance work by 50%.
How was the initial setup?
The initial setup was straightforward.
It took us a lot of effort and nerves to get it really running. I would also expect for the major CI/CD pipeline tools that these are somehow handled and covered.
The last upgrade of Certify happened in the month of March. That upgrade's time was around 30 minutes to one hour. There were also preparations needed because of internal policies for taking care of backups, which were a bit time-consuming.
What about the implementation team?
There are separate server and database teams who have their own SLAs for deployment. It all depends on different project specifications.
What was our ROI?
We have seen ROI from using Worksoft Certify. For example, in the mobility sector, we are frequently finding issues or defects that might have come into production if not properly tested. Some of them might cost some $10,000 if we had waited to solve them after they went to production.
Automation using Worksoft Certify has saved our testing times by 40% to 50%.
What's my experience with pricing, setup cost, and licensing?
We got subscription model licenses three or four weeks ago. Now, we are setting up enrollment for other products of Worksoft. It is recommended that we should do our migration and upgrades in a test enrollment environment first, then move to a production environment.
In general, they changed their license model. Before you had to buy licenses for each component, and now they changed it so you can buy a license and use it for nearly all their applications.
Which other solutions did I evaluate?
We also evaluated Tricentis Tosca. Their pricing includes all their training. This is free of cost to everyone, even users without a Tosca license. If Worksoft came up with something similar, I think that they would get more customers.
What other advice do I have?
We haven't bought any projects or use cases to automate Salesforce.
Worksoft Process Capture is a tool that captures the user actions. Usually, the functional consultant knows the functionality that has to be automated. We then have to install the feature on his machine for him to use Process Capture. The challenge is, since they will be unaware of the tool, we first need to educate him how to use the tool. Because of this challenge, we aren't using Process Capture right now.
I would rate this solution as eight out of 10. We are very satisfied with the solution.
Which deployment model are you using for this solution?
On-premises
Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.