We have used the solution for malware testing and APM.
A stable solution used for malware testing and APM that needs to improve its performance
What is our primary use case?
What is most valuable?
Actually, it gives the whole log, especially the output reports. The best part is the video part. It gives us the whole video of our execution. It has some in-built functions where we could keep our external files, and then we can give all those references of external files in our code. So, basically, we are not required to keep all those folders related to those files in the root folder.
What needs improvement?
It is slow. It is super slow. Performance is an area that can be improved. Whenever we upload our Zip files to that particular platform, you know, it takes quite some time, especially if the file is heavy. So on average, I have seen that it takes around ten minutes to upload our executable files.
There are some other advantages of AWS compared to some of the other services. I should have used it, but I could not use it since there was no need for them in my current project.
For how long have I used the solution?
What do I think about the stability of the solution?
I rate the stability an eight out of ten.
What do I think about the scalability of the solution?
Scalability is good, but the only thing is that they have some timing, you know, time limits they have, so if you are going to use it for three or four hours, you have to distribute your project into four parts since the time limit is an hour and a half. I rate the scalability a seven out of ten. Seven automaton test engineers were using the solution in my company.
It is meant for large and medium organizations, not for the smaller ones.
How are customer service and support?
Support comes under some sort of premium service. So, if we do not have premium service, there will be no technical support. Whenever I had to connect, I connected with the support team. They were helpful and very good.
I rate the support a nine out of ten.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
I have been working on Perfecto and SeeTest for the last three or four months. Before that, I was working with AWS Device Farm.
How was the initial setup?
The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems.
I rate the setup process a seven out of ten, with ten being the easiest setup.
Since I had to study the solution, it took me a week to properly deploy it.
I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.
What's my experience with pricing, setup cost, and licensing?
Which other solutions did I evaluate?
After our evaluation, we were planning to go for SeeTest, but there were some problems with its stability. So we used that for around one month and went to Perfecto. SeeTest was breaking a lot. There were some pop-ups or something which was not coming in SeeTest. Speed-wise, it was better than AWS Device Farm. Perfecto, I feel like it is better than AWS Device and SeeTest.
What other advice do I have?
I would recommend others to use the solution.
It is a good solution because, you know, it is a distributed system. So we can give access to all of our team members, and they can go there and check for the reports. I am just a little, you know, concerned about whether we can do all those things in Jenkins. So I would say that if something can be done on Jenkins, we should not opt for a cloud solution since Jenkins is free, and you can do everything for free.
I rate the overall solution a seven out of ten.
