Perfecto Reviews

We use it to test the mobile apps that we develop.

The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well. That increases the efficiency of our testing and saves money, time, and effort. It would take us six times longer to do what we now do.

We are also able to run tests without needing to monitor them. It delivers comprehensive testing that we otherwise wouldn't be able to achieve.

In addition, it has allowed us to maintain high app quality. By testing the app thoroughly, which Perfecto allows us to do, we get that high quality.

The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests.

Another important feature is being able to manually control a device.

When it comes to executing cross-platform testing, we only use two platforms, but it's still pretty good.

We also utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs, and that is really important as well. The lab provides us with same-day access to devices.

The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.

I have been using Perfecto for a year and three months.

It's stable most of the time but we do come across bugs and we have to reach out to support.

It's very scalable, although it's unlikely we will increase our usage of the solution.

It is used across at least 10 teams in our organization. 

We get pretty good response times and I have someone I can contact very quickly if I have a problem.

We did not have a previous solution

It took us about three months to realize the benefits, from the time of deployment.

It's a pretty fair investment.

It's definitely on the higher end of prices for this type of service.

Look at the cost of the product and check its feasibility in the context of your projects, and what you want to use it for.

The maintenance involved with the solution can be done by one person and the main duty is to ensure that the scripts are running correctly.

We are using it to test the digital application that we are building. It is an insurance application. It is a web application that we test on multiple browsers and mobile devices. It is not a mobile native app.

We are an insurance company. As we expand the feature set or offerings that we have for our customers, we have to ensure that we are catering to the gamut of users. More and more people are becoming digital savvy, and they are using multiple devices to access applications online and on the road. So, we need to test our application on all possible devices that people may use. Even though it is not a mobile application, people do use mobiles for accessing web applications.

We have been using a competing product. We encountered some challenges in that competing solution in the cross-browser area. Perfecto has certainly brought positive change. We no longer have the defects or issues we were encountering earlier. It has been great from that aspect.

We use Perfecto’s cloud-based lab to test across devices, browsers, and OSs. It is very important for us. It saves the effort and the cost of investing in all different devices, which can become obsolete very soon. Continuous maintenance is not needed, and there is a single platform to access everything. All these benefits don't just make it cost-effective but also make things administratively light. It is very useful for us.

They provide same-day access to new devices, but we didn't require that. The majority of our tests focus on the in-market version. So, we haven't used it, but that's a good capability to have.

Perfecto’s device lab has helped us to scale our testing operations. One good thing is that you just need an email address, and you can share it with anyone. It is very prompt.

We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost.

It certainly has brought more capabilities to our coordinating teams. We are able to cater to different testing asks from the business and IT teams, and we are able to meet some of the key areas that our enterprise testing strategies are requiring us to do.

It is very important for scaling our testing. Investing in all different devices and then managing them, when it is not your primary job as a company, is not easy. Using virtual devices is certainly something that we can easily do at an enterprise level.

It affects our software quality. Our solutions are now tested for compatibility and accessibility. In the Ontario region where we are operating, accessibility is mandated by the government. It has also made us compliant with the accessibility requirements.

The inventory of browser options with the latest versions is valuable. There are various iOS and Android options. They are useful to us. We are using its cross-browser capability. It is certainly helpful for us. We have CrossBrowser for Mobile. We use Edge as our enterprise browser, but we know people use Chrome, Safari, and other browsers. We test our application through those browsers.

We also like some of the plugins and integrations that Perfecto has.

Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making.

My team and I started using Perfecto a couple of months ago. It has been about three months, but different units in our organization have been using Perfecto and various other tools. 

It is on the cloud. So, it is available anytime. Its stability is very good.

It is positive. We haven't noted any challenges so far.

So far, so good. We haven't created an official service ticket yet, but the inquiry and the follow-up seem to be good. 

Positive

We used SmartBear. There were certain challenges that were noted by the users of the tool. The testers on my team and on the vendor's team noted a few challenges. The tool was showing some issues that we couldn't see on the actual mobile device or browser. There were some false red flags that the tool was throwing. Sometimes, the UI controls were not clickable. We had to invest a lot in defect analysis and resolution. So, we started looking at alternatives, and we started to evaluate Perfecto. 

In terms of the overall usage in the testing space, we have very limited use of Perfecto. We still rely on major enterprise tooling sets. As we transform our IT services, at least in the area where we have identified its use, it has brought positive change.

Perfecto hasn't helped to speed up our testing efforts. We were using a similar tool, and the testing effort has been the same as before.

I was not involved in its setup.

It has saved us the costs and efforts of having to maintain our own virtual test environment, but I don't have the metrics. We haven't done an ROI yet. At the end of the year, we might undertake that exercise.

When assessing the cost of our investment in the solution against the benefits we receive from it, we start at an equal playing field because we had another tool previously. However, the cost of investing in this tool to do testing to catch defects before going live would be six times less than the cost of finding defects and fixing them in production. We will use that as a benchmark. We will also consider the effort that it has taken for us to execute test cases specifically on devices and browsers. Those will be the basis for us to calculate the ROI.

Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced.

It came through recommendations from other teams that were using it. So, we started with a trial. We used BitBar, and we also used CrossBrowser for Mobile.

Even though we are not using a lot of integrations, we do like some of the plugins and integrations that Perfecto has. Essentially, the tool is not integrated into our entire testing life cycle. 

With BitBar, we did not see a direct Jira plugin. So, the scope of use may be limited, or we may have not explored that integration. Perfecto seems to have that integration, and based on the documentation I had from the team, it seems that it is also well integrated with the Jira life cycle, which is valuable to me as a QE Manager.

I would advise specifically identifying the use cases that you want to try with the solution. The range of offerings that Perfecto is planning to bring to the market seems good. There is a lot of innovation happening in the space of test data management and usability and accessibility testing. If you are not looking at spending a lot of licensing money on enterprise tools, Perfecto is certainly good for starting small and then scaling up at the enterprise level. 

Perfecto supports open-source technologies, such as Selenium and Appium among others, but we are not using these capabilities. Based on my theoretical understanding and assessment of other tools, the range seems really impressive. Their roadmap is also impressive. It is good to see the integrations and collaboration it has with most of our testing tools. That's really impressive. 

They are certainly a good provider of services and solutions. We do not use Perforce BlazeMeter with Perfecto, but its collaboration with BlazeMeter excites me. I'm happy about that.

We don't leverage Perfecto's reporting and analytics capability, and we also don't use it for cross-platform testing.

Based on the size of the solution offering and the way they operate, I would rate it a nine out of ten. 

We have a website as well as a mobile app, Android and iOS. We do a lot of functional, UI-related testing. And we have automated a lot of test cases through Perfecto, and we have even started to automate mobile now.

Perfecto's device lab has helped us to scale our testing and it has made testing easier for us. We've been able to run our regression testing. We have hundreds of test cases, the majority of which are mobile-related, and we use Perfecto for them.

We've also been able to get our testing done a lot faster, especially during COVID when we weren't going to the office and didn't have our physical devices. We ended up using and being dependent on Perfecto a lot.

We have access to 15 or 20 devices. Even if some of them are being used by other testers, I can utilize another one. That was not stopping my testing when I was doing manual testing. That has helped us a lot

And for automation, we run our jobs at night when these devices are not being used by manual testers. Just the fact that we can automate our tests on Perfecto and run our jobs and have test results in the morning has given us a lot of flexibility and has helped a lot.

We've been able to automate test cases that are mobile-related. That's helping a lot with our automation. Obviously, you can't automate on a physical device, it's something that we do on a virtual machine. The fact that we can automate on mobile, Android and iOS, is working well for us.

We use the CI Dashboard. Perfecto's analytics are very important because that is where we have our test results, which we later input into Jira as well.

We use the device lab in our testing operations and mobile is one of the things we use. We have multiple devices, about 20, including Android and iOS. That's what we are running our automated test cases on. The device lab is extremely important because we are doing our automatic test cases and even our manual testing there. We don't have physical devices. We go into the Perfecto website and use all the mobile devices available on the cloud.

Also, we're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us.

We are mostly using Selenium and we are slowly putting our hands on Appium as well. That's working out well for us too.

When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good. For example, if I open up a Google Pixel on my laptop, using Perfecto, just navigating on Google Pixel is quite slow. Improving on that would help us a lot.

I've been doing manual testing with Perfecto for a while, but I started automation a few months ago. That's when I really got to work with Perfecto properly.

My main area of concern when it comes to improvement of the solution is that it lags often. If that could be improved, then it would make our testing a lot faster and more efficient. Apart from that, I'm pretty happy with Perfecto. It's going in the right direction.

It's definitely scalable. For mobile testing, if Perfecto gets faster then we can utilize it in our bigger test cases. We do have some data-related test cases that really slow it down. If Perfecto can find a way to handle that, it can definitely grow with us.

The technical support gets back to us within a few days. I have not used it that much and I don't have complaints, nor have I heard complaints. My team lead is the one who uses the technical support more often, and he's quite happy with it.

Positive

It's a great tool for running functional, UI-related test cases. But I would give a heads-up about the speed that the mobile devices run at on our laptops or monitors, because it can slow us down a bit.

But in the bigger picture, it helps us because, obviously, even when doing manual testing, you're not going to be testing on your own personal devices. With a lot of people working from home, you cannot give cell phones to everyone to test on. Overall, it definitely helps.

We need to test a certain bank's application on different devices, mobile and web. We're using Perfecto to set up devices on the cloud, and that way, the whole distributed team can use it and test different devices.

The Perfecto device cloud has helped us to scale our testing operations. We can do much more testing than we did previously. Business has picked up, and the latest version of OSs needs to be tested. That would not have been possible if we had physical devices and had to give them out to the whole team. And that would involve a lot of cost. Having shared devices makes it much easier for the business.

People from all over the world can use it at the same time. It's not for a particular location. That's most valuable. Their cloud-based lab to test across devices, browsers, and OSs is the main part of it. People from offshore and onshore can access the devices. We can open everything on our system so we don't have to go looking for physical devices.

It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle.

And same-day access to new devices is quite important. When OSs are updated or something new comes onto the market, upon our request, we can have new devices installed on the cloud and have access to them. We don't have any wait time and that's great.

Overall, it has helped massively to speed up our testing efforts and not just from a device point of view. Over the last two years, the performance of the Perfecto tool has picked up as well. It's much more real-time now, compared to what it was when I started.

Also, when I started using it, we did not have the web capabilities and we used to test only on mobile. We had Android and iOS, and that was great, but around 2020, they added web functionality as well, with Windows and Mac devices on the Perfecto cloud. It's great having everything together on one platform.

We use Perfecto's reporting and analytics for automation testing. Obviously, we need to see what the results are for whatever tests we perform from an automation perspective. Reporting results to our business team plays a huge role.

One other feature is the screenshots that Perfecto has. If I'm testing something and I want to take a screenshot, it's just a click away. That makes it much easier to record all the results.

There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.

I've been using Perfecto since 2018.

Stability-wise, it's fine. There have been no unforeseen outages.

There is a huge possibility to scale it up. It depends on our project environment if we actually need to, but scalability-wise it is quite good.

We have a huge team of around 100 people who are using it, but it's distributed across teams. It's not like everyone uses it at once. We have a certain number of devices available and we are only able to use those devices.

Their technical support is very good. They immediately respond to our queries and try to resolve them in the best way possible. Obviously, there are times when they need more information from us, but when they have the full information, it's quite fast.

Positive

I wasn't involved in the deployment, but there is maintenance required from time to time. That's mostly on a ticket basis. If we need something done, we raise a ticket with Perfecto support and they help us do it. It's not like we get regular maintenance notifications. It's on-demand maintenance.

In terms of Perfecto's effect on our software quality, it's neutral. It does improve our software, but there's no direct impact from Perfecto on our quality.

My advice about Perfecto is "the earlier the better." I haven't looked into competitors of Perfecto, but from my experience, this is one of the best tools.

We have a cross-section of mobile devices and web devices, and we use those for browser compatibility and device compatibility testing, as well as functional testing of several apps and websites. So, we have testers that pull up the appropriate device, whether it's an Android or iPhone, and validate that all the functionality of the app or website is working as expected.

It is hosted by Perfecto. They take care of all the hosting.

Benefit-wise, by being able to share all the devices across 800+ users, we get a much better cross-section of testing across a wide platform of devices versus having to buy one or two phones for each tester. To be able to share a pool of devices is a huge saving. It is also a huge benefit to be able to test on a wide variety of devices. So, it saves us from having bugs go out that would only be found on, for instance, two versions back of OS or a device that's not really common but is used by our customers. If our app is having trouble running on a Google Pixel 5, we're going to find it because we have access to a wide variety of devices in our Perfecto cloud.

The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB-type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto. We also recently started using SSO for login which has streamlined our onboarding process and improved security.

Its performance should be improved. Anything to speed up the user interface would be a great help. On the admin side, it would be useful to be able to filter/sort any page with a list of items and export it to a CSV file.  

In the web testing area, we discovered when you select Windows 10 or 11, the VM is running a version of Windows server that emulates the desktop experience. We would like to have the ability to run on the actual desktop version of Windows 10 and Windows 11.

I have been using this solution for six years.

I would give it pretty high marks. It doesn't have a hundred percent uptime, but it is pretty good. I would probably rate it a four or a four and a half out of five.

Its scalability is very good. We're a fully agile organization, so most of the users are testers, but we also have developers, product owners, and maybe a handful of business analysts who use it. It is currently being used extensively by a team of 800+ users. 

I commend their tech support. Their support is very efficient, very helpful, and very personalized. They just go above and beyond. I never had any complaints about their tech support. I am definitely satisfied with their support.

Positive

The initial setup was done before my arrival at the company.  But since then I have been an administrator and have found it to be easy to manage the device pool and user base. 

There are four of us who do the admin for Perfecto. Mainly, it is a liaison with Perfecto on a routine basis. We don't do any updates to the software since it is all in their hands. We're paying for software as a service. So, our main duties are adding users, troubleshooting problems that our testers encounter, and managing which devices are going into the cradles. I and the team of three others are responsible for those admin duties. Everyone is a tester.

ROI can be measured in terms of the number of mobile devices we DON'T have to purchase since we can share our device pool across 800+ users. It also provides a solution for our offshore testers who otherwise would not be able to test on a mobile device since we cannot issue company phones to our offshore sites. Aside from that, the ROI is the broader coverage we gain by maintaining a device pool that has a mix of devices that closely matches what our customers are using, as well as a range of OS versions that allow us to test against versions N, N-1 and N-2 of IOS and Android.

The pricing is competitive when you compare apples to apples. We have seen cases where comparisons are made between the cost of public cloud vs private cloud. Private cloud is more expensive but it is required in some cases where security is of utmost importance. I advise taking advantage of Perfecto's Black Belt service. The personalized service you get is worth the extra cost.  Perfecto's support team is amazing. We normally get same-day resolution of issues we report, and in some cases, they are resolved within the hour. Consider this when looking at price and comparing against other tools.

We continually evaluate test tools for use by our QA team. In the past, we have reviewed SauceLabs, BrowserStack, Kobiton, and others. We believe we get the best value from our investment in Perfecto.

I would recommend trying it. Go through the trial period. I would imagine that anyone who does so would compare it favorably to the competition. It may not be the lowest-cost product out there, but you get a lot of value from the tech support and from the feature set that is out there.

I would rate it an eight out of ten. It is a great solid product for mobile testing and web testing. It has got great features, and we've utilized pretty much all of them.  We use it heavily for both manual/exploratory testing as well as automation testing.  

We use it for manual mobile testing and a little bit of web testing.

Perfecto makes it easier for us to do mobile testing, rather than shipping mobile devices. They always have the newest versions.

Although I can't comment on cost savings, it is useful for us because of our offshore-onshore model. We are able to utilize the devices even if we don't have a physical device available to us.

Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy.

Perfecto’s cloud-based lab to test across devices is very important because as a banking and financial project, we need to ensure that our app is working on all devices, irrespective of version.

It is slow compared to physical device testing. The interactive speed could be improved. 

And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perfectly on the physical device, in Perfecto we find issues. That is another thing we'd like to see improved. Perfecto support said not to use the instrument option so that you do not face that issue. But unless we use the instrument option we cannot do the inspection. We haven't had this issue with all versions of our apps, only with a few.

I have been using Perfecto for almost five years.

The stability of the solution is good, around eight out of 10. And the new features they're bringing out are also good. They are useful for us. 

The scalability is a seven out of 10.

Whenever we have an issue we raise a ticket and it is resolved pretty fast. The technical support is great and it's quicker now than when I first used it. The follow-up is also great.

Positive

The initial deployment is not that complex, and the solution doesn't require any maintenance.

We don't have to carry physical devices from one place to another. They are virtual, so we can always use them without any issues. It has been very helpful from that perspective for us.

Overall, it's a great solution. They just need to improve on the slowness. I would definitely recommend it.

Our main use case for Perfecto is for our testers to test their mobile or PC applications.

One of the benefits of Perfecto is that it helps us keep our devices up to date with the right OSs, because we test across different mobile OSs. The solution has been instrumental in helping us to keep our devices at the right levels for our testing.

The solution also helps us to eliminate defects. Any application defect is a bad thing. I'm the "application police." If something is wrong with it, I'm going to give you a ticket and ask you to get it fixed. As a bank, we cannot have defects in the applications and Perfecto is instrumental in that process. That's how it helps us, organization-wide. It really stinks if one of our end-users opens up a mobile app, expecting they can do something but they can't because of a problem with the application. Testing with Perfecto, we find those defects and we get the developers to get them fixed before the end-user sees them.

When we retest and they pass, we're achieving the quality results that we're looking for.

And it has saved us tremendously on the effort and the costs of maintaining our own virtual test environment. We don't have to hire so many personnel to take care of those devices. Perfecto has people employed in its lab to physically work on devices when needed. We would have had to do the same thing if we didn't use the solution. As a high-profile bank, hiring an employee includes doing extensive background checks, and those kinds of things cost the company. Using Perfecto saves time, resources, and it saves on physical intervention with the devices. Overall, it results in huge cost savings for our company. 

There are a whole bunch of things that I like about the solution, but I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. The reports are very detailed. They provide all of the information needed for the testers and developers to really look at their applications and know if there are any issues or not.

Perfecto is excellent when it comes to executing cross-platform testing. They offer support, and their support is excellent. They're very responsive. With a lot of those cross-platform applications, we have to work together so that we can set up the configurations between the two interfacing applications, but it's very good.

When it comes to reporting, we take a look at how many users are using Perfecto, and for which devices. That helps us to narrow down exactly which devices are being used the most for the applications our teams are testing. I find the reports and the analytics to be extremely helpful. I cross-reference the user reports with the users' lines of business because it's helpful for us to know which users and which lines of business are using Perfecto.

The most widely-used reports are the individual testers' reports. When they run their automation scripts, it gives them a lot of the details about the test run, such as which components passed or failed. And when something fails, it points that out with an error so that the development and testing teams can look at what that error is pointing to.

And the cloud-based device lab is extremely important to our testing operations. The mobile device testing is one of the main things we use Perfecto for, although we do have a couple of teams that use the PC platforms as well. On a scale of one to 10, the importance of the mobile testing is a nine or 10.

Our testers have other means of testing our PC applications. They can test some of those applications from their local machines. They may or may not need access to Perfecto's PC resources, but for mobile devices, we have users who are offshore, and they do not have access to physical mobile devices. Having Perfecto's cloud-based application, users in India can access the cloud and do their testing. It's extremely important for our organization to be able to provide mobile devices for offshore testing.

We mainly use Appium among the open-source technologies that Perfecto supports. A couple of our PC teams may be using Selenium, but for the most part, the mobile users are using Appium, and the integration between Perfecto and Appium is excellent. If there is any issue for our Appium users, a lot of the time it's not on the Perfecto side, it's on our side; usually configuration issues. 

I can't really say anything negative about Perfect, but if we talk about feature enhancement, there are a couple of things that I'm working on with our customer support manager. I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have.

I love the idea that the testers will be able to run either their manual or their automation scripts, and that the test report will automatically go into that team's JIRA instance. That will save some time. The testers won't have to extract the report, save it, and bring it over to their JIRA instances. Then, when the scrum master reviews the test results, if there are questions, they have all of the details from the report right there.

One other enhancement that I've already spoken with them about is that they don't support Android for ADA (Americans with Disabilities Act) testing. They mentioned that they're going to try to begin supporting that later this year.

I have been using it off and on for at least seven to 10 years.

I support our teams and help them with their test environments and mobile device configurations. It meshes perfectly with my job role and what I like to do. Perfecto is my favorite tool.

I would rate the stability of the solution as an 11 out of 10. There has not been one moment that Perfecto has not been accessible. They schedule their maintenance windows during the weekends, and on most weekends, nobody in our company is working. And even on most weekends the platform is up. 

I never receive an email from a user saying, "Hey, Perfecto is down," or that there's a problem. That is not to say it won't happen, but if it happens we will address it at the time. But since I've been using Perfecto, we haven't had any issues like that.

We have open cradles where we can add devices and shift things around as needed. The scalability is 10 out of 10. All we have to do is specify which devices we want, where we want them, and what OSs we need those devices on.

As a ballpark figure, on both of our clouds, there may be 1,100 to 1,200 users.

We're talking about getting a Perfecto ADA demo scheduled. If our teams like how ADA works for them with Perfecto, I anticipate a lot more usage of the application.

Perfecto's support goes above and beyond, with its automation support. We have biweekly meetings with some of Perfecto's support staff and they help us with automation issues. If there is some problem that Perfecto can help with, they are there. Their support is excellent. They're very friendly and great to work with.

From time to time, we may find a URL that needs to be whitelisted or allowed with Perfecto. The support team has been great as far as making sure that IPs are allowed, and that things are up on the Perfecto side for any integration.

Positive

When I started, we were using an in-house solution. Later, I was moved to Perfecto as the admin, and the more I started using Perfecto, the more I really liked it. Using Perfecto, there weren't as many issues as we saw on the other platform. Perfecto is better than our other tools, and I've been trying my best to move others off of other tools they're using and onto Perfecto.

The switch to Perfecto was an internal process. I was an admin on the other solution, and I had to do all the device upgrades to that platform. But there was a security issue with that process and those upgrades were moved to a secure location within our company. We still have the other solution, but we don't let the word out about it too much.

I was not involved in the initial setup, but I was extremely involved with the configuration to comply with our security requirements.

We're accessing Perfecto through private clouds that they host. We have two instances, enterprise and wholesale, and we configure our users here for activation and utilization in both of those clouds. We have an internal solution in which we add the users to Active Directory groups. If a user leaves the company, they're not able to access Perfecto through our clouds. That setup complies with security policies.

Perfecto is only used in our test environment. We cannot place any actual production data outside of our company so we use fictitious data. It's not data about real people or real accounts. Those devices are configured for our test environment only.

I go beyond what the normal Perfecto admin would do. Normally, the admin would just help facilitate the accounts and get users logged in. But I go a step further, because some of our users are unfamiliar with the environments and how to set things up. I help them with their test environments, on our side, for the mobile devices. That's not something Perfecto support would be able to do.

We had to involve a consultant from Perfecto because certain changes were needed on the Perfecto side, as well as on our side, to comply with our security regulations. That worked great. The consultant was great to work with, and we got everything matched up, configured, and working. He was extremely helpful and instrumental in our success in meeting our security requirements. Our security team is happy.

We have another platform that supports some limited ADA testing, but it has been having intermittent issues. Perfecto offers some ADA support and offers pretty much 100 percent uptime. That saves time because testing with the other platform has to wait until those intermittent issues are resolved. Because Perfecto is up, the testing can go on. The other platform can become unavailable for three or four days and that could be brought down to zero if we can use Perfecto for ADA.

There is another team within our company that went off on their own and got an application called BrowserStack. However, my manager and our team are trying our best to get that team to stop using BrowserStack and over to Perfecto. That would also result in cost savings for our company by saving the cost of that platform. From my comparison of BrowserStack and Perfecto, I like Perfecto a lot better because of the UI, reports, and everything else.

I've seen a lot of new functionality added over the years, a lot of performance and speed enhancements, and I think the product is very good. It's one of the top solutions for device simulation and for users to perform testing. I'm very happy with it and I really like the product a whole lot. It's a very good application.

Perfecto is doing everything that I need it to do, and I enjoy using it. Sure, we have a few open issues, but we're seeing timely updates.

We use it to automate regression test cases for the mobile app of our application. We use Android and iOS for execution, in both English and French. We also use the solution to execute tests in different browsers.

It has really helped us speed up our testing process. We are able to execute tests overnight and see the results quickly.

Our devices are in the Perfecto cloud and that's extremely important because we have monthly releases and a lot of OS upgrades in our mobile application. We always have to validate our app for both forward and backward compatibility, as well as in the browser, to make sure that all the features of the application are working. Perfecto facilitates delivering the product on time, through the cloud devices, so that there is no impact to our end-users. That's extremely important for us.

The Perfecto lab also provides same-day access to new devices, which is another very important aspect. If we want to do some tests to make sure the features work in the latest Android 11 version, we don't have to contact the Perfecto team and ask them to provide us with access to that particular device. We can get that access and execute tests against the devices.

The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream. 

It's also very user-friendly. I can see and locate any issues that come in and it's easy to see which test case has failed. Under the Perfecto job name, if you click on it, it will show how many passed, how many failed and due to what issues, such as "element not found" or "object not found" or a Java error.

It also has video recording with the screenshots which is really good.

Another very good feature is the cross-platform testing. We are able to execute in multiple browsers and multiple Chrome, Safari, and Microsoft Edge versions. We have the capability in Perfecto to develop scripts. We just need to capture the capabilities of the different browsers and update them in our Quantum framework and we are able to execute. It's very easy. 

There is an option in Perfecto to capture the capabilities using the tool itself. If we want to run it in, let's say, a particular Android device, we can capture it from there and put it into the code and we can update the information and execute.

The range of open-source technologies that Perfecto supports is really good. I don't see any issue in using Perfecto for that.

In terms of its reporting and analytics, whenever I'm doing any execution for a new release, I just put in my release number and it's easy for me to look for what happened in the test case execution I ran for the previous month's release. I can easily locate it and I can get the information.

In addition, I can schedule the devices I need in Perfecto and I can block those devices so that other users on the team do not try accessing them.

The reporting can be improved due to the scrolling you need to do. We have an option for filtering and generating reports, but we are limited to three months of history. After that, we are no longer able to see the information. If they would maintain the history for a minimum of two years, that would be helpful.

Another issue is that sometimes, when we have to locate a button through physically accessing a mobile app, versus through Perfecto, we feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required.

I have been using Perfecto since 2019.

I would rate the scalability as an eight out of 10.

I work closely with my Perfecto vendor and he is very supportive. Every time there is a new update he will share it with us and get our feedback to help enhance the tool.  They help update the core into the Quantum framework. We have had some key, latest, knowledge-sharing sessions with their team regarding these new updates.

We also have the Perfecto support portal, where we'll raise incident tickets. If, for example, a device is not working, it's not connecting, or a tool is not supporting what we're doing, we will raise a defect ticket. We can indicate the severity and wait for updates from the Perfecto customer solution team.

In terms of objects, we had some challenges initially and we told our point of contact about them. They updated the solution as a result. Also, sometimes we were not able to access iOS devices. Every time we wanted to go to iOS devices, we had to trust the app, otherwise the lab would not be launched. And we had some challenges accessing the iOS app from the Quantum framework. We worked with the Perfecto team and we got solutions to those issues.

That process is ongoing. We ask them about whatever ideas we have for them to improve. One of the ideas I asked about is because there are a lot of things we need to export into ALM Test Lab. It would be great if Perforce could create a plugin that could be added to the Perfecto portal so that we could just provide the ALM URL domain name and password to connect it to Perfecto. Right now, we need to write code to integrate it with ALM and export the results once the execution is done. An integration with Jira would also help.

Positive

I have not used any other tool for a long time.

I wasn't involved in the initial setup but there is some ongoing script maintenance involved.

It's user-friendly, adaptable, extendable, and scalable. We are able to understand everything through the UI. They just need to enhance it further to adopt the kinds of changes we would like to see.

We are application developers and we use Perfecto to ensure that our applications are working on a variety of devices. We have a need to support a broad range of mobile devices, which Perfecto is able to assist with.

One of the good things about Perfecto is the scalability that it provides. We are able to quickly scale up the devices. We can choose Android devices, web-based applications, or whatever we need, and we can scale up quickly and easily.

We bought this solution because it is supposed to be proficient at both web and mobile testing. It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution. Specifically, if it is a native app then it does really well. But, with a hybrid, or it is a native mobile web app, it seems to be lagging.

We have been working with Perfecto for approximately two years.

I have not experienced any stability-related issues.

The scalability is very good. We have four to five people using it at the moment, and we have five or six concurrent licenses. At peak, we have five people using it.

There are three or four teams of approximately eight people each who use it, and the time is shared based on their needs. We may expand this in the future but for now, we art set.

I have not interacted directly with their technical support. We have a team that deals with them.

We also use UFT Mobile.

The initial setup seemed to be straightforward.

We used a vendor partner and they completed most of the setup.

The team looked like they have been doing it as part of their service and they were able to complete it pretty quickly.

I would rate this solution a seven out of ten.

We write applications for mobile devices and we use Perfecto Mobile to test them. We set up automated tests, although we perform manual tests in some cases.

The most valuable feature is automated testing.

We have had challenges while using this product.

The main problem has to do with OTP. OTP comes on the SIM but there is no SIM card in the cloud, so it makes it a big challenge for us. It is available in development but because we don't have the OTP API exposed, we don't have it in production.

We have had some issues with performance, which is something that should be improved.

The price of Perfecto Mobile should be lowered.

I have been using Perfecto Mobile for more than a year.

We experience some device hangs, as well as other performance-related issues.

It is not auto-scalable. We have dedicated devices that we use for testing our applications. There is an option for scalability but we aren't using it.

We have had contact with technical support and they are good. We have no issues with them.

The initial setup is not easy because the networking team is in the bank and the network is secure. It took a lot of time to get approval, receive access, and then set it up properly. 

We had to engage the Perfecto team to assist with deployment.

This is an expensive solution compared to others, by 30% to 40%.

This is a product that I would recommend. However, we have complaints about both cost and performance.

I would rate this solution a six out of ten.