I can use it just as much as I need. It is quick and intuitive.
I can use it just as much as I need. It is quick and intuitive.
We are able to ensure very quickly and frequently that our product is ready for prime time. Using StormRunner, Codefresh has managed to identify performance issues and when these issues are introduced.
When you start a test, it takes times to initiate.
We have been using the solution for 7 months.
No issues with deployment.
No issues with stability.
We never encountered issues with scalability.
Excellent customer service.
Technical Support:Excellent technical support.
Very intuitive.
In-house technical people.
StormRunner does the job in a very simple and cost effective way. HP has always lead this market.
Flexibility and speed to provision and start large (high concurrency) performance testing cycles.
This software solution has allowed us to run larger, high concurrency performance testing cycles in a very repetitive manner…a requirement for validating our application solutions and supporting infrastructure for customer facing web apps.
Out of the box reporting could be improved.
We have been using the solution for 9 months.
Some issues with UI but HP did provide high levels of support and the issue(s) were quickly fixed (within 3 days of initial product usage).
No issues with stability.
No issues with scalability.
Customer service was an 8/10.
Technical Support:Technical support 9/10.
Utilized a different HP toolset (ALM/PC) for performance testing. SRL provided a better solution from a pricing and scaling perspective.
Initial setup was straightforward…cloud based solution with a simple, flexible UI.
Vendor team…expertise (10).
Looked briefly at Neotys…actively doing a POC of CloudTest for comparison purposes.
You need to effectively plan anticipated usage of the toolset. This will enable you to purchase the appropriate amount of Vusers hours for your contractual period (in our case this was 12 months).
The documentation could absolutely be improved and scripts. For example, during a performance test, the monitoring graph is not very clear as to what its representing. I wasn’t sure what the graphs represented so my guess is a lot of customers feel the same way.
One month - were doing a trial.
No issues.
No, the only thing I remember seeing as a “bug” when you hover your mouse over the graph, it will jumps around and doesn’t follow the mouse movement, other than that I don’t remember seeing anything from a stability perspective.
No, but haven’t really scaled it yet.
That's where the documentation could be really helpful, apparently I had an older version on my machine, which was creating conflict. If everything had gone as supposed to would have been simple but the documentation could have better and clearer.
Customers should understand the amount of time it takes to build a script - benefit of StormRunner as opposed to other cloud based Load testing tools is the ease of scripting. End users should understand the impact of the time it takes to build scripts. If StormRunner can save you 50% of your scripting, you need to understand how that translates into value. Expertise of StormRunner and LoadRunner includes these elements.
At the moment, its a bit early for us to tell - does everything we need it to. HP is looking to expand to see what exactly it can be used for.
We did a trial since it was launched.
No issues with deployment.
No issues with stability.
We were only running a small set of numbers, but no issues.
It's not something we've really had to worry about - we were able to crack it open and begin.
Technical Support:The help files on the web are good and the video links/ guides are good.
We use LoadRunner extensively for Performance testing.
Setup was straightforward.
In-house implementation.
I can't calculate the ROI right now but I would assume a lot considering savings on infrastructure cost and license costs. It will still take some time to run a performance test but setup saves a lot of time.
We evaluate a lot of testing tools. NeoLoad, LoadRunner, we prefer HP.
If you're looking at an application that can be seen on the WAN and using agile approach, then its a tool that should be recommended and used.
We primarily use this solution to deploy our apps to the server, for public use.
The usability and ability to integrate with other solutions is quite good. When I use it in on Azure, then Red Hat is the most likely solution I use. When I use AWS, then I tend to use Lambda functions. In either case, it works well and you can use it either way.
The features on offer do everything we need them to.
I don't know of any features that should be added. The solution isn't lacking anything at this point. We're happy with what is on offer.
I have had seven years of experience using this solution. It's been quite a while at this point.
We're a customer. We don't have any business partnerships with the company.
I'd rate the solution eight out of ten overall. The solution has been quite good and integrates well with other products. It has all of the features we need and isn't really lacking anything that we've noticed.
What are the advantages/special features this tool provides compared to Loadrunner?