Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Visual Studio Test Professional comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
6.7
Apache JMeter offers scalable, cost-effective performance testing, integrating well with CICD and outperforming HP Performance Center in returns.
Sentiment score
7.3
Visual Studio Test Professional boosts productivity and ROI, enhancing development speed and quality, while varying ROI across companies.
With Apache JMeter, I have gained great statistics for performance and server metrics.
 

Customer Service

Sentiment score
6.2
Apache JMeter relies on community support, praised for efficiency but lacking the dedicated assistance of commercial tools.
Sentiment score
7.1
Visual Studio Test Professional's support is well-rated for responsiveness, knowledgeable staff, and helpful resources, despite navigation challenges.
Apache JMeter has strong support through its vast Java-based community on platforms like Stack Overflow.
The support for Apache JMeter is excellent.
Apache JMeter relies more on community support.
Sometimes, the documentation is not readable, being too long or too detailed and not connected to my problem.
 

Scalability Issues

Sentiment score
6.6
Apache JMeter is scalable for large loads, but requires careful configuration and infrastructure, especially for enterprise-level setups.
Sentiment score
7.5
Visual Studio Test Professional is highly scalable, effectively supporting various team sizes and projects despite cost and infrastructure considerations.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
For backend automation and performance testing with web services, web APIs, and queue management systems, I would rate Apache JMeter's scalability as between eight and nine.
 

Stability Issues

Sentiment score
7.2
Apache JMeter is stable but may face memory issues under high loads; effective in non-GUI mode with proper management.
Sentiment score
7.9
Visual Studio Test Professional is generally stable, with updates enhancing reliability, though occasional performance issues are reported.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
 

Room For Improvement

Apache JMeter needs UI, reporting, and automation improvements to handle complex scenarios, large loads, and enhance overall usability.
Visual Studio Test Professional needs improved performance, integration, usability, compatibility, and support for automation and web application testing.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
With BlazeMeter, you can view the results in real-time.
Enabling the conversion of scripts from commercial tools like LoadRunner or NeoLoad into JMeter scripts would also be advantageous.
Sometimes, the library version is not compatible with other libraries, causing errors in my application.
The product needs contextual help integrated within its interface.
The Git extensions are very basic and can be more extensive compared to other software focused on Git, like GitTower or SmartGit.
 

Setup Cost

Enterprise users prefer Apache JMeter for its cost-effectiveness and flexibility in performance testing without licensing fees.
Visual Studio Test Professional is costly but offers competitive value, priced at $52 monthly per user, with multi-user discounts.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
The price is expensive.
 

Valuable Features

Apache JMeter is praised for its user-friendliness, cost-effectiveness, plugin support, and integration capabilities in performance testing.
Visual Studio Test Professional excels in code testing, user interface, integration, debugging, and scalability for efficient software development.
Apache JMeter helps my testing analysis by providing precise reports; the HTML format report gives me the exact transactions, response times, and graphs that show average response times, as well as throughput per second.
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
It supports cross-platform functionality.
Visual Studio Test Professional is highly valuable because it provides extensive extensions and plugins that assist in measuring code quality.
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
94
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (1st)
Visual Studio Test Professi...
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
52
Ranking in other categories
Functional Testing Tools (8th), Test Management Tools (5th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 20.0%, down 25.6% compared to last year.
Visual Studio Test Professional, on the other hand, focuses on Functional Testing Tools, holds 0.8% mindshare, up 0.7% since last year.
Performance Testing Tools
Functional Testing Tools
 

Featured Reviews

Shashidhara Allalappa - PeerSpot reviewer
Extensive Protocol Support and Precise Reporting Elevate Testing, Though GUI Usability Needs Improvement
The GUI of Apache JMeter is not that user-friendly because we have many proxies, and we have to record through the proxy. With the limited SSL we have, we cannot use it for UI, which is a drawback. However, Apache JMeter is really good for REST APIs. I don't think there are any other areas other than the GUI that I would want improved about Apache JMeter; it is generally good and supports multiple protocols.
CharlesChang - PeerSpot reviewer
Valuable performance and libraries but needs compatibility improvements
We use Visual Studio Test Professional to develop our internal applications for our company The performance of Visual Studio Test Professional is valuable. Additionally, there are many libraries that I can use, and it supports cross-platform functionality. Visual Studio Test Professional is…
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
860,592 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
20%
Computer Software Company
15%
Manufacturing Company
7%
Government
6%
Financial Services Firm
20%
Computer Software Company
14%
Manufacturing Company
11%
Real Estate/Law Firm
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
What do you like most about Visual Studio Test Professional?
The most valuable features of the solution are its ease of use and availability.
What is your experience regarding pricing and costs for Visual Studio Test Professional?
The tool is free, resulting in no costs associated with its use. The absence of price makes it cost-effective.
What needs improvement with Visual Studio Test Professional?
The product needs contextual help integrated within its interface. Currently, I need to search online to find out how to use certain functions. This feature would save time by providing direct assi...
 

Also Known As

JMeter
No data available
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Transport for Greater Manchester, Ordina, Bluegarden A/S, CLEAResult, Jet.com, OSIsoft, Australian Taxation Office, BookedOut, Tracasa
Find out what your peers are saying about Apache, Perforce, Tricentis and others in Performance Testing Tools. Updated: May 2025.
860,592 professionals have used our research since 2012.