Postman vs Runscope comparison

"The solution provides visibility for PDF reports without needing to install plugins."

"Simple to use and you can easily store your projects."

"It allowed us to understand the working and performance of the APIs."

"The API testing features are valuable."

"Overall rating: Ten out of ten."

"The solution has a great user interface and collection of features."

"It is a very stable solution."

"It is a scalable solution."

"Valuable features include: Being able to add tests as sub-tests in a parent test for regression testing; notifications for tests that pass/fail; being able to customize expected results with assertions; being able to set tests to run daily."

"It has a relatively simple user experience."

"We have the ability to populate environment variables using scripts. This allows us to keep the configuration mostly dynamic and avoid a lot of manual updates when something changes."

"When it's a problem on our side, the server is down, or there is a lack of memory, the first thing to break is the API, because the calls can't be processed. So we know exactly at that moment because we receive notifications, and we can take action. It doesn't only notify us of the type problem, but it also links it to our servers."

"Environment initial variables allow our team to run tests against multiple environments on the fly."

"It is a cloud-based environment for building and executing tests, which allows me to focus on building, running, and reviewing test results."

"The feature of automatically executing tests at a predefined time interval is great as we can be continuously testing our end-points before and after builds are deployed."

"We love the fact that we can have our API tests run on a schedule as often as we need. We also take advantage of being able to set up different environment settings so that we can use the same test in our production, integration, and QA environments, easily. The ability to string together a number of API tests for a test suite is very important to us as well."

"One of the features that is missing in Postman is reporting; it's very basic."

"The performance needs to be improved."

"Integration of the solution towards Bitbucket, BitHub, and CI pipelines is difficult."

"Postman needs to improve its support for a lot of integrations."

"If there is any way to have a record and playback feature through UI, as we do in Selenium and IDEs such as Eclipse, it would be great."

"We cannot see transaction times in the product."

"I would like to see improvements in the maintenance of the scripts and their collections. It is really painful that the user cannot drag and drop. It was also painful to create the standard suite of operations for the product. I am not sure if this is improved in the tool’s latest versions. The maintenance of the complex scenarios prompted us to use the solution only for unit testing. In the future, we may switch to the k6 framework."

"Postman does not have database validation available, which affects its scalability."

"Needs the ability to create code which runs before and after API tests."

"Reliability. I would like to see more money invested in disaster recovery testing of the application. The product should be hosted across several AWS regions so if there are issues with an EC2 instance in a particular region, the whole application won't be affected. Once or twice a year there are issues with AWS that causes the reliability of the application to suffer."

"It would be nice to be able to generate API documentation."

"If you forget to set the default environment during test creation, you have to go through every test and make sure that it is set to the environment that you prefer if using shared environments. If there was an option to force all tests within a bucket into a specific environment with one click, this would save a lot of time."

"The user interface requires a lot of clicking around."

"Navigation can be a little tricky when changing run environments and switching between test run results and editing the tests. It would be nice if you could switch the environment for all tests in a Bucket to run, rather than having to change each test environment."

"the built-in editor for the scripts can be improved a lot. Instead of making such a basic editor, maybe include a little more so it is easier to look at things and debug."

"There are not many options for scalability."

"We use the open-source version. They introduced a new licensing model where your company must subscribe to their services if you're using it for business purposes. However, I think they charge too much if you're only using the basic features. It limits what your organization can do if you're not a paying customer."

"We are currently using the free version, but we have plans to buy a license."

"It is free."

"I use the tool's free version."

"We are using the free version that is available."

"Postman is a free service."

"I rate the price of Postman a four out of five."

"This is an open source solution."

"Having the different plans organized by team size, buckets, and requests per billing period works for our needs. Larger companies may need to take a close look at these elements."

"The price for the product is very reasonable for a team of more than four to five members."

"Runscope pricing is unbeatable"

"Pricing is fair."