Oracle Application Testing Suite Reviews

Helps us to reduce the workload to check the system. It saves us a lot of time to do the testing.

The most valuable feature is that you can play back to do the function test.

We want to have some script that can be used in different instances. The URN can be added and then retraced, so that we can use the script. Right now we have to record the script for each instance so the workload is a bit higher. 

Room for improvement would be for the reporting features. If they could improve the dashboards, that would be helpful.

The software is mature and easy to use but there is room for improvement.

1. Java as native supported language.
2. User friendly UI / Tree view to work with adding steps.
3. The initial kick of time of a functional test automation script is lesser than other popular tools like QTP. But not as quick as selenium :). But selenium supports of automation of only web applications.
4. Stable enough for Oracle EBS Applications and other products of Oracle, there are some components which are not recognized by other test automation products but are recognized by OATS ( Oracle Application Testing Suite )

To provide test automation support for other products like SAP, Windows and Java Applications when it comes to Functional Test Automation testing. Which otherwise they have a pretty good coverage to test all Cloud or Web Based applications.

I have used for about 8 years now, had worked with this tool from the time of inception at oracle, as I had worked at ORACLE for 7.5 years and used OATS for most of the time. It was our default solution for test automation of Oracle EBS Applications.

OATS 12.5.0.2 has a pretty smooth installation process.

In budding stages, the product had serious stability issues, but ORACLE has put its best people behind and made the product quite stable. Now I feel its the best tool to automate any of the Oracle Products, which include Oracle EBS Applications, PeopleSoft, JD Edwards, Siebel, Adobe Flex, ADF applications, etc..

The technical support on Linkedin Groups and Direct support are good, would rate it as 4 out of 5

We used Winrunner earlier and later HP had stopped its support so we had to switch to another Test automation product and when an internal tool could support, there was no point in paying to external companies, while I was working with ORACLE

Simple and easy

There was huge ROI, as we stopped all Licenses that were paid to HP and used something internally at ORACLE

ORACLE is giving at a very competitive rates to all its customers, and its a simple licensing process.

Yes, we tried with QTP, but it was doing no good than internal tool for test automation of Oracle EBS Applications.

It's a really amazing solution, which I have ever used, three tools which I used most were Winrunner, QTP and OATS. I feel OATS is best, even now I am out of ORACLE I believe OATS has much more value, compared to others. and I liked it so much that I started writing my experiences over my personal blog which is http://testingtools.co

Automation with recorded scripting: This is a nice feature, which allows customized testing scenarios to be created and edited depending on the testing needs at the time.

It has allowed more thorough testing with performance-based testing, in addition to regression testing and regular testing with each software release.

It does not provide easy diagnostics to ascertain end to end transaction monitoring. It shows statistics on individual class calls and it is challenging to aggregate the data into a single end-to-end transaction based on a single individual user experience.

We have used this solution for over two years.

No issues with deployment.

No stability issues encountered.

A system integrator installed the tool and has provided the support and expertise to initially run the testing and train our staff.

The tool is expensive to purchase and use based on licensing requirements for number of users.

This is the best tool I have used till today as it allows us to handle automation in variety of ways. It has lots of features which are bundled together in a single package (e.g. OTM, OFT). We can use the same automated test script for functional testing. Lots of features are there in it. Best tool for automation on Siebel Object.

1. Need to improve in Object Identification process. 
2. Performance is slow as compared to other tools like QTP. 
3. Internet Explorer is facing difficulties in identifying siebel object so browser functionality needs to be improved etc.

In the past one year, I have worked on the upgraded version of OATS 11.2 and its has some good features with includes automation API for Peoplesoft automation, good log management and improved version of interface. Although it has few issues with Oracle Siebel Object Identification which is sorted by Oracle by providing patch. I will update you further in the coming months.

It's user friendly and in-built API support makes it very easy to automate or develop an automation framework.

Screenshot from the server machine when Script is running on server from OTM and the server logs off. That shouldn't happen.

We've had no issues with deployment.

We have stability issues with the server logging off when a script runs from OTM.

It has scaled for our needs.

OpenScript and several objects that can be used in scripting. Option to Iterate over scripts is good. It allows you to run the same script for different instances. The report that is generated is quite detailed and useful, only becomes too big (MB's) when running several scripts.

This product can facilitate the lowering of test execution times for operational people. In other words, the bulk of the (repeating) test steps can be taken away by automating the EBS regression set in OpenScript, every release. After the automated regression set has run, all standard EBS functionalities have been tested and Employees only have to validate custom pieces of the system, without having to prepare. This takes away a significant amount of man hours.

Improvement in performance and stabilizing record/playback in the EBS forms option.

I've used it for three years.

I'm not a developer, but I've heard from the technical people that there limitations programming wise, which brought some limitations.

There's no issues with the stability.

We're an organization with 3,000 employees, and active roll in testing for about 100.

I haven't needed to use technical support.

This product is one of the few products that can run with Oracle Forms (Java servlet applet), and a discount was giving for using this product in combination with licenses for the Oracle e-Business Suite.

I didn't do the install myself, but I've heard that the installation guide wasn't very clear, and some tial and error had to be done to get it working.

We did it in-house.

$80,000 profit after three years, and then $50.000 per year.

Loads of possibilities. I use mostly use the WebForm and EBS forms options. WebForms works fine, but Scripting in the EBS forms option isn't very consistent and stable. During recording and playback errors occur. Elements of forms aren't recognized which makes scripting and playback a time consuming activity.

I advise you to use an isolated server with as much privileges/rights as possible, and limited access to the outside. Restrict connections to needed test environments only. Double the hardware that is stated on the specs for minimum hardware requirements. When scripting, try not to script all, but focus on the part where the expectation is that is will not/minimally change in the coming period. Also, when scripting, try to work in modular way and try to make them re-usable.

One feature that I find valuable and very useful is the ability to use a different version of the database for the repository other than the Oracle Lite DB that it comes with by default. This means you can make your database repository fully redundant and infinitely scalable.

OATS provides the functionality to institute a corporate-wide standardized method and approach for all types of application testing. This tool is perfect for organizations that do a lot of in-house development and/or regularly perform maintenance. I would say it is a mandatory tool to have and use if your organization is planning to perform a major upgrade or begin a large implementation.

There is one piece of functionality that is currently not offered and would be very good to have: Support for Digital Certificates authentication and Single Sign-On (SSO). This method of authentication, to the best of my knowledge, is still not supported by OATS and would be a great addition to the tool.

I used OATS for over five years. While working for Oracle Consulting, I've seen the tool used successfully at numerous clients.

It is easy to deploy.

It is very stable.

It is very scalable.

Within the Oracle ecosystem, OATS has a small but very capable and technically advanced support team. To the best of my knowledge, most of these folks came to Oracle as part of the acquisition process of OATS, meaning they were supporting and/or working in product development of OATS for a long time.

I used HP LoadRunner in the past and do not really have a preference for either OATS or LoadRunner.

The initial set-up/install/deployment is very straightforward and should not present any problems for any reasonably technical person.

While working with Oracle Consulting, I implemented OATS myself personally as a hired Oracle consultant as well as together with clients' in-house teams.

One advice I would give if you are planning to do a multi-node install on Linux/Unix is as follows: Unless your organization is very familiar with the product and complex architectures that require fault tolerance have someone from Oracle Consulting come in for a short engagement, set everything up, document everything and do a knowledge transfer. This way you will be ahead of the curve from the start. From personal experience, any kind of rework is always more costly than doing it right from the start.

It's a little complicated to calculate an ROI of a product that isn't replacing another product. I would say the best way to calculate an ROI is not to focus on OATS and its associated cost, but to calculate the amount rework needed to fix issues if OATS were not to be used.

There are basically only two products that cover the space of Performance/Scalability/Functional Testing on the market. OATS from Oracle and LoadRunner from HP.

One advice for anyone planning to implement OATS: Make sure there is an existing Java skill-set in your organization as OATS' recording language is Java.

Openscript and Oracle Load Testing (OLT) as I worked on performance testing with this tool.

It helped in running performance testing cycles and identifying the bottlenecks of the application, helping our clients to run their application successfully and smoothly.

Also, I used it for automating manual flows, which helped in saving time and effort in manual testing.

Improvements can be made in a number of protocol support areas, including enhanced Citrix support.

Also, the reporting utility for load testing could be improved.

I've used it for three years.

Garbage collection of our WebLogic server was not working properly when running large volumes of performance tests.

My experiences are good. There is a forum where you can post your issues and experts and others users will answer them.

Also, a service request which will be resolved quickly would be nice. There were a few patches given by the dev team to resolve issues.

Initial setup is straightforward. It will install Oracle Database, WebLogic Server, and other components by itself. At every step you will be prompted on your screen, but no other setups steps are required.

We implemented it in-house, but only a person who has good experience should be involved in the implementation, otherwise some issues might come later.

If you are using the Oracle bundled application then it is he best tool available in the market. But in some areas it lacks features and protocol support that its competitors, such as HP LoadRunner, have.

You should have a good and experienced person working with it, and also they should take people who have prior Java programming knowledge. The tool uses Eclipse IDE and Java script.

Robustness of Oracle Application Testing Suite to manage end-to-end testing of projects, especially in Oracle ERP implementation projects.

Oracle Application Testing Suite is very good for managing testing through Oracle Test Manager (OTM), automating test cases with Oracle Functional Test (OFT) and conducting performance testing in Oracle Load Test (OLT).

Implementation of Oracle Application Testing Suite package has increased the overall efficiency. Test cases and defects are now tracked well in Oracle Test Manager which help management to have better visibility and traceability. Increasing automation coverage has been reducing manual efforts in executing test cases and in a recent test cycle automated execution, it saved seven days of manual execution effort in a two-week test cycle.

OTM Test Report – We needed to develop custom reports as there is less flexibility.

OFT Support for Non Oracle ERP/CRM Product – As of now OFT supports only Oracle ERP/CRM Products. OFT has to support other vendor’s ERP/CRM packages to increase its base.

I've used it for over five years.

In Windows 7 and in Windows 2008 R2 server deployment is very straight forward. In Windows 2012 R2 server, deployment is a little bit tricky as .NET Framework 3.5 is not a part of OS distribution. One has to separately install it. You have to take care of this before going for installation in 2012 R2 Server. For Linux/Unix deployment you have to be well aware of Unix/Linux OS environment and you need database administration knowledge/support.

No issues encountered.

No issues encountered.

It's good, 7/10.

It's good, 7/10.

We switched because of lower licensing costs and it has good support for Oracle ERP/CRM.

It wasn't complex.

We implemented it in-house. Though the initial set up is not very complex, implementation should be done by resources who have good experience in Oracle Application Testing Suite and have a testing background. Database administration knowledge or support is also required.

I don't have specifics, but the product is cheaper than similar products from HP UFT and Quality Center.

Oracle Application Testing Suite is best suited for managing testing activities in implementation and upgrade project for Oracle’s ERP/CRM products.

The best feature of this and Load Test is simplicity. They are probably not as functional as the corresponding HP products, but you can start using them immediately after installation. Script development platform is based on Eclipse IDE and was much better and stable than LoadRunner VUGen 11.5 and earlier versions.

Load Test has perfect monitoring features. It fully supports JMX (we were able to monitor WebLogic internals in a couple of clicks), modern SNMP versions, flexible custom metrics, etc. We didn’t have any problems with collecting data we wanted from Windows, Linux, Solaris machines, and that’s really great. I can’t compare it with HP SiteScope (don’t have much experience with it), but it definitely beats standalone HP LoadRunner facilities.

I also liked the web interface of the Load Test controller. It supports remote test execution and provides quite convenient API. You don’t have to use separate solution as Performance Center or LoadRunner Analysis to create test reports and provide remote access to your test artifacts.

The scripts are written in Java, so migration from C (used in our LoadRunner scripts) to Java significantly accelerated and simplified script development. We have also managed to monitor our infrastructure more precisely.

Load Test provides great facilities and templates to monitor other Oracle products and create simpler scripts to automate load test pipeline. You load the script into Load Test, run the test, and generate the report.

I’m not sure about the functional testing API, but the load testing one wasn’t rich. We had to extend it by adding lots of functions, but it can be easily done. Transaction handling was very simple and I’d say quite primitive. We were unable to pause, dynamically create them and change their state, such as transaction name and other properties.

API was convenient but too poor, but I know that Oracle has extended it. Reporting features were very simple as well, especially report templates.

We've used it for about a year. We’ve migrated our scripts and related test automation (e.g. report generation) successfully. It wasn’t perfect. We had to migrate our HP LoadRunner 11.5 scripts to Oracle Linux Test, and we had to do a lot of manual work to add features missing in it, such as writing custom functions in scripts, calculate target metrics with SQL on its database, etc. Though it was mostly stable and reliable, Test Management wasn’t. However, things may have changed in updated versions.

As far as I remember, we had lots of issues with Test Management stability, but the recent version are stable. We had several issues with Load Test monitoring, but were quickly fixed by Load Test developers.

It's excellent. We usually got help in a couple of days (hours in critical situations). The Load Test team frequently asked for feedback from our managers and included our suggestions into releases.

We tried a lot of solutions and used HP LoadRunner for six to seven years before switching. When Oracle Application Test Suite became ready for enterprise usage and met our needs, we started to use it, partially because it’s free for usage with other Oracle products.

It was really simple. The installation package can do everything for you (install WebLogic and Oracle XE) or you can customize the process. Anyway installation process is very transparent and flexible.

We did it ourselves with a little assistance from the development team. The documents are a good starting point so almost all of the questions can be addressed after reading the manual.

It was completely free for us, because we use it with other Oracle products.

It is a simple yet useful tool for performance testing. Compared with LoadRunner, it’s definitely less functional. I’d recommend you to try their free (development) version to understand what it does and does not.