No more typing reviews! Try our Samantha, our new voice AI agent.
it_user347607 - PeerSpot reviewer
Technical Leader at a tech services company with 10,001+ employees
Real User
Nov 28, 2015
I was part of a systems architecture team and we were looking into various kinds of automation tools. We found this solution to be the most complete tool.
Pros and Cons
  • "It's a great tool that covers many features and is straightforward with logs."
  • "More APIs could be added."

What is most valuable?

It allows me to invoking an application and then to browse the application. I've done some good research with TestComplete along with Google Earth.

How has it helped my organization?

I was part of a systems architecture team and we were looking into various kinds of automation tools. We found this solution to be the most complete tool.

What needs improvement?

More APIs could be added.

For how long have I used the solution?

I used it for six months.

Buyer's Guide
SmartBear TestComplete
May 2026
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: May 2026.
900,747 professionals have used our research since 2012.

What do I think about the stability of the solution?

I didn't encounter any stability issues in my short tenure, although I remember invoking the application twice although there is was an instance already open.

How are customer service and support?

Customer Service:

I haven't had to use customer service.

Technical Support:

I haven't had to use technical support.

How was the initial setup?

Initial setup was easy, but implementation was a little tricky initially. I could not find any sample projects that I could use as a guide.

What's my experience with pricing, setup cost, and licensing?

It's open source, so it's free.

Which other solutions did I evaluate?

We looked at other solutions, but this was the most complete.

What other advice do I have?

It's a great tool that covers many features and is straightforward with logs.

Disclosure: My company does not have a business relationship with this vendor other than being a customer.
PeerSpot user
PeerSpot user
Mobile QA Tester at a comms service provider with 1,001-5,000 employees
Real User
Nov 26, 2015
It's enabled us to automate a lot of our tests for Android devices.
Pros and Cons
  • "Even with my limited programming knowledge, I was able to create automation tests using the Keyword Test feature."

    Valuable Features

    I found the Keyword Test feature very valuable. Even with my limited programming knowledge, I was able to create automation tests using the Keyword Test feature. Also, the ability to create image based tests was extremely helpful, especially when automating tests for mobile devices.

    Improvements to My Organization

    TestComplete has enabled us to automate a lot of our tests for Android devices.

    Use of Solution

    I've used it for three months.

    Customer Service and Technical Support

    I would rate it 10/10. Every time I had a question or issue I couldn’t figure out, they were right there to help.

    Initial Setup

    Set-up was pretty straightforward.

    Implementation Team

    We implemented it through an in-house team.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    Buyer's Guide
    SmartBear TestComplete
    May 2026
    Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: May 2026.
    900,747 professionals have used our research since 2012.
    it_user340986 - PeerSpot reviewer
    Senior QA Analyst at a financial services firm with 501-1,000 employees
    Vendor
    Nov 26, 2015
    It helps to organize test runs using the Test Items page of the project editor.
    Pros and Cons
    • "Data driven testing using Microsoft Excel Viewing properties of objects using Object Spy Organizing test runs using the Test Items page of the project editor"
    • "It seems to crash once every two to three months."

    Valuable Features

    • Data driven testing using Microsoft Excel
    • Viewing properties of objects using Object Spy
    • Organizing test runs using the Test Items page of the project editor

    Use of Solution

    For versions 8.X to 9.20.2460.7, I've been using TestComplete for about four and a half years.

    Stability Issues

    It seems to crash once every two to three months.

    Customer Service and Technical Support

    Customer Service:

    7/10

    Technical Support:

    7/10

    Initial Setup

    For a node-locked license, it's pretty straightforward. For floating licenses, it's a little more complex because you have to set-up the license manager and do a little bit of configuration on the computers that use the floating licenses.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user340989 - PeerSpot reviewer
    Quality Assurance Specialist at a tech vendor with 201-500 employees
    Vendor
    Nov 26, 2015
    It has saved time by eliminating the need for manual testing. It's also led to the discovery of bugs that wouldn't have been found otherwise.
    Pros and Cons
    • "With TestComplete, I can discover bugs faster and easier than testing manually."
    • "The initial deployment of TestComplete was difficult, but with the assistance of SmartBear technical support, I was able to get it up and running."

    What is most valuable?

    With TestComplete, I can discover bugs faster and easier than testing manually. It eliminates the need for regression testing sessions as TestComplete can be set up to test automatically overnight against each day's build from programmers.

    How has it helped my organization?

    It has saved time by eliminating the need for manual testing. It's also led to the discovery of bugs that wouldn't have been found otherwise.

    What needs improvement?

    I'm completely satisfied with TestComplete 10, but looking forward to seeing what's in store for version 11!

    For how long have I used the solution?

    I've used it for about two years.

    What was my experience with deployment of the solution?

    The initial deployment of TestComplete was difficult, but with the assistance of SmartBear technical support, I was able to get it up and running.

    How are customer service and technical support?

    SmartBear's technical support is excellent. However, due to time zone differences, support can be a little slow.

    Which solution did I use previously and why did I switch?

    Previously, testing was performed manually. TestComplete was a great solution to automate the process.

    How was the initial setup?

    Installing TestComplete was easy, however "floating license" configuration was challenging with the use of VMs.

    What about the implementation team?

    I implemented TestComplete independently. Their "How-To" videos, forums, and support team are incredibly valuable!

    What's my experience with pricing, setup cost, and licensing?

    If you have any questions about licensing, Smart Bear's staff is very helpful!

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user340992 - PeerSpot reviewer
    Test Automation Specialist at a tech services company with 501-1,000 employees
    Consultant
    Nov 26, 2015
    It gives us the option to work in the same suite without changing from one project to another.
    Pros and Cons
    • "Object spy and object recognition are working very well, giving us a lot of possibilities."
    • "A test case design (schema) module would be nice."

    What is most valuable?

    • Object spy and object recognition are working very well, giving us a lot of possibilities.
    • Option to work in the same suite without changing from one project to another, which is better than HP QTP/UTF.
    • USEINIT feature is really nice (+/- like importing in Java)

    How has it helped my organization?

    It didn’t really change the way my organization works.

    What needs improvement?

    A test case design (schema) module would be nice.

    For how long have I used the solution?

    I've been using it for nine months, and my customer has been using it for three years.

    What was my experience with deployment of the solution?

    No issues encountered.

    What do I think about the stability of the solution?

    No issues encountered.

    What do I think about the scalability of the solution?

    No issues encountered.

    How are customer service and technical support?

    I just contacted them once. They responded very quickly, which is good, but the problem was on our side, so I cannot really evaluate.

    Which solution did I use previously and why did I switch?

    TestComplete was already in place when I arrived, but I know that they chose it because of the debugger and the fact that TestComplete recognizes more objects than QTP/UFT.

    What about the implementation team?

    It was done in-house.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    PeerSpot user
    QA Automation Manager at a tech vendor with 51-200 employees
    Vendor
    Nov 26, 2015
    We use it to do the automation test on our product’s web UI. In total, over 500 test cases are written and the automation coverage is over 80%.
    Pros and Cons
    • "We use TestComplete to do the automation test on our product’s web UI; in total, over 500 test cases are written and the automation coverage is over 80%, which helps to reduce manual effort dramatically, and by using the same script, we can run the test on both IE and Google Chrome."
    • "Some of the objects/parent objects are dynamically created in the web page. During the test, TestComplete will have problem to identify these kind of objects."

    What is most valuable?

    The name mapping function to manage the objects across different web pages and the support for different web browsers are the most valuable features for us.

    How has it helped my organization?

    We use TestComplete to do the automation test on our product’s web UI. In total, over 500 test cases are written and the automation coverage is over 80%. This helps to reduce manual effort dramatically, and by using the same script, we can run the test on both IE and Google Chrome.

    What needs improvement?

    The scripts are saved as binary files on disk. This makes it troublesome to perform version control and merge it with the work that is done by other team members. I am not sure what the reason is that SmartBear chose to save the files as binary, but if they can change to plain text for the scripts in the future, that would be helpful.

    For how long have I used the solution?

    I've used it for one year.

    What do I think about the stability of the solution?

    Some of the objects/parent objects are dynamically created in the web page. During the test, TestComplete will have problem to identify these kind of objects. This will cause a lot of false rejection and block the following test cases. Thus it requires some rework when running all the test cases as a batch.

    How are customer service and technical support?

    I have not used any customer service/tech support yet. I cannot provide more comments on that.

    Which solution did I use previously and why did I switch?

    TestComplete is the first tool that I use for automation on UI and I have not used any other tools yet.

    How was the initial setup?

    It is pretty straightforward. Just by following the instructions given in the document and do the corresponding configuration on the web browsers that you want to test. However, we also encounter some problems such as the Chrome blocking users from proceeding because of an unsafe SSL connection, but we found a work around eventually.

    What about the implementation team?

    We implement the automation by ourselves, not through any other vendor team. My suggestion is that you need to decide how to divide the automation work into corresponding components carefully. Otherwise, it will be hard for you to share the common scripts with other team members. Also, the code architecture design is very important as well.

    What was our ROI?

    I am not responsible with the licensing quotation/renewal, but the benefit that TestComplete brings to us is, apparently, acknowledged.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user341001 - PeerSpot reviewer
    Junior ASP/.Net Developer at a construction company with 501-1,000 employees
    Vendor
    Nov 15, 2015
    Its environment exposes a significant portion of its functionality to the command line, where execution details can be left to .bat files or Windows Scripts.
    Pros and Cons
    • "The initial set-up was exceedingly simple."
    • "We did not maximize our ROI until we put somebody full-time on our TestComplete endeavours. The tool does have a learning curve, and it wasn't until we had an in-house expert on it that we began to see the benefits of automated testing over traditional QA roles."

    Valuable Features

    Object-based recording, and data-driven testing.

    Separation of data into Excel files made tests modifiable by QA personnel with limited development experience, and object-based recording kept maintenance to a minimum.

    Improvements to My Organization

    TestComplete's environment exposes a significant portion of its functionality to the command line, where execution details can be left to .bat files or Windows Scripts.

    This allowed us to schedule execution of lengthy tests for nighttime and non-core hours, and to synchronize tests with Jenkins build releases.

    This freed up QA assets to perform more specialized testing and reduced redundancy.

    Room for Improvement

    Native test result reporting does not provide overview reporting methods for tests that span multiple project suites. Features that allow for flagging a test as dependent on the result of another in multi-project hierarchies while maintaining name-mapping segregation would be much esteemed.

    Use of Solution

    I've used it for approximately eight months.

    Customer Service and Technical Support

    Customer Service:

    8/10 - SmartBear representatives are surprisingly responsive, and they go out of their way to offer assistance.

    Technical Support:

    8/10 - SmartBear representatives are surprisingly responsive, and they go out of their way to offer assistance.

    Initial Setup

    The initial set-up was exceedingly simple. There is a silent mode option available during set-up, which is very convenient when deploying to multiple machines or remotely.

    Implementation Team

    We implemented it through an in-house team.

    ROI

    We did not maximize our ROI until we put somebody full-time on our TestComplete endeavours. The tool does have a learning curve, and it wasn't until we had an in-house expert on it that we began to see the benefits of automated testing over traditional QA roles.

    Pricing, Setup Cost and Licensing

    The licensing options for TestComplete both running a licensing server. This prevents users from running more sessions simultaneously than purchased keys. This can prove problematic if you want multiple developers writing or running tests at once, and prevents you from using your key while a distributed test is running.

    For pricing, carefully consider how many machines you want running the software, rather than the number of developers.

    Other Solutions Considered

    We also evaluated another SmartBear product called SoapUI. The change to TestComplete occurred because we changed our target from web applications to desktop.

    Other Advice

    My advice in regards to implementation would be to choose carefully which tests to automate, specifically focusing on lengthy procedures, tasks that require looping, or places where you want to test against multiple data sets.

    Additionally, I found it beneficial to prefix my keyword tests with a character and number to provide logical ordering instead of alphabetic.

    I also found it beneficial to record "undo" steps with each keyword test; this allows each test to be more stand-alone and prevents your test from being dependent on the state the previous test left the application in.

    Finally, I would suggesting limiting the number of test applications per test suite to prevent bloated name-mapping schemes.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user336978 - PeerSpot reviewer
    it_user336978Multimedia Solutions Verification Engineer at a comms service provider with 1,001-5,000 employees
    Real User

    Test Complete provides detailed reports since every profit software should do, since people pay for its reporting functionality also. On the other hand, some big and expensive products stil has the reporting gaps, for example there are third party reporting tools for HP QC.

    See all 3 comments
    PeerSpot user
    Systems Engineer at a tech services company with 51-200 employees
    Consultant
    Top 20
    Nov 11, 2015
    The automation module helped us save time in regression tests, but we needed to perform adjustments on our systems to get it to fit in.
    Pros and Cons
    • "The automation has improved over time, allowing it to integrate with other external tools for defect tracking."
    • "This tool is also very expensive compared to the similar tools in the market. Price needs to be affordable."

    Valuable Features

    The automation has improved over time, allowing it to integrate with other external tools for defect tracking.

    Improvements to My Organization

    The automation module helped us save time in regression tests.

    Room for Improvement

    It works by recording and playing a script for some part of development. However, there's no way of knowing where it failed. The developers needed help to correct these errors to script them in order to work. I noticed many changes made from version to version.

    This tool is also very expensive compared to the similar tools in the market. Price needs to be affordable.

    Use of Solution

    I've used it since 2012.

    Deployment Issues

    We faced lots of code breaking, and needed to perform adjustments on our systems to get Test Complete to fit in.

    Stability Issues

    Sometimes it runs fast, and sometimes it runs slow.

    Scalability Issues

    No issues encountered.

    Customer Service and Technical Support

    Customer Service:

    They used to respond in less than 24 hours, and compared to SpiraTest, it's not that great.

    Technical Support:

    SpiraTest took a minute to respond to any technical support issues, but Test Complete takes longer.

    Initial Setup

    It's not complex.

    Implementation Team

    It was already in place when I joined the company.

    ROI

    6/10.

    Pricing, Setup Cost and Licensing

    It's priced high, and they should look into it to make it more competitive.

    Other Solutions Considered

    We also looked at Selenium IDE, and chose it because it's cheaper.

    Other Advice

    Check the price and compare to other available tools in the market and decide select the one best fits the needs.

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user69072 - PeerSpot reviewer
    QA Manager at Airpush India Pvt Ltd
    Vendor
    Nov 5, 2015
    Automation testing using TestComplete

    For more than a year, I've been working on automation of functional testing, regression testing using TestComplete. It's a paid automation tool.

    It's an little tricky to learn and use but quite similar to Selenium. You can use xpath, record and play to script test cases.

    Pros:
    - Similar to Selenium IDE, you can record and play test scripts
    - Similar to Selenium webdriver, you can create test scripts in VBScript, JScript, DelphiScript, C++Script or C#Script. (personally, I liked VBScript)
    - Test results logs helps in finding precisely the issue where test failed
    - Tests can be recorded in keyword driven or screen capture modes
    - Tests can be created for regression, functional, DDT (data driven testing), ODT(object driven testing), and so on
    - Can easily do cross-browser testing

    Cons:
    - Automated tests can not be run on Mac OSX
    - No support for mobile testing automation (though there is a package 'seetest' which can be integrated with TC)
    - It can not read xpath values for browsers other than IE, Firefox, chrome, Safari.

    Also, you can learn about TestComplete by this book(written by Genndiy Alpaev and reviewed by me):

    https://www.packtpub.com/application-development/testcomplete-cookbook 

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    it_user340998 - PeerSpot reviewer
    it_user340998Software Quality Analyst I at a tech services company with 1,001-5,000 employees
    Top 20Consultant

    In our organization we are using TestComplete for desktop based application using Visual Basic. Not using record and play back because this technique is not stable and must be used for learning purposes. We have very comprehensive set of regression testing integration with Jenkins. Yes you are right it need alot of improvement in web and mobile automation. For web based application I would personally recommend to use Selenium Webdriver using Java.

    See all 3 comments
    it_user327474 - PeerSpot reviewer
    QA Automation Engineer at a computer software company with 501-1,000 employees
    Vendor
    Oct 15, 2015
    We can test our applications manually for a full 48 hours continuously, but it lacks its own log viewer.
    Pros and Cons
    • "With TestComplete, we need just eight hours (or even less if we're using multiple machines) for stability and stress testing, whereas manual tests would take 48 hours."
    • "Sometimes, TestComplete crashes when attempting to delete over 10 logs."

    What is most valuable?

    The opportunity to work with DevExpress and WPF objects.

    How has it helped my organization?

    • Approximately, we get new build once per week. So I need to provide smoke testing for it. In case of manual tests execution, it is needed 48 hours (six working days) to smoke it. With TestComplete, we need just eight hours (or even less - if we're using multiple machines)
    • Stability and Stress testing. It is impossible to test our applications manually for 48 hours (two full days) continuously. With TestComplete, it is possible

    What needs improvement?

    • Better stability, as sometimes, TestComplete crashes when attempting to delete over 10 logs
    • Support for the latest versions of DevExpress
    • More comfortable XML editor (like in Notepad++)
    • A better script editor. I will be happy, if the TestComplete editor would contain a design like the one in Visual Studio or Eclipse - errors and unusable variables being highlighte, and refactoring opporunities
    • Own log viewer in TestExecute. For now, it is possible to open it only within a browser, which is not very good, because if the log is 2GB or more, it will take 10-20 minuts to open with Internet Explorer

    For how long have I used the solution?

    I've used it for three years, including, v7, & v9 with TestExecute v9, and it's been in use on the project since 2010.

    What was my experience with deployment of the solution?

    When we migrated from v7 to v9, we encountered a problem with using recursive code; in DelphiScript recursion was completely broken.

    What do I think about the stability of the solution?

    Sometimes, TestComplete crashes when attempting to delete over 10 logs.

    How are customer service and technical support?

    Customer Service:

    It's acceptable.

    Technical Support:

    It's acceptable.

    Which solution did I use previously and why did I switch?

    I tried Visual Studio 2010 (Coded UI Tests feature). The tool was changed, because TC is cheaper and more acceptable for those apps testing. But for now, this project doesn't use QA automation and I am working in another project

    Disclosure: My company does not have a business relationship with this vendor other than being a customer.
    PeerSpot user
    Buyer's Guide
    Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.
    Updated: May 2026
    Buyer's Guide
    Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.