No more typing reviews! Try our Samantha, our new voice AI agent.

Azure OpenAI vs IBM Watson Machine Learning comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 4, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Azure OpenAI
Ranking in AI Development Platforms
2nd
Average Rating
7.8
Reviews Sentiment
6.4
Number of Reviews
36
Ranking in other categories
No ranking in other categories
IBM Watson Machine Learning
Ranking in AI Development Platforms
16th
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
7
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of September 2026, in the AI Development Platforms category, the mindshare of Azure OpenAI is 7.2%, down from 9.9% compared to the previous year. The mindshare of IBM Watson Machine Learning is 1.6%, down from 2.0% compared to the previous year. It is calculated based on PeerSpot user engagement data.
AI Development Platforms Mindshare Distribution
ProductMindshare (%)
Azure OpenAI7.2%
IBM Watson Machine Learning1.6%
Other91.2%
AI Development Platforms
 

Featured Reviews

MA
Consultant/Owner at Transc byte
Intelligent incident remediation has improved and medical summaries are generated automatically
The customization option in Azure OpenAI is quite challenging because any customization must be done through the knowledge base since Azure OpenAI models cannot be trained. I must build a knowledge base and feed it so that it will learn from that knowledge base. This differs from other local LLMs that I can train directly. For integration of Azure OpenAI with other Azure services, I would rate it five out of ten because it is an open Azure product and integrations work well with Azure services. However, when it comes to services outside of Azure, integration is quite difficult and requires more exploration. It is not as convenient. The point for improvement is integration with third-party services, which has a gap that needs addressing. Regarding other points for improvement for Azure OpenAI, Azure OpenAI is performing well overall, but I believe their models should offer local dedicated models for customers. All data sent to the current models goes to public models. Azure OpenAI should provide solutions to deliver local dedicated models for customers and should enable model training based on customer data. Customers are mostly concerned about their data, so this option is not feasible as currently structured. Even if it were dedicated for the customer and not used by others, it still does not align with compliance requirements because it remains an open model.
reviewer2319402 - PeerSpot reviewer
Director of Business Development at a educational organization with 1,001-5,000 employees
Good fit for medium-sized companies, and offers good AutoML feature
In future releases, I would like to see a more flexible environment. It's a good product for customization and developing products. But when we need the most control over the delivery, Watson isn't the best. We can't fix everything because we're working with a machine that's creating a product. And the ability to go in-depth and tweak our model easily would be really nice.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The product saves a lot of time."
"Two aspects I appreciate are the turnaround time and ease of use. As it's a managed service, the quick turnaround is beneficial, and the simple interface makes it easy to work with. Performance and scalability are also strong points since you can scale as needed."
"The document intelligence feature has significantly aided in our operations, facilitating the creation of descriptive content."
"Our clients are interested in building knowledge bases, particularly in child welfare. In this domain, we focus on supporting caseworkers by compiling and organizing relevant information. This information is then stored in a database using a query. The database generates summaries and reminders for specific actions and even facilitates sending emails to parents or other relevant parties. The system's complexity is tailored to the specific needs of child welfare cases. Additionally, we're exploring opportunities to assist a healthcare organization. Specifically, we're working on streamlining the process of filling out forms required for insurance claims. This effort aims to ensure that hospitals can receive funding or payment for the care they provide."
"We have many use cases for the solution, such as digitalizing records, a chatbot looking at records, and being able to use generative AI on them."
"Azure OpenAI is easy to use because the endpoints are created, and we just need to pass our parameters and info."
"Its versatility makes it incredibly useful for technical problem-solving, content creation, data analytics, and more."
"GPT was useful for our projects."
"We can enable and change developer productivity with artificial intelligence-recommended code based on natural language input or exciting source code."
"Scalability-wise, I rate the solution ten out of ten."
"I was particularly interested in trying the AutoML feature to see how it handles data and proposes new models. The variety of models it provides is impressive."
"We have seen an ROI, as it has improved self-service and customer satisfaction."
"The solution is very valuable to our organization due to the fact that we can work on it as a workflow."
"The most valuable aspect of the solution's the cost and human labor savings."
"I like the whole concept of using Watson; it has a lot of good features and we find the image classification very useful."
 

Cons

"The fine-tuning of models with the use of Azure OpenAI is an area with certain shortcomings currently, and it can be considered for improvement in the future."
"Azure OpenAI will be expensive if you want to implement it as a permanent solution for a customer."
"There is room for improvement in their support services."
"Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources."
"Latency performance is a major part. And I'm seeking support for multiple models that handle text, images, videos, and voice. I'm from India, and I'm looking for more support in Indian languages. There are 18 official languages and many more unofficial. We need support for these languages, especially in voice moderation, which is not yet available."
"There are certain shortcomings with the product's scalability and support team where improvements are required."
"One major drawback of Azure OpenAI is its availability, as it's not consistently accessible for effective use."
"The dialogue manager needs to be improved."
"However, early on, they relied heavily on building out these massive reference tables. That was a ton of the work that had to be done."
"Scaling is limited in some use cases. They need to make it easier to expand in all aspects."
"They should add more GPU processing power to improve performance, especially when dealing with large amounts of data."
"In future releases, I would like to see a more flexible environment."
"Honestly, I haven't seen any comparative report that has run the same data through two different artificial intelligence or machine learning capabilities to get something out of it. I would love to see that."
"If I consider how we want to use it in our organization, certain areas of improvement can be addressed. For instance, we want to use it with Generative AI, not like ChatGPT, but in a way intended for industrial use."
"Sometimes training the model is difficult."
"The supporting language is limited, and other languages could be added."
 

Pricing and Cost Advice

"We started with monthly payments, but we plan to switch to yearly billing once we've stabilized our solution."
"The licensing is interaction-based, meaning transactional. It's reasonably priced for now."
"It's a token-based system, so you pay per token used by the model."
"Regarding pricing and licensing, it's a bit complex due to the minimum purchase requirement for PTO units. We're evaluating the best approach between PTE and pay-as-you-go models. Our organization is cautious about committing to PTE due to the fixed bandwidth reservation, while pay-as-you-go doesn't offer enough flexibility. We're discussing these matters with legal teams to ensure compliance and data security."
"The pricing is acceptable, and it's delivering good value for the results and outcomes we need."
"The cost is quite high and fixed."
"I'm uncertain about the licensing, specifically the pricing. This falls under the purview of other teams, particularly the sales teams. I am not informed about the pricing details."
"If you consider the long-term aspect of any project, Azure OpenAI is a costly solution."
"I've only been using the free tier, but it's quite competitive on a service basis."
"The pricing model is good."
report
Use our free recommendation engine to learn which AI Development Platforms solutions are best for your needs.
914,109 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
10%
Financial Services Firm
9%
Outsourcing Company
9%
Manufacturing Company
9%
Financial Services Firm
10%
University
10%
Construction Company
9%
Comms Service Provider
9%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business17
Midsize Enterprise1
Large Enterprise19
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for Azure OpenAI?
In terms of pricing for Azure OpenAI, I would rate it as average compared to Gemini. Currently, Gemini is becoming increasingly popular, which prompts leadership to consider a switch primarily due ...
What needs improvement with Azure OpenAI?
The customization option in Azure OpenAI is quite challenging because any customization must be done through the knowledge base since Azure OpenAI models cannot be trained. I must build a knowledge...
What is your primary use case for Azure OpenAI?
Azure OpenAI's main use case for me involves defining solutions for incident remediation where AI provides intelligence to solve problems, perform root cause analysis, or triage incidents or change...
Ask a question
Earn 20 points
 

Overview

Find out what your peers are saying about Azure OpenAI vs. IBM Watson Machine Learning and other solutions. Updated: September 2026.
914,109 professionals have used our research since 2012.