Try our new research platform with insights from 80,000+ expert users

Amazon Bedrock vs NVIDIA DGX Cloud comparison

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Amazon Bedrock
Ranking in AI Infrastructure
2nd
Average Rating
8.0
Reviews Sentiment
6.5
Number of Reviews
15
Ranking in other categories
Infrastructure as a Service Clouds (IaaS) (12th)
NVIDIA DGX Cloud
Ranking in AI Infrastructure
3rd
Average Rating
9.0
Number of Reviews
1
Ranking in other categories
No ranking in other categories
 

Featured Reviews

RodrigoBassani - PeerSpot reviewer
Advanced integration and flexible architecture drive efficient business solutions
I have to gain more maturity to provide some improvements to Amazon Bedrock. I have a lot to do with the environment they already provided. For example, they are able to connect to any LLM solution such as Llama, Meta, Gemini, or ChatGPT. It is open; you just choose your favorite LLM solution, and you can integrate it into Amazon Bedrock. We have a lot of possibilities to do this integration at this moment; we just need to work on it, create more maturity, and then we can provide some enhancements that we can see on the solution as a whole. For companies in general, the main pain point or main issue related to Amazon Bedrock is security because they are not confident that all information is hidden by this kind of architecture. They wonder if they are providing some company information that can run away, and I think that is the challenge we have now. We need to find ways to work on it and make our clients' data secure. They are looking for that to guarantee that this is a great solution for companies that is also secure.
reviewer2309676 - PeerSpot reviewer
Versatile, well-built, and powerful
The initial setup of the DGX server was quite straightforward. We treated it like any other server during deployment. It went to the data center, where they set it up, placed it in the rack, and enabled it. The deployment process was familiar, using our standard tools like Foreman and Ansible. Since the operating system is supported, we didn't encounter any specific challenges. For deploying the DGX server, we typically need two people for software tasks and sometimes vendor assistance for hardware setup. The process takes about four hours, with NVIDIA firmware updates taking the most time (around two hours), and the rest dedicated to OS and Ansible deployment. Maintaining the DGX server is pretty straightforward. We treat it like any other server, with around 10% downtime, while the rest of the cluster remains up.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is the best solution in this category and is rated a nine out of ten."
"Amazon Bedrock offers an environment where we only pay for the model we use, and AWS handles the scaling."
"The most valuable features of Amazon Bedrock include scalability, ease of access, having 20 to 25 plus pre-trained models, and scaling capabilities."
"Bedrock proved beneficial for generating SQL queries, which helped in delivering precise information from the database."
"The valuable feature of Bedrock is its flexibility and comprehensiveness in what it's offering, providing parameters that we can change."
"The most valuable feature of Bedrock is its security and the model's ability to modify vector dimensions easily."
"Amazon Bedrock is easy to use and practical, allowing for quick development."
"The most beneficial aspect of Bedrock is its pool of models to choose from, catering to specific needs."
"The most valuable thing about DGX Systems is their super-fast connection."
 

Cons

"There is a need for improved documentation, smoother integration, and possibly reduced prices given the competition."
"For companies in general, the main pain point or main issue related to Amazon Bedrock is security because they are not confident that all information is hidden by this kind of architecture."
"The advantage of Bedrock is not as an amazing enabler of AI platforms, yet we utilize it to deploy application services and microservices within Bedrock ecosystem and leverage prequalified foundation models like Claude and others."
"For companies in general, the main pain point or main issue related to Amazon Bedrock is security because they are not confident that all information is hidden by this kind of architecture."
"It would be beneficial if Amazon Bedrock could provide multiple responses to a query, allowing users to choose the best option."
"I would appreciate a greater focus on agentic Gen AI applications in Bedrock."
"The user interface of Amazon Bedrock on the management console needs improvements."
"Amazon Bedrock is quite highly scalable, but there are some limitations they impose on the accounts, which could be an area for improvement."
"One thing that could be better in DGX Systems is their power consumption."
 

Pricing and Cost Advice

"The cost of using Amazon Bedrock is quite high, as I incurred unexpected charges amounting to $130 USD within two weeks without actually deploying the model."
"One customer paid around $100 to $200 per month, which was significant given their overall infrastructure costs."
Information not available
report
Use our free recommendation engine to learn which AI Infrastructure solutions are best for your needs.
865,295 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
13%
Manufacturing Company
12%
Financial Services Firm
9%
University
8%
Manufacturing Company
13%
Computer Software Company
13%
University
10%
Educational Organization
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for Amazon Bedrock?
The pricing depends on the LLM model in use, such as the 1.2 Anthropic Claude ( /products/claude-reviews ). Costs are based on the number of characters obtained in return. It follows a pay-as-you-g...
What needs improvement with Amazon Bedrock?
The only aspect that could be improved about Amazon Bedrock is the pricing. There are no additional features or improvements needed for the product itself.
What is your primary use case for Amazon Bedrock?
Amazon Bedrock is one of the services which is similar to ChatGPT. From my perspective, I was creating a version of ChatGPT that would answer my customers' questions. The significant difference bet...
What do you like most about NVIDIA DGX Systems?
The most valuable thing about DGX Systems is their super-fast connection.
What is your experience regarding pricing and costs for NVIDIA DGX Systems?
The prices for DGX are pretty high, and not everyone can afford them. We only have a few out of our total servers because of the cost. It would be great if the prices could come down in the future ...
What needs improvement with NVIDIA DGX Systems?
One thing that could be better in DGX systems is their power consumption. They have been making improvements, but finding the right balance between performance and using less power is a challenge. ...
 

Also Known As

No data available
NVIDIA DGX-1, DGX Cloud, NVIDIA DGX Platform
 

Overview

 

Sample Customers

Information Not Available
Open AI, UC Berkley, New York University, Massachusetts General Hospital