My focus is liquid cooling. We are taking the air-cooled PowerEdge systems and converting them to liquid cooling. That usually involves replacing and doing material compatibility, adjusting the thermal interface materials inside the systems, and adjusting the heat sinks. We turn off the fans and adjust the BIOS systems in some of the subsystems, such as PSUs.
This allows the server that has been designed for air cooling to be submerged in dielectric fluid so that it can now be cooled with dielectric fluid running through the systems. Because of the fact that it is submerged, all the subsystems are being cooled, but instead of air, it is done by fluid. It is far more effective at pulling heat out of the systems, taking that heat out of the unit, and then being able to use that heat for other purposes.
For the larger PowerEdge systems that have GPU integrations in them, we have seen a lot of trends in building those for AI systems. We have seen a generated interest in the PowerEdge system across the board for a majority of industries.
I am quite new to the company, but I see that customers keep asking for these servers. From our side, because of our relationship with Dell, we can take a server and convert it to liquid far quicker than with other partners. That has been a big advantage. The PowerEdge system is good in many aspects. Many times customers just want to deploy these systems, especially given the acceleration that we have seen in the AI industry. People just want to be able to get their systems up and running as quickly as possible, so sometimes, there is an advantage to the lead time of getting these things converted. We have been able to do that quicker through Dell than with other IT vendors. We have relationships with HPE as well as with Lenovo. We are dynamic. We are not tied to any particular vendor, and we can work with all customers to deploy different systems inside their environment for liquid cooling.
From our side, there is always a little bit of a challenge with the footprint. I am in an area where we are submerging these devices in tanks. We are in a situation where some of the server designs are a little bit deep. For example, PowerEdge R760xa has a slightly extended depth. It is not as long as PowerEdge XE9680, but PowerEdge R760xa is a beast in itself. It is influencing the infrastructure designers to change their footprint so that they can incorporate something like this in their AI systems. That is very impressive. This is the thing that so many people are talking about at the moment. We see a lot of potential in a device like this because of the fact that you can load H100 or H200 GPUs with NVLink. It is a complete system for AI training models.
We have our own challenges with firmware, but that is only because we sometimes have to adjust the firmware of things like PSUs. With the firmware that they have by default, there is a fan running inside that. When we run fluid through, we want to adjust the firmware so that the fan is turned off. We usually have to adjust the firmware to a very high version because we do not want someone updating the firmware to the new standard. That is because the moment they do that, the fans will start running again, and all the alarms are going to go off because a bunch of fluids are running through the systems. So, we have our own firmware challenges to work with, but Dell is strong in being able to help us with that information and get the firmware so that we can adjust it. It is not just one vendor who provides the PSUs, and firmware adjustments are far more successful than having to emulate the PSUs, which is something some people have done in the past, but they led to some failures inside the PSUs when they try to convert to liquid cooling.
In terms of energy consumption, because I am on the liquid cooling side of things, we turn the fans off. If we can get a PowerEdge system and convert it to liquid cooling, we can reduce the power consumption of that server by up to 40%. In data center environments, energy consumption is becoming an important ratio to measure when people are building up these large data centers around the world. Currently, in an air-cool system, power usage effectiveness (PUE) is 2.0 or 1.5. When you start to liquidate all these, that dramatically drops to 1.2 or 1 PUE. You can even get less than 1 PUE if you effectively reuse the heat. So, you get more environment-friendly servers. If you are reducing carbon emissions and your power consumption by 20% or 30%, that is incredibly attractive when you are trying to build out new systems. Not only that, with air-cool, to maintain strong air conditioning to keep these things cool, especially something like PowerEdge XE9680, air conditioning has to use up a lot of water, whereas, with immersion, you do not have to use up that water. You are using incredibly small amounts of water to cool. It is even zero in many cases. So, liquid cooling has a huge amount of environmentally friendly advantages, and the fact that we are able to do quite a lot of liquid cooling PowerEdge systems in turn makes PowerEdge a more environmentally friendly option.
Because we are able to change the standard with cooling, it gets purchased in positions where we can run the GPUs at their maximum performance. In fluid systems that we have tested using things like PowerEdge XE9680, we are able to achieve maximum frequency and maximum performance.
The Dell name holds a lot of weight on our position as a partner of Dell's when it comes to liquid cooling the systems. We have a great relationship with Dell, so we are able to exchange information very easily to be able to build these systems for our customers. When it comes to converting one of these to liquid cooling, we need to know a lot of information about the sub-components, the vendors, and the firmware inside PSUs. Without a strong relationship with our IT partner Dell, we would not be able to do that effectively and quickly to meet the lead times of our customers.
Dell PowerEdge systems are very strong or well-rounded systems. A lot of people like the 4th and 5th generation Xeon that has been implemented into PowerEdge. Xeon has a good advantage when it comes to the inputting element of AI systems, and, of course, Intel also has a good name. However, from our position, as a partner and as a systems integrator, the real strength is the relationship that we have with Dell and being able to exchange that information.
I have been a part of my current organization for a few months. I started at the end of last year. I have been acclimatizing to the PowerEdge systems.
In the metrics that I have worked with, they have been very stable and reliable so far. We have not had cases where we have to go in and do maintenance work on our side of things. Usually, any issues that they have had from a liquid cooling side of things have mostly been down to people not doing the proper practice when it comes to installation.
A lot of the time, we deal with customers who already have a pre-existing architecture. They perhaps have Cisco systems or HPE systems in their infrastructure. The challenge is to convert them to a new unit. The data center's presentation is such a big element of design. It is good if they stick with the same vendor and have the same relationship, but it is sometimes challenging to have someone change their traditional air-cooled infrastructure systems with the ones from Dell.
I have not heard anything negative about its deployment.
To those who are thinking about liquid cooling, I would strongly recommend it, especially in the EU. It is an environmentally friendly option. It is important to make sure that you have an integrator who understands liquid cooling to a strong degree. It is not something that you can just convert by yourself in the data center. It is something that needs to be done in a lab environment, and it needs to be supported going forward by someone who understands liquid cooling. You need a liquid cooling specialist who is able to assist with that, as well as being able to assist on the services and support side from Dell. We work fluently with Dell in those situations. We found that once the liquid cooling starts running in these systems, if there is going to be a problem, it would have happened in the first few weeks. It is usually down to installation practices, not the systems themselves.
I would rate Dell PowerEdge Rack Servers a nine out of ten. It is a very strong solution.