Supermicro has added to their strong line of Common GPU techniques with an 8U field able to housing eight socketed (SXM) NVIDIA A100 and H100 GPUs that assist NVLink and NVSwitch. This implies NVSwitch GPU-to-GPU bandwidth of 600 GBs and a complete mixture bandwidth of 4.8TB/s with the A100s. Along with dealing with immediately’s wants, the Supermicro GPU SuperServer SYS-820GP-TNAO is prepared for what’s subsequent, with loads of headroom for greater TDP CPUs and accelerator playing cards.
Supermicro has added to their strong line of Common GPU techniques with an 8U field able to housing eight socketed (SXM) NVIDIA A100 and H100 GPUs that assist NVLink and NVSwitch. This implies NVSwitch GPU-to-GPU bandwidth of 600 GBs and a complete mixture bandwidth of 4.8TB/s with the A100s. Along with dealing with immediately’s wants, the Supermicro GPU SuperServer SYS-820GP-TNAO is prepared for what’s subsequent, with loads of headroom for greater TDP CPUs and accelerator playing cards.
Supermicro GPU SuperServer SYS-820GP-TNAO Highlights
The spotlight of this field is clearly the assist for NVIDIA’s HGX A100 8-GPU SXM4 Multi-GPU Board. That board and related followers and heatsinks for cooling make up the decrease half of the 8U chassis seen above. This field helps CPU-GPU PCIe 4.0 x16 interconnect, and GPU-GPU interconnect by way of NVIDIA NVLink with NVSwitch.
Cooling is a giant take care of GPU techniques like this; if thermals get uncontrolled, the system will throttle efficiency. Supermicro has put vital effort into its twin cooling zones to make sure the GPUs stay working at peak efficiency. There are followers at the back and front of the system, along with a financial institution contained in the server and some extra within the again. Whereas the first go-to-market chassis is air-cooled, Supermicro does provide liquid cooling assist on this chassis.
The highest half of the Supermicro GPU SuperServer SYS-820GP-TNAO is the pc and storage portion of the server.
At launch, this makes use of a Supermicro Tremendous X12DGO-6 motherboard, with assist for 2 Intel Xeon Scalable CPUs with TDP as much as 270W. The board additionally affords 32 DDR4 DIMM slots, which interprets to a max DRAM footprint of 8TB (LRDIMMs).
The motherboard additionally affords 10 PCIe slots, all PCIe4 x16 LP, together with AIOM/OCP 3.0 assist. These slots are break up into two banks on the again of the system and are prepared for NICs or all kinds of accelerator playing cards. By way of storage, the system helps six drives within the entrance (tri-mode) and an non-compulsory set of 4 NVMe bays on the again. A few of the SSD bays additionally assist NVIDIA GPUDirect Storage. There’s M.2 onboard for boot obligation.
A single 6000W OCP-compliant energy provide gives energy. As well as, the system helps each AC and DC Energy, together with assist for normal OCP DC rack configurations.
Our Perspective
Supermicro is listening to clients in HPC and AI fields who’re clamoring for extra highly effective GPU techniques. Thus far, Supermciro has additionally been versatile of their Common GPU line, making it simple to swap out Intel for AMD CPUs, for example, or NVIDIA SXM GPUs for one thing else. Meaning from a number of base parts, Supermicro can get fairly artistic to resolve high-end GPU wants.
The one factor that’s unusual with the Supermicro GPU SuperServer SYS-820GP-TNAO is that it’s 8U. That’s a really beefy field and one thing that may be a problem for individuals who are rack U-sensitive. Supermicro can configure comparable 8-GPU servers in 4U and 5U. There are causes to go together with the 8U chassis although; it’s just a little extra environment friendly, it ought to have higher thermals, and there are numerous extra growth choices.
Supermicro is leaning very exhausting into the GPU server house; in conventional Supermicro type, they’ve one thing for everybody. This 8U field seems fairly spectacular however is maybe nearing the final hurrah for air-cooled GPUs. These containers can solely get so large and highly effective earlier than liquid cooling is the first answer.
Supermicro GPU Servers
Interact with StorageReview
Publication | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed
