The Supermicro AI Training SuperServer SYS-820GH-TNR2 is a purpose-built AI training and inference server, optimized exclusively for Intel Gaudi 2 accelerators. Designed in close collaboration with Intel, this 8U rackmount system delivers a cost-effective and scalable platform for enterprises seeking to accelerate deep learning and generative AI workloads without relying on NVIDIA GPUs.
The heart of the SYS-820GH-TNR2 are eight Intel Gaudi 2 accelerators, each with integrated high-bandwidth memory and on-die networking. This architecture eliminates the need for external switches, reducing latency and simplifying system design. The Gaudi 2 processors provide strong performance for training large-scale models, while offering a compelling price-to-performance ratio compared to alternative GPU-based solutions.
Intel Gaudi 2 accelerator benchmarks, performance, and reviews:
ServeTheHome finds the NVIDIA marketing slide that was intended to highlight its supremacy, inadvertently showcased Gaudi 2’s compelling value proposition.
-Kennedy, P. (2023, November 8). NVIDIA Shows Intel Gaudi2 is 4x Better Performance Per Dollar than its H100
WCCFTech shows the Intel Gaudi 2 GPU accelerator offers 33% better value than its competitors "Intel Gaudi 2 Accelerators Showcase Competitive Performance Per Dollar Against NVIDIA H100 In MLPerf 4.0 GenAI Benchmarks"
-Mujtaba, H. (2024, March 27). Intel Gaudi 2 Accelerators Showcase Competitive Performance Per Dollar Against NVIDIA H100 In MLPerf 4.0 GenAI Benchmarks
Databricks reinforces the Intel Gaudi 2 GPU accelerator position as a cost-effective and high-performing alternative to NVIDIA’s offerings "LLM Training and Inference with Intel Gaudi 2 AI Accelerators"
-Venigalla, A. and Khudia, D. (2024, January 4). LLM Training and Inference with Intel Gaudi 2 AI Accelerators
Stability.ai benchmarks the Intel Gaudi 2 GPU accelerator, while emphasizing that more accessible and efficient options like the Gaudi 2 helps democratize AI, "Behind the Compute: Benchmarking Compute Solutions"
-"Behind the Compute: Benchmarking Compute Solutions." (2024, March 11). Stability AI. Retrieved from https://stability.ai/news/putting-the-ai-supercomputer-to-work
Intel explains how the Gaudi 2 AI accelerator is a viable and cost-effective alternative to NVIDIA's H100 in generative AI inference, "Intel Gaudi 2 Remains Only Benchmarked Alternative to NV H100 for GenAI Performance"
-"Intel Gaudi 2 Remains Only Benchmarked Alternative to NV H100 for GenAI Performance." (2024, March 27). Intel. Retrieved from https://stability.ai/news/putting-the-ai-supercomputer-to-work
Here at The Server Store the customer always comes first. If you have any questions concerning our product please feel free to call or chat with us at any time. Don't forget to check out the rest of our wide array of refurbished IT Equipment here at The Server Store.
