News from the AI & ML world
DeeperML
Jim McGregor,@Tirias Research
//
Advanced Micro Devices Inc. has launched its new AMD Instinct MI350 Series accelerators, designed to accelerate AI data centers and outperform Nvidia Corp.’s Blackwell B200 in specific tasks. The MI350 series includes the top-end MI355X, a liquid-cooled card, along with the MI350X which uses fans instead of liquid cooling. These new flagship data center graphics cards boast an impressive 185 billion transistors and are based on a three-dimensional, 10-chiplet design to enhance AI compute and inferencing capabilities.
The MI350 Series introduces significant performance improvements, achieving four times faster AI compute and 35 times faster inferencing compared to previous generations. These accelerators ship with 288 gigabytes of HBM3E memory, which features a three-dimensional design in which layers of circuits are stacked atop one another. According to AMD, the MI350 series features 60% more memory than Nvidia’s flagship Blackwell B200 graphics cards. Additionally, the MI350 chips can process 8-bit floating point numbers 10% faster and 4-bit floating point numbers more than twice as fast as the B200.
AMD is also rolling out its ROCm 7 software development platform for the Instinct accelerators and the Helios Rack AI platform. "With flexible air-cooled and direct liquid-cooled configurations, the Instinct MI350 Series is optimized for seamless deployment, supporting up to 64 GPUs in an air-cooled rack and up to 128 in a direct liquid-cooled and scaling up to 2.6 exaFLOPS of FP4 performance," stated Vamsi Boppana, the senior vice president of AMD’s Artificial Intelligence Group. The advancements aim to provide an open, scalable rack-scale AI infrastructure built on industry standards, setting the stage for transformative AI solutions across various industries.
ImgSrc: imageio.forbes.
References :
The MI350 Series introduces significant performance improvements, achieving four times faster AI compute and 35 times faster inferencing compared to previous generations. These accelerators ship with 288 gigabytes of HBM3E memory, which features a three-dimensional design in which layers of circuits are stacked atop one another. According to AMD, the MI350 series features 60% more memory than Nvidia’s flagship Blackwell B200 graphics cards. Additionally, the MI350 chips can process 8-bit floating point numbers 10% faster and 4-bit floating point numbers more than twice as fast as the B200.
AMD is also rolling out its ROCm 7 software development platform for the Instinct accelerators and the Helios Rack AI platform. "With flexible air-cooled and direct liquid-cooled configurations, the Instinct MI350 Series is optimized for seamless deployment, supporting up to 64 GPUs in an air-cooled rack and up to 128 in a direct liquid-cooled and scaling up to 2.6 exaFLOPS of FP4 performance," stated Vamsi Boppana, the senior vice president of AMD’s Artificial Intelligence Group. The advancements aim to provide an open, scalable rack-scale AI infrastructure built on industry standards, setting the stage for transformative AI solutions across various industries.
ImgSrc: imageio.forbes.
Share:
References :
- Tirias Research: AMD introduces the new Instant MI350 Series GPU accelerators, the ROCm 7 software development platform for the Instinct accelerators, and the Helios Rack AI platform.
- AI ? SiliconANGLE: Advanced Micro Devices Inc. today introduced a new line of artificial intelligence chips that it says can outperform Nvidia Corp.’s Blackwell B200 at some tasks.
- AI News | VentureBeat: AMD announced its new AMD Instinct MI350 Series accelerators, which are four times faster on AI compute and 35 times faster on inferencing.
- siliconangle.com: AMD debuts new flagship MI350 data center graphics cards with 185B transistors
- insidehpc.com: AMD Announces New GPUs, Development Platform, Rack Scale Architecture
- www.eejournal.com: AMD Unveils Vision for an Open AI Ecosystem, Detailing New Silicon, Software and Systems at Advancing AI 2025
- Quartz: AMD is going after Nvidia
- insideAI News: AMD Announces New GPUs, Development Platform, Rack Scale Architecture
- insidehpc.com: Vultr Cloud to Provide AI Workloads with AMD Instinct MI355X GPU