Nvidia claims its new Vera ARM CPU is 80% faster than leading x86 CPUs

NVIDIA Unveils Vera CPU: A Game Changer for AI with Claimed 80% Performance Boost

Nvidia is making waves in the AI and high-performance computing space with the introduction of its groundbreaking Vera CPU. This new processor, set to power the Vera Rubin platform alongside the Rubin GPU, promises a significant leap forward in computational power. Nvidia claims Vera delivers an average speedup of 1.8 times, or approximately 80%, compared to current leading x86 CPUs.

Inside the Vera CPU: Architecture and Performance Potential

The Vera CPU is a behemoth in terms of core count, boasting 88 Olympus cores. These cores are built on the ARM instruction set and feature Spatial Multithreading, enabling each socket to handle an impressive 176 threads. Complementing this raw processing power is its capacity for memory, supporting up to 1.5TB of LPDDR5X RAM. This configuration allows for a staggering memory bandwidth of 1.2TB/s, a critical factor for demanding AI inference tasks.

Versatile Applications for Vera

Nvidia envisions Vera as a versatile solution for a range of intensive workloads. It can function as a standalone CPU for agentic AI applications, reinforcement learning, and complex data processing and analytics. To facilitate large-scale deployments, Nvidia has also developed the Vera CPU Rack, a system designed to house 256 Vera CPUs, equating to a massive 22,528 cores and 45,056 threads.

Synergy with Rubin GPUs and Industry Adoption

Alternatively, the Vera CPU can serve as the host processor in conjunction with Nvidia's Rubin GPUs. A prime example is the NVIDIA Vera Rubin NVL72 system, which integrates 36 Vera CPUs with 72 Rubin GPUs. The seamless communication between these processors is enabled by the Nvidia NVLink-C2C interconnect, boasting a remarkable 1.8TB/s transfer rate. The industry's recognition of Vera's potential is evident in its early adoption by key players. Major AI leaders like Anthropic (Claude), OpenAI (ChatGPT), and SpaceXAI (Grok) are slated to utilize Vera CPUs. Hyperscale cloud providers such as ByteDance, CoreWeave, and Oracle Cloud Infrastructure are also on board. Furthermore, established hardware manufacturers including Dell, HP, Lenovo, and Supermicro will be building standalone Vera CPU systems. The interest extends even to critical infrastructure, with the New York Stock Exchange exploring its use for its massive daily data processing needs. Source