NVIDIA Vera Rubin Drives Performance Per Watt and Lowest Token Costs for Global Partners
NVIDIA's Vera Rubin platform is entering full production with support from 300 partners worldwide. Companies including CoreWeave, Google Cloud, Microsoft Azure, and Mistral are among those deploying Vera Rubin, which sets new benchmarks for performance per watt and token cost efficiency.
The Vera Rubin NVL72 production is scaling up with racks running at CoreWeave, Google Cloud, Microsoft Azure, and Oracle Cloud Infrastructure. The platform spans more than 350 factory sites across 30 countries, giving it the largest and most mature rack-scale supply chain ever built to meet customer compute demand.
Built from chip to grid, the Vera Rubin platform delivers the highest performance per watt and the lowest token cost. CoreWeave's first benchmark on DeepSeek-R1 showed a 10x improvement in throughput per megawatt compared with Grace Blackwell NVL72, hitting the metric that matters most for power-constrained AI factories.
Extreme Co-Design Enables Performance Gains
Vera Rubin's performance comes from extreme co-design across seven chips and five rack trays: Vera Rubin NVL72, Vera CPU rack, Groq 3 LPX, Spectrum-6 SPX, and Vera BlueField-4 STX. These components are engineered as a single system rather than assembled from separate off-the-shelf products.
At the center is the NVIDIA Vera CPU, which redefines what an AI factory CPU can be. Designed for the agent era, its custom Olympus core delivers 2x single-threaded performance, 3x core-to-core bandwidth, and 40% lower memory latency compared with competing chiplet designs. This makes it the most efficient single-threaded CPU for agentic workloads.
Purpose-Built Networking Accelerates AI Factories
For networking, the platform's sixth-generation NVLink scale-up delivers more than 2x throughput on complex workloads, 3x lower latency, and 10x higher packet rates than off-the-shelf Ethernet. For scale-out, Spectrum-X Ethernet combines 102.4T Spectrum-6 switch systems, 1.6T ConnectX-9 SuperNICs, adaptive routing, advanced congestion control, telemetry, and open operating system support. This enables 1.6x higher RDMA bandwidth than off-the-shelf Ethernet.
Leading AI infrastructure builders including CoreWeave, Microsoft, SpaceXAI, and Tesla are among the first to deploy Spectrum-6 switches to accelerate their AI factories. NVIDIA Photonics with co-packaged optics for scale-out, the industry's first such switch in volume manufacturing, adds 5x lower power and 10x higher MTBI versus pluggable transceivers. CoreWeave, Lambda, and OCI are among the first adopters.
Spectrum-XGS Ethernet extends performance across sites with 1.9x multi-site throughput, because gigascale AI is not a single building problem. NVLink Fusion opens the NVIDIA infrastructure platform to third-party XPUs, giving partners a faster path to market on the proven NVLink scale-up stack and ecosystem.
Setup Time and Water Savings
NVIDIA's three generations of rack-scale co-design produced a Vera Rubin NVL72 system with no cables, fans, or hoses in the tray. This cuts compute tray assembly time from hours to one minute.
A 45-degree Celsius liquid cooling inlet temperature design enables chiller-free dry-cooler operation. For new AI factories, this higher temperature dry cooling along with the closed-loop liquid cooling system saves millions of gallons of water per megawatt annually.
Vera Rubin Powers Europe's Open-Model Era
Vera Rubin is delivering next-generation performance to Europe's AI infrastructure. It serves as the foundation for a newly expanded partnership between Microsoft and Mistral that brings frontier AI to the region. The partnership combines open European models with cloud and customer-controlled environments so governments and regulated industries can adopt AI on their own terms.
Underpinning the partnership is a new multibillion-dollar agreement focused on expanding AI infrastructure in Europe. Mistral is adding its GPU capacity, drawing on thousands of the latest NVIDIA Vera Rubin GPUs to increase AI compute availability for customers and provide a shared platform for training, inference, and large-scale deployment.
Vera Rubin is ramping into full production. The rack-scale AI supercomputer unifies seven new chips co-designed as one system. It will power the next generation of Mistral Compute and Microsoft's European AI infrastructure, drawing on tens of thousands of GPUs.
Europe wants the world's most capable AI, running under its own laws, close to home, and fully within its control. The bar keeps rising: agentic systems can consume up to 15x more tokens than traditional AI applications, making efficient infrastructure a strategic priority. Meeting that expectation takes more than computing capacity. It requires AI that scales efficiently while satisfying regional requirements for data control, governance, resilience, and strategic autonomy.
Vera Rubin provides the computing foundation for Europe's open-model ecosystem. Its full-stack architecture combines accelerated computing, networking, and software so models and agents run efficiently from training through production.
Open Models Built for Enterprise AI
Together, Microsoft, Mistral, and NVIDIA are delivering sovereign-ready AI across public cloud, cloud-connected, and fully disconnected private cloud environments. This pairs the flexibility of open models with the infrastructure required to operate them at scale.
Mistral Medium 3.5 and OCR 4 are now available in Microsoft Foundry, and Mistral models are integrated into CoPilot directory Studio. Through Azure Local and Foundry Local, customers can use the same models, tools, and operating patterns across cloud and customer-controlled environments.
AI on Europe's Terms
Government agencies can apply AI to sensitive workflows. Healthcare and financial services organizations can deploy within regional requirements. Manufacturers can process data on site for faster decisions. Compared with NVIDIA GB200 NVL72, Vera Rubin NVL72 delivers up to 10x more tokens per megawatt and one-tenth the cost per million tokens, providing more intelligence within the same power footprint.
Stay ahead of the AI curve
The most important updates, news, and content — delivered weekly.
No spam. Unsubscribe anytime.
Sovereign AI should not force organizations to choose among innovation, economics, and control. With Vera Rubin as the computing foundation, and Microsoft and Mistral delivering sovereign cloud infrastructure and open European models, Europe can pursue all three.
CoreWeave Benchmark Shows 10x Tokens Per Megawatt
Embracing extreme co-design with NVIDIA, CoreWeave is delivering an order of magnitude performance leap on Vera Rubin NVL72. Close collaboration with partners like CoreWeave is mission-critical to bringing up a new generation of NVIDIA accelerated computing into AI factories.
After months of co-engineering work, CoreWeave became the first AI cloud to bring up and validate Vera Rubin NVL72. It is now sharing the first measured performance numbers from live hardware.
CoreWeave ran a DeepSeek-R1 benchmark on Vera Rubin NVL72 and saw a 10x improvement in tokens per second per megawatt compared with Grace Blackwell NVL72.
Tokens per megawatt is the metric that determines whether AI infrastructure can profitably scale. More tokens per megawatt means more intelligence from the same power budget, or the same workload on significantly less power. AI labs and enterprises such as Jane Street will use the Vera Rubin platform to scale their AI factories on the CoreWeave cloud.
Beating Bottlenecks With NVIDIA Spectrum-X
DeepSeek R1's MoE architecture makes all-to-all GPU communication a critical requirement at scale. Each token must be routed across distributed expert sub-networks. Vera Rubin NVL72's 260 TB/s all-to-all NVLink 6 fabric removes that constraint, enabling the rack to behave as a single unified accelerator.
CoreWeave is among the first to deploy the NVIDIA Spectrum-X Ethernet SN6600-LD as the switching fabric for Vera Rubin NVL72. Built on the 102.4 Tb/s Spectrum-6 switch chip and featuring a liquid-cooled design, CoreWeave deploys dense switching racks, delivering 1.64 Pb/s per rack with 100% more capacity than previous generation air-cooled switches. CoreWeave also provides a fully non-blocking, multi-plane, multi-rail spine and leaf fabric connecting Vera Rubin NVL72 GPUs without oversubscription.
Google Cloud A5X Instance Powers Ineffable Intelligence
NVIDIA Vera Rubin NVL72 is powering Google Cloud's first A5X instance, now up and running for London startup Ineffable Intelligence.
Ineffable Intelligence develops a new generation of intelligent "superlearner" systems that continuously learn through experience to discover new breakthroughs across all fields. Their agents learn directly from interaction with their environments, rather than from static datasets. Instead of using large language models, Ineffable is developing "superlearner" systems through reinforcement learning, generating experience across continuously simulated, massively parallel environments and rapidly translating that experience into policy updates and evaluation. These tightly coupled learning loops place exceptional demands on compute, memory bandwidth, and interconnect, requiring infrastructure that can operate at enormous scale with extremely low latency.
"The next era of research requires the next era of hardware," said Lasse Espeholt, co-founder of Ineffable Intelligence. "We feel privileged to work with the teams at NVIDIA and Google Cloud, who were able to grant us early access to Vera Rubin. The support across both teams has been unmatched; we were up and running almost immediately and are already testing infra for our superlearners."
NVIDIA Vera Rubin NVL72 is designed for this kind of agentic training, delivering predictable latency, high utilization, and significantly more intelligence per dollar than previous generation systems, making it a natural platform choice for large-scale reinforcement learning.
Google Cloud A5X instances, announced at Google Cloud Next, are bare-metal instances built on NVIDIA Vera Rubin NVL72 rack-scale systems. They deliver up to 10x lower inference cost per token and 10x higher token throughput per megawatt than the prior generation.
A5X uses NVIDIA ConnectX-9 SuperNICs combined with next-generation Google Virgo networking, enabling clusters that can scale to tens of thousands of NVIDIA Rubin GPUs within a single site and up to nearly a million GPUs across multisite configurations. This gives customers a unified, AI-optimized stack for training, tuning, and serving frontier, open, agentic, and physical AI models while optimizing for performance, cost, and sustainability.
This infrastructure is designed to help unlock the next generation of reinforcement learning systems for breakthroughs in superlearning and superintelligence.
DeepInfra Benchmark Shows Vera CPU Doubles Orchestration Speed
Benchmark results from DeepInfra show that the NVIDIA Vera CPU is more than twice as fast and can support more concurrent AI agents compared with other CPUs.
Cloud platform DeepInfra, an early access participant in the NVIDIA open AI ecosystem, independently designed and ran benchmarks using its production AI agent infrastructure. DeepInfra processes nearly five trillion tokens a week, with about 30% driven by agentic systems. Its cloud platform is built for high-throughput AI inference.
The benchmarks demonstrate support for up to 1.6x more concurrent AI agents at the same quality of service and up to 2.2x faster orchestration than alternative CPUs, while improving infrastructure utilization and cost efficiency. These results show that the NVIDIA Vera CPU delivers the cost efficiency, low latency, and throughput that production agentic AI demands.
As AI agents take on more complex reasoning, planning, tool use, and data movement, CPU performance has become increasingly important for orchestrating work around each model call.
Part of NVIDIA's extreme co-design approach to AI factories, the Vera CPU is built for agentic workloads. DeepInfra's benchmark highlights how the NVIDIA Vera CPU helps cloud providers improve infrastructure utilization, increase cost efficiency, and support more concurrent AI agents at the same quality of service.