GPU giants throw HPC users some tasty crumbs

At Supercomputing 2026 this week, Nvidia unveiled a new variant of its Rubin GPUs aimed at – you’ll never believe it – high performance computing (HPC).

The creatively named Rubin HPC promises more than 50,000 CUDA cores, nearly twice that of the AI-focused version of the chip that Nvidia unveiled earlier this year. It will arrive sometime in 2028.

According to Dan Ernst, Nvidia’s senior director of supercomputing, the new chip offers a rebalanced architecture optimized for the kinds of simulation, engineering, and high-performance analytics workloads common in the HPC and scientific computing communities.

This is not the first time Nvidia has introduced specialized hardware. Last year, the company optimized its B300 accelerator for AI inferencing workloads.

“Rubin HPC is the same idea,” Ernst told . “Within the Rubin platform, but we’re building variants to really focus on a specific sub domain of applications.”

Details remain remarkably thin. Nvidia hasn’t disclosed peak performance memory capacity or bandwidth. That said, the chip will likely include features which show Nvidia can think beyond AI and still cares about the HPC community.

Fearing that Nvidia could ignore HPC is reasonable becuase beginning with the launch of Blackwell Ultra (B300/GB300), the company traded double-precision matrix acceleration for higher throughput at lower-precisions.

The result was a chip that at FP4 churned out 15 petaFLOPS of AI compute, but just 1.3 teraFLOPS at FP64. That's good for AI, but less useful for scientists.

When Nvidia unveiled Rubin, it seemed the GPU-slinger would continue this trend. At 33 teraFLOPS, the chip was not only slower at FP64 than the Blackwell GPUs it replaced, but slower than Nvidia’s now four-year-old Hopper accelerators as well.

Nvidia contended that for sparse vector-heavy workloads measured by the High Performance Conjugate Gradients (HPCG) benchmark, the higher ratio of memory bandwidth to compute should deliver meaningful performance gains.

Meanwhile, for dense matrix-heavy workloads, for which benchmarks like High-Performance Linpack (HPL) are representative, Nvidia adopted a new strategy: FP64 emulation.

The algorithm works by decomposing FP64 matrix operations into a string of INT8 operations that, when run on Nvidia’s tensor cores, achieve higher-than-native performance.

Nvidia, we’re told, isn’t using INT8, but it is unlocking substantial performance gains, at least for certain workloads. According to Nvidia, Rubin can churn out up to 200 emulated FP64 matrix teraFLOPS.

While Ernst didn’t offer any specifics, he assured us that Nvidia’s HPC hardware should offer native FP64 matrix performance and customers won't have to rely entirely on emulation.

Assessing the new chip's vector performance is much easier. With more than 50 thousand CUDA cores (by our calculation, it should be closer to 53,248), the chip should deliver at least 86 percent higher vector performance at double precision.

AMD is also cooking up new HPC chips. In a blog post published late last week, AMD revealed the HPC-tuned version of its MI400-series GPUs.

The Instinct MI430X boasts 432 GB of HBM4, 23 TB/s of memory bandwidth and a whopping 288 teraFLOPS of peak double precision grunt.

AMD isn’t relying on FP64 emulation. Instead, AMD took advantage of its modular chiplet architecture to build two distinct versions of its MI400-series accelerators: one optimized for AI and another designed to excel in HPC and scientific computing workloads.

Benchmark MI430X vs MI300A (Projected) MI430X (Projected)
HPL 3.96x 190 TFLOPS
HPL-MxP (FP16) 4.16x 1790 TFLOPS
HPCG 5.57x 3.08 TFLOPS

AMD has shared predictions as to how the chips will perform in several of the Top500’s headline benchmarks. In a total non-surprise, the House of Zen says systems like EuroHPC’s Alice Recoque and Oak Ridge National Laboratories’ upcoming Discovery supers would enjoy significant performance gains if they upgrade from its earlier Instinct MI300A and MI250X-based offerings. ®

Original source GPU giants throw HPC users some tasty crumbs

Back to home