NVIDIA 2026-07-16
Product Launch Impact: Important Conf: 85%

NVIDIA CUDA 13.3 Introduces clmad for Hardware-Accelerated Carryless Multiplication on GPUs

Summary

NVIDIA CUDA 13.3 adds the clmad hardware instruction for carryless multiply-accumulate on Ampere+ GPUs. GHASH throughput reaches 6.3 TB/s on B200, up to 18.8x faster than bitsliced. Sum-check protocol accelerates 3-13x. The instruction also benefits CRC, Reed-Solomon, and post-quantum cryptography.

Key Takeaways

NVIDIA CUDA 13.3 introduces the clmad PTX instruction for hardware-accelerated carryless multiply-accumulate on all Ampere and newer GPUs (SM 80+), filling a long-standing gap in GPU-native binary extension field arithmetic. GHASH, the core of AES-GCM authenticated encryption, achieves up to 6.3 TB/s on the NVIDIA B200, approaching DRAM read bandwidth and 18.8x faster than prior bitsliced circuits. The GeForce RTX 5090 sees 2x improvement. The sum-check protocol, essential for zero-knowledge proofs over GF(2^128), accelerates by 3-13x on B200, with benefits scaling with polynomial size. The clmad instruction also benefits CRC, Reed-Solomon codes, BCH codes, quantum stabilizer codes, and post-quantum cryptography. Implementation uses clmad.lo and clmad.hi variants, enabling Karatsuba multiplication for 128-bit field operations. GHASH iteratively multiplies and adds in GF(2^128). Sum-check leverages clmad for highly parallelizable polynomial evaluations. NVIDIA states the instruction works on all deployed Ampere+ systems via software update.

Why It Matters

On the surface, this is a performance boost, but strategically NVIDIA is defending against Intel's CPU advantage in cryptography (e.g., PCLMULQDQ) and targeting the emerging ZK proof market by locking developers into its GPU ecosystem. Vendor lock-in: ZK systems optimized for clmad will be difficult to port to AMD GPUs lacking similar instructions. Physical limits: GHASH throughput approaches DRAM bandwidth on B200, but is constrained by HBM3e bandwidth (~8 TB/s). clmad only handles 64-bit inputs; 128-bit multiplication requires multiple calls and reduction, introducing potential tail latency. Also, the benefit is limited to Ampere+ GPUs, creating an asset depreciation trap that forces GPU upgrades. ZK proving systems may have other bottlenecks beyond sum-check.

PRO Decision

【Vendors】AMD and Intel should accelerate development of similar hardware instructions or optimize software-based bitsliced implementations in ROCm and oneAPI to narrow the gap, emphasizing cross-platform portability to counter NVIDIA's lock-in. They could collaborate with open-source communities to create standardized binary field arithmetic libraries.
【Enterprises】CIOs and architects should conduct zero-trust audits: evaluate if workloads truly benefit from clmad; consider hybrid CPU-GPU deployments to balance cost; perform independent benchmarks of ZK systems to validate real-world gains; watch for vendor lock-in risks; ensure code portability across GPU vendors; for non-Ampere GPUs, bitsliced remains an alternative.
【Investors】Look beyond the PR: clmad improves cryptographic performance but addresses a niche market. NVIDIA's move is defensive against CPU encroachment. Watch for AMD and Intel responses and ZK hardware acceleration startups. Long-term, ZK hardware acceleration may become a GPU battleground, but demand needs validation.

Source: blog
View Original →

Get 3-5 key AI infrastructure signals weekly →

💬 Comments (0)