Technical Blog

NVIDIA Technical Blog

Recent

See all
Sep 18, 2026

Benchmarking LLM Inference at Scale with AIPerf

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send...
11 MIN READ
Sep 16, 2026

How to Use AI Agents to Prepare 3D Scenes for Simulation

Agentic AI workflows can be used to prepare and validate digital twins for physical AI systems. Agents can inspect 3D scenes, author simulation-relevant data...
18 MIN READ
Sep 16, 2026

TensorRT Edge-LLM Completes the MLPerf Edge Agentic Benchmark 6.4x Faster on Jetson AGX Thor

AI agents are moving from cloud data centers to vehicles, robots, and other edge devices. Unlike a chatbot that answers a single prompt, an agent works through...
7 MIN READ
Sep 16, 2026

Translating CUDA Tile Operations from Python to Rust Using Agentic AI

cuTile Rust (cutile-rs) is a tile-based system for safe, idiomatic GPU kernel authoring in the Rust programming language. Extending the Rust ownership model to...
19 MIN READ
Sep 15, 2026

Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each

How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...
9 MIN READ
Sep 15, 2026

How NVIDIA Groq 3 LPX Deterministic Execution Drives Power-Efficient High-Interactivity Inference on NVIDIA Vera Rubin

Power is a defining constraint for AI factories. As AI workloads demand a full compute platform to serve them, each component of that platform must maximize...
10 MIN READ
Sep 15, 2026

How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster...
12 MIN READ
Sep 15, 2026

Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE

Federated learning (FL) projects often begin with a straightforward setup: one server, a few clients, and one dataset at each site. As those projects grow, the...
10 MIN READ

Inference Performance

See all
Sep 10, 2026

How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra

Deploying a large language model is only the first step toward production-ready serving. Production teams also need to serve as many concurrent users as...
6 MIN READ
Sep 02, 2026

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and...
15 MIN READ
Sep 01, 2026

How to Size GPUs for AI Inference and TCO Without Overspending

The surge in AI adoption is transforming everything from chatbots to content generation. Still, a common pain point remains: How can organizations confidently...
13 MIN READ
Aug 24, 2026

How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin

NVIDIA Groq 3 LPX is the interactive AI inference accelerator for the NVIDIA Vera Rubin platform. At the core of the platform is NVIDIA Vera Rubin NVL72, the...
13 MIN READ
Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because...
14 MIN READ
Jul 24, 2026

ModelExpress: Distributing Model Artifacts at the Speed of Light

Every byte moved has a cost. As model checkpoints grow to hundreds of gigabytes or even a terabyte, that cost adds up quickly. To make things even worse,...
12 MIN READ
Jul 10, 2026

AI Model Co-Design: Hardware-Friendly LLM Design

AI performance comes down to three dimensions:  Accuracy: How well the model reasons and produces outputs Throughput: How many tokens per second a...
17 MIN READ
Decorative image.
Jul 02, 2026

Hardware-Rooted AI Security That Won't Slow You Down

AI has transformed how organizations operate, driving unprecedented levels of productivity and innovation. However, AI adoption can be impeded by concerns...
6 MIN READ
]

Build AI Agents

See all
Sep 04, 2026

Building a Memory-Driven Agent with NVIDIA NemoClaw

Enterprise work spans messages, decisions, projects, and obligations that change over time. An AI agent that starts without this context must reconstruct it...
6 MIN READ
A decorative image.
Aug 19, 2026

Evaluating AI Agent Skill Performance with NVIDIA SkillEvaluator

AI agents are only as effective as the context they receive. Even with capable models and well-documented NVIDIA libraries, agents can spend extra steps...
8 MIN READ
Decorative image.
Jul 22, 2026

Make Long-Running NVIDIA TensorRT Engine Builds Observable and Cancelable in Python or C++

A TensorRT engine build can take seconds to many minutes. Large strongly typed models, deep tactic search, and a cold timing cache on a brand-new GPU SKU can...
11 MIN READ
Jul 07, 2026

Building an Analysis AI Agent for Industrial Alarm Management with NVIDIA Nemotron

Industrial machinery generates more alarms than technicians can triage. For each important alarm requiring follow-up, the technician pulls historical context,...