NVIDIA AIPerf Exposes the Benchmark Bottleneck Nobody Measures
NVIDIA released AIPerf on September 18 as the designated successor to GenAI Perf. The headline is a new inference benchmarking tool. The more important point is less flattering to the benchmark culture around local AI: sometimes the machine generating the test traffic is the bottleneck, not the inference server being