Computing · Compute Affordability

Cost per GFLOPS

The invisible curve behind simulation, graphics, science, and AI.

• $1T+ → ~1¢ per GFLOPS
• Halving: 20mo → 45mo since 2015
• Driven by GPUs; newest points are FP32
• Not like-for-like: precision varies

The cost of arithmetic has collapsed so far that entire categories of research became software problems. From the room-sized ENIAC to commodity graphics cards, the price of a billion floating-point operations fell from over a trillion dollars to about a cent. GPUs accelerated the curve by turning parallel workloads into mass-market performance, and the AI boom has since made low-precision throughput the metric that matters.

One caveat across eighty years: these points are not perfectly like-for-like. The oldest machines are measured in fixed-point or double-precision arithmetic and the newest in single precision, apart from a half-precision build in 2017, so read this as an order-of-magnitude cost curve rather than a single benchmark held constant. The slope has also flattened: the price of a gigaflop halved about every 20 months from ENIAC through 2011, but has taken about 45 months per halving over the past decade. Note which way the caveat cuts — the newest cards advertise far larger half- and 8-bit matrix figures than the single-precision ones plotted here, and both ends of the past decade are single precision, so precision does not explain a curve that is still slowing.

Source: Wikipedia: cost of computing (FLOPS)

Download the data: flops_per_dollar.csv · flops_per_dollar.json

All curves · The chart is drawn in your browser and needs JavaScript. Every number it plots is in the table above.