Beginner Basics

Artificial intelligence and computing power

Since 2012, the computing power used to train the largest AI systems has grown more than 300,000-fold, doubling every 3.4 months—a pace far exceeding Moore's Law's two-year doubling period. Because greater compute has consistently produced more capable AI, this exponential trend suggests AI systems may rapidly surpass today's performance levels, with major implications for developers, businesses, researchers, and policymakers planning for the future.

If you follow AI developments and wonder why progress feels like it's accelerating, a new analysis offers a striking answer: the computing power devoted to training the biggest AI systems has been growing at a pace that dwarfs even Moore's Law. This matters for anyone trying to anticipate where machine learning is headed, from developers planning projects to businesses thinking about adoption timelines.

The headline finding

The analysis tracks the total amount of compute used in the largest AI training runs going back to 2012. What it reveals is exponential growth with a doubling time of just 3.4 months. For context, Moore's Law — the famous observation that chip density, and by extension computing capability, roughly doubled every two years — looks almost leisurely by comparison.

Over the period since 2012, this growth compounds to something remarkable: the compute behind the biggest training runs has expanded more than 300,000 times. If progress had simply followed Moore's Law over that same stretch, we'd expect a gain of roughly 7x. The gap between those two numbers tells you how unusual the current era of AI development really is.

Why compute matters so much

It's worth stepping back and asking why raw computing power is such a big deal for AI. Over the past decade, some of the most significant leaps in capability — better language understanding, sharper image recognition, more capable game-playing systems — have come not from entirely new theories but from scaling up existing methods. Bigger models, fed more data, trained with more processing power, tend to simply work better.

That makes compute a reasonable proxy for tracking the field's trajectory. When the resources poured into training grow this quickly, the capabilities of the resulting systems tend to climb alongside them.

What happens if the trend continues

The analysis doesn't claim this pace will last forever — exponential trends in technology rarely do, since they eventually run into physical, economic, or practical limits. But the key takeaway is a planning one: as long as this trend holds, we should expect AI systems to reach performance levels far beyond what today's models can do, and possibly on a much shorter timeline than most people assume.

That has implications worth thinking about now rather than later. Systems that seem like research curiosities today could become practical tools surprisingly quickly. Organizations, researchers, and policymakers all have a stake in understanding what it means when the capabilities ceiling keeps rising this fast.

The bottom line

The compute invested in cutting-edge AI has grown over 300,000-fold since 2012, doubling every 3.4 months — a pace roughly seven times faster than Moore's Law in terms of doubling period. Because more compute has consistently translated into better AI, this trend is one of the clearest signals we have about where the field is going. Preparing for much more capable systems isn't speculation; it's a reasonable response to a measurable, ongoing shift.

Note: One figure in the original analysis was later corrected; the 3.4-month doubling time reflects the corrected data.

Comments (0)

  1. No comments yet. Be the first to share what worked for you.

Leave a comment

Comments are reviewed before they appear. Your email address is not published.