Spotlight

Beyond Benchmarks: Why Industrial Engineering is the Real Race in AI

Tags: AI infrastructure, hardware optimization, data gravity, AI, semiconductor, large language models, industry
Illustrative graphic
AI disclosure: This article and its audio were drafted with generative AI. A human editor reviewed the facts, sources and final text before publication. The China Technology Review is responsible for its content.

🎙 Listen to a summary of this story

The race for artificial intelligence leadership is moving beyond chatbots and benchmark scores into a harder contest: securing electricity, manufacturing sophisticated components and keeping vast computing systems running reliably.

A model that performs well in a laboratory still needs an industrial foundation before it can serve millions of customers. That means chips, memory, cooling equipment, dependable networks and usable data, supported by engineers who can turn experimental software into an affordable service.

For governments and companies investing in AI, the distinction matters. Research breakthroughs can attract attention and investment. But economic returns depend on whether those breakthroughs work consistently in factories, offices and public services, at costs customers can sustain.

The emerging competition resembles an infrastructure buildout as much as a software revolution. Its constraints are increasingly physical, and overcoming them requires capabilities that cannot be downloaded or assembled overnight.

The race runs through the electricity grid

The scale of the challenge is becoming clearer. In its 2026 analysis of energy and AI, the International Energy Agency said global data centre electricity consumption increased 17% in 2025, while consumption at facilities focused on AI surged 50%.

The agency projects total data centre consumption will roughly double from 485 terawatt-hours in 2025 to 950 terawatt-hours in 2030, approaching 3% of global electricity demand. Those figures cover all data centres, rather than AI alone.

That expansion exposes a mismatch between the pace of digital development and the time required to build its foundations. Software can be updated rapidly. Electricity networks, manufacturing plants and cooling systems require planning, equipment and construction.

Buying powerful processors therefore addresses only part of the problem. Operators must supply them with electricity, remove the heat they generate and connect them efficiently. Equipment failures or network delays can leave expensive computing capacity underused.

The IEA also identified a shortage of high-bandwidth memory, a crucial component for AI chips, that it expects to persist through at least the end of 2027. The constraint illustrates how progress depends on an interconnected supply chain, with potential bottlenecks beyond the processors themselves.

Advanced packaging is another essential capability. Taiwan Semiconductor Manufacturing Co., in its 2025 annual report, describes packaging and chip-stacking technologies designed to support greater interconnectivity and lower power consumption. Such engineering receives less public attention than model launches but helps make increasingly complex computing systems practical.

Cheaper answers still require dependable systems

Efficiency improvements are nevertheless changing the economics of AI. Stanford University’s 2025 AI Index found that the price of querying a model matching GPT-3.5’s performance on one widely used benchmark fell more than 280-fold between November 2022 and October 2024.

That comparison measures the price of achieving a particular benchmark result. It does not mean every AI service became equally cheaper, or that more demanding applications require little computing power.

For businesses, the practical question is how much useful work a system delivers for each pound or dollar spent. A smaller model that handles a defined task reliably may offer greater value than a more powerful model that is slower, more expensive or harder to supervise.

Data presents a similarly practical challenge. A company may hold years of maintenance records, customer correspondence or technical documents, yet still need to correct errors, reconcile formats and establish access controls before an AI application can use them effectively.

The work continues after deployment. A customer service tool must remain available during busy periods. A document assistant needs current information. Both require checks that detect failures before they spread through business processes.

The U.S. National Institute of Standards and Technology’s March 2026 report on monitoring deployed AI identifies challenges spanning functionality, infrastructure, security and human interaction. Its findings underline the distance between demonstrating a model’s capabilities and maintaining a trustworthy service.

Sovereignty depends on industrial capacity

These requirements are reshaping national ambitions. Governments seeking greater control over AI must consider where computing takes place, who supplies essential components and whether domestic organisations can access the infrastructure.

The European Commission’s AI Continent Action Plan, launched in April 2025, brought computing infrastructure, data, skills and adoption into a common strategy. The approach reflects how closely research capacity depends on wider industrial and institutional support.

That does not make complete self-sufficiency a straightforward goal. AI systems draw on specialised suppliers across multiple countries. Reducing dependence requires investment and alternatives, while duplicating every part of the supply chain can be costly.

Nor does building infrastructure guarantee demand. Governments and investors must also establish whether businesses can use the capacity productively and generate returns sufficient to support continued spending.

The implication is that leadership will depend partly on execution: bringing power, equipment, data and expertise together, then converting them into dependable services. Benchmark victories remain valuable. Their lasting significance will be measured in systems that work beyond the laboratory.

Subscribe to CTR

✉ The CTR Newsletter

Discover the best new stories about Chinese technology each week. Subscribe to The CTR newsletter.

Our privacy policy