A forecast from International Data Corporation (IDC) predicts that shipments of ‘AI PCs’ that have built-in capability to run generative AI tasks locally will grow from nearly 50 million units in 2024 to more than 167 million in 2027, representing nearly 60% of all PC shipments worldwide.
► Devices with built-in neural processing units (NPU) will quickly start to dominate sales
► Higher-performance NPU devices expected to trigger updates to Windows 11
‘The PC industry is running fast to capitalise on the expected benefits of bringing AI capabilities down from the cloud to the client’, said Tom Mainelli, group vice president, devices and consumer research. ‘Promises around enhanced user productivity via faster performance, plus lower inferencing costs, and the benefit of on-device privacy and security, have driven strong IT decision-maker interest in AI PCs. In 2024, we'll see AI PC shipments begin to ramp, and over the next few years, we expect the technology to move from niche to a majority.’
Until recently, running an AI task locally on a PC was done on the CPU, GPU, or a combination of the two. However, this can have a negative impact on the PC's performance and battery life because these chips are not optimised to run AI efficiently. PC silicon vendors have now introduced AI-specific chips, called neural processing units (NPUs), that run these tasks more efficiently.
To date, IDC has identified three types of NPU-enabled AI PCs:
- Hardware-enabled AI PCs include a NPU that offers <40 tera operations per second (TOPS) performance and typically enables specific AI features within apps to run locally. Qualcomm, Apple, AMD, and Intel are all shipping chips in this category today.
- Next-generation AI PCs include a NPU with 40–60 TOPS performance and an AI-first operating system (OS) that enables persistent and pervasive AI capabilities in the OS and apps. Qualcomm, AMD, and Intel are all expected to launch future chips for this category, with delivery likely to begin in 2024. Microsoft is also expected to roll out major updates (and updated system specifications) to Windows 11 to take advantage of these high-TOPS NPUs.
- Advanced AI PCs are PCs that offer >60 TOPS of NPU performance. While no silicon vendors have announced such products, IDC expects them to appear in the coming years. This IDC forecast does not include advanced AI PCs, but they will be incorporated into future updates.
In 2024, we'll see AI PC shipments begin to ramp, and over the next few years, we expect the technology to move from niche to a majority
While shipments of hardware-enabled AI PCs will ramp up quickly over the next two years, next-generation AI PCs are forecast to dominate the market by the end of the forecast. IDC believes shipments of next-generation AI PCs will be double that of hardware-enabled AI PCs by 2027. Many of these AI PCs will be sold to commercial buyers, but consumers will have much to look forward to in the coming AI PC age, including potential improvements in PC gaming and digital content creation.
There are three primary technical reasons for bringing AI workloads from the cloud to the client:
- Enhance performance by eliminating the round trip that current AI workloads must make to the cloud and back over the network
- Enhance privacy and security by keeping data on the device versus in motion
- Lower the cost by limiting the need to access costly cloud resources
