The Rise of Neural Processing Units: A Deep Dive into Microsoft's AI Chips

• Microsoft

Suppose you've been following the latest technological updates. In that case, you may have heard about Neural Processing Units (NPUs) and wondered what they are and why they are generating a buzz in the tech world, particularly with tech giant Microsoft.

"In the realm of AI, the power of processing lies within the chip."

What are NPUs?

NPU stands for Neural Processing Unit, sometimes called Neural processor. These are specialized processors designed to accelerate machine-learning tasks. In essence, they are dedicated AI chips specifically engineered to alleviate the load on your computer's CPU and GPU during the execution of AI-related workloads.

AI is ubiquitous in today's digital world, with applications ranging from ChatGPT, the internet's favorite chatbot, to facial recognition systems and photo editing software. Consequently, the advantages of having a chip exclusively devoted to managing these tasks continually expand.

The Power of NPUs

NPUs can handle machine learning workloads up to 10,000 times faster than a standard GPU. They are also more power-efficient, making them a crucial addition to hardware running AI tools.

Microsoft's Interest in NPUs

Microsoft has shown a strong interest in AI, promising an AI-powered Copilot assistant to Windows and Microsoft 365 shortly. The recently announced Surface Laptop Studio 2 will feature a custom-designed NPU developed by Intel, highlighting Microsoft's commitment to integrating AI into their hardware.

Why are NPUs important?

Soon, it is anticipated that there won't be any laptops without a built-in neural processor. This may sound like a bold prediction, but the ubiquity of these chips is inevitable. Key players in the tech industry, such as Apple and Nvidia, are also focusing on AI. Apple is investing in a ChatGPT competitor, while Nvidia has been reaping the benefits of its long-standing efforts to prioritize AI hardware.

With Microsoft's overt efforts to integrate AI into Windows 11 and Apple's plans to incorporate machine learning features into macOS and iOS, it's clear that AI is here to stay. As computer hardware generations progress, this growing reliance on AI implies that NPUs will soon become common in our devices.

Microsoft's Future-Proof Strategy

Microsoft's Surface product line is a prime example of a brand that has future-proofed its new laptops and tablets for the AI generation. The new Surface Laptop Studio 2 is the first laptop to feature Intel's new NPU chip, making it more appealing to consumers seeking a new device. Notably, the previous Surface Pro 9 5G also featured an NPU, albeit a less powerful one made by Qualcomm instead of Intel.

Other tech companies like Apple also integrate NPUs into their devices. Like the M2 chip found in the most recent 15-inch MacBook Air, Apple's M-series silicon features its multi-core neural processor, which Apple calls a 'neural engine.'

Given the increasing integration of AI into our daily tech usage, investing in a device featuring an NPU could be a wise decision. With third-party laptop manufacturers likely to catch up soon, having hardware capable of handling AI will become increasingly important.