About The New Hanguang 800 And Chinese AI

Today was the first day of the Apsara Conference, an event that is bringing together some of the brightest minds in technology to discuss the future of cloud computing and AI.

As an Alibaba Cloud MVP, I had the chance to hold Alibaba’s first AI inference chip, the Hanguang 800 NPU, in my hands. After chatting with the people behind this feat, I want to write a bit about my thoughts on the state of AI in China.

Ok, But, What Exactly is the Hanguang 800?

I’m glad you asked! The Hanguang 800 is a powerhouse designed specifically for AI inference tasks. It’s tailor-made for applications like image recognition, natural language processing, and recommendation systems—tasks that require real-time decision-making.

During the conference, Alibaba shared some performance metrics:

78,563 Inferences Per Second (IPS): That’s right, 4x the current best AI chip
Energy Efficiency of 500 IPS/W: That’s 3.3x better than the second-ranked one

Why This Hanguang 800 Release Matter?

This chip isn’t just another piece of hardware. It’s a sign of Alibaba’s vision for the future of AI and cloud computing. By integrating the chip into its cloud infrastructure, Alibaba Cloud is empowering businesses to harness the power of AI without worrying about the underlying complexity, opening up new possibilities for real-time decision-making in industries like healthcare, transportation, and smart cities.

But this is not just about Alibaba. It shows the progress in AI that is happening in China. The chinese government is clear with this with the “New Generation Artificial Intelligence Development Plan”, which aims to make China the world leader in AI by 2030.

At the Apsara Conference, I saw firsthand how companies like Alibaba are driving this vision forward. The Hanguang 800 is a clear example of how Chinese tech giants are not just adopting AI but also developing the hardware and software needed to power it. This level of innovation positions China as a key player in shaping the future of AI on a global scale.

Chip wars? Chinese investors are excited about it.