OVERVIEW

Powering Android Smartphones’ On-Device AI With SME2

Google and Arm are transforming mobile AI with Scalable Matrix Extension (SME2), a set of advanced matrix compute instructions integrated into Android through KleidiAI. This enables developers to deliver efficient, real-time AI across billions of devices without rewriting code. From real-time translation to intelligent assistants, SME2 accelerates generative AI experiences directly on CPUs, reducing latency and improving energy efficiency.

IMPACT
AI chip icon

Efficient AI inference

SME2 boosts CPU performance for vision, language, and voice AI tasks.

6x faster speedometer icon

Lower latency

Up to 6x faster AI responses and real-time app experiences.

Developer icon

Developer-Ready

Seamless integration via Arm KleidiAI across Google's XNNPACK, LiteRT, and MediaPipe.

“We're really excited about Arm's new offering (SME2) because it brings additional compute to the CPU. For the first time, we can run these (GenAI) capabilities across a wide range of devices in the ecosystem.”
Oli Gaymond, Head of AI/ML Product, Android, Google
4 layers of chip design
TECHNOLOGIES USED

Arm SME2: Accelerating Android Mobile AI Workloads

SME2 is the latest CPU extension on Arm Lumex CSS Platform, the advanced subsystem for next-gen devices, designed to accelerate matrix-oriented compute workloads directly on device. It improves performance for AI and ML models, especially those that rely on operations like matrix multiplication, common in transformers, convolutional neural networks (CNNs), and large language models (LLMs).

Explore Arm SME2

Arm KleidiAI: Unlock SME2 Performance With Zero Code Changes

Android integrates SME2 using Arm KleidiAI within XNNPACK, LiteRT, MediaPipe and other popular frameworks. This allows AI models like Gemma 3 to deliver 6x faster responses and instant summarization directly on CPUs. Developers benefit automatically by using supported libraries and frameworks.

Learn Arm KleidiAI Optimize Android Apps
RELATED STORIES

Explore Similar Stories

vivo X200 Series Flagship Mobile Phones

Superior Mobile Experiences

Open-source frameworks and models from Meta pave the way for revolutionizing the future of AI innovation at scale on Arm.

Learn More

Stability AI

Transforming On-Device Audio AI

Stability AI partnered with Arm and used Arm KleidiAI to transform on-device audio creation, reducing response times from minutes to seconds on Arm mobile CPUs.

Learn More

Samsung Galaxy S24

Transformational AI Capabilities

Beginning a new era of AI phones that go beyond the current smartphone experience.

Learn More
Discover More Success Stories