The CPU Architecture for the Future of AI
AI Summary
Armv9-A is the latest generation of the Arm A-profile CPU architecture, designed to meet the compute, efficiency, and security demands of AI-driven systems. It introduces Scalable Vector Extension 2 (SVE2) and Scalable Matrix Extension (SME) for higher-throughput data processing, and Realm Management Extension (RME) for confidential computing. These features enable developers and SoC architects to build scalable, secure, and power-efficient platforms across edge and cloud deployments.
Faster Algorithms and Power Efficient Compute, Built with Security in Mind
Armv9-A accelerates the processing of large datasets, which is critical for cutting edge scenarios like genomics and computer vision. All are made possible without the need to recompile software and remain power efficient through improved memory use.
Developers can be assured that data and proprietary programs are built with security in mind, through Arm’s latest confidential compute features. Combined with the latest optimization tools, Armv9-A offers performance improvements without compromising development time or software integrity.
Key Features for Unleashing CPU Performance at Scale
Scalable Vector Extensions optimize the amount of data processed at once, based on available silicon. With the latest iteration, SVE2, algorithms can process more data on more powerful processors, unlocking more high-performance compute scenarios without re-compiling software.
AI applications process large amounts of data, making them power intensive. Arm SME2 boosts AI performance and efficiency with optimized data handling and matrix compute. It improves bandwidth and reduces power use, enabling complex, real-time tasks like generative AI, audio/visual processing, and digital assistants to run locally with lower latency.
BRBE gives a history of recent execution so developers can prioritize optimization tasks, improving the software experience for users. Combining BRBE with other tools enables profiling-based optimization, which recompiles and runs the most optimal code based on real-time usage.
Key Features for Building-In Security from the Ground Up
Realms offer the level of isolation and encryption required to perform confidential computing on Arm. Realms are scalable ‘Trusted Execution Environments’ that protect an application and its data when in use. The contents of a realm, or its processes, cannot be accessed by higher privilege software. Realms are managed through open-source hardware and can extend to accelerators.
Attacks frequently attempt to subvert software control flow. PAC and BTI help ensure control flow integrity by providing defences against return-orientated programming (ROP) and jump-orientated programming (JOP) attacks. Through effective authentication, hackers cannot modify code, or manipulate the control flow of an application.
Spatial and temporal memory safety issues account for 70% of all serious security bugs. MTE helps detect memory safety issues, such as use-after-free or overrun. Both the pointer and data they point to are tagged, so the processor can check permissions at run time.
Inference on Arm CPUs
Our relentless innovation enables the most pervasive CPU architecture for the future of AI, whether in the datacenter or at the edge. We enable the creation of custom silicon to match software strategies, deliver the CPU architecture to create performant software, and provide a comprehensive suite of security features to protect sensitive data, with software libraries that facilitate development cycles. Find out more about the benefits of using Arm CPUs for your AI workloads and why our platform is the most pervasive.
Get Building with Armv9-A Architecture Today
Everything you need to get started with Armv9-A. Includes technical documentation, how-to guides and tutorials.
Flexible Licensing for SoC Designs with Armv9-A Processor Technology
Accelerate your path to silicon success with licensing models that fit your business. Arm Total Access and Arm Flexible Access are designed to bring your ideas to life faster.
Latest Armv9-A News and Resources
News:
Report:
Webinar:
Blogs:
- Arm to Supercharge AI on Android, Powering Next-Gen Features Across Mobile Apps
- Get ready for Arm SME, coming soon to Android
- Next-Generation AI Smartphone Experiences on Armv9 with MediaTek and vivo
- Introducing Armv9 Scalable Matrix Extension for AI Innovation on the Arm CPU
- New Armv9 CPUs for Accelerating AI on Mobile and Beyond
Key Takeaways
Key Takeaways
- Armv9-A is designed to meet the compute and security needs of AI, delivering faster performance for large datasets.
- Features like SVE2 and SME improve memory bandwidth and vector/matrix efficiency for scalable AI workloads.
- Realm Management Extension (RME), MTE, BTI, and PAC provide hardware-enforced runtime protection.
- Armv9-A enables secure, power-efficient computing at both the edge and in the datacenter.
- It supports innovation without requiring software recompilation, helping developers shorten time to deployment.