On-Device People Detection Built on Arm
One of the hottest areas of IoT development today is imaging. Whether it’s video doorbells, conference-room monitoring, home security cameras or smart retail applications, innovative companies are developing cost-effective imaging solutions that leverage artificial intelligence (AI) and machine learning (ML).
Plumerai, headquartered in London, specializes in enabling complex AI-assisted computer vision tasks efficiently on small, embedded devices. These tasks include people detection, identifying familiar faces, vehicles, and pets. Plumerai engineers have developed a real-time people detection application and ported it to run on the Renesas RA8D1 microcontroller (MCU), based on the Arm Cortex-M85 core, making use of Arm Helium vector extensions to accelerate the neural network.
4x speedup of people detection through Helium acceleration.
Performance boost to 13 frames per second (FPS).
Increased imaging speed, enhancing accuracy and efficiency.
4x Speedup of People Detection with Arm
Plumerai selected the Arm architecture because of its extensive reach and ecosystem. Engineers leveraged the Arm Cortex-M85 CPU with Arm Helium technology to accelerate their people-detection neural networks.
Arm Helium is a vector extension for Cortex-M-class processors that provides enhanced capabilities for executing AI and ML workloads on small, power-efficient devices. Helium includes hardware and software optimizations that help accelerate neural network model execution on Cortex-M processors, making them suitable for various applications, including smart sensors, IoT devices, wearables, and more.
Leveraging Neural Networks
The Plumerai approach to compact neural networks involves vertical integration and considering all AI layers together. In other words, they don’t treat data, models, training, inference, and hardware separately. This holistic approach is vital for efficiency.
This approach doesn’t just focus on the model architecture; that’s just a fraction of the entire process. It considers how components are intricately tied to data. Data is crucial for tiny neural networks, so gathering, curating, and correctly labeling training data is essential.
Discover the Real-World Impact of Edge AI
Explore in-depth use cases that show how edge AI is powering the next generation of IoT, solving real-world problems, driving faster decisions, and lowering costs through smarter operations right at the device level.
- Plumerai develops Arm-optimized people detection AI for smart cameras and embedded vision.
- Arm Cortex-M85 with Helium delivers 13 FPS inference on low-power microcontrollers.
- Running fully on-device, Plumerai enables privacy-friendly, always-on detection.
- Arm tools help optimize small neural networks for speed and efficiency.
- With Arm, Plumerai delivers real-time vision AI in constrained, cost-sensitive environments.