Overview

On-Device People Detection Built on Arm

One of the hottest areas of IoT development today is imaging. Whether it’s video doorbells, conference-room monitoring, home security cameras or smart retail applications, innovative companies are developing cost-effective imaging solutions that leverage artificial intelligence (AI) and machine learning (ML).


Plumerai, headquartered in London, specializes in enabling complex AI-assisted computer vision tasks efficiently on small, embedded devices. These tasks include people detection, identifying familiar faces, vehicles, and pets. Plumerai engineers have developed a real-time people detection application and ported it to run on the Renesas RA8D1 microcontroller (MCU), based on the Arm Cortex-M85 core, making use of Arm Helium vector extensions to accelerate the neural network.

Impact
Arm 4 times acceleration icon

4x speedup of people detection through Helium acceleration.

Arm performace boost icon

Performance boost to 13 frames per second (FPS).

arm-icon-accelerated-time-to-market

Increased imaging speed, enhancing accuracy and efficiency.

         “Because it runs on the microcontroller, we can do everything on the device — we don’t have to send data to the cloud. This is a very privacy-friendly solution.”
          Cedric Nugteren, Software Engineer at Plumerai
Machine Learning People Detection
Technologies Used

4x Speedup of People Detection with Arm

Plumerai selected the Arm architecture because of its extensive reach and ecosystem. Engineers leveraged the Arm Cortex-M85 CPU with Arm Helium technology to accelerate their people-detection neural networks.

Arm Helium is a vector extension for Cortex-M-class processors that provides enhanced capabilities for executing AI and ML workloads on small, power-efficient devices. Helium includes hardware and software optimizations that help accelerate neural network model execution on Cortex-M processors, making them suitable for various applications, including smart sensors, IoT devices, wearables, and more.

Abstract network mesh on purple background

Leveraging Neural Networks

The Plumerai approach to compact neural networks involves vertical integration and considering all AI layers together. In other words, they don’t treat data, models, training, inference, and hardware separately. This holistic approach is vital for efficiency.

This approach doesn’t just focus on the model architecture; that’s just a fraction of the entire process. It considers how components are intricately tied to data. Data is crucial for tiny neural networks, so gathering, curating, and correctly labeling training data is essential.

Full Implementation Here
Ebook expanded cover of Edge AI - Enabling Smart IoT Applications

Discover the Real-World Impact of Edge AI

Explore in-depth use cases that show how edge AI is powering the next generation of IoT, solving real-world problems, driving faster decisions, and lowering costs through smarter operations right at the device level.

Read eBook
KEY TAKEAWAYS
  • Plumerai develops Arm-optimized people detection AI for smart cameras and embedded vision.
  • Arm Cortex-M85 with Helium delivers 13 FPS inference on low-power microcontrollers.
  • Running fully on-device, Plumerai enables privacy-friendly, always-on detection.
  • Arm tools help optimize small neural networks for speed and efficiency.
  • With Arm, Plumerai delivers real-time vision AI in constrained, cost-sensitive environments.

Explore Similar Stories

ROBOTIS AI Autonomous Robots

Robot Innovation

Pioneering a new era through the development of artificial intelligence that enables robots with physical intelligence to co-exist with humans.

Raspberry Pi for Home and Industry

Accessible Computing for Everyone

Raspberry Pi partners with Arm to make AI efficient, flexible, and cost-effective with new capabilities and increased efficiency.

LifeSignals

Biosensors for Patient Monitoring

Wireless patches let clinics track patient health at home, in the hospital, and in quarantine environments.

Discover More Success Stories