Why is ML Moving to the Edge?
Arm
Cortex-M
Contextual awarenessSensor fusion
Voice activation Biometrics
More Intelligence at the Edge
Range of “Edge” Applications
•
•
Developing NN Solutions on Cortex-M
Developing NN Solutions on Cortex-M
Arm Cortex-M based MCU Platforms
•
•
•
–
–
–
–
–
NN Models: Memory vs. Ops
•
–
–
Use Case - Keyword Spotting
H/W Constrained NN Model Search
Optimize Models for the Platform
Developing NN Solutions on Cortex-M
–
–
–
–
–
–
–
–
–
NN Model Quantization
•
•
•
•
•
Model Deployment on Cortex-M MCUs
Developing NN Solutions on Cortex-M
•
•
•
Cortex Microcontroller Software Interface Standard (CMSIS)
•
•
•
•
•
CMSIS-NN
•
•
•
•
•
•
•
•
•
•
A11 A12 A13 A14
A21 A22 A23 A24
A31 A32 A33 A34
A41 A42 A43 A44
0
0
0
0
A11
A12
0
A21
A22
0
0
0
A12
A13
A14
A22
A23
A24
0
0
0
A14
A15
0
A24
A25
0
0
A21
A22
0
A31
A32
0
A41
A42
A22
A23
A24
A32
A33
A34
A42
A43
A44
A15
A25
A35
A45
A51 A52 A53 A54 A55
w11 w12 w13
w21 w22 w23
w31 w32 w33
w11 w12 w13 w21 w22 w23 w31 w32 w33
•
•
Convolution: Im2col + Matrix Multiplication
Data Layout in Memory: CHW vs. HWC
Image classification - Convolutional neural network
•
•
Convolutional Neural Network (CNN) on Cortex-M7
•
•
•
Convolutional Neural Network (CNN) on Cortex-M7
Convolutional Neural Network (CNN) on Cortex-M7
•
•
•
•
Summary
•
•
•
•
Summary
Resources
•
•
•
•
•
•
•
•
2929 © 2018 Arm Limited
The Arm trademarks featured in this presentation are registered trademarks or
trademarks of Arm Limited (or its subsidiaries) in the US and/or elsewhere. All
rights reserved. All other marks featured may be trademarks of their respective
owners.
www.arm.com/company/policies/trademarks

"Deep Learning on Arm Cortex-M Microcontrollers," a Presentation from Arm