Implementing AI: Hardware Challenges: Ultra-Low Power AI at the Edge with Lattice sensAI: The complete solution for AI inference - Matt Holdsworth, Lattice Semiconductors Inc
•
0 likes•88 views
In this session we will give an introduction to Lattice’s sensAI solution stack including the latest enhancements to support higher accuracy, lower-latency AI applications. sensAI is Lattice’s award winning AI solutions stack providing a complete suite of material for deploying AI at the edge of the network including software tools, hardware platforms, IP, reference designs and production ready NN models. The Implementing AI: Hardware Challenges, hosted by KTN and eFutures, is the first event of the Implementing AI webinar series to address the challenges and opportunities that realising AI for hardware present. There will be presentations from hardware organisations and from solution providers in the morning; followed by Q&A. The afternoon session will consist of virtual breakout rooms, where challenges raised in the morning session can be workshopped. Artificial Intelligence now impacts every aspect of modern life and is key to the generation of valuable business insights. Implementing AI webinar series is designed for people involved in the management and implementation of AI based solutions – from developers to CTOs. Find out more: https://ktn-uk.co.uk/news/just-launched-implementing-ai-webinar-series
Recommended
Recommended
More Related Content
What's hot
What's hot (18)
Similar to Implementing AI: Hardware Challenges: Ultra-Low Power AI at the Edge with Lattice sensAI: The complete solution for AI inference - Matt Holdsworth, Lattice Semiconductors Inc
Similar to Implementing AI: Hardware Challenges: Ultra-Low Power AI at the Edge with Lattice sensAI: The complete solution for AI inference - Matt Holdsworth, Lattice Semiconductors Inc (20)
More from KTN
More from KTN (20)
Recently uploaded
Recently uploaded (20)
Implementing AI: Hardware Challenges: Ultra-Low Power AI at the Edge with Lattice sensAI: The complete solution for AI inference - Matt Holdsworth, Lattice Semiconductors Inc
- 1. LATTICE RISING 2020 Delivering Milliwatt AI to the Edge with Ultra-Low Power FPGAs Matt Holdsworth FAE Lattice Semiconductors matt.holdsworth@latticesemi.com
- 2. - NASDAQ: LSCC2 Rapidly Emerging Edge Computing Trend Edge Networking Cloud IoT Communication Gateway Wireless / Wireline Access Core Network Driven by Latency, Privacy, and Bandwidth Limitations Unit growth for edge devices with AI will explode increasing over 110% CAGR over the next five years – Semico Research
- 3. - NASDAQ: LSCC3 HARDWARE PLATFORMS IP CORES SOFTWARE TOOLS REFERENCE DESIGNS / DEMOS CNN Compact Accelerator CNN Accelerator UPduino + Himax Shield – iCE40 UltraPlus FPGA Embedded Vision Development Kit – ECP5 FPGA 1 mW, 5.5 mm2, 1/8/16 bits 1 W, 100 mm2, 1/8/16 bits CUSTOM DESIGN SERVICES Smart CarSmart Home Smart City Smart Factory Neural Network Compiler Ultra Low Power Small Form Factor Customizable Neural Network Accelerators Key Phrase Detection Object Counting Object Identification Human Presence Detection Face Tracking Hand Gesture Detection
- 4. - NASDAQ: LSCC4 Focus Applications Focus Applications Object Detection Human Machine Interface (HMI) Object Identification Defect detection in smart security and embedded vision cameras Feature extraction enabling navigation of robots Key Phrase detection to control smart appliances
- 5. - NASDAQ: LSCC5 Reference Design / Demo – Human Presence Detection FEATURES Sensor CMOS image sensor Speed 5 frames per second Power 7 mW on iCE40 UltraPlus ALWAYS ON HUMAN DETECTION IN APPLIANCE LOW POWER HUMAN DETECTION FOR WAKE ON APPROACH FOR LAPTOPS AND PRINTERS
- 6. - NASDAQ: LSCC6 Reference Design / Demo Object Counting FEATURES Sensor CMOS image sensor Speed 17 frames per second - Lower Latency Power 850 mW on ECP5-85K HUMAN DETECTION IN VIDEO SECURITY DEVICES HUMAN COUNTING IN RETAIL CAMERA APPLICATIONS DEFECT DETECTION AND OPERATOR COMPLIANCE IN SMART FACTORY CAMERAS Defect Detected Type: Crack
- 7. - NASDAQ: LSCC7 Popular sensAI Accelerator Use Cases Post Processing Preprocessing PreprocessingStand-alone
- 8. - NASDAQ: LSCC8 Hardware Platforms Modular Platforms for Rapid Prototyping Key features ▪ Video and Audio sensors ▪ Compact 22 x 50 mm ▪ Includes HM01B0 image sensor board ▪ Arduino Micro form factor UltraPlus board HM01B0 UPduino Shield Board Key features ▪ Video and Audio sensors ▪ Compact 22 x 50 mm ▪ Includes HM01B0 image sensor board ▪ Arduino Micro form factor UltraPlus board Key features ▪ Video and Audio sensors ▪ Compact 22 x 50 mm ▪ Includes HM01B0 image sensor board ▪ Arduino Micro form factor UltraPlus board Embedded Vision Development Kit Key features ▪ ECP5 FPGA consuming under 1 W of power consumption ▪ Flexible video connectivity with support for MIPI CSI-2, eDP, HDMI, GigE Vision, USB 3.0, and more
- 9. - NASDAQ: LSCC9 Software Tools Neural Network Compiler ▪ Implement networks developed using standard frameworks into Lattice FPGAs without prior RTL experience ▪ Rapidly analyze, simulate, and compile CNNs/BNNs for implementation on Lattice sensAI IP cores Key Features
- 10. - NASDAQ: LSCC10 Customizable Reference Designs Trained Model Quantized Weights and Instructions FPGA Bitstream Training FPGA Design NN Models NN IP System Interface Training Dataset Training Scripts NN Compiler Lattice sensAI Components Lattice FPGA Design Tools ML Frameworks
- 11. - NASDAQ: LSCC11 PERFORMANCE POWER 1 fps 5 fps MCU 2W 400mW SoC 5x FASTER 5x LOWER Sensors MCU Results Lattice CrossLink-NX SRAM (weights / activations) Sensor Interface Neural Network Accelerators ALWAYS-ON HUMAN COUNTING Higher Performance and Lower Power with CrossLink-NX ECP5-45K NX-40K 10 fps 2x FASTER ECP5-45K 200mW NX-40K2x LOWER
- 12. - NASDAQ: LSCC12 HIGHER ACCURACY REFERENCE DESIGNS HIGHER SPEED LOWER POWER Summary of Latest sensAI Updates CrossLink-NX, the dedicated embedded vision and AI inference FPGA, provides the highest accuracy at the lowest power ECP5 FPGA extends support to MobileNet and Resnet for higher speed processing at high accuracy iCE40 UltraPlus, the ultra- low power edge AI accelerator now delivers higher accuracy at the lowest power New and updated demos and end-to-end reference designs Key Phrase Detection Human Identification Human Presence Detection Object Counting with MobileNet
- 13. - NASDAQ: LSCC13 Reference Design ▪Where to find sensAI page • Applications -> AI/Machine Learning
- 14. - NASDAQ: LSCC14 Where to find Demos and Reference Designs ▪ Demos: • Provided as bitstream and Quickstart Guide • Allows easy demonstration of functionality. ▪ RDs: • Complete solution: RTL Code, Training Scripts, Dataset, Complete User Guide • Allows user to reproduce solution and reuse in own design framework.
- 15. - NASDAQ: LSCC15 HARDWARE PLATFORMS IP CORES SOFTWARE TOOLS REFERENCE DESIGNS / DEMOS CNN Compact Accelerator CNN Accelerator UPduino + Himax Shield – iCE40 UltraPlus FPGA Embedded Vision Development Kit – ECP5 FPGA 1 mW, 5.5 mm2, 1/8/16 bits 1 W, 100 mm2, 1/8/16 bits CUSTOM DESIGN SERVICES Smart CarSmart Home Smart City Smart Factory Neural Network Compiler Ultra Low Power Small Form Factor Customizable Neural Network Accelerators Key Phrase Detection Object Counting Object Identification Human Presence Detection Face Tracking Hand Gesture Detection