GestIC® Technology
Gesture Recognition Kit
https://www.pantechsolutions.ne
t/gesture-kit
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 2
Agenda
Introduction
MGC3130 System
Core Features
(Colibri Suite)
Pantech Gesture Kit
Resources & Summary
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 3
intuitive fun
gadgets
Applications
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 4
Technology Basics –How it works
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 5
No Blind Spots
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 6
fast data sampling at 200 Hz
32-bit signal processing unit
mouse-like resolution of 150 dpi
super low noise analog front end
self calibration
70-130 kHz range - no RF interference
frequency hopping against noise
no environmental influences
self wake-up at 150 µW
field upgradable
Colibri Gesture Suite on-chip
Smart Features
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 7
Colibri Gesture Suite
wake-up on approach
x/y/z hand position
flick gestures
circle gestures
symbol gestures
Ease of Design
sensor signals
gestures
x/y/z
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 8
0
200
400
600
800
1000
1200
Battery Efficiency
mW
>
GestIC®
Technology
Other
45µA to
max 30mA!*
lowest power
90%
always-on
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 9
Low Power
9 µA
30 mA
Iavg
current
Deep Sleep
Mode
Self Wake-Up Mode
under self control with presence detection
Processing
Mode
under Host control Approach Scan Calibration Approach Scan Calibration Approach Scan full operation
* @ 3.3V, typical
IScan = 45 µA*
@ 150 ms scan
time
10-150ms
2sec-10sec
Note: Not relevant for gesture only apps!
ICalib = 440 µA*
@ 10 sec calib (incl. 150 ms Iscan)
IPeak = 30 mA*
Mobile friendly
Isleep = 9 µA*
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 10
Agenda
Introduction
MGC3130 System
Core Features
(Colibri Suite)
Pantech Gesture Kit
Resources & Summary
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 11
Near Field Sensing
Host Controller
MCU/APPS Processor
Electrode
E-Field
MGC3130
Digital
Position
Tracking
Gestures
Recognizer
Analog
GestIC® Technology
I2C™ Interface
Utilizes electrical
near field sensing to
sense user‘s action
MGC3130
processes
signals into
positions and
gestures
Host uses the
gesture data to
control the user
interface
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 12
MGC3130 System
Main System Building Blocks
MGC3130 Controller
Embedded GestIC® Technology
Library / Colibri Suite
External electrodes
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 13
MGC3130 System
low noise AFE
5 ch Rx / 1Tx
Storage
32k Flash / 12K RAM
28-pin QFN package
5 x 5 x 0.9 mm
4pin IO
2x I2C™ / SPI
E-field lines
Electrode
Colibri Suite
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 14
External Electrodes
Frame shape electrodes
1x Transmitter electrode Tx
4–5x Receiving electrodes Rx
2-Layer stack-up
Optional GND layer
MGC3130 System
South
West
East
Center
North
Top Rx Layer
Bottom Tx Layer
Rx
Tx
GND
Isolation
GND
Initially MGC3130 will only support
frame shape electrodes
with an aspect ratio of 1:1 to 1:2.
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 15
MGC3130 System
GestIC® Technology Library
Operational code for MGC3130 SPU
Binary preprogrammed in the chip’s flash memory
Configurable, updatable
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 16
Agenda
Introduction
MGC3130 System
Core Features
(Colibri Suite)
Sabrewing Evaluation Kit
Resources & Summary
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 17
Colibri Suite
Data acquisition
Digital signal processing
Interpretation
Included:
Signal Validation
Digital filtering
Automatic Frequency Hopping
Calibration
Output of data streams
Output of position / gesture events
Digital Signal Processing
Core Features
Colibri Suite
Position
Tracking
Gesture
Recognition
Approach
Detection
Frequency
Hopping
Calibration
Signal
Validation
Approach
Detection
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 18
Hidden Markov Model
Gesture Recognition
model to detect and
classify hand movement
patterns performed inside
the sensing area.
classification based
Gesture Recognition
Gesture begins when:
Entering the active space from outside
Moving after a resting period
Gesture ends when:
Resting within the active space
Leaving active space
Max. gesture duration exceeded
SensorSignalsSensorSignals
startstart timetimeendend
Sequence of sensor signals during a flickSequence of sensor signals during a flick
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 19
Position Tracking
Three-dimensional hand position over
time and area
Absolutely to the defined origin of the
Cartesian coordinate system (x, y, z)
Continuously acquired in parallel to
Gesture RecognitionPerformance:
Position rate: 200 positions/sec
Spatial resolution: up to 150 dpi
Parameterization:
Alpha2 release: Sabrewing 7”
Beta releases: Parameters variable to fit to customized
electrodes
Position xyzPosition xyz
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 20
Approach Detection for Power saving
Average current consumption in a calibration aware
Approach Detection Mode is 466 µA at VDD= 3.3V, 20
ms Approach Scans and 10 sec Calibration Scans
Wake-up signal from
host detected
Gesture detected
(Approach)
No user interaction
(Timeout)
t[s]
I
Ids=9uA
Ipeak=30mA
Iavg=50...700uA
(*)
Deep sleep Self Wake-Up Self Wake-UpProcessing
Calibration Approach scans
(*) depending on
use case
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 21
Dependencies for Custom Designs
Parameterization of AFE & DSP required
- Electrode design rules required
- Development Kit and reference designs
required
Analog Front End (AFE)
parameterization
DSP parameterization:
Tracking: Beta 1 release (CQ2)
Gestures: Beta 2 release (CQ3)
HMM Trainer: Beta 3 release (CQ4)GestIC Design Guide:
Beta 1 release (CQ2)
Hillstar + Aurea Tooling:
Beta 1 release in (CQ2)
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 22
Agenda
Introduction
MGC3130 System
Core Features
(Colibri Suite)
Pantech Gesture Kit
Resources & Summary
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 23
MGC3130 Pantech Single Zone Evaluation Kit
Pantech Gesture Kit
1. Microchip MGC3130 MCU
2. Built in 7” electrodes
3. I²C™ to USB bridge (PIC)
4. USB powered
and Microchip Colibri Suite
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 24
Electrodes and Usage
Built in 7” electrodes
3 Layer PCB
(Rx – Tx - GND)
Parameterization for
45° hand posture
Rx electrode Rx electrode
Tx electrode
45° hand posture
Tx: 35 µm
Rx Electrode: 18 µm
GND: 18 µm
Not Used: 35 µm
935µm
1.546mm
540µm
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 25
MGC3130 Interface Model
Application Software
e.g. Aurea - GUI for MGC3130
Visualization and Control
GestIC® Technology API
Abstraction layer for MCG3130
messages
Bridge
Optional conversion of HW
interfaces (e.g. I²C™ to USB
withPIC 18F14K50)
For provisioning of data within the
OS an OS driver may be needed
GestIC Technology Library
Operational code for MGC3130
including Colibri Suite
Note: GestIC Technology library
streams Position data every 5 ms
and Gestures as they occur
MGC3130 Software Interface
Application Host
MGC3130
Application Software
GestIC® API
- Message decoding
- Buffering
GestIC® Library
API Structures
Message Interface
Bridge
Application Host
MGC3130
Application Software
- Message decoding
- Buffering
GestIC® Library
Message Interface
I²C
USB
I²C
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 26
Aurea Visualization Software
Evaluate Colibri Suite Discover Signals Setup MGC3130
1. Positions Tracking
2. Gesture Recognition
3. Demo applications
1. View signals
2. Write log file
3. Advanced features
1. Signal matching
2. Tx settings
3. Update GestIC Library
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 27
Pantech Gesture Start-up
Requirements
1. PC with Windows® XP, Windows 7 or
Windows 8 operating system and
USB 2.0 port
2. Sabrewing Evaluation Board
3. Latest MGC3130 software release
package
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 28
Agenda
Introduction
MGC3130 System
Core Features
(Colibri Suite)
Sabrewing Evaluation Kit
Resources & Summary
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 29
Resources
http://www.microchip.com/GestIC
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 30
MGC3130 Summary
Thank You
© 2014 www.pantechsolutions.net All Rights Reserved. Slide 32
Trademarks
The Microchip name and logo, the Microchip logo, dsPIC, KeeLoq, KeeLoq logo, MPLAB, PIC, PICmicro,
PICSTART, PIC32 logo, rfPIC and UNI/O are registered trademarks of Microchip Technology Incorporated in the
U.S.A. and other countries.
FilterLab, Hampshire, HI-TECH C, Linear Active Thermistor, MXDEV, MXLAB, SEEVAL and The Embedded Control
Solutions Company are registered trademarks of Microchip Technology Incorporated in the U.S.A.
Analog-for-the-Digital Age, Application Maestro, chipKIT, chipKIT logo, CodeGuard, dsPICDEM, dsPICDEM.net,
dsPICworks, dsSPEAK, ECAN, ECONOMONITOR, FanSense, HI-TIDE, In-Circuit Serial Programming, ICSP,
Mindi, MiWi, MPASM, MPLAB Certified logo, MPLIB, MPLINK, mTouch, Omniscient Code Generation, PICC, PICC-
18, PICDEM, PICDEM.net, PICkit, PICtail, REAL ICE, rfLAB, Select Mode, Total Endurance, TSHARC,
UniWinDriver, WiperLock and ZENA are trademarks of Microchip Technology Incorporated in the U.S.A. and other
countries.
SQTP is a service mark of Microchip Technology Incorporated in the U.S.A.
All other trademarks mentioned herein are property of their respective companies.
© 2013, Microchip Technology Incorporated, All Rights Reserved.

MG3130 gesture recognition kit

  • 1.
    GestIC® Technology Gesture RecognitionKit https://www.pantechsolutions.ne t/gesture-kit
  • 2.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 2 Agenda Introduction MGC3130 System Core Features (Colibri Suite) Pantech Gesture Kit Resources & Summary
  • 3.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 3 intuitive fun gadgets Applications
  • 4.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 4 Technology Basics –How it works
  • 5.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 5 No Blind Spots
  • 6.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 6 fast data sampling at 200 Hz 32-bit signal processing unit mouse-like resolution of 150 dpi super low noise analog front end self calibration 70-130 kHz range - no RF interference frequency hopping against noise no environmental influences self wake-up at 150 µW field upgradable Colibri Gesture Suite on-chip Smart Features
  • 7.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 7 Colibri Gesture Suite wake-up on approach x/y/z hand position flick gestures circle gestures symbol gestures Ease of Design sensor signals gestures x/y/z
  • 8.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 8 0 200 400 600 800 1000 1200 Battery Efficiency mW > GestIC® Technology Other 45µA to max 30mA!* lowest power 90% always-on
  • 9.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 9 Low Power 9 µA 30 mA Iavg current Deep Sleep Mode Self Wake-Up Mode under self control with presence detection Processing Mode under Host control Approach Scan Calibration Approach Scan Calibration Approach Scan full operation * @ 3.3V, typical IScan = 45 µA* @ 150 ms scan time 10-150ms 2sec-10sec Note: Not relevant for gesture only apps! ICalib = 440 µA* @ 10 sec calib (incl. 150 ms Iscan) IPeak = 30 mA* Mobile friendly Isleep = 9 µA*
  • 10.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 10 Agenda Introduction MGC3130 System Core Features (Colibri Suite) Pantech Gesture Kit Resources & Summary
  • 11.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 11 Near Field Sensing Host Controller MCU/APPS Processor Electrode E-Field MGC3130 Digital Position Tracking Gestures Recognizer Analog GestIC® Technology I2C™ Interface Utilizes electrical near field sensing to sense user‘s action MGC3130 processes signals into positions and gestures Host uses the gesture data to control the user interface
  • 12.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 12 MGC3130 System Main System Building Blocks MGC3130 Controller Embedded GestIC® Technology Library / Colibri Suite External electrodes
  • 13.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 13 MGC3130 System low noise AFE 5 ch Rx / 1Tx Storage 32k Flash / 12K RAM 28-pin QFN package 5 x 5 x 0.9 mm 4pin IO 2x I2C™ / SPI E-field lines Electrode Colibri Suite
  • 14.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 14 External Electrodes Frame shape electrodes 1x Transmitter electrode Tx 4–5x Receiving electrodes Rx 2-Layer stack-up Optional GND layer MGC3130 System South West East Center North Top Rx Layer Bottom Tx Layer Rx Tx GND Isolation GND Initially MGC3130 will only support frame shape electrodes with an aspect ratio of 1:1 to 1:2.
  • 15.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 15 MGC3130 System GestIC® Technology Library Operational code for MGC3130 SPU Binary preprogrammed in the chip’s flash memory Configurable, updatable
  • 16.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 16 Agenda Introduction MGC3130 System Core Features (Colibri Suite) Sabrewing Evaluation Kit Resources & Summary
  • 17.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 17 Colibri Suite Data acquisition Digital signal processing Interpretation Included: Signal Validation Digital filtering Automatic Frequency Hopping Calibration Output of data streams Output of position / gesture events Digital Signal Processing Core Features Colibri Suite Position Tracking Gesture Recognition Approach Detection Frequency Hopping Calibration Signal Validation Approach Detection
  • 18.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 18 Hidden Markov Model Gesture Recognition model to detect and classify hand movement patterns performed inside the sensing area. classification based Gesture Recognition Gesture begins when: Entering the active space from outside Moving after a resting period Gesture ends when: Resting within the active space Leaving active space Max. gesture duration exceeded SensorSignalsSensorSignals startstart timetimeendend Sequence of sensor signals during a flickSequence of sensor signals during a flick
  • 19.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 19 Position Tracking Three-dimensional hand position over time and area Absolutely to the defined origin of the Cartesian coordinate system (x, y, z) Continuously acquired in parallel to Gesture RecognitionPerformance: Position rate: 200 positions/sec Spatial resolution: up to 150 dpi Parameterization: Alpha2 release: Sabrewing 7” Beta releases: Parameters variable to fit to customized electrodes Position xyzPosition xyz
  • 20.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 20 Approach Detection for Power saving Average current consumption in a calibration aware Approach Detection Mode is 466 µA at VDD= 3.3V, 20 ms Approach Scans and 10 sec Calibration Scans Wake-up signal from host detected Gesture detected (Approach) No user interaction (Timeout) t[s] I Ids=9uA Ipeak=30mA Iavg=50...700uA (*) Deep sleep Self Wake-Up Self Wake-UpProcessing Calibration Approach scans (*) depending on use case
  • 21.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 21 Dependencies for Custom Designs Parameterization of AFE & DSP required - Electrode design rules required - Development Kit and reference designs required Analog Front End (AFE) parameterization DSP parameterization: Tracking: Beta 1 release (CQ2) Gestures: Beta 2 release (CQ3) HMM Trainer: Beta 3 release (CQ4)GestIC Design Guide: Beta 1 release (CQ2) Hillstar + Aurea Tooling: Beta 1 release in (CQ2)
  • 22.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 22 Agenda Introduction MGC3130 System Core Features (Colibri Suite) Pantech Gesture Kit Resources & Summary
  • 23.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 23 MGC3130 Pantech Single Zone Evaluation Kit Pantech Gesture Kit 1. Microchip MGC3130 MCU 2. Built in 7” electrodes 3. I²C™ to USB bridge (PIC) 4. USB powered and Microchip Colibri Suite
  • 24.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 24 Electrodes and Usage Built in 7” electrodes 3 Layer PCB (Rx – Tx - GND) Parameterization for 45° hand posture Rx electrode Rx electrode Tx electrode 45° hand posture Tx: 35 µm Rx Electrode: 18 µm GND: 18 µm Not Used: 35 µm 935µm 1.546mm 540µm
  • 25.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 25 MGC3130 Interface Model Application Software e.g. Aurea - GUI for MGC3130 Visualization and Control GestIC® Technology API Abstraction layer for MCG3130 messages Bridge Optional conversion of HW interfaces (e.g. I²C™ to USB withPIC 18F14K50) For provisioning of data within the OS an OS driver may be needed GestIC Technology Library Operational code for MGC3130 including Colibri Suite Note: GestIC Technology library streams Position data every 5 ms and Gestures as they occur MGC3130 Software Interface Application Host MGC3130 Application Software GestIC® API - Message decoding - Buffering GestIC® Library API Structures Message Interface Bridge Application Host MGC3130 Application Software - Message decoding - Buffering GestIC® Library Message Interface I²C USB I²C
  • 26.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 26 Aurea Visualization Software Evaluate Colibri Suite Discover Signals Setup MGC3130 1. Positions Tracking 2. Gesture Recognition 3. Demo applications 1. View signals 2. Write log file 3. Advanced features 1. Signal matching 2. Tx settings 3. Update GestIC Library
  • 27.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 27 Pantech Gesture Start-up Requirements 1. PC with Windows® XP, Windows 7 or Windows 8 operating system and USB 2.0 port 2. Sabrewing Evaluation Board 3. Latest MGC3130 software release package
  • 28.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 28 Agenda Introduction MGC3130 System Core Features (Colibri Suite) Sabrewing Evaluation Kit Resources & Summary
  • 29.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 29 Resources http://www.microchip.com/GestIC
  • 30.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 30 MGC3130 Summary
  • 31.
  • 32.
    © 2014 www.pantechsolutions.netAll Rights Reserved. Slide 32 Trademarks The Microchip name and logo, the Microchip logo, dsPIC, KeeLoq, KeeLoq logo, MPLAB, PIC, PICmicro, PICSTART, PIC32 logo, rfPIC and UNI/O are registered trademarks of Microchip Technology Incorporated in the U.S.A. and other countries. FilterLab, Hampshire, HI-TECH C, Linear Active Thermistor, MXDEV, MXLAB, SEEVAL and The Embedded Control Solutions Company are registered trademarks of Microchip Technology Incorporated in the U.S.A. Analog-for-the-Digital Age, Application Maestro, chipKIT, chipKIT logo, CodeGuard, dsPICDEM, dsPICDEM.net, dsPICworks, dsSPEAK, ECAN, ECONOMONITOR, FanSense, HI-TIDE, In-Circuit Serial Programming, ICSP, Mindi, MiWi, MPASM, MPLAB Certified logo, MPLIB, MPLINK, mTouch, Omniscient Code Generation, PICC, PICC- 18, PICDEM, PICDEM.net, PICkit, PICtail, REAL ICE, rfLAB, Select Mode, Total Endurance, TSHARC, UniWinDriver, WiperLock and ZENA are trademarks of Microchip Technology Incorporated in the U.S.A. and other countries. SQTP is a service mark of Microchip Technology Incorporated in the U.S.A. All other trademarks mentioned herein are property of their respective companies. © 2013, Microchip Technology Incorporated, All Rights Reserved.