Perceptual Computing
Upcoming SlideShare
Loading in...5
×
 

Perceptual Computing

on

  • 1,933 views

Presentation by @sulagarcia at Munich MeetUp April 10th about Intel´s Perceptual Computing SDK

Presentation by @sulagarcia at Munich MeetUp April 10th about Intel´s Perceptual Computing SDK

Statistics

Views

Total Views
1,933
Views on SlideShare
1,911
Embed Views
22

Actions

Likes
1
Downloads
40
Comments
0

2 Embeds 22

https://twitter.com 21
http://tweetedtimes.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Perceptual Computing Perceptual Computing Presentation Transcript

  • Perceptual SDK Sulamita Garcia Technical Marketing Engineer
  • /me @sulagarcia Copyright© 2012, Intel Corporation. All rights reserved.*Other brands and names are the property of their respective owners.
  • Intel® Perceptual Computing SDK2013  Gold released  Hand and Fingers tracking (specific IR- depth camera required)  Face recognition, tracking and attribution  Voice and commands recognition (dual-array mic required)  3D objects tracking  Low and high level APIs Free download on intel.com/software/perceptual Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. View slide
  • Intel® Perceptual Computing SDK Mix of algorithms and modules • Directly usable • Can be extended • Hardware accelerated on Intel® platforms Nature user interfaces - gestures, voice… Creating and manipulating 3D content Games - Navigating 3D works, head-coupled perspective4 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. View slide
  • Creative* Camera  30fps RGB 720p Camera  IR projector  60fps IR 320x240 Camera  Dual-array Mic  Powered by USB Order from intel.com/software/perceptual5 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • SDK directories Bin: You can find some executable that show you some possible applications or features available with the SDK Doc: The documentation in PDF format Framework: All you need to use the SDK in C#, Unity, etc. Include: The header files Lib: The SDK libraries Redist: Contains the minimum required installations to be able to run applications that use the SDK Sample: Contains the source code of many of the examples available in the bin folder6 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • SDK architecture SDK Applications SDK Samples SDK Utilities SDK Frameworks and Language Ports SDK Interfaces I/O Modules Algorithm Modules Core Services: Context Module Loading Synchronization Interoperability Multiple Multiple Implementations Implementations Available Available7 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • SDK interfaces Applications C# Port Processing* Port openFrameworks* Port Unity* Port Core Framework PXCMSession PXCUPipeline (C) PXCMImage PXCMAudio I/O PXCMCapture Algorithms PXCMGesture UtilPipeline (C++) PXCMFaceAnalysis PXCMVoiceRecognition PXCMVoiceTTS Pipeline UtilMCapture UtilMPipeline UtilCapture (C++) C++ Core Framework I/O Algorithms PXCSession PXCCapture PXCGesture PXCImage PXCFaceAnalysis PXCAudio PXCVoiceRecognition PXCVoiceTTS8 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • Gesture recognition ~30cm Blob Intermediate images, help separating: • Background • Hands GeoNode Skeleton nodes • Hand openness • Open Hand: Fingertips, middle, elbows • Closed Hand: up, middle, bottom Gesture Predefined: • THUMB UP/DOWN, PEACE, BIG5 • WAVE, CIRCLE, SWIPE LEFT/RIGHT/UP/DOWN Alert Alertes prédéfinies • FOV_LEFT/_RIGHT/_TOP/_BOTTOM • FOV_BLOCKED/_OK • GEONODE_ACTIVE/INACTIVE9 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • Hands and fingers tracking QueryNodeData() – PXCPoint3DF32 positionWorld; – PXCPoint3DF32 positionImage; – pxcU64 timeStamp; – pxcU32 confidence; – pxcF32 radius; – Label body; – PXCPoint3DF32 normal; – pxcU32 openness; QueryBlobData() – pxcU64 timeStamp; – pxcU32 labelBackground; – pxcU32 labelLeftHand – pxcU32 labelRightHand QueryBlobImage() – PXCImage** image; + HAND_FINGERTIP10 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.
  • Hello Worldclass GesturePipeline:public UtilPipeline {public:GesturePipeline(void):UtilPipeline(), m_render(L"Gesture Viewer") { EnableGesture();}virtual void PXCAPI OnGesture(PXCGesture::Gesture *data) { if (data->active) m_gdata = (*data); switch (data->label) { case PXCGesture::Gesture::LABEL_NAV_SWIPE_LEFT: break; //do something case PXCGesture::Gesture::LABEL_NAV_SWIPE_RIGHT: break; //do something default: break; }}virtual bool OnNewFrame(void) { return m_render.RenderFrame(QueryImage(PXCImage::IMAGE_TYPE_DEPTH), QueryGesture(), &m_gdata);}protected: GestureRender m_render; PXCGesture::Gesture m_gdata;};11 Copyright© 2012, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.