Augmented Reality - HCI & kinect


Published on

Presentation of the Meetup 'Augmented Reality Barcelona' celebrated on december 12th at Campus La Salle Barcelona. Isidro Navarro – CEO at INAR, organizer of the meeting -Introduction to AR & HCI
List of speakers:
William Provancher - founder of Tactical Haptics - Utah -creators of Reactive Grip™ Touch Feedback for VR, gaming, and medical apps
Joseph Rampolla – co-founder of AR Meetup NY & founder of the Augmented Reality Dirt Podcast & Blog – New York - Presentation of AR references in global scenario
Richard Hebert – Director of BLOOM – Girona - 3D center and emerging technologies
Brian Wassom - attorney and co-founder of AR Meetup Detroit - Augmented Reality Games - Legal Concerns
David Miralles – DTM Enginyeria La Salle - Strategy Advisor on Interaction at La Salle BCN presents research projects

Published in: Technology

Augmented Reality - HCI & kinect

  2. 2. By ISIDRO NAVARRO INTRODUCTION #meetupARHCI Augmented Reality & HCI-KINECT • Introduction – ‘Augmented Reality Barcelona’ – Blogs, Communities and Groups • • • • • HCI Research Industry Applications Related Themes AUGMENTED REALITY BARCELONA 2
  3. 3. By ISIDRO NAVARRO INTRODUCTION Augmented Reality Barcelona Who we are? ...more than 110 members from more than 35 entities La Salle, LAYAR, Catchoom, Engidia, INAR, Tetravol, Mitjans Digitals, TSystems, Alt64, Bienetec, Aumentaty, Namastech, MKTCultural, A ugmate, BOC, Ltc&group, EspiRA, Funky Whale Games, BeMyApp, FoolHead Studio, FEZOO, TEF, Medialab Barcelona, PANGEA Reality, Iris Control Systems, Mobile World Center, Innovae Vision, UPC, Aumentasolutions, AR Dirt Podcast, Doubleyou, Amplified Robot, Merchlar, Boston Scientific, Einnova, AR Standards, ENTI,… AUGMENTED REALITY BARCELONA 3 #meetupARHCI Augmented Reality & HCI-KINECT
  6. 6. Augmented Reality & HCI-KINECT By ISIDRO NAVARRO INTRODUCTION #meetupARHCI GROUPS in Linkedin Mobile Augmented Reality (3500+) AR Glasses (2700+) Immersive 3D Environments & Augmented Reality (1000+) Geospatial Augmented Reality (400+) Layar Reality Browser (400+) AR-UX : Augmented Reality User Experience (250+) ARE: Augmented Reality Educators (50+) La Salle AR (40+) AUGMENTED REALITY BARCELONA 6
  7. 7. By ISIDRO NAVARRO INTRODUCTION AR market studies Virtual Reality & Augmented Reality Market worth 1.06 Billion by 2018 “Virtual Reality & Augmented Reality Market – By Technology (Mobile & Spatial AR, Semi & Fully Immersive VR); By Sensors & Components (Accelerometer, Data Glove, HMD, ICs); By Applications (Medical, Military, Gaming), By Geography (2013 – 2018) ”, published by MarketsandMarkets WEB AUGMENTED REALITY BARCELONA 7 #meetupARHCI Augmented Reality & HCI-KINECT
  8. 8. Augmented Reality & HCI-KINECT HUMAN COMPUTER INTERACTION CONCEPT #meetupARHCI By ISIDRO NAVARRO Human-Computer Interaction (HCI) is a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them. 1992, SIGCHI Curriculum Development Group AUGMENTED REALITY BARCELONA 8
  9. 9. Augmented Reality & HCI-KINECT SIXTHSENSE - MIT Media Lab Haptic System 'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Author: Pranav Mistry WEB VIDEO AUGMENTED REALITY BARCELONA 9 #meetupARHCI RESEARCH By ISIDRO NAVARRO
  10. 10. Augmented Reality & HCI-KINECT OCULUS RIFT & Motion Capture System This projects details a stereo camera rig that I've built for the Oculus Rift, and showcases a series of augmented reality demonstrations. The video also covers a method to use the Rift wirelessly (Virtual Environments and Computer Graphics group at University College London) Author: William Steptoe WEB VIDEO AUGMENTED REALITY BARCELONA 10 #meetupARHCI RESEARCH By ISIDRO NAVARRO
  11. 11. Augmented Reality & HCI-KINECT SANDBOX – KeckCAVES Science education, Keck Foundation, California The sandbox is equipped with a Kinect 3D camera and a projector to project a real-time colored topographic map with contour lines onto the sand surface. The sandbox lets virtual water flow over the surface using a GPU-based simulation of the Saint-Venant set of shallow water equations. Authors: Oliver Kreylos, Buraz Yikilmaz & Peter Gold from KeckCAVES VIDEO WEB AUGMENTED REALITY BARCELONA 11 #meetupARHCI RESEARCH By ISIDRO NAVARRO
  12. 12. Augmented Reality & HCI-KINECT RESEARCH By ISIDRO NAVARRO #meetupARHCI REALITY EDITOR - MIT Media Lab Internet Of Things The Reality Editor is a system that supports editing the behavior and interfaces of socalled “smarter objects”, i.e. objects or devices that have an embedded processor and communication capability. Author: Valentin Heun WEB VIDEO AUGMENTED REALITY BARCELONA 12
  13. 13. By ISIDRO NAVARRO RESEARCH Gestural Interface for Remote Spatial Perception Wearable device GIST helps the blind ‘see’ what’s around them. Authors: Vinitha Khambadkar and Eelke Folmer are computer scientists from the University of Nevada WEB VIDEO AUGMENTED REALITY BARCELONA 13 #meetupARHCI Augmented Reality & HCI-KINECT
  14. 14. Augmented Reality & HCI-KINECT Kinect Sign Language Translator – Microsoft Research The prototype system understands the gestures of sign language It displays the signer and renders a written and spoken translation of the sign language in real-time, and it also takes the non-signer's spoken words and turns them into accurate, understandable sign language. Author: Xilin Cen, Professor, Chinese Academy of Sciences WEB VIDEO AUGMENTED REALITY BARCELONA 14 #meetupARHCI RESEARCH By ISIDRO NAVARRO
  15. 15. Augmented Reality & HCI-KINECT RESEARCH By ISIDRO NAVARRO #meetupARHCI inFORM – MIT Dynamic Shape Display inFORM can render 3D content physically, so users can interact with digital information in a tangible way. It also interact with the physical world around it, for example moving objects on the table's surface. Remote participants in a video conference can be displayed physically, allowing for a strong sense of presence and the ability to interact physically at a distance. Authors: Daniel Leithinger, Sean Follmer & Hiroshi Ishii from MIT VIDEO AUGMENTED REALITY BARCELONA WEB 15
  16. 16. Augmented Reality & HCI-KINECT PRIMESENSE labs SMART TERRAIN Apps powered by Vuforia can now enable users to create their own play space and interact with the physical world in ways not experienced before by enabling game physics to apply to real world surfaces and objects. WEB VIDEO AUGMENTED REALITY BARCELONA 16 #meetupARHCI INDUSTRY By ISIDRO NAVARRO
  17. 17. Augmented Reality & HCI-KINECT OMEK OMEK BECKON & GRASP Omek Beckon and Grasp are a full-featured set of middleware and tools that enables you to quickly and efficiently deploy full-body and hands gesture and tracking interfaces in your applications and devices, for operation at ranges from 1.5 to 3.5 meters and 10 cm. VIDEO WEB AUGMENTED REALITY BARCELONA 17 #meetupARHCI INDUSTRY By ISIDRO NAVARRO
  18. 18. By ISIDRO NAVARRO INDUSTRY XBOX ONE – Microsoft Kinect-Game The console includes a newly upgraded Kinect motion sensing peripheral. New features such as a built-in Skype client for videoconferencing, user recognition and tracking, and the ability to use voice commands and gestures to navigate the console's user interface. VIDEO AUGMENTED REALITY BARCELONA 18 #meetupARHCI Augmented Reality & HCI-KINECT
  19. 19. Augmented Reality & HCI-KINECT By ISIDRO NAVARRO INDUSTRY #meetupARHCI PLAYGROUND – Playstation 4 Player interaction for immersive gaming. The Playroom, an alternate reality game that comes pre-loaded on PlayStation 4 projects the miniature machines into players' living rooms. Using the PlayStation Camera, players can interact with them, kicking, flicking, and cradling them as they frolic and cower. VIDEO AUGMENTED REALITY BARCELONA 19
  20. 20. By ISIDRO NAVARRO INDUSTRY RAZER HYDRA – Sixense Entertainment Magnetic motion sensing It uses a weak magnetic field to detect the absolute position and orientation of the controllers with a precision, as stated by its developers, of 1 mm and 1°; it has six degrees of freedom. The current release is wired, but a wireless version is in development. VIDEO AUGMENTED REALITY BARCELONA 20 #meetupARHCI Augmented Reality & HCI-KINECT
  21. 21. By ISIDRO NAVARRO INDUSTRY REACTIVE GRIP – Tactical Haptics Friction controller Reactive Grip touch feedback works by mimicking the friction and shear forces that we feel in the real world when holding an object or touching a surface. This is accomplished by measuring the movements of the player’s hand and actuating small sliding plates in the grip of the controller to recreate the friction and shear forces you expect VIDEO AUGMENTED REALITY BARCELONA 21 #meetupARHCI Augmented Reality & HCI-KINECT
  22. 22. Augmented Reality & HCI-KINECT STREET MARKETING - Appshaker Interaction in public spaces for street marketing. Projects using augmented reality, motion/body tracking and gesture control. WEB VIDEO AUGMENTED REALITY BARCELONA 22 #meetupARHCI APPLICATIONS By ISIDRO NAVARRO
  23. 23. Augmented Reality & HCI-KINECT LEAP MOTION & Kinect The Leap Motion controller senses how users moves their hands over the device. Author: Yhosinaga Takashi WEB VIDEO AUGMENTED REALITY BARCELONA 23 #meetupARHCI APPLICATIONS By ISIDRO NAVARRO
  24. 24. Augmented Reality & HCI-KINECT IRIS – Hybe Interactive mirror with Arduino and Kinect RIS is a media canvas with matrix of conventional information display technology - a monochrome LCD. Through the phased opening and closing of circular-segmented black Liquid Crystal, IRIS can create various patterns and control the amount (size) of passing lights. Seoul Art Space_Geumcheon, KOREA VIDEO AUGMENTED REALITY BARCELONA 24 #meetupARHCI RELATED THEMES By ISIDRO NAVARRO
  25. 25. Augmented Reality & HCI-KINECT EYEBORG – Cyborg Foundation Eyeborg is a cybernetic eye that allows you to hear colours from infrared to ultraviolet. The current eye is based on a chip that transmits sounds via bone conduction. Author: Neil Harbisson WEB VIDEO AUGMENTED REALITY BARCELONA 25 #meetupARHCI RELATED THEMES By ISIDRO NAVARRO
  26. 26. Augmented Reality & HCI-KINECT EPOC nuroheadset - EMOTIV EMOTIV + KINECT CONTROLLED ROBOT The Microsoft Kinect RGB-Depth camera overlays the floor in relation to the robot's position and orientation. The user selects a location on the floor with the mouse by moving his head. WEB VIDEO AUGMENTED REALITY BARCELONA 26 #meetupARHCI RELATED THEMES By ISIDRO NAVARRO
  27. 27. Augmented Reality & HCI-KINECT RELATED THEMES By ISIDRO NAVARRO #meetupARHCI OLIMPIC CHANGES Contest for the best idea of projects about the olimpic winter games in Rusia. People interacts with the tickets machine to get it for free while they do sport. WEB VIDEO AUGMENTED REALITY BARCELONA 27
  28. 28. Augmented Reality & HCI-KINECT NEUROCAM – Neurowear Wearable camera system that detects your emotions. It automatically records moments of interest based on an analysis of the users brainwaves.. Author: Mitsukura, professor of Keio University WEB VIDEO AUGMENTED REALITY BARCELONA 28 #meetupARHCI RELATED THEMES By ISIDRO NAVARRO
  29. 29. Augmented Reality & HCI-KINECT RELATED THEMES By ISIDRO NAVARRO #meetupARHCI SHIPPO – Neurowear & Kiluck Neuro tagging map – Wearable device registers your emotions and tag the map for sharing in social apps. WEB VIDEO AUGMENTED REALITY BARCELONA 29
  30. 30. Augmented Reality & HCI-KINECT #meetupARHCI By ISIDRO NAVARRO ISIDRO NAVARRO LinkedIn Youtube Slideshare Google+ Twitter Facebook Scholar Meetup AUGMENTED REALITY BARCELONA 30