Enter document name                      Stepping into              Kinect and Augmented Reality             from EON Real...
Enter document nameSpeaker Introduction                                                                                   ...
Enter document nameAgenda• EON Reality company overview• EON Interact live demo• EON Interact: Kinect solution introductio...
Enter document nameWho We AreFounded in 1999, privately held US corporation based inIrvine, California with branches in Si...
Enter document nameOur Vision  Understand Faster             Decide Better                                Remember Longer ...
Enter document nameOur Mission                   I hear … I forget        I see… I remember      I do… I understand       ...
Enter document nameWhat We Do    3D Visualization Software                                                 Online 3D Meeti...
Enter document nameHow We Do It                               Display Systems       Enable content for publishing in diffe...
Enter document nameImmersive 3D Display Systems                                                              Immersive Roo...
Enter document nameHolographic Displays           Copyright 2011 EON Reality Inc. All rights reserved                10
Enter document nameCommercial Customers          Copyright 2011 EON Reality Inc. All rights reserved                      ...
Enter document nameAcademic Customers          Copyright 2011 EON Reality Inc. All rights reserved                        ...
Enter document nameChallenges with Traditional TrainingEngage and motivate; “an educational software that is ascompelling ...
Enter document nameWhat is HCI play here?Entertainment Games                     vs.                  Serious GamesKill ti...
Enter document nameWhat can Serious Games Offer?    a way to share knowledge and   gain experience from “what-if’ scenario...
Enter document nameEducational Value Add                                                                      “The delta b...
Enter document nameIndustry Value Add “Studies have shown that training retention     by virtual-worldtrainees is 80% bett...
Enter document nameKey Success Criteria #1 RealismUsing EON Reality systems for more than 5 years for Product Visualizatio...
Enter document nameKey Success Criteria #2 Interaction Interactive 3D Training Application developed by EON Reality.      ...
Enter document nameKey Success Criteria #3 ImmersionVirtual Training – Fully Immersive, Interactive and Realistic         ...
Enter document name             Case Studies2011-10-15    Copyright 2010 EON Reality.Inc All rights reserved              ...
Enter document name  NTU Institute of Media Innovation (IMI), Singapore  NTU – Nanyang Technological University – is on of...
Enter document name  Installation and Curation Works– Before / After  Before                                              ...
TemasekEnter document name                                                                                    Polytechnic,...
EnterUniSIM, Singapore                                                                                       document name...
Chulalongkorn University, Thailand                                                                              Enter docu...
Enter documentNorway                                                                                                      ...
SiMT, USA                                                                                        Enter document name  Scho...
Imperial College, UK                                                                                               Enter d...
Psychology and Psychotherapy                                                                                             E...
Medical Engineering and Psychology                                                                              Enter docu...
KCTCS, USA                                                                                               Enter document na...
Enter document nameFuture Real-time collaboration in Immersive 3D Environment                                             ...
Enter document name                                         Demos                                             Visual Featu...
Enter document nameEon 7.6 Support - EON Experience Portal    EON Experience is an online interactive 3D library. A 3D sto...
Enter document nameEon 7.6 Support - EON Experience Portal15/10/2011                                                36
Enter document nameEon 7.6 Support - EON CreatorWhat is EON CreatorEON Creator is an easy to use tool that empowers users ...
Enter document nameEon 7.6 Support - EON CreatorGetting started Overview: http://www.youtube.com/watch?v=QN5VXt2Ip3kVideo ...
Enter document nameOutline for EON Interact• Natural User Interface + 3D = EON Interact• Showcase of EON Interact demo   –...
Enter document nameNUI + 3D = EON Interact  To create a seamless experience between the real world and the  Virtual World ...
Enter document nameOpenNIManager
Enter document name OpenNITexture   No calibration needed                 • ConfigurationFile:                    – OpenNI...
Enter document nameNUI + 3D = EON Interact              Kinect Sensor       OpenNI framework         Skeleton Data        ...
Enter document nameShowcase of EON Interact demo• View Tracking   – Head tracking• DSTA weapon demo   – Menu Interaction• ...
Enter document nameCreate your own interaction!15/10/2011                                           45
Enter document namePrototypes for EON InteractNearestUser        Find the nearest person in the camera viewGetHand        ...
Enter document nameHow to create gestures?15/10/2011                                      47
Enter document nameEON Scripting• Let’s learn Scripting from BP demo   – Valve Turning   – Navigation   – Clap15/10/2011  ...
Enter document nameWorkflow of Medical Room                                                      49                     „S...
Enter document nameWorkflow of Medical Room• Avatar• Scene• Interaction   – RightHand / Menu Selection   – Change mode (Av...
Enter document nameEON Avatar15/10/2011                         51
Enter document nameBring the whole scene and object from online portal15/10/2011                                          ...
Enter document nameMotion Capture system and Virtual Glove15/10/2011                                       53
Enter document nameAugmented Reality in EON SG• Exxon Mobil and MBS video clip15/10/2011                                  ...
Enter document nameInternship Opportunity                                                                                 ...
Enter document name                                                                               (Jay) Ying-Chieh HUANGQ&...
Upcoming SlideShare
Loading in …5
×

Eon nus hci_master_class

747 views

Published on

EON Demo

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
747
On SlideShare
0
From Embeds
0
Number of Embeds
71
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Eon nus hci_master_class

  1. 1. Enter document name Stepping into Kinect and Augmented Reality from EON Reality SG perspective (Jay) Ying-Chieh HUANG Research Engineer jay@eonreality.com.sg2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 1
  2. 2. Enter document nameSpeaker Introduction After facility is built• 2002-2006 Bachelor in ECE National Cheng Kung University, Taiwan• 2008-2009 Research Assistant, TOUCH Center• 2010-2011 Master in CS, SoC National University of Singapore• Present Research Engineer at EON Reality, SG• Research Topic in AR, VR, and HCI – Multitouch projects in TOUCH Center – Kinect projects in NUS and EON Reality Copyright 2011 EON Reality Inc. All rights reserved
  3. 3. Enter document nameAgenda• EON Reality company overview• EON Interact live demo• EON Interact: Kinect solution introduction• Interactive demo session• EON Interact application (gesture and interaction) workflow• Introduction to industrial AR project in EON• Discussion and Internship opportunity15/10/2011 3
  4. 4. Enter document nameWho We AreFounded in 1999, privately held US corporation based inIrvine, California with branches in Singapore, Sweden and 19Interactive Digital Centers around the world.World’s leading provider of a total solution (software,applications and immersive displays) for interactive visualizationbased on Virtual Reality technology.Wide Customer acceptance in Education, Aerospace, Defense,Energy and Manufacturing.International Management, Board and Partners: diverse,experienced and global team.+15 years of R&D as base for own software platform.Mission critical solutions for Simulation Based Learning, Training,Sales & Marketing and Product Development. Copyright 2011 EON Reality Inc. All rights reserved 4
  5. 5. Enter document nameOur Vision Understand Faster Decide Better Remember Longer Copyright 2011 EON Reality Inc. All rights reserved 5
  6. 6. Enter document nameOur Mission I hear … I forget I see… I remember I do… I understand Ancient Chinese proverb (Confucius) Copyright 2011 EON Reality Inc. All rights reserved 6
  7. 7. Enter document nameWhat We Do 3D Visualization Software Online 3D Meetings From BP, Virtually Prepared 3D Immersive Display Systems Consulting Services & Customized Development Copyright 2011 EON Reality Inc. All rights reserved 7
  8. 8. Enter document nameHow We Do It Display Systems Enable content for publishing in different display formats from web to immersive Displays with EON Viewer and immersive 3D systems Applications Develop complete Training, Sales & Marketing, Support & Collaborative applications with EON application software Development Software Bring Products and 3D environments to life with EON Development software Exchange data between CAD/3D/2D systems and EON CAD / PDM Autodesk, 3DS, Maya, Microstation, PTC, Siemens-Unigraphics, … Copyright 2011 EON Reality Inc. All rights reserved 8
  9. 9. Enter document nameImmersive 3D Display Systems Immersive Rooms (aka CAVE and ICube) Flat and angular 3D Stereo displays Concave and curved 3D stereo displays. Copyright 2011 EON Reality Inc. All rights reserved 9
  10. 10. Enter document nameHolographic Displays Copyright 2011 EON Reality Inc. All rights reserved 10
  11. 11. Enter document nameCommercial Customers Copyright 2011 EON Reality Inc. All rights reserved 11
  12. 12. Enter document nameAcademic Customers Copyright 2011 EON Reality Inc. All rights reserved 12
  13. 13. Enter document nameChallenges with Traditional TrainingEngage and motivate; “an educational software that is ascompelling as the best video game and as effective as a personaltutor.”Improve Retention; engage and excite with a “I see, I do”approach. Perform training in a replica of the real-worldenvironment. Problem based learning.Save costs; reduce travel cost, enable effective self-studycapabilities, avoid using expensive mock-ups,Accelerate timelines; enable availability, improve trainingproductivity, reduce time.Increase “hands-on” experience; train multiple times onscenarios that in real life would be limited in accessibility. Copyright 2011 EON Reality Inc. All rights reserved 13
  14. 14. Enter document nameWhat is HCI play here?Entertainment Games vs. Serious GamesKill time Save time Training Efficiency Safety Productivity Reduce carbon footprint Copyright 2011 EON Reality Inc. All rights reserved 14
  15. 15. Enter document nameWhat can Serious Games Offer? a way to share knowledge and gain experience from “what-if’ scenarios in a virtual 3D environment Copyright 2011 EON Reality Inc. All rights reserved 15
  16. 16. Enter document nameEducational Value Add “The delta between pre- and post-lesson tests was huge. The group that received its lesson in 3D saw a 35 percent increase in test scores.” Tracey Masamoto, Director for JTM Concepts http://www.dlp.com/downloads/DLP-CaseStudy-Classroom3.pdf Copyright 2011 EON Reality Inc. All rights reserved 16
  17. 17. Enter document nameIndustry Value Add “Studies have shown that training retention by virtual-worldtrainees is 80% better than that of groups who undertake traditional training.” Brian Ralphs, BP Technology Director. Image from BP, “Virtually Prepared”http://www.bp.com/liveassets/bp_internet/globalbp/globalbp_uk_english/reports_and_publications/frontiers/STAGING/local_assets/pdf/bpf25_10-14_3dve.pdf Copyright 2011 EON Reality Inc. All rights reserved 17
  18. 18. Enter document nameKey Success Criteria #1 RealismUsing EON Reality systems for more than 5 years for Product Visualization, Client Interaction and Sales andMarketing activities.Snapshots of EON Immersive Displays and 3D datasets used by Boeing. Copyright 2011 EON Reality Inc. All rights reserved 18
  19. 19. Enter document nameKey Success Criteria #2 Interaction Interactive 3D Training Application developed by EON Reality. Copyright 2011 EON Reality Inc. All rights reserved 19
  20. 20. Enter document nameKey Success Criteria #3 ImmersionVirtual Training – Fully Immersive, Interactive and Realistic Copyright 2011 EON Reality Inc. All rights reserved 20
  21. 21. Enter document name Case Studies2011-10-15 Copyright 2010 EON Reality.Inc All rights reserved 21
  22. 22. Enter document name NTU Institute of Media Innovation (IMI), Singapore NTU – Nanyang Technological University – is on of the premier universities in Asia ranked amongst the top 10 in Asia according to 2011 QS World University Rankings by Engineering subjects A newly completed (2011, July) innovative Immersive and Interactive 3D Display System at IMI, headed by Prof. Nadia THALMANN, will provide a center for world-class R&D around interactive 3D technologies. Round, 320 degrees, 3 x 8 m 20 Megapixels in stereoscopic 3D Five (5) high-end projectors, each of them in HD Stereo Very bright, totally of 50,000 lumens (5 x 10,000 lumens / proj) Interactive 3D Stereo and cluster s/w (EON ICube software) Research and Development platform (EON Ultra and EON SDK) University Dept. exterior. Conceptual display design. Images showing construction phase (March 2011)2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 22
  23. 23. Enter document name Installation and Curation Works– Before / After Before After Display area is outlined on existing floor. Screen mounted, a surrounding room is constructed and mounts / truss for projectors.2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 23
  24. 24. TemasekEnter document name Polytechnic, Singapore School of Interactive Media,0Temasek Polytechnic, Singapore Temasek Polytechnic (TP) is a significant contributor to the field of para-professional education in Singapore. It is a pioneer in Problem-based Learning (PBL). The Polytechnic is a firm believer in forging partnerships with industry to keep students close to current industry practice. TP currently offers 38 full-time diploma courses in the areas of Applied Science, Business, Design, Engineering and Information Technology and over 40 part-time courses, up to the Advanced Diploma level. For more information, please visit www.tp.edu.sg2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 24
  25. 25. EnterUniSIM, Singapore document name SIM University, Singapore - A first in Singapore: an interactive 3D classroom in a secure environment, combining rich 3D models with video and PowerPoint - Phase 1 consists of Six (6) Lectures at 3h each - Ninety (90) interactive 3D models created by EON Reality - Ability to use both in the actual classroom, as well as enabling students to log-in from home (“online version”) - Ability for interactive self-studies (“off-line version”)2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 25
  26. 26. Chulalongkorn University, Thailand Enter document name Department of Architecture 0 Civil Engineering and Chulalongkorn University is the oldest in Thailand and has long been considered the countrys most prestigious university. At the Department of Civil Engineering, EON Reality in June 2011 completed the installation of an turn-key EON ICube, 3-projector system for stereoscopic and interactive 3D presentations.2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 26
  27. 27. Enter documentNorway UMB, name 0 School of Architecture and Urban Planning, Oslo, Norway Department of Landscape Architecture and Spatial Planning (ILP) at the Norwegian University of Life Sciences (UMB) is active in the field of planning research, education and development of methods and techniques in planning theories.2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 27
  28. 28. SiMT, USA Enter document name School of Manufacturing and Technology SiMT – Southeastern Institute of Manufacturing and Technology – http://www.simt.com Specializing in the design, development and implementation of 3D/Virtual Reality business solutions for sales, marketing, training, trade show presentations and other applications, the center works with business and industry to develop immersive and interactive customer/employee experiences.2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 28
  29. 29. Imperial College, UK Enter document name When Imperial College received a grant from the British Government to form Design London, a substructure to the university, they collaborated with EON Reality on the creation of a Virtual Reality simulation environment.2011-10-15 Copyright 2010 EON Reality Inc. All rights reserved 29
  30. 30. Psychology and Psychotherapy Enter document name Babes-Bolyai University, Romania Project Description • Psychotherapy using interactive 3D technologies, including EON ICube EON Reality Solution • EON ICube 4 walls • EON Professional for application development • Upgrade to 5 walls planned in 2011 Benefits • Safe, controllable and repeatable exposure to scenarios • Cost effectiveness Client Statements •"Virtual reality therapy corrects major limitations. Taking in account that in a virtual environment you can at any time stop the process, you can control the medium and as a therapist I have control over the reactions and behavior of the client,” said Professor Daniel David.2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 30
  31. 31. Medical Engineering and Psychology Enter document name University of Montreal - School of Medical Engineering and Psychology Athlete’s Brain Training - Video at http://www.youtube.com/watch?v=La-WRhYeMCw&feature=related A new simulations system for rehabilitation and training of athletic performance and clinical populations, developed by Professor Jocelyn Fauberts team will be immersed within the EON ICube, a technology that allows virtual training in a natural and realistic environment.2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 31
  32. 32. KCTCS, USA Enter document name Kentucky Community and Technical College System, USA The KCTCS Interactive Digital Center is a solution center for workforce development and teaching and learning applications and business and industry. It is a research and content development center that utilizes cutting edge visualization technologies to create highly immersive and interactive simulation based learning and training applications. Working with the colleges’ multiple industry partners to create interactive visualization content for partners for varying aspects of training their employees, i.e. Coal Academy (mining), Fire Commission (fire science), etc. to begin to show the colleges the winning relationships for building self-sustaining environments within the colleges. http://www.kctcs.edu/system_initiatives/interactive-digital-center/about_us.aspx2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 32
  33. 33. Enter document nameFuture Real-time collaboration in Immersive 3D Environment A major Oil Corporation has created a life-like virtual 3D replica of the actual production site which can be shared in real-time through EON Reality software – in scale 1 : 1. - Improve productivity, reduce costly mistakes - Real-time Knowledge transfer - Cross-discipline communication - Real-time sharing of 3D data, Documents, Voice - Remote training - Remote maintenance guidance - Reduce costs - Reduce carbon footprint - Reduce risk exposure (personnel) 33 Copyright 2011 EON Reality Inc. All rights reserved
  34. 34. Enter document name Demos Visual Feature Eon Interact• Video for EON Interact (Gu-qin “Ancient Musical Instrument”)2011-10-15 Copyright 2011 EON Reality Inc. All rights reserved 34
  35. 35. Enter document nameEon 7.6 Support - EON Experience Portal EON Experience is an online interactive 3D library. A 3D store. There are Huge 3D models library in EON Experience Portal. http://www.eonexperience.com/EonModel/Main.aspx  Over 2000 high quality 3D models at your disposal  Integrated search function and simple object manipulation  You can play them on web browser (IE, Chrome, Firefox)  3D Component, 3D Scenes, Partner Content15/10/2011 35
  36. 36. Enter document nameEon 7.6 Support - EON Experience Portal15/10/2011 36
  37. 37. Enter document nameEon 7.6 Support - EON CreatorWhat is EON CreatorEON Creator is an easy to use tool that empowers users to instantly select from thousands of 3Dmodels to configure, customize, publish high-quality interactive 3D content and view it in 3Dstereoscopic mode. With EON Creator users can create engaging interactive learning simulationsfor training, education and presentation purposes.Features: Select and download your contents. Configure and customize your content. Build up your own Virtual Scenes. Upload the scenes on portal and share them with friends. Use your scenes to start up meeting online. (Eon Coliseum)15/10/2011 37
  38. 38. Enter document nameEon 7.6 Support - EON CreatorGetting started Overview: http://www.youtube.com/watch?v=QN5VXt2Ip3kVideo Tutorials: http://www.youtube.com/playlist?list=PLE3E91248F14DB3A815/10/2011 38
  39. 39. Enter document nameOutline for EON Interact• Natural User Interface + 3D = EON Interact• Showcase of EON Interact demo – View Tracking / DSTA / BP / Medical Room• Create your own interaction!• How to create gestures?• EON Avatar• Workflow of Medical Room15/10/2011 39
  40. 40. Enter document nameNUI + 3D = EON Interact To create a seamless experience between the real world and the Virtual World – there are a few things we need to do…15/10/2011 40
  41. 41. Enter document nameOpenNIManager
  42. 42. Enter document name OpenNITexture No calibration needed • ConfigurationFile: – OpenNIConfig.xml • CalibrationFile: – UserCalibration.bin15/10/2011 42
  43. 43. Enter document nameNUI + 3D = EON Interact Kinect Sensor OpenNI framework Skeleton Data Skeleton Control RGB/Depth image EON Studio OpenNIManager User Interface OpenNITexture Interaction15/10/2011 43
  44. 44. Enter document nameShowcase of EON Interact demo• View Tracking – Head tracking• DSTA weapon demo – Menu Interaction• British Petroleum demo – Valve Turning, Navigation, Clap• Medical Room – Full body tracking, Avatar control15/10/2011 44
  45. 45. Enter document nameCreate your own interaction!15/10/2011 45
  46. 46. Enter document namePrototypes for EON InteractNearestUser Find the nearest person in the camera viewGetHand Returns the nearest user’s right hand or left hand, relative to reference position (ex: Torso, Shoulder)RightHand Animation hand with visual feedback and time settingHandsUp Active when hand position is above head positionCollisionCube Well-defined element for 3D user interface, such asCollisionSphere button, virtual object, gestures, and interaction trigger. It can be used with Hand (RightHand prototype)Others: CamOrientation, SkeletonControl, Navigation, Clap, ...etc
  47. 47. Enter document nameHow to create gestures?15/10/2011 47
  48. 48. Enter document nameEON Scripting• Let’s learn Scripting from BP demo – Valve Turning – Navigation – Clap15/10/2011 48
  49. 49. Enter document nameWorkflow of Medical Room 49 „See‟ inside of your own body. 49
  50. 50. Enter document nameWorkflow of Medical Room• Avatar• Scene• Interaction – RightHand / Menu Selection – Change mode (Avatar control / Menu Selection) – Heart / Brain• Gesture – HandsUp – Clap – Touch• Tricks - Hide Cursor on simulation started15/10/2011 50
  51. 51. Enter document nameEON Avatar15/10/2011 51
  52. 52. Enter document nameBring the whole scene and object from online portal15/10/2011 52
  53. 53. Enter document nameMotion Capture system and Virtual Glove15/10/2011 53
  54. 54. Enter document nameAugmented Reality in EON SG• Exxon Mobil and MBS video clip15/10/2011 54
  55. 55. Enter document nameInternship Opportunity After facility is built• We are looking for interns – Technical projects: Kinect, Vision-based body tracking, Augmented Reality, mobile rendering, cloud rendering, sensors – Usability test, HCI – Project management – Visual/concept/interaction designer – or tell me how you can contribute• Get industry experience from the VR/AR industry leader• Employment opportunity• Contact: Eng Tat KHOO, R&D Director, engtat@eonreality.com.sg Copyright 2011 EON Reality Inc. All rights reserved 55
  56. 56. Enter document name (Jay) Ying-Chieh HUANGQ&A Research Engineer jay@eonreality.com.sg • Thanks for your feedback https://docs.google.com/spreadsheet/viewform?formkey=dEw1R2Z3S042a U50bUQ3a3pmeE5RbWc6MQ • A real immersive experience will revolutionize the way people interact with the world. virtual reality create, diminished reality simplify, and augmented reality reshape a better world.15/10/2011 56

×