ASE 2014 Augmented Reality Teaching

731 views
663 views

Published on

Presentation for the Association of Science Education Annual Conference at the University of Birmingham, 9th January 2014 by Dr. Francisco Pérez Garcíah

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
731
On SlideShare
0
From Embeds
0
Number of Embeds
359
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

ASE 2014 Augmented Reality Teaching

  1. 1. ASE Conference University of Birmingham, 9th January 2014 Augmented Reality Teaching Dr. Francisco Pérez García Head of Technology Dept. , Pompeu Fabra High School, Martorell Head of i-Campus Project, University of Barcelona, Barcelona U 1 U N IV E R S ITAT D E B A R C E L O N A Unitat de Farmacologia i Farmacognòsia - Facultat de Farmàcia B
  2. 2. The author respects article 32 of the Spanish Law of Intellectual Property to use images and other materials contained in this presentation. The Berne Convention provides for a specific exception to allow uses of copyrighted works for the purpose of teaching: “ Art.10.2.-It shall be a matter for legislation in the countries of the Union, and for special agreements existing or to be concluded between them, to permit the utilization, to the extent justified by the purpose, of literary or artistic works by way of illustration in publications, broadcasts or sound or visual recording for teaching, provided such utilization is compatible with fair practice” U 2 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  3. 3. Contents of this presentation 1. Augmented reality (AR) as a disruptive technology? 2. Level 0: AR with no programming knowledge a) App: Google Googles (QR and GeoWeb) b) Online: www.learnar.org c) Free software: BuildAR 3. Level 1: AR with minor programming skills a) Open Source software: processing 2 b) libraries NyAR4psg, OBJLoader, etc c) Online: Create 3D objects http://www.123dapp.com/catch 4. Level 2: AR with programming skills: Google Glasses U 3 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  4. 4. Augmented reality A disruptive technology? Lavandula angustifolia Something that generates a very important change U 4 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  5. 5. Augmented reality A disruptive technology? Lavandula angustifolia Something that generates a very important change U 5 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  6. 6. Higher Level 2 Programming skills Level 1 Lower Level 0 LEVEL OF PROGRAMMING SKILLS REQUIRED TO CREATE AUGMENTED REALITY APPLICATIONS U 6 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  7. 7. Types of Augmented Reality Hiperlinks in the real world Marker based augmented reality Markerless augmented reality Geoweb-Internet of places Internet of things Trigger by QR Markers Objects or pictures Objects and GPS position Sensors, objects and GPS U 7 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  8. 8. Level 0 AUGMENTED REALITY: QR CODE http://www.goqr.me (among many other ways to generate QR) Zint Barcode Generator U 8 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  9. 9. U 9 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  10. 10. U 10 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  11. 11. U 11 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  12. 12. U 12 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  13. 13. 13 Internet of places - Geoweb U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  14. 14. U 14 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  15. 15. http://www.learnar.org AUGMENTED REALITY WITH A BROWSER AND MARKERS U 15 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  16. 16. U 16 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  17. 17. U 17 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  18. 18. U 18 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  19. 19. U 19 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  20. 20. U 20 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  21. 21. U 21 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  22. 22. U 22 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  23. 23. U 23 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  24. 24. http://6007.stem.org.uk Gravity, Bugs, Sounds and Materials 24 U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  25. 25. Creating book with Augmented Reality with www.zooburst.com U 25 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  26. 26. Download Build AR free version at http://www.buildar.co.nz/home/download/?did=6 Two examples in the next slides U 26 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  27. 27. 27 http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdf Movement to understand eclipse Dr. Francisco Pérez García - Institut Pompeu Fabra U U N IV E R S ITAT D E B A R C E L O N A B
  28. 28. 28 http://www.buildar.co.nz/buildar-showcase-2/ Movement to understand Stirling engine U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  29. 29. Students using technology or students creating technology? U 29 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  30. 30. TO CREATE AUGMENTED REALITY APPS WE NEED CREATIVE STUDENTS… U 30 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  31. 31. WITH COMMON HARDWARE, AND… U 31 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  32. 32. SOME SOFTWARE, AND PROGRAMING SKILLS? 32 U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  33. 33. U 33 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  34. 34. U 34 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  35. 35. Processing Open Source software Derived from Java Many available examples Many contributed libraries: for Arduino, 3DObject, QRCode, Box2D for games, Open Computer Vision, for Augmented Reality like NyAR4psg or NyAR2, etc. U 35 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  36. 36. Marker augmented reality (NyAR4psg, NyAR2 libraries) Loading 3D objects Markerless augmented reality (Saito OBJLoader library) (OpenCV library) Lego robots (NTXcomm library) QR code library Data communication (libraries for SMS, SQL databases,…) Games (pBox2D library) Machine learning (Gnet library) Arduino library (http://tecnologies.net/?page_id=206) 36 U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  37. 37. U 37 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  38. 38. AUGMENTED REALITY MARKERS U 38 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  39. 39. U 39 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  40. 40. U 40 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  41. 41. We need extra libraries and programs to start executing augmented reality code with Processing: • Libraries  GSVideo http://sourceforge.net/projects/gsvide o/files/gsvideo/1.0 • Programs  QuickTime http://www.apple.com/es/quicktime/d ownload/  OBJLoader https://code.google.com/p/saitoobjloader/  Nyar4psg-1.3.1 http://sourceforge.jp/projects/nyartoolkit/ releases/?package_id=8920  WinVDIG http://www.eden.net.nz/7/2007100 8/ U 41 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  42. 42. Quicktime 7: http://www.apple.com/ca/quicktime/download/ http://www.eden.net.nz/7/20071008/ U 42 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  43. 43. GSVIDEO LIBRARY (ONLY FOR PROCESSING 1.5.1) http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0/ U 43 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  44. 44. MAIN AR LIBRARY FOR PROCESSING: NyAR4psg http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920 U 44 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  45. 45. MULTIMARKER LIBRARY FOR AUGMENTED REALITY USING PROCESSING http://cpbotha.net/files/nyar4psg_multimarker/ U 45 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  46. 46. http://code.google.com/p/saitoobjloader/downloads/list U 46 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  47. 47. WHERE WE HAVE TO PUT THE EXTRA LIBRARIES Libraries: Inside processing (modes>java>libraries) U 47 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  48. 48. WHERE WE HAVE TO PUT THE EXTRA PROGRAMS Programs: At the same folder than processing U 48 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  49. 49. SIMPLELITE.PDE SIMPLEST CODE FOR AUGMENTED REALITY USING PROCESSING U 49 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  50. 50. CODE CHANGES IF GSVIDEO LIBRARY IS USED import processing.video.*; //core library import codeanticode.gsvideo.*; //gsvideo contributed library Capture cam; GSCapture cam; cam=new Capture(this,width,height); cam=new GSCapture(this,width,height); cam.start(); U 50 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  51. 51. U 51 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  52. 52. U 52 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  53. 53. U 53 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  54. 54. U 54 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  55. 55. CREATING 3D OBJECTS FROM PHOTOGRAPHS U 55 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  56. 56. U 56 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  57. 57. U 57 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  58. 58. Creating 3D objects with www.blender.org www.sketchup.org U 58 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  59. 59. http://flash.tarotaro.org/ar/MarkerGeneratorOnline.swf U 59 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  60. 60. http://www.brosvision.com ar-marker-generator/ U 60 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  61. 61. Online quiz about processing: http://blocs.xtec.cat/pile/2013/05/quiz1.swf U 61 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  62. 62. Computer vision OpenCV library + Processing 2.1 U 62 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  63. 63. Level 2. AR WITH GOOGLE GLASSES U 63 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  64. 64. U 64 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  65. 65. U 65 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  66. 66. U 66 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  67. 67. Woodpecker images from @tecnotic 67 U U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  68. 68. John and Anne are getting fat. I must send a message now I detected a weigth of 60.4kg Anne’s seat John’s seat My sensor measured 70.2kg THE INTERNET OF THINGS U 68 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  69. 69. References http://www.tecnologies.net http://www.processing.org http://www.learningprocessing.com/ http://www.openprocessing.org http://www.creativeapplications.net/category/processing/ https://www.coursera.org/course/digitalmedia U 69 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  70. 70. U 70 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  71. 71. MOOC from University of London about www.processing.org U 71 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  72. 72. U 72 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  73. 73. http://www.wiley.com/WileyCDA/WileyTitle/productCd1118036638,miniSiteCd-SYBEX,descCd-DOWNLOAD.html U 73 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  74. 74. ACKNOWLEDGEMENTS -To the Government of Catalonia, Department of Education for the school innovation project “Technological Creativity” at Pompeu Fabra High School -To the University of Barcelona for the innovation project “i-Campus” U 74 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B
  75. 75. THANK YOU VERY MUCH FOR YOUR ATTENTION QUESTIONS? U 75 U N IV E R S ITAT D E B A R C E L O N A Dr. Francisco Pérez García - Institut Pompeu Fabra B

×