Slides from my 4 week/4 part STEAM class teaching the next generation of creators about the next generation of media consumption. A group of Catholic school students learned about Augmented Reality’s history, future, current applications, career opportunities and tools then used Apple’s Reality Composer tool to create AR experiences about the life of Pope Francis.

1. Augmented Reality
Opportunities in
with
Brian Cody

2. Legal Copyright Disclaimer
• This presentation is for educational purposes only.
• Fair Use Copyright Disclaimer under section 107 of the
Copyright Act of 1976, allowance is made for “fair use” for
purposes such as criticism, comment, news reporting,
teaching, scholarship, education and research.

3. Course Plan
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Applications of AR and future career opportunities
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters
Academic Practical

4. Agenda
Definition & History
How AR Works
Introductions
Who We ARe
Beyond the Box
Why AR Matters

5. Introductions
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters
What experiences have you had with
Augmented reality?
What are you hoping to take away from
this course?

6. OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters
I am… Iron Man?

7. OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and how STREAM makes it happen

8. About Me
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters
• MIS Major at Iowa State University
• VP of Digital Media at Waddell &
Reed
• 15+ years digital marketing &
marketing technology experience

9. GAME DEVELOPERS CONFERENCE NEXT
November 5-7, 2013
Expo Dates: Nov 5-6
Los Angeles, CA
GDCNext.com

11. What is AR?
Augmented reality (AR) is a live, direct or indirect, view of
a physical, real-world environment whose elements are
augmented by computer-generated sensory input such as
sound, video, graphics or GPS data.
Or… superimpose graphics, audio and other sensory
enhancements over a real-world environment in real time.
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

12. History of AR

13. History of AR

14. History of AR

15. How AR works…
How the NFL’s 1st Down Line Works: https://www.youtube.com/watch?v=1Oqm6eO6deU
• Measure the field…
• Phone scans the environment to build a 3D grid to track
• Gather Camera Position, Tilt, Zoom etc.
• Software reads your phone’s position, tilt, etc. in real time
• Yellow line is drawn and put behind players
• Software inserts AR elements and occludes them with real elements
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

16. Beyond the BoxWhy Augmented Reality Matters…

17. Boxed Media
• Media contained in a isolated environment
• Fixed in two dimensions (length X width)
•Main purpose is consumption
• It’s... Books, TV, PCs & Mobile Devices

18. We spend
70.6 hrs
per week
in The Box
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

19. The Box
Media
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

20. Media & Lifeare still on two different sides of the window

21. AR is the Bridgeto get us out of The Box...

22. From GUI to XUIinstead of looking through the window we step through it!

23. Proceed with Caution…
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

25. Questions / Thoughts
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

26. See you next time:
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Applications of AR and future career opportunities
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build
OPPORTUNITIES IN AUGMENTED REALITY
February 18th - Defining AR, its History and why it matters

27. Session 2

28. Augmented Reality
Opportunities in
with
Brian Cody

29. Course Plan
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Current Applications, career opportunities & advancing tech
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build
Academic Practical

30. Agenda
AR Career
Opportunities
Current AR
Applications
Advancing Tools &
Technology

31. Current AR Applications
OPPORTUNITIES
•Mixed Reality
•3D Visualization
•Real World Gaming
•Education & Learning
•Manufacturing
How are developers
& brands leveraging
Augmented Reality?

32. Mixed Reality Experiences

33. AR Search, Visualize & Buy
3D Product Visualization

34. GAME DEVELOPERS CONFERENCE NEXT
November 5-7, 2013 | Expo Dates: Nov 5-6 | Los Angeles, CA | GDCNext.com
3D Building Visualization

35. GAME DEVELOPERS CONFERENCE NEXT
November 5-7, 2013 | Expo Dates: Nov 5-6 | Los Angeles, CA | GDCNext.com
Real World Gaming

36. Education & Learning

37. Manufacturing

38. Downloads of AR
apps worldwide in
2022 are predicted at
+5.5 billion, a drastic
increase from the 2016
downloads which were
slightly over 1 billion.

39. Demo Time!
•3D Visualization
•IKEA Place
•InkHunter
•Gucci
•Gaming
•Angry Birds
•Lego Hidden Side
•Stack AR
•Education
•Night Sky
•Statue of Liberty
•Enter The Room

40. AR Career Opportunities

41. “As AR, VR and MR have become more
accessible to the consumer, companies have
begun to expand their programs, which has
increased the demand for candidates.”
- Lauren Williams
Division Director, Robert Half Technology

42. AR/VR content developer
AR/VR content strategist
AR/VR user experience designer
Designer, animator or sound artist
specializing in AR &VR
AR/VR community manager
AR/VR project manager

43. STREAM + AR
SCIENCE
Optics is the branch
of physics that studies
the behavior and
properties of light,
including its interactions
with matter and the
construction of
instruments that use
or detect it.

44. STREAM + AR
TECHNOLOGY
• Working with
AR platforms
• Software
development

45. STREAM + AR
RELIGION
Religious institutions all over
the world have started to
experiment with AR
capabilities. Some use it to
enhance their weekly
brochures or Christmas
invitations and others offer
tours of their worship temple.

46. STREAM + AR
ENGINEERING
Hardware Development
• Electrical Engineering
• Mechanical Engineering
• Industrial Engineering
• Chemical Engineering

47. STREAM + AR
ARTS
• Storytelling through AR experiences
• Creating 2D & 3D design assets

48. MATH
• Thin Lens Equation
• Color Space Selection
• Labeled Pixels Analysis
Based on Mean Shift
• Tracking Features
STREAM + AR

49. So why hasn’t
Augmented Reality
taken off yet?
Current State
•Technology is in its infancy
•Brand new mechanics
•‘Gimmicky’ Content
•Awkward User Experience
LIMITATIONS
How do we get there?

50. Advancing Tools & Tech

51. “I’m excited about AR. My view is it’s
the next big thing, and it will pervade
our entire lives”
“The smartphone is for everyone, we
don’t have to think the iPhone is about
a certain demographic, or country or
vertical market: it’s for everyone. I
think AR is that big, it’s huge.”
- Tim Cook, Apple CEO

52. Since 2016 Apple has
filed numerous
patents, bought
startups, hired new
managers and
launched ARKit, its AR
software developer kit.

53. “Augmented reality (will
become) a core feature of
most of Android over the
next few years.”
- Amit Singh, vice president of business and
operations for virtual reality (VR)

54. Google added
Augmented Reality to
search & released
ARCore to compete
with Apple’s ARKit.
Google says
monetization
opportunities would
arise as AR use
becomes a “daily habit”

55. Microsoft's HoloLens
2 augmented reality
headset, which
was introduced at
Mobile World
Congress last
February, is now
available to buy.

56. “It’s still not
immersive enough
for consumers.
It’s the single
most comfortable
product out there
but it’s still not
comfortable
enough.”
“All of these are
opportunities and
they give us
focus . . . We are
already working on
the next one.”
- Alex Kipman,
Technical Fellow
Cloud and AI
Microsoft

57. Over the period from 2017 to
2025, the augmented reality
market size is estimated to increase
by over 195 billion U.S. dollars,
increasing from roughly 3.5 billion
in 2017 to over 198 billion U.S.
dollars in 2025.

58. Key Takeaways
• AR is being used in a meaningful way but obstacles persist.
• Demand for candidates who can work on AR is growing rapidly.
• AR is made possible by combining all areas of STREAM.
• Major brands are investing heavily in AR to create more versatile
smart glasses and software that will enable better AR experiences.
• Soon augmented reality will join the Internet and real-time video
as an unexceptional part of our everyday lives.

59. Questions / Thoughts

60. See you next time:
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Current Applications, career opportunities & advancing tech
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build

61. Session 3

62. Augmented Reality
Opportunities in
with
Brian Cody

63. Course Plan
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Current Applications, career opportunities & advancing tech
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build

64. • AR Creation Tools & Apple ARKit Overview
• Instructions & Team Setup
• Reality Composer Training & Examples
• App Build Ideas???
• More AR Apps & Demos
Agenda

65. AR Creation Toolsoptions for building Augmented Reality Experiences
ARKit: Reality Composer

66. ARKit3
• Show AR content in front of or behind people.
• Tracking up to three faces at a time.
• Integrate human movement with skeletal tracker.
Reality Composer allows you to quickly prototype and
produce content for AR experiences that are ready to
integrate into apps using Xcode or export to AR Quick Look
About Apple’s ARKit3

67. Scene / Anchor Setup
Navigating the Environment
Deleting & Adding 3D Objects
Reality Composer Tasks
Editing Objects
Display in AR
Adding Behaviors
Applying Physics
Animating Objects
Sharing the Experience

68. Reality Composer
Demos…
BLAST OFF!
AR Holiday Card

70. Key Takeaways
• There are many FREE options available to design augmented
reality experiences for Social Media and Media Apps.
• Apple’s Reality Composer design tool allow you to quickly and
easily prototype Augmented Reality experiences.

71. App build ideas??

72. More Demos!
•3D Visualization
•IKEA Place
•InkHunter
•Gucci
•Gaming
•Angry Birds
•Lego Hidden Side
•Stack AR
•Education
•Night Sky
•Statue of Liberty
•Enter The Room

73. See you next time:
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Current Applications, career opportunities & advancing tech
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build

74. Session 4

75. Augmented Reality
Opportunities in
with
Brian Cody

76. Course Plan
1. Session 1: Defining AR, its History and why it matters
2. Session 2: Current Applications, career opportunities & advancing tech
3. Session 3: Apple Reality Composer Setup, Overview and Demos
4. Session 4: Apple Reality Composer - Application build

77. Curé of Ars
STREAM AR App
The Pope Francis
Experience

78. 1. Create new .reality file with Image Anchor Type
2. Set PopeFrancisAnchor.jpg as the anchor image
3. Create “Early Life” text button and “shelf” object
4. Add family.jpg, class.jpg, child.png images using
the Frames object type in the Arts section
5. Add Flag.usdz 3D model and blue rings
6. Add text from JorgeCollege.txt
7. Add behavior to hide all objects (except button)
on Scene Start
8. Add button tap behavior to show objects on play
flag Usdz Animation
9. Add Tap and Play Sound behavior to play Pope
Early Years.m4a audio file on button tap
10.Use AR & play buttons to save, test and iterate
11.Extra Credit: Add sequenced animations
Pope Francis App Build
3
3
2
4
4
4
55
5
Dropbox ▸ CureStreamAR ▸ FrancisAR
6

79. 1. Create new .reality file with Image Anchor Type
2. Set PopeFrancisAnchor.jpg as the anchor image
3. Create “Early Life” text button and “shelf” object
4. Add family.jpg, class.jpg, child.png images using
the Frames object type in the Arts section
5. Add Flag.usdz 3D model and blue rings
6. Add text from JorgeCollege.txt
7. Add behavior to hide all objects (except button)
on Scene Start
8. Add button tap behavior to show objects on play
flag Usdz Animation
9. Add Tap and Play Sound behavior to play Pope
Early Years.m4a audio file on button tap
10.Use AR & play buttons to save, test and iterate
11.Extra Credit: Add sequenced animations
Pope Francis App Build
3
3
2
4
4
4
55
5
Dropbox ▸ CureStreamAR ▸ FrancisAR
67
8
9

80. Final Key Takeaways
• Soon AR will be a common
medium with TONS of career
opportunities supporting it.
• Start creating AR experience
NOW with the many FREE
options available.
• Try Swift Playground to learn
more about coding and
software development.
Swift Playgrounds

81. Thank You!

82. Legal Copyright Disclaimer
• This presentation is for educational purposes only.
• Fair Use Copyright Disclaimer under section 107 of the
Copyright Act of 1976, allowance is made for “fair use” for
purposes such as criticism, comment, news reporting,
teaching, scholarship, education and research.