How the User interactions evolved with time and why it is important to think beyond the keyboard and screen. Where is the industry heading and how will it impact the lives of everyone?

2. Think Beyond Keyboard and Screen
by
Kuldeep Singh
Principal Technologist, ThoughtWorks
kuldeep-reck thinkuldeep

4. Evolution of
Technology &
User Interactions
Beyond
Keyboard and
Screens
ARVR is here to
stay
Impact of ARVR
Get ready...

5. Evolution of Technology and Interactions
Recap

7. Evolution
Batch Age
1940 1970 2000
CLI Age GUI Age Interactions Age
1980 1990 2010
Internet Age
2019
AI Age
No Interactions Attentive WYSIWYG Seamless transition Touch and Feel Immersive

8. Virtual is new real.

9. Beyond Keyboard and Screen

10. ●No GUI or Minimal UI
●Sound and Touch
●Wearables
○ Clothing
○ Shoe
○ Gloves
○ Watch
●Smart dust
No UI
I'll believe it when I see it

11. ●Brain Computer Interface
●Smart contact lens
●Edible tech: Smart pills
●Foldable tech
●Scanners - Skin, Iris, Retina, Tears
●Behaviour & Emotions
●Gestures
Getting inside

12. Holograms
Volumetric Display
3D Videos
HUD
Augmented Reality and
Virtual Reality
Spatial Displays

13. Augmented reality (AR)
overlays digital content in
the live environment.
Augmented Reality

14. A complete immersive
experience that shuts out
the physical world and takes
into the virtual world.
Virtual Reality

15. Combination of both AR and
VR, where physical world
and digital objects interact.
Mixed Reality

16. ARVR is here to stay
Where are we in ARVR space?

17. XR - AR/VR/MR, Augmented VR, Virtual AR
Mixing, Interactions
Treadmill with VR
GPS enabled VR Tours
Try augmenting on virtual objects

18. Terminologies
● IMU - Accelerometer, Gyroscope, Magnetometer
● Degree of Freedom - 3DOF, 6DOF
● Depth Sensing - IR, Dual Camera
● SLAM
● Feature Points - Cloud Anchors
● Occlusions
● Light Baking

19. Mobile XR

20. Web XR
Do I need HMD device?
Do I need apps to download?
Do I need browser plugin to download?
https://codelabs.developers.google.com/codelabs/ar-with-webxr/#0

21. Tools and Tech...
Devices
● VR - Oculus Go, GearVR, Vive, Cardboard
● AR - Google Glass 2, Vuzix, Epson, Lenovo Mirage, Dell Visor
● MR - Hololens 2, Magic Leap, Lenovo ThinkReality A6, Dell Visor,
Samsung Odyssey
Development Tools
● ARCore and ARKit
● Wikitude - full computer visions engine sdk , C++, Java,
Javascript, ObjC.
● Unreal Engine - Epic Games - C++
● Vuforia - PTC
● Unity Engine - C# and Javascript
● UWP - MS.

22. ●Industry adoption (in last 2-3 years) - wait
and watch
●Device incapability - Business need precision,
more power, and adaptation to environment
●Outdoor is too much variations
●AI enabled Virtual Environment may help
●Laws and Regional Regulations - Face
recognition, biometric data storage, GDPR
●Industry practices are missing.
Challenges

23. Impact of ARVR
How it impacts of life of software development and
developers?

24. Software Engineering -> Art and Science
●Working conditions
●Context driven
●Virtual environments
●Sound and lights
●Color
●World space - Real Scale
●Estimations

25. Business Analysis >> Movie Director
●Gamify the experience
●Open 3D space
●Control the sound and lights
●Changing Inputs
●Changing Outputs
●Making it Real.

26. Graphic Designers >> Multimedia Artists
●3D Modeling
●Textures
●Animations
●Video mockups

27. Developer >> Mathematician >> Scientist
●Vector and Statistics
●Geography
●Physics
●Estimations
●CV, AI, ML
●Software development

28. ●Stay ready take up the challenge, and
practice more...
●Create environments, and make it the
mainstream...
●Setup studios - where people come and
experiment, share devices.
●Trainings and community
The way a head ...

29. Thank you!
Kuldeep Singh
Principal Technologist, Head of ARVR Practice, ThoughtWorks
kuldeep-reck
thinkuldeep
Join us - ARVR Enthusiasts