Today the parallel experience can be done in two ways: The augmented reality in which our physical environment is increased. Virtual reality where we are completely immersed in a new universe. These two implementations are of course very different and do not respond to the same needs. But what are the interactions at our disposal? With the rise of technologies of parallel realities, it is important to know the best methods of interaction within these worlds. Once immersed in a virtual environment, should we privilege the physical buttons on the helmets or the interactions of the gaze? By increasing our real world, should we add virtual buttons to this increased environment or back to physical interactions on the smartphone? We will show you the different ways to develop a parallel experience and show the best practices of interaction in the increased world then in the virtual environment under Android. Link to virtual reality project : https://github.com/wajdibr/interaction_google_daydream Link to augmented reality project : https://github.com/wajdibr/interaction_vuforia_virtual_buttons

1. INTERACTIONS IN PARALLEL
WORLDS WITH ANDROID
Wajdi Ben Rabah
www.wajdibr.com/
@WajdiBenRabah

3. #appbuilders17

4. Plan
⬡Android as an OS
⬡Parallel realities ?
⬡Application area
⬡Interactions in parallel dimensions
⬡Live coding
⬡What’s coming next

5. Android
⬡Linux based OS.
⬡Open source.
⬡Android TV, Android Auto, Android
Wear.
⬡Android Nougat 7.1
1/25

6. Android
2/25

7. Parallel realities
3/25

8. Virtual Reality
⬡Artificial environment,
presented as reality
alternative.
⬡Experienced senses:
⬡Hearing.
⬡Sight.
4/25

9. Headsets
5/25

10. Google Daydream
⬡New Google platform for virtual reality.
⬡Sensors
⬡Screen resolutions QHD 1440p + OLED
⬡Android N.
⬡CPU (snapdragon 820) +GPU+RAM
⬡60fps stereoscopic.
6/25

11. Application areas
⬡Health
⬡Entertainment
⬡automobile
⬡Ads
⬡Education
⬡Tourism
⬡Space / Military
7/25

12. Augmented reality
⬡A way of fusing the real and the virtual world by overlaying digital data
on to real-world analogue views.
⬡Anyone with a mobile phone or laptop with built-in video capability
can augment and extend their reality with easy-to-use applications.
8/25

13. Application areas
⬡Games
⬡Marketing
⬡Fashion
⬡Social media
⬡Health
⬡Tourism
⬡Industry (cars, boats …)
⬡Press
⬡Ads
9/25

14. Application areas
10/25

15. Marker-based VS Location-based
11/25

16. VR or AR ?
⬡AR:
⬡Combine the real world and virtual data in real time.
⬡Be interactive in real world.
⬡Using a 3D environment.
⬡VR:
⬡Alternative to the real world.
⬡Creation of content.
12/25

17. VR and AR tinker with our reality — but
AR enhances it, while VR diverts us from
it.
13/25

18. Interact in the parallel dimension
14/25

19. Daydream controller
15/25

20. Eyes tracking / Gaze input
16/25

21. Virtual buttons
17/25

22. Requirements
⬡Android smartphone (Android Nougat as a min version).
⬡Daydream SDK.
⬡Android SDK.
⬡Unity 3D / Android Studio 1.0 and above.
18/25

23. Android
<manifest ...
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" />
...
<uses-sdk android:minSdkVersion="19" android:targetSdkVersion="25"/>
...
<uses-feature android:glEsVersion="0x00020000" android:required="true" />
<uses-feature android:name="android.software.vr.mode" android:required="false"/>
<uses-feature android:name="android.software.vr.high_performance" android:required="false"/>
...
19/25

24. Android
<application
...
<activity
android:name=".TreasureHuntActivity"
android:screenOrientation="landscape"
android:configChanges="orientation|keyboardHidden|screenSize"
android:enableVrMode="@string/gvr_vr_mode_component"
android:theme="@style/VrActivityTheme"
android:resizeableActivity="false">
...
<intent-filter>
<action android:name="android.intent.action.MAIN" />
<category android:name="android.intent.category.LAUNCHER" />
<category android:name="com.google.intent.category.CARDBOARD" />
<category android:name="com.google.intent.category.DAYDREAM" />
</intent-filter>
</activity>
</application>
20/25

25. Unity3D
⬡Unity is a platform for
creating experiences in 2D
and 3D.
⬡SDK : simplify the
creation of a VR/AR
experience.
21/25

26. Google Design Lab
22/25

27. Demo
23/25

28. Download the project
24/25
Interactions in
virtual
dimension
Interactions in
augmented
dimension

29. Future of parallel worlds
⬡Lower price for devices.
⬡“VR/motion sickness”
⬡Tango project.
⬡Loneliness/Isolation.
25/25

30. References
⬡https://developer.vuforia.com
⬡https://developers.google.com/
⬡http://www.vrs.org.uk/virtual-reality-games/future-expectations.html
⬡https://www.google.com/atap/project-tango/
⬡http://answers.unity3d.com/
⬡https://www.assetstore.unity3d.com
⬡http://www.augment.com/

31. Thank you !
@WajdiBenRabah