This document provides instructions for playing 360 videos in Unity. It includes: 1. Installing Unity and creating a new project 2. Placing a main camera at the origin and adding a large surrounding sphere 3. Adding a custom shader and material to make the sphere's inside texture visible 4. Importing a 360 video and assigning it as the material's texture 5. Adding a script to playback the video texture on the sphere 6. Adjusting the main camera position to view different areas of the 360 video

1. Project:
Play 360 Videos in Unity
By Shanyuan Teng
https://github.com/tanyuan
http://tengshanyuan.com/

2. Basic Idea Sphere: 360 Video
Camera

3. Install Unity
Please note that different versions of Unity are not compatible. You should
export/import packages (.unitypackages) for cross versions. Export as packages
before updating your Unity.
For this example: 5.3.4f1 Personal

4. Create a project

5. Hierarchy
GameObjects
Inspector
GameObject
Components
Assets
Files
Unity is a 3D programming environment

6. Save the scene! (360Video.unity)
Unity might crash at any time so please Ctrl + S / Cmd + S frequently.

7. 1. Place the main camera to the origin (0, 0, 0)

8. 2. Create a big sphere called VideoSphere that
surrounds the camera

9. Unity default texture can only be seen
from outside, so we need a custom
shader to make inside texture visible.
A material contains a texture (what to render) and a shader
(how to render)

10. 3. Create a folder Materials and create a material
(360Video)

11. Drag material 360Video to Inspector of VideoSphere

12. 4. Create a folder Shaders and create a shader
(InsideVisible)

13. Double click to edit. Replace the code from the repo.

14. Drag InsideVisible to material of VideoSphere

15. 5. Create a folder Videos, drag the video inside, and
drag it to the material as texture.
It might take a while importing videos to Assets. (even 10+ min)

16. Now we need to tell Unity to play the
video texture.
We use the built-in MovieTexture.

17. 6. Create an empty GameObject and name it
VideoPlayback

18. Add a script VideoPlayback.cs to VideoPlayback
Add Component > Create a C Sharp script > Edit Script

19. Paste the code from the repo.

20. 6. Drag VideoSphere to Sphere
Every public member will appear in Inspector.

21. 7. Click play!
You can live adjust Main Camera Position and Rotation to find other Pokémon.

22. Any adjustment in Play mode will be lost.
Write down the value if you need to save for later use.

23. 8. Play sound
Add Component > Audio Source > select Audio Clip as the same with the video

24. Stream from 360 camera
Ricoh Theta S as an example

25. 1. Switch to LIVE mode on Theta S
While holding the camera icon button, press power button to go to LIVE stream
mode. Then connect it to computer via USB.

26. 2. Install RICOH THETA UVC Blender (Mac, Win)
Richo Theta S captures dual fisheye views, while this driver can blend the two
views into a single equirectangular view.
即時串流應用程式 https://theta360.com/ct/support/download/
RICOH THETA S - Dual Fisheye (native) THETA UVC Blender - Equirectangular (with driver)

27. 2. Add a script (WebCamStream) to VideoPlayback
Drag the VideoSphere and specify Camera Number.
Device 0: RICOH THETA S
Device 1: THETA UVC Blender
Device 2: FaceTime HD Camera
Play once and check Unity console:
Uncheck
Check

28. Note: 360 Video on mobile devices
Unity built-in MovieTexture does not support mobile platforms (iOS, Android).
AVPro Video plugin ($450) provides good support for mobile and high resolution
videos.