Sliced Bread's main role in the VR has been the creation of models, animation and lighting using Maya and Unity. In the medical VR session I will be demonstrating key do's and don'ts in developing a VR pipeline, bringing in some learnings from our early projects. Given the nature of production, planning all the asset requirements is key. Unlike linear animation, where everything is built to camera, here you build for the environment. That means many more assets and detail and you’ll need to balance that with performance constraints (polygon count etc.). You won’t want to compromise the experience either, VR projects are not particularly cheap to produce and against the investment, you’ll want to be sure the end-user walks away with lasting memory of their experience.
3. "Virtual Valve uses Oculus Rift’s virtual reality headsets combined with
motion sensor technology to enable hundreds of delegates to experience
travelling through the aortic arch into the heart with full 360 degree vision.
Once inside, they were able to explore the left ventricle and interact with
the experience to simulate levels of aortic stenosis and assess the impact
of this condition on the patient’s heart."
4. We are approaching a phase where we are no longer voyeurs,
looking outside in, observing someone else’s life. We are now
approaching a world where we are physically in the film.
5. “Another VR phenomenon linked to emotional
experience is presence. Presence is a dimensional
construct and describes the extent to which a user
feels present in a VR environment1”
1Mike Cartel, “Why VR “Storytelling” does not currently work. And can it ever work?” 11th January 2016
6. We are used to viewing in flat film but now we have the 360
dimension which opens up our peripheral, enhancing our
presence further.
7.
8. 1. Engage your audience
2. Build the scene
3. Build tension and release tension
4. Focus on what's important
5. Keep the flow logical
6. Make it feel conclusive
13. VR projects are not particularly cheap to produce and against
the investment, you’ll want to be sure the end-user walks away
with lasting memory of their experience.
15. Whenever you start a VR project there is this inherent
excitement that everything is possible, and you are going to do
something breathtaking and awesome.
17. A pipeline is essential. There is the model build, the testing,
then texturing and performance considerations. That often
means flicking through various different pieces of software.
19. Third party software is constantly updating and it’s definitely
worth keeping an eye on new releases and features in case they
can enhance the process and experience.
21. Goes without saying really, but testing, testing, and testing is
integral to any VR production. In all our projects there was
constant flow of testing and adjustments.
22. Virtual reality is great at replicating the feeling of real
life, but mind how you replicate it.
23. 5 Do's and don'ts when developing a VR pipeline
Website: thebestthingsince.com/
Follow us: twitter.com/slicedbreadanim
Editor's Notes
Given the nature of production, planning all the asset requirements is key. Unlike linear animation, where everything is built to camera, here you build for the environment. That means many more assets and detail and you’ll need to balance that with performance constraints (polygon count etc.). You won’t want to compromise the experience either, VR projects are not particularly cheap to produce and against the investment, you’ll want to be sure the end-user walks away with lasting memory of their experience. When they first put on the headset, the first thing they do is look ALL around. And that’s where you need the *WOW* moment!
The two common measurements of a game model’s “cost” are polygon count and vertex count. Depending on the use, a game model may stretch anywhere from 2 triangles for a billboard, to 40,000+ triangles for a complex character. (reference)
Whenever you start a VR project there is this inherent excitement that everything is possible, and you are going to do something breathtaking and awesome. Then you set about creating your experience, 2 of our projects involved going inside the human body, in one example we wanted to demonstrate synapse pulses of the brain coupled with a ride. We started by planning a procedural type of rollercoaster ride, but when we tested that with others they reported the feeling of sickness. I think the learning from this is that sometimes the ‘vista’ is enough of an experience and that you should try to avoid putting everything in the mix, especially if there are essential take aways, like education and learning.
VR devices can cause fatigue and nausea because of the “flat plane” 3D images they produce. Since those images don’t contain any depth information, your eyes can’t focus on near and far objects like you would in real life. Our brains want physical actions (like focusing) to jibe with what we see, so any disconnect can make us sick. (reference)
One of the thankful things about VR against standard film animation is that you don’t have to sweat over render times. At the other end through, a pipeline is essential, there is the model build and testing, then texturing and performance considerations. That often means flicking through various different pieces of software and equipment.
One of the learnings we found was what you may view in Maya (or any other 3D software package) was not what was viewed in the Oculus. Given that we were attempting to create medically accurate visuals this was often challenging. And at all costs avoid images with transparencies (pngs).
When we did our first VR project, Unity was not as advanced as it is now, and we came across a few issues. That meant we had to reconsider standard approaches we would normally have done. That was particularly relevant with animation, for example, deformers in Maya don’t work, and we had to use a frame-by-frame export method, a bit like using replacement heads in stop-frame animation.
Unity is constantly updating and it’s definitely worth keeping an eye on new releases and features in case they can enhance the process and experience.
Goes without saying really, but testing, testing and testing is integral to any VR production. In all our projects there was constant flow of testing and adjustments. Its important to allow enough time in the schedule to work this through. It is still new technologies and therefore it doesnt come without faults.
