Delivered at Casual Connect USA 2018. In this presentation Dale will discuss the techniques developed to create immersive and hyper realistic audio experiences in the Amazonian Rain Forest. Topics include Adaptive Music, Sound Effects, Ambience, and Animal Vocalizations provided by human voiceover actors. The platforms discussed will include Unity, FMOD, Elias, and Google’s Resonance Audio and how the creative vision of the game designers were delivered utilizing these various modalities.

1. Immersive Music,
Sound and Voice in
Mobile VR – Exploring
the Amazonian
Rainforest
Dale Crowley
Creative Director at Somatone
Interactive and Director of
Business Development at Elias
Software

2. Designing Music NOW
This talk will be available for download from
www.DesigningMusicNOW.com after the show

3. What Will We Cover?
Flutter VR –
the Game
3D
Positional
Audio
Basics
FMOD +
Resonance
Audio
Music –
Elias
VO –
Critters
Conclusions

4. Flutter VR

5. Flutter VR
• Meditative Experience
• Instill Awe for Nature and the
Environment
• Catalog Butterflies with your Camera
• Set up Camp
• Explore the Amazon Rain Forest
• Realistic Sound Effects – Camp Site,
Camera, Interacting with trees, water,
and other objects
• Ambient Environments – Day Night
Cycle
• Relaxing Music + Stingers
• Voice Overs – for Rainforest Denizens

6. Teaser Trailer

7. Runaway Play Team

8. Teaser TrailerFlutter Gameplay/Review

9. 3D Positional Audio

10. Resonance Audio
The Resonance Audio Soundfield plugin supports FOA encoded
in the AmbiX (Amisonic data exchange) (ACN-SN3D) format

11. The Math
Is really really hard (and CPU intensive)
Spherical Harmonics up to Ambisonic order 5 as
commonly displayed, sorted by increasing Ambisonic
Channel Number (ACN), aligned for symmetry.

12. Level + Time Differences

13. Wavelength Matters
High Frequency > 1.5 kHz smaller than your head
Frequency Wavelength (feet)
100 Hz (~G1) 11.25 ft
500 Hz (~B2) 2.25 ft
1000 Hz 1.13 ft (13.5 in)
1500 Hz .72 ft (8.6 in)

14. Height Detection – Ears are Filters (and we move our heads)

15. Early Reflections

16. Binaural Rendering - HRTFs

17. Occlusions

18. Reverb – Size and Surface materials, Different for each ear

19. Directivity

20. Google Audio Room - Room Materials

21. FMOD Implementation

22. Audio Listener
• Add the Audio Listener to the Master bus

23. Ambisonic
Event
Audio Source
Ambisonic Event

24. 3D Audio Source
Mono Audio

25. Curve Type
Falloff Distance
Spread, Occlusion,
Directivity

26. Elias Implementation

27. ELIAS + FMOD: Two Great Middleware Working Together
ELIAS
Flutter VR
FMOD

36. ELIAS + FMOD – Programmer Sound

37. Flutter VR OST

40. Animal VO

41. Birds of the Amazon
Spectacled Owl
Blue-throated
Bellbird
Taco Toucan Screaming Piha

42. Frogs of the Amazon
Yellow Banded
Poison Dart Frog Monkey Frog
Strawberry Poison
Dart Frong
Golden Poison
Dart Frog

43. Mammals of the Amazon
Howling Monkey Kinkajou Capybara Ocelot

44. Ambient Loops for Different Times of Day
Forest Ambience Jungle Ambience Night Forest Rain Night

45. Capybarra VO (Human)
Bark Chirping Frustrated Singing
Created by Alex Walker Smith

46. Tips and Tricks

47. Repeat Important Sounds

48. Move the Source when Player is not looking

49. Use Ambisonics for distant Ambeint sounds
Ambisoncs DO NOT respond to Movement through the scene, only Head Movement

50. Ambix Encoder VST
http://www.matthiaskronlachner.com/?p=2015

51. Use Point Sources and sprinkle them throughout
Birds, Insects, Randrops

52. Use A Broad range of Frequencies

53. www.SomaTone.com
www.EliasSoftware.Com
www.DesigningMusicNOW.com
Dale Crowley
Creative Director at Somatone
Interactive and Director of
Business Development at Elias
Software. Founder of Designing
Music NOW.