Virtual reality, augmented reality, and mixed reality are emerging technologies that are shaping journalism, storytelling, and how consumers engage with media. VR and AR were originally used for entertainment but are now being applied to deliver informative, factual, and non-fiction content. News organizations are experimenting with VR newsrooms to tell immersive stories in interactive and nonlinear ways. The future of immersive journalism will leverage volumetric video, high-end capturing equipment, computer vision, and analytics to provide unique experiences for users across VR, AR, and responsive web platforms.

1. Augmentingthepowersofjournalism
Caro Milkezby

2. Immersivelandscape
AR VR
RealWorld MetaVerseComputer simulated
environment, track
head movement and
positional data
Opticalheadmounted
display. Overlays text,
information and graphics
on top of real
environment
A composite view
of computer
generated images
and the viewers
real world
MR
Whatisvirtualreality,augmentedrealityandmixreality?

3. Newsrooms Journalist Storytelling ConsumersPublishing
Attheconvergenceofmediaandtechnology,journalismisoneofthemost
prominentfieldswhereemergingtechnologiesareshaping,thenewsroom,
publishinghouses,journalist,storytellingandconsumers

4. Theywayweconsumestories,howthosestoriesaretoldandtheway
storiesarebeingmadehasbeenhighlyinfluencedbythegaming
industry.

5. Technologiesthatwereuseasaformofentertainmentareinthevergeof
becomingwidespreadindeliveringinformative,factualandnon-fiction
content.
http://emblematicgroup.com

6. Googledaydreamcontent
VRNewsrooms
https://vr.google.com/daydream/

7. GoogleGoogleDaydreamVRplatformlaunchedin2016.ShowcasingleadingnewsbrandsNYTimes,WSJ,CNNtheGuardian,
ARTE,BBCZDF
VRNewsrooms
https://vr.google.com/daydream/

8. Productsforearlyadopters&Innovators
Brandsarewantingtoridethewaveofinnovationandarereadytotakethelongshotinuser
reachasmuchofthisexperiencescurrentlyreachonlyanspecificniche
Early Adopters Innovators
Early Majority Late Majority Laggards
Nevertheless,thisareinfluentialtargetgroupsforbrand
awarenessandrecognition.

9. compellingengagingstoriesthatwraparoundthefactual,informativecontent.
Thecoreiscontent

10. Howtoengageusersinthevirtualspace?

11. Dynamicstorytelling
Theviewerisincontrol
• Story structure is branched, there is no
predefine order to the story
• Thinking in multiple perspectives
• Active consumption
• Observing vs. participating audience
• Engage participate and shape the story
• Allow users to explore at own pace
• Explores narrative elements independently, thus
affecting the narrative of the story
• Freedom to shape the story through movement and
interactivity
Story Audience

12. Storytellingmodels
Theaudienceactivelyexploretheexperience
non-
linear
linear
ImmersiveStorytelling AR/VR

13. ElementsofVRstorytelling
Acclimation
Guidestheusertofollow
thesuspensefulplot
Spatialsound
calltostory,guiding
titlesandgraphics
Gazebasenarratives.
Highlightstory
elementstocreate
affordance foruser
Timedelayedaction
Thenarrativeaddressestheviewer,
Theenvironmentcallstheuser.
Acknowledgment

14. HandsonexperienceinthefieldofAR/VR

15. Winner Journalism 2030 Hackathon
Augmented Reality Challenge
RedBull and Asus
Participated in FC Bayern Hackathon
Magenta VR Challenge
Telekom and FC Bayern
ImmersiveHackathons
Team: ThomasFickert,AlexanderHofmann,
RichardJoerges,CaroMilkezandMinhTri
Team: ThomasFickert,AlexanderHofmann,
Verena,CaroMilkezandNA,NA,

16. EventARApp,wherethehackathonwasdocumented.Theusercouldgobacktothelocationanre-experiencetheevent.
ARApp:Documentingahackathon

17. ARAppandexperiencemanagingsystemforallimmersiveexperiences
HowdoesJournalismlookslikein2030?
• Experience Managing System for VR and
AR applications
• 3D assets library
• Meta data and geolocation can facilitate
assets to recreate the environment
• Library of haptics
• Advertising models
Re-creatinganevent:
Mountainbike

18. FCBayernHackathon
Multiplayerparticipation:RealtimeVR/AR
Cross-location-inaneventlocation,thewhole
stadiumoranywhereworldwide.
Cross-realityusingthefullspectrumof
immersivemedia&technologies,beiteither
AR/MRorVR.
Cross-eventthismeanseitherliveoron-
demand.

19. Thefutureofimmersivestorytelling

20. VR&ARStatedoftheart
Realtimeexperiencesforhighendapplications,uniqueexperiencesforusers
• Volumetric video
• High-end capturing equipment
• Computer vision
• Analytics
• Korea 2018 winter olympics:
Intel’s True VR camera allow
users to view the games
through different perspectives
https://youtu.be/WutiTAJxhq4

21. WebVRandWebAR
WebAR/VRenablesURLshareabilityforimmersiveexperiences.
https://www.unit9.com
Responsivewebextendsoverdesktop,tableandmobiletoXR

22. WebXRDeviceAPI
AFrame
ARCore:
AR.JS
Experimentalplatforms,
frameworksandplaygrounds
Experimental platform for AR web
experiences with javascript
library,three.ar.js, and prototype browsers
for ARCore on Android and ARKit on iOS.
https://developers.google.com/ar/develop/web/quickstart
Augmented reality for the web,
https://github.com/jeromeetienne/ar.js
A web framework for building virtual reality
experiences
https://aframe.io/
The WebXR Device API provides
interfaces to VR and AR hardware to
allow developers to build compelling,
comfortable VR/AR experiences on
the web.
https://immersive-web.github.io/webxr/

23. Thebeautyoftheweb
Thinksimple,shareabilityreachesthewideraudience
Early Adopters Innovators
Early Majority Late Majority Laggards
Thankyou,CaroMilkez www.theblurcircus.com www.caromilkez.com