Geollery: A Mixed Reality Social Media Platform

Ruofei Du
Ruofei DuResearch Scientist at Google
Geollery: A Mixed Reality Social Media Platform
Ruofei Du, David Li, and Amitabh Varshney
image courtesy: plannedparenthood.org
Introduction
2
image courtesy: huffingtonpost.com
Introduction
3
Motivation
4
image courtesy:
instagram.com,
facebook.com,
twitter.com
Motivation
5
Motivation
image courtesy:
pinterest.com
6
Motivation
image courtesy:
viralized.com
7
Motivation
8
Motivation
9
Related Work
10
Related Work
11
Related Work
12
Related Work
13
Related Work
14
Related Work
15
Related Work
16
Related Work
17
Related Work
18
Related Work
19
Related Work
20
What's Next?
What may a social media
platform look like in mixed reality?
21
What's Next?
What if we could allow social media
sharing in a live mirrored world?
22
What's Next?
What use cases can we benefit
from social media platform in XR?
23
Geollery.com
24
Geollery.com
25
Conception, architecting & implementation
Geollery
A mixed reality system that can depict geotagged social
media and online avatars with 3D textured buildings.
26
Extending the design space of
3D Social Media Platform
Progressive streaming, aggregation approaches,
virtual representation of social media, co-presence
with virtual avatars, and collaboration modes.
27
Conducting a user study of
Geollery vs. Social Street View
by discussing their benefits, limitations, and potential
impacts to future 3D social media platforms.
28
System Overview
29
System Overview
30
System Overview
31
System Overview
32
System Overview
33
System Overview
34
System Overview
35
System Overview
36
System Overview
37
System Overview
38
System Overview
39
System Overview
40
System Overview
41
System Overview
42
System Overview
43
Design Space
44
User Study
45
20 participants (10 females; age range: 21 - 30, with an average of 25.75 and standard
deviation of 3.02) via campus email lists and flyers
User Study
46
User Study
47
A background interview
An exploration of Geollery and Social Street View
A quantitative evaluation
A discussion session about the future of 3D social media platforms
User Study
48
User Study
49
User Study
50
User Study
51
User Study
52
User Study
53
I post news about sports and
games every day.
54
I majorly use Instagram, I post
from my own portfolio.
55
User Study
56
User Study
57
User Study
58
University Campus New York City Washington D.C.
User Study
59
What's Next?
What's your first impression?
60
First Impression
61
I think it’s a very good start, it’s
very good experience to walk
around.
62
I believe I am in a museum.
63
I like that the buildings are
forming while I am walking.
64
It's cool to see posts by people
in real time, along with the
establishment they're in.
65
It’s like you don’t have to be
there.
66
User Study
67
User Study
68
User Study
69
Post Interview
Suppose that we have a polished 3D social media
platform like Geollery or Social Street View, would you
like to use it? If so, how much time would you like to
spend on it?
70
Post Interview
71
I would like to use it every day
when I go to work, or travel
during weekends.
72
If it’s not distracting like
Facebook and Instagram, I
would use it every day on a
couple of things.
73
I am a follower on most social
media sites. I would only join a
3D social media platform once
my friends are there.
74
If my friends are all on this, I
can see myself spend a couple
of hours every week.
75
I don’t think I will use this. I
prefer to use Yelp to see
comments [of nearby
restaurants]
76
Post Interview
Can you imagine your use cases for Geollery and Social
Street View? What would you like to use 3D social media
platforms for?
77
I would like to use it for the food in
different restaurants. I am always
hesitating of different restaurants. It
will be very easy to see all restaurants
with street views. In Yelp, I can only see
one restaurant at a time.
78
[I will use it for] exploring new places. If
I am going on vacation somewhere, I
could immerse myself into the location.
If there are avatars around that area, I
could ask questions.
79
I think it (Geollery) will be useful for
families. I just taught my grandpa how
to use Facetime last week and it would
great if I could teleport to their house
and meet with them, then we could
chat and share photos with our
avatars.
80
… for communicating with my families,
maybe, and distant friends, [so] they
can see New York. And, getting to
know more people, connecting with
people based on similar interests.
81
Post Interview
If you were a designer or product manager for Geollery
or Social Street View, what features would you like to
add to the systems?
82
A mapping of the texture,
high-resolution texture, will be
great.
83
if there is a way to unify the
interaction between them,
there will be more realistic
buildings [and] you could have
more roof structures. Terrains
will be interesting to add on.
84
I would like to see kitties and
puppies running around, and
birds flying in the air
85
I could also add a bike, add a
vehicle, a motorcycle in
Geollery, this will add some
fun.
86
Insights
87
High-quality content and seed users play key roles
Insights
88
Interactivity and panoramic textures matter.
Insights
89
Customization of avatars, diversity, and accessibility are crucial.
image courtesy:
Facebook
Messenger
Discussion
90
...
Discussion
91
...
Discussion
92
Discussion
93
Challenge
94
Research Goal
95
Future Directions
96
Future Directions
97
Future Directions
98
Future Directions
99
Future Directions
100
Future Directions
101
Acknowledgement
102
Acknowledgement
103
Thank you!
Ruofei Du, David Li, and Amitabh Varshney
Geollery: A Mixed Reality Social Media Platform
Ruofei Du, David Li, and Amitabh Varshney
Geollery: A Mixed Reality Social Media Platform
Geollery: A Mixed Reality Social Media Platform
1 of 107

Recommended

Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Soc... by
Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Soc...Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Soc...
Project Geollery.com: Reconstructing a Live Mirrored World With Geotagged Soc...Ruofei Du
214 views123 slides
Google Plus: Changing The Way We Share by
Google Plus: Changing The Way We ShareGoogle Plus: Changing The Way We Share
Google Plus: Changing The Way We ShareChristian Adams
304 views28 slides
Concept art style ha 5 task 3 by
Concept art style   ha 5 task 3Concept art style   ha 5 task 3
Concept art style ha 5 task 3NeilRogero
106 views2 slides
10 Mobile Social Trends for 2012 and Beyond: Customer Engagement Technology W... by
10 Mobile Social Trends for 2012 and Beyond: Customer Engagement Technology W...10 Mobile Social Trends for 2012 and Beyond: Customer Engagement Technology W...
10 Mobile Social Trends for 2012 and Beyond: Customer Engagement Technology W...David Berkowitz
4.3K views97 slides
Unveiling the web, making the implicit explicit. by
Unveiling the web, making the implicit explicit.Unveiling the web, making the implicit explicit.
Unveiling the web, making the implicit explicit.Ian Mulvany
716 views68 slides
Virtual reality by
Virtual realityVirtual reality
Virtual realityangelina2632
378 views22 slides

More Related Content

Similar to Geollery: A Mixed Reality Social Media Platform

Eyeo festival redux by
Eyeo festival reduxEyeo festival redux
Eyeo festival reduxthas naseemuddeen
1.5K views29 slides
FMS2010 Go Global Masterclass - Social Media by
FMS2010 Go Global Masterclass - Social MediaFMS2010 Go Global Masterclass - Social Media
FMS2010 Go Global Masterclass - Social MediaGo Global
529 views61 slides
Developer of the Minute by
Developer of the MinuteDeveloper of the Minute
Developer of the MinuteMicky Metts
919 views28 slides
Denis cronin 10103031 individual report interaction design by
Denis cronin 10103031 individual report   interaction designDenis cronin 10103031 individual report   interaction design
Denis cronin 10103031 individual report interaction designDenis Cronin
227 views5 slides
16 interesting ways_to_possibly_use_google_ by
16 interesting ways_to_possibly_use_google_16 interesting ways_to_possibly_use_google_
16 interesting ways_to_possibly_use_google_BreakThruGSAA
712 views17 slides
The Social Network Essay by
The Social Network EssayThe Social Network Essay
The Social Network EssayChelsea Porter
3 views78 slides

Similar to Geollery: A Mixed Reality Social Media Platform(20)

FMS2010 Go Global Masterclass - Social Media by Go Global
FMS2010 Go Global Masterclass - Social MediaFMS2010 Go Global Masterclass - Social Media
FMS2010 Go Global Masterclass - Social Media
Go Global529 views
Developer of the Minute by Micky Metts
Developer of the MinuteDeveloper of the Minute
Developer of the Minute
Micky Metts919 views
Denis cronin 10103031 individual report interaction design by Denis Cronin
Denis cronin 10103031 individual report   interaction designDenis cronin 10103031 individual report   interaction design
Denis cronin 10103031 individual report interaction design
Denis Cronin227 views
16 interesting ways_to_possibly_use_google_ by BreakThruGSAA
16 interesting ways_to_possibly_use_google_16 interesting ways_to_possibly_use_google_
16 interesting ways_to_possibly_use_google_
BreakThruGSAA712 views
Social Machines and how to study them by David De Roure
Social Machines and how to study themSocial Machines and how to study them
Social Machines and how to study them
David De Roure548 views
Danielle Leigh Portfolio 2015 by Danielle Leigh
Danielle Leigh Portfolio 2015Danielle Leigh Portfolio 2015
Danielle Leigh Portfolio 2015
Danielle Leigh121 views
Project Night Meta - Ruby Tuesday - Pitch by ottawaruby
Project Night Meta - Ruby Tuesday - PitchProject Night Meta - Ruby Tuesday - Pitch
Project Night Meta - Ruby Tuesday - Pitch
ottawaruby572 views
Design for Social Sharing Workshop by Rashmi Sinha
Design for Social Sharing WorkshopDesign for Social Sharing Workshop
Design for Social Sharing Workshop
Rashmi Sinha2.8K views
Crowdsourcing Wisdom by Vantte
Crowdsourcing WisdomCrowdsourcing Wisdom
Crowdsourcing Wisdom
Vantte460 views
Slides_IxD21 workshop_Forget artefact. design speculative lifeworlds instead! by Angelica Fontana
Slides_IxD21 workshop_Forget artefact. design speculative lifeworlds instead!Slides_IxD21 workshop_Forget artefact. design speculative lifeworlds instead!
Slides_IxD21 workshop_Forget artefact. design speculative lifeworlds instead!
Angelica Fontana258 views
Jez jowett social media, digital, sports and marketing predictions for 2012 by Jez Jowett
Jez jowett social media, digital, sports and marketing  predictions for 2012Jez jowett social media, digital, sports and marketing  predictions for 2012
Jez jowett social media, digital, sports and marketing predictions for 2012
Jez Jowett1.4K views
Enable viz april 2016 by Jon Schull
Enable viz april 2016Enable viz april 2016
Enable viz april 2016
Jon Schull142 views
Changing Classrooms With Robots by Weeda Hamdan
Changing Classrooms With RobotsChanging Classrooms With Robots
Changing Classrooms With Robots
Weeda Hamdan151 views
Editorial. More than just excited about the nintendo3ds by René Ponce
Editorial. More than just excited about the nintendo3dsEditorial. More than just excited about the nintendo3ds
Editorial. More than just excited about the nintendo3ds
René Ponce250 views

More from Ruofei Du

Fusing Multimedia Data Into Dynamic Virtual Environments by
Fusing Multimedia Data Into Dynamic Virtual EnvironmentsFusing Multimedia Data Into Dynamic Virtual Environments
Fusing Multimedia Data Into Dynamic Virtual EnvironmentsRuofei Du
465 views295 slides
Montage4D: Interactive Seamless Fusion of Multiview Video Textures by
Montage4D: Interactive Seamless Fusion of Multiview Video TexturesMontage4D: Interactive Seamless Fusion of Multiview Video Textures
Montage4D: Interactive Seamless Fusion of Multiview Video TexturesRuofei Du
3.3K views83 slides
CTUAAA Summit 2017 Schedule by
CTUAAA Summit 2017 ScheduleCTUAAA Summit 2017 Schedule
CTUAAA Summit 2017 ScheduleRuofei Du
676 views4 slides
交大历史与梅竹赛 by
交大历史与梅竹赛交大历史与梅竹赛
交大历史与梅竹赛Ruofei Du
336 views49 slides
Social Street View: Blending Immersive Street Views with Geo-tagged Social Media by
Social Street View: Blending Immersive Street Views with Geo-tagged Social MediaSocial Street View: Blending Immersive Street Views with Geo-tagged Social Media
Social Street View: Blending Immersive Street Views with Geo-tagged Social MediaRuofei Du
11.6K views123 slides
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi... by
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...Ruofei Du
3.2K views83 slides

More from Ruofei Du(11)

Fusing Multimedia Data Into Dynamic Virtual Environments by Ruofei Du
Fusing Multimedia Data Into Dynamic Virtual EnvironmentsFusing Multimedia Data Into Dynamic Virtual Environments
Fusing Multimedia Data Into Dynamic Virtual Environments
Ruofei Du465 views
Montage4D: Interactive Seamless Fusion of Multiview Video Textures by Ruofei Du
Montage4D: Interactive Seamless Fusion of Multiview Video TexturesMontage4D: Interactive Seamless Fusion of Multiview Video Textures
Montage4D: Interactive Seamless Fusion of Multiview Video Textures
Ruofei Du3.3K views
CTUAAA Summit 2017 Schedule by Ruofei Du
CTUAAA Summit 2017 ScheduleCTUAAA Summit 2017 Schedule
CTUAAA Summit 2017 Schedule
Ruofei Du676 views
交大历史与梅竹赛 by Ruofei Du
交大历史与梅竹赛交大历史与梅竹赛
交大历史与梅竹赛
Ruofei Du336 views
Social Street View: Blending Immersive Street Views with Geo-tagged Social Media by Ruofei Du
Social Street View: Blending Immersive Street Views with Geo-tagged Social MediaSocial Street View: Blending Immersive Street Views with Geo-tagged Social Media
Social Street View: Blending Immersive Street Views with Geo-tagged Social Media
Ruofei Du11.6K views
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi... by Ruofei Du
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...
Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Envi...
Ruofei Du3.2K views
Chinese Caligraphy 品读书法·感悟中华 (2010) by Ruofei Du
Chinese Caligraphy 品读书法·感悟中华 (2010)Chinese Caligraphy 品读书法·感悟中华 (2010)
Chinese Caligraphy 品读书法·感悟中华 (2010)
Ruofei Du618 views
Statistics for K-mer Based Splicing Analysis by Ruofei Du
Statistics for K-mer Based Splicing AnalysisStatistics for K-mer Based Splicing Analysis
Statistics for K-mer Based Splicing Analysis
Ruofei Du817 views
基于视频的疲劳驾驶检测系统 by Ruofei Du
基于视频的疲劳驾驶检测系统基于视频的疲劳驾驶检测系统
基于视频的疲劳驾驶检测系统
Ruofei Du3K views
Online Vigilance Analysis Combining Video and Electrooculography Features by Ruofei Du
Online Vigilance Analysis Combining Video and Electrooculography FeaturesOnline Vigilance Analysis Combining Video and Electrooculography Features
Online Vigilance Analysis Combining Video and Electrooculography Features
Ruofei Du2.5K views
Deliberately Planning and Acting for Angry Birds with Refinement Methods by Ruofei Du
Deliberately Planning and Acting for Angry Birds with Refinement MethodsDeliberately Planning and Acting for Angry Birds with Refinement Methods
Deliberately Planning and Acting for Angry Birds with Refinement Methods
Ruofei Du2.8K views

Recently uploaded

The details of description: Techniques, tips, and tangents on alternative tex... by
The details of description: Techniques, tips, and tangents on alternative tex...The details of description: Techniques, tips, and tangents on alternative tex...
The details of description: Techniques, tips, and tangents on alternative tex...BookNet Canada
126 views24 slides
Voice Logger - Telephony Integration Solution at Aegis by
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at AegisNirmal Sharma
31 views1 slide
Special_edition_innovator_2023.pdf by
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdfWillDavies22
17 views6 slides
Five Things You SHOULD Know About Postman by
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About PostmanPostman
30 views43 slides
Uni Systems for Power Platform.pptx by
Uni Systems for Power Platform.pptxUni Systems for Power Platform.pptx
Uni Systems for Power Platform.pptxUni Systems S.M.S.A.
55 views21 slides
Business Analyst Series 2023 - Week 3 Session 5 by
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5DianaGray10
237 views20 slides

Recently uploaded(20)

The details of description: Techniques, tips, and tangents on alternative tex... by BookNet Canada
The details of description: Techniques, tips, and tangents on alternative tex...The details of description: Techniques, tips, and tangents on alternative tex...
The details of description: Techniques, tips, and tangents on alternative tex...
BookNet Canada126 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma31 views
Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2217 views
Five Things You SHOULD Know About Postman by Postman
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About Postman
Postman30 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10237 views
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn21 views
Attacking IoT Devices from a Web Perspective - Linux Day by Simone Onofri
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day
Simone Onofri15 views
From chaos to control: Managing migrations and Microsoft 365 with ShareGate! by sammart93
From chaos to control: Managing migrations and Microsoft 365 with ShareGate!From chaos to control: Managing migrations and Microsoft 365 with ShareGate!
From chaos to control: Managing migrations and Microsoft 365 with ShareGate!
sammart939 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
1st parposal presentation.pptx by i238212
1st parposal presentation.pptx1st parposal presentation.pptx
1st parposal presentation.pptx
i2382129 views
Web Dev - 1 PPT.pdf by gdsczhcet
Web Dev - 1 PPT.pdfWeb Dev - 1 PPT.pdf
Web Dev - 1 PPT.pdf
gdsczhcet60 views
SAP Automation Using Bar Code and FIORI.pdf by Virendra Rai, PMP
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdf
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker33 views

Geollery: A Mixed Reality Social Media Platform