Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Seman&cally	
  Linked	
  Photos	
  for	
  
building	
  Visual	
  Web	
  
	
  
	
  
Ramesh	
  Jain	
  
Dept.	
  of	
  Compu...
Experiences
Life =
Events
+
Literal	
  
Visual	
  
Oral	
  
Progress: Knowledge Creation and
Propagation
Oral
Literal	
  
Visual
 
	
  
Vannevar Bush 1945
Memex:As we may think.
Scaling up Knowledge tools for humans
The human mind works
by association...
Berners-­‐Lee:	
  	
  Suppose	
  all	
  the	
  informa0on	
  stored	
  
on	
  computers	
  everywhere	
  were	
  linked.	
...
Web: Human experiences, knowledge,
and understanding captured using
associative links.
And	
  the	
  World	
  changed	
  forever.	
  
Volume determines
organization.
Time	
  
Number	
  
Increasing volume of
documents brought us
to the World Wide Web
and Go...
•  Top 8 Apps in 2013 were Visual.
•  Selfies are becoming a popular
communication tool.
•  Significantly more time spent ...
Text	
  based	
  
documents	
  are	
  not	
  
NATURAL.	
  
	
  
	
  Language	
  and	
  
Literacy	
  come	
  in	
  
the	
  ...
Disruption: Capturing and sharing is
easier for photos than text.
Imagine if every photo and video
captured were connected to every
other. 	
  
Going	
  beyond	
  Gutenberg	
  Legacy:	
  
Photos	
  and	
  Videos	
  are	
  New	
  Documents.	
  
What is a camera?
Is	
  a	
  Smartphone	
  camera	
  s&ll	
  a	
  
camera?	
  
EXIF	
  data	
  is	
  all	
  metadata	
  related	
  to	
  the...
 Events	
  are	
  ‘Connectors’	
  
Events	
  create	
  ‘Context’	
  
Causal	
  	
  
Experiential	
  
Structural	
  
People...
EMPT: Extractable Mobile Photo Tags
Exif	
  
Content	
  
Analysis	
  
EMPT	
  
	
  
People	
  
Place	
  
Objects	
  
Event...
EMPT	
  Provides	
  Implicit	
  
Seman&c	
  Links	
  for	
  a	
  Photo.	
  
Next Generation Photos.
Mee&ng	
  at	
  Dagstuhl.	
  
Gardens	
  by	
  the	
  
Marina	
  Bay.	
  
Photo is an Experiential component of a
Moment.
Photos	
  and	
  videos	
  are	
  
experien&al	
  data	
  from	
  
an	
  E...
How	
  much	
  is	
  a	
  
Picture	
  worth?	
  
Mee&ng	
  at	
  Dagstuhl.	
  
A	
  SEMANTICALLY	
  LINKED	
  
PICTURE	
  ...
Time	
  
1-­‐	
  dimensional	
  Space	
  
Events	
  Happen	
  
Time	
  
1-­‐	
  dimensional	
  Space	
  
Events	
  Are	
  Connected	
  	
  
Event Base
Event
Presentation/
Navigation
Control
Event Grouping, Linking, Assimilation
Atomic
Event
Entry
EXIF
Features
T...
Time: 9AM on Feb 6, 2015
Location: Anaheim Marriott
EXIF: Indoor Scene; Face
Keynote Talk
at IEEE-ICSC
2015
by Charles Elk...
Snapviz Demo: Your Personal Web
www.snapviz.com	
   Android	
  App	
  
iOS	
  
Android.	
  
Krumbs:	
  	
  	
  A*aches	
  
EMPT	
  and	
  creates	
  a	
  
message.	
  
Too	
  Many	
  connec&ons	
  for	
  each	
  
photo	
  –	
  how	
  to	
  select	
  the	
  
‘RIGHT’	
  ones.	
  
•  Ranking	...
•  Addressing (URI)
•  Transfer Protocol (HTTP)
•  Authoring and Presentation (HTML)
•  Ranking
•  Contextual Processing
•...
Sky	
  is	
  the	
  Limit.	
  
Applica&ons:	
  
Lifestyle	
  
Health	
  
Commerce	
  
Surveillance	
  and	
  Monitoring	
 ...
ICSC2015 KeyNote: Semantic links in visual web
ICSC2015 KeyNote: Semantic links in visual web
Upcoming SlideShare
Loading in …5
×

ICSC2015 KeyNote: Semantic links in visual web

2,418 views

Published on

Photos and videos are new documents. They are independent of language and literacy. By linking photos with other photos as well as other sources of information, we can create a Web that will be a visual Web. This web may be accessible to people in every part of the world.

Published in: Internet
  • Be the first to comment

ICSC2015 KeyNote: Semantic links in visual web

  1. 1. Seman&cally  Linked  Photos  for   building  Visual  Web       Ramesh  Jain   Dept.  of  Computer  Science   University  of  California,  Irvine   jain@ics.uci.edu  
  2. 2. Experiences Life = Events +
  3. 3. Literal   Visual   Oral   Progress: Knowledge Creation and Propagation
  4. 4. Oral
  5. 5. Literal  
  6. 6. Visual
  7. 7.     Vannevar Bush 1945 Memex:As we may think. Scaling up Knowledge tools for humans The human mind works by association. The process of tying two items together is the important thing.
  8. 8. Berners-­‐Lee:    Suppose  all  the  informa0on  stored   on  computers  everywhere  were  linked.  Suppose   I  could  program  my  computer  to  create  a  space   in  which  anything  could  be  linked  to  anything.  
  9. 9. Web: Human experiences, knowledge, and understanding captured using associative links.
  10. 10. And  the  World  changed  forever.  
  11. 11. Volume determines organization. Time   Number   Increasing volume of documents brought us to the World Wide Web and Google  
  12. 12. •  Top 8 Apps in 2013 were Visual. •  Selfies are becoming a popular communication tool. •  Significantly more time spent on visual media. •  Photo Uploads continue exponential growth. Source:  h*p://digiday.com/pla5orms/5-­‐charts-­‐growth-­‐visual-­‐web/  ;     h*ps://www.metabunk.org/threads/the-­‐growth-­‐of-­‐photography-­‐photos-­‐per-­‐year-­‐and-­‐ the-­‐illusion-­‐of-­‐frequency.2491/   21st Century Made WWW Visual.
  13. 13. Text  based   documents  are  not   NATURAL.      Language  and   Literacy  come  in   the  way.  
  14. 14. Disruption: Capturing and sharing is easier for photos than text.
  15. 15. Imagine if every photo and video captured were connected to every other.  
  16. 16. Going  beyond  Gutenberg  Legacy:   Photos  and  Videos  are  New  Documents.  
  17. 17. What is a camera?
  18. 18. Is  a  Smartphone  camera  s&ll  a   camera?   EXIF  data  is  all  metadata  related  to  the  Event.   •  Exposure Time •  Aperture Diameter •  Flash •  Metering Mode •  ISO Ratings •  Focal Length •  Time •  Location •  Face   Smartphone  camera  captures  events.  
  19. 19.  Events  are  ‘Connectors’   Events  create  ‘Context’   Causal     Experiential   Structural   People   Things   Places   Time   Experiences   Events  
  20. 20. EMPT: Extractable Mobile Photo Tags Exif   Content   Analysis   EMPT     People   Place   Objects   Events   …  
  21. 21. EMPT  Provides  Implicit   Seman&c  Links  for  a  Photo.  
  22. 22. Next Generation Photos. Mee&ng  at  Dagstuhl.   Gardens  by  the   Marina  Bay.  
  23. 23. Photo is an Experiential component of a Moment. Photos  and  videos  are   experien&al  data  from   an  Event.   People   Place Events   Objects   Each  Photos  has  different   types  of  implicit  links.  
  24. 24. How  much  is  a   Picture  worth?   Mee&ng  at  Dagstuhl.   A  SEMANTICALLY  LINKED   PICTURE  IS     WORTH     A  THOUSAND  SEMANTICALLY   LINKED  PICTURES.  
  25. 25. Time   1-­‐  dimensional  Space   Events  Happen  
  26. 26. Time   1-­‐  dimensional  Space   Events  Are  Connected    
  27. 27. Event Base Event Presentation/ Navigation Control Event Grouping, Linking, Assimilation Atomic Event Entry EXIF Features Tags/ Context Photo stream Segment.Event Ontology User Annot- ations Story Telling Search Control Photos  and  Events  
  28. 28. Time: 9AM on Feb 6, 2015 Location: Anaheim Marriott EXIF: Indoor Scene; Face Keynote Talk at IEEE-ICSC 2015 by Charles Elkan on Theory versus Practice in Data Science Annotations Calendars Environment Conditions Application Knowledge Geographic Landmarks Camera Parameters Event: Keynote Talk at ICSC, Speaker: Dr. Charles Elkan
  29. 29. Snapviz Demo: Your Personal Web www.snapviz.com   Android  App  
  30. 30. iOS   Android.   Krumbs:      A*aches   EMPT  and  creates  a   message.  
  31. 31. Too  Many  connec&ons  for  each   photo  –  how  to  select  the   ‘RIGHT’  ones.   •  Ranking  Photos   – Quality   – Diversity   – Coverage   – Other  Contextual  Factors  
  32. 32. •  Addressing (URI) •  Transfer Protocol (HTTP) •  Authoring and Presentation (HTML) •  Ranking •  Contextual Processing •  Content Analysis •  Privacy and Security •  Information Vs Experience Challenges  
  33. 33. Sky  is  the  Limit.   Applica&ons:   Lifestyle   Health   Commerce   Surveillance  and  Monitoring   Agriculture   Research  and  development   Construc&on   …    

×