How Your Facebook Update Could        Make You a Victim of Crime                         : On the Privacy Implications of ...
Monday, October 29, 12
Phillip MarkoffMonday, October 29, 12
Phillip Markoff       • Boston University medical                         studentMonday, October 29, 12
Phillip Markoff       • Boston University medical                             student       •                 ‘Craigslist ...
Phillip Markoff       • Boston University medical                             student       •                 ‘Craigslist ...
Phillip Markoff       • Boston University medical                             student       •                 ‘Craigslist ...
Phillip Markoff       • Boston University medical                             student       •                 ‘Craigslist ...
Monday, October 29, 12
Lonely Heart                 KillersMonday, October 29, 12
Lonely Heart                 Killers                     1940s         Victims posted personal ads on                   ne...
Monday, October 29, 12
• I don’t post personal ads to Craigslist or                         newspaper... so I’m safe?Monday, October 29, 12
• I don’t post personal ads to Craigslist or                         newspaper... so I’m safe?                    • Well.....
Facebook Friend or Foe?                                     http://www.sileo.com/facebook-status-update-leads-to-robbery/M...
Facebook Friend or Foe?                                     http://www.sileo.com/facebook-status-update-leads-to-robbery/M...
Facebook Friend or Foe?                                     http://www.sileo.com/facebook-status-update-leads-to-robbery/M...
Facebook Friend or Foe?                                     http://www.sileo.com/facebook-status-update-leads-to-robbery/M...
Facebook Friend or Foe?                                               http://www.sileo.com/facebook-status-update-leads-to...
http://pleaserobme.com/                   Gathers check-in infos (FourSquare,                 Gowalla, Loopt) from your Tw...
• I don’t use ‘check-in’ feature... so I’m safe?Monday, October 29, 12
http://icanstalku.com/Monday, October 29, 12
Mayhemic Labs:                “Are you aware that Tweets are geo-tagged?”, and can                tell you EXACTLY where y...
What is Geo-Tag?    Source: Wikipedia                       9Monday, October 29, 12
Geo-Tagging : Benefits       Allows easier clustering of photo and video       series as well as additional services.      ...
• OK.. can you do real harm with Geo-tags??Monday, October 29, 12
Doing Real Harm with Geo-Tag         G. Friedland and R. Sommer: "Cybercasing the Joint: On the Privacy    Implications of...
Doing Real Harm with Geo-Tag        • Cybercasing: Using online (location-based) data and        services to enable real-w...
Doing Real Harm with Geo-Tag        • Cybercasing: Using online (location-based) data and        services to enable real-w...
Doing Real Harm with Geo-Tag        • Cybercasing: Using online (location-based) data and        services to enable real-w...
Case Study 1: Twitter                                                 13Monday, October 29, 12
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged                                                 13Monday, O...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged                                                 13Monday, O...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Case Study 1: Twitter    •Pictures in Tweets can be geo-tagged    •From a technically-savvy celebrity we     found:       ...
Celebs unaware of Geo-                                 Tagging                                           Source: ABC News ...
Celebs unaware of Geo-                                 Tagging                                           Source: ABC News ...
Celebs unaware of Geotagging                                         15Monday, October 29, 12
Google Maps shows Address...                                          16Monday, October 29, 12
Case Study 2: Craigslist     “For Sale” section of Bay Area Craigslist.com:     In 4 days:     • 68729 pictures total     ...
People are Unaware of Geo-      Tagging                                   18Monday, October 29, 12
People are Unaware of Geo-      Tagging     •Many ads with geo-location otherwise        anonymized                       ...
People are Unaware of Geo-      Tagging     •Many ads with geo-location otherwise      anonymized     •Sometimes selling h...
People are Unaware of Geo-      Tagging     •Many ads with geo-location otherwise      anonymized     •Sometimes selling h...
People are Unaware of Geo-      Tagging     •Many ads with geo-location otherwise      anonymized     •Sometimes selling h...
Craigslist: Real Example                                                    19Monday, October 29, 12
Craigslist: Real Example                                                    19Monday, October 29, 12
Geo-Tagging Resolution      iPhone 3G picture                                        Google Street Viewgure 1: 1: Photo a ...
What about Inference?             Valuable                               OwnerMonday, October 29, 12
Case Study 3: YouTube                                                 22Monday, October 29, 12
Case Study 3: YouTube     Recall:                                                 22Monday, October 29, 12
Case Study 3: YouTube     Recall:     • Once data is published, the Internet keeps     it (in potentially many copies).   ...
Case Study 3: YouTube     Recall:     • Once data is published, the Internet keeps     it (in potentially many copies).   ...
Case Study 3: YouTube     Recall:     • Once data is published, the Internet keeps     it (in potentially many copies).   ...
Cybercasing on YouTube        Experiment: Cybercasing using the YouTube        API (240 lines in Python)                  ...
Cybercasing on YouTube     Input parameters                                                  24Monday, October 29, 12
Cybercasing on YouTube     Input parameters     Location: 37.869885,-122.270539     Radius: 100km     Keywords: kids     D...
Cybercasing on                         YouTube     Output                                          25Monday, October 29, 12
Cybercasing on                         YouTube     Output     Initial videos: 1000 (max_res)                              ...
Cybercasing on                         YouTube     Output     Initial videos: 1000 (max_res)     ➡User hull: ~50k videos  ...
Cybercasing on                         YouTube     Output     Initial videos: 1000 (max_res)     ➡User hull: ~50k videos  ...
Cybercasing on                         YouTube     Output     Initial videos: 1000 (max_res)     ➡User hull: ~50k videos  ...
Cybercasing on                         YouTube     Output     Initial videos: 1000 (max_res)     ➡User hull: ~50k videos  ...
• What if I turn off geo-tagging feature?Monday, October 29, 12
Ongoing Work:                         http://mmle.icsi.berkeley.edu                                                       ...
Multimodal Location Estimation       We infer location of a media (video/photo/       document) based on visual, audio, an...
http://www.multimediaeval.org/                                         Mediaeval Placing Task                         - An...
Overview of Our Approach                                {berkeley,	  sathergate,	                              {berkeley,	...
Results: MediaEval      J. Choi, G. Friedland, V. Ekambaram, K. Ramchandran: "The 2012 ICSI/Berkeley      Video Location E...
YouTube Cybercasing                              Revisited                                     Old Experiment             ...
Monday, October 29, 12
• But... is this really about Geo-Tags?Monday, October 29, 12
• But... is this really about Geo-Tags?                    • No, it’s about the privacy implications of                   ...
Example                                   34Monday, October 29, 12
Example     Idea: Can one link videos across acounts?                                                 34Monday, October 29...
Example     Idea: Can one link videos across acounts?     (e.g. YouTube linked to Facebook vs     anonymized dating site) ...
Persona Linking using Internet         Videos           Speaker Recognition System           - Given a voice sample, it te...
Experiment           - 4869 test videos from Flickr               - 500 users in training,           493 hits, 2289 non-hi...
User ID on Flickr videos                                             Even with a preliminary                              ...
Linkage Attacks on SNS                    •    There are methods to link a user’s accounts only by                        ...
Linkage Attacks                     •  Multiple accounts on social networks                     •  Same or different purpo...
De-anonymization Model                                                                      ?                             ...
Where a user is posting                           - Twitter locations                           - Yelp locations          ...
When a user is posting                                                                                              6     ...
Performance of matching with                                  location profile                                            ...
Problems ReformulatedMonday, October 29, 12
Problems Reformulated                    •    Many applications are encouraging sharing data                         heavi...
Problems Reformulated                    •    Many applications are encouraging sharing data                         heavi...
Problems Reformulated                    •    Many applications are encouraging sharing data                         heavi...
Problems Reformulated                    •    Many applications are encouraging sharing data                         heavi...
Status QuoMonday, October 29, 12
Status Quo                    • People will continue to want social                         networks and location-based se...
Status Quo                    • People will continue to want social                         networks and location-based se...
Status Quo                    • People will continue to want social                         networks and location-based se...
What Now?                    • Research might help to:                     • quantify and qualify risk factors            ...
Conclusion                    •    We should continue to explore multimedia                         retrieval             ...
Take Home MessageMonday, October 29, 12
Take Home Message                    • Be aware of the risks of revealing your                         personal life onlin...
Take Home Message                    • Be aware of the risks of revealing your                         personal life onlin...
Thank You!                          Questions?                                Work together with:        Robin Sommer, Oan...
Upcoming SlideShare
Loading in …5
×

How Your Facebook Update Could Make You a Victim of Crime : On the Privacy Implications of Multimedia Retrieval

578 views
494 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
578
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

How Your Facebook Update Could Make You a Victim of Crime : On the Privacy Implications of Multimedia Retrieval

  1. 1. How Your Facebook Update Could Make You a Victim of Crime : On the Privacy Implications of Multimedia Retrieval International Computer Science Institute Jaeyoung Choi jaeyoung@icsi.berkeley.edu UC Berkeley KGSA Talk & Seminar - Oct 16, 2012Monday, October 29, 12
  2. 2. Monday, October 29, 12
  3. 3. Phillip MarkoffMonday, October 29, 12
  4. 4. Phillip Markoff • Boston University medical studentMonday, October 29, 12
  5. 5. Phillip Markoff • Boston University medical student • ‘Craigslist Killer’ - He found his victims through the ads on CraigslistMonday, October 29, 12
  6. 6. Phillip Markoff • Boston University medical student • ‘Craigslist Killer’ - He found his victims through the ads on CraigslistMonday, October 29, 12
  7. 7. Phillip Markoff • Boston University medical student • ‘Craigslist Killer’ - He found his victims through the ads on CraigslistMonday, October 29, 12
  8. 8. Phillip Markoff • Boston University medical student • ‘Craigslist Killer’ - He found his victims through the ads on CraigslistMonday, October 29, 12
  9. 9. Monday, October 29, 12
  10. 10. Lonely Heart KillersMonday, October 29, 12
  11. 11. Lonely Heart Killers 1940s Victims posted personal ads on newspaperMonday, October 29, 12
  12. 12. Monday, October 29, 12
  13. 13. • I don’t post personal ads to Craigslist or newspaper... so I’m safe?Monday, October 29, 12
  14. 14. • I don’t post personal ads to Craigslist or newspaper... so I’m safe? • Well.. do you use Facebook? Twitter?Monday, October 29, 12
  15. 15. Facebook Friend or Foe? http://www.sileo.com/facebook-status-update-leads-to-robbery/Monday, October 29, 12
  16. 16. Facebook Friend or Foe? http://www.sileo.com/facebook-status-update-leads-to-robbery/Monday, October 29, 12
  17. 17. Facebook Friend or Foe? http://www.sileo.com/facebook-status-update-leads-to-robbery/Monday, October 29, 12
  18. 18. Facebook Friend or Foe? http://www.sileo.com/facebook-status-update-leads-to-robbery/Monday, October 29, 12
  19. 19. Facebook Friend or Foe? http://www.sileo.com/facebook-status-update-leads-to-robbery/ Facebook ‘friend’ robbed $11,000 off Keri McMullen’s house.Monday, October 29, 12
  20. 20. http://pleaserobme.com/ Gathers check-in infos (FourSquare, Gowalla, Loopt) from your Twitter timelineMonday, October 29, 12
  21. 21. • I don’t use ‘check-in’ feature... so I’m safe?Monday, October 29, 12
  22. 22. http://icanstalku.com/Monday, October 29, 12
  23. 23. Mayhemic Labs: “Are you aware that Tweets are geo-tagged?”, and can tell you EXACTLY where you are? http://icanstalku.com/Monday, October 29, 12
  24. 24. What is Geo-Tag? Source: Wikipedia 9Monday, October 29, 12
  25. 25. Geo-Tagging : Benefits Allows easier clustering of photo and video series as well as additional services. 10Monday, October 29, 12
  26. 26. • OK.. can you do real harm with Geo-tags??Monday, October 29, 12
  27. 27. Doing Real Harm with Geo-Tag   G. Friedland and R. Sommer: "Cybercasing the Joint: On the Privacy Implications of Geotagging", Proceedings of the Fifth USENIX Workshop on Hot Topics in Security (HotSec 10), Washington, D.C, August 2010. 12Monday, October 29, 12
  28. 28. Doing Real Harm with Geo-Tag • Cybercasing: Using online (location-based) data and services to enable real-world attacks.   G. Friedland and R. Sommer: "Cybercasing the Joint: On the Privacy Implications of Geotagging", Proceedings of the Fifth USENIX Workshop on Hot Topics in Security (HotSec 10), Washington, D.C, August 2010. 12Monday, October 29, 12
  29. 29. Doing Real Harm with Geo-Tag • Cybercasing: Using online (location-based) data and services to enable real-world attacks. • Three Case Studies:   G. Friedland and R. Sommer: "Cybercasing the Joint: On the Privacy Implications of Geotagging", Proceedings of the Fifth USENIX Workshop on Hot Topics in Security (HotSec 10), Washington, D.C, August 2010. 12Monday, October 29, 12
  30. 30. Doing Real Harm with Geo-Tag • Cybercasing: Using online (location-based) data and services to enable real-world attacks. • Three Case Studies:   G. Friedland and R. Sommer: "Cybercasing the Joint: On the Privacy Implications of Geotagging", Proceedings of the Fifth USENIX Workshop on Hot Topics in Security (HotSec 10), Washington, D.C, August 2010. 12Monday, October 29, 12
  31. 31. Case Study 1: Twitter 13Monday, October 29, 12
  32. 32. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged 13Monday, October 29, 12
  33. 33. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged 13Monday, October 29, 12
  34. 34. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: 13Monday, October 29, 12
  35. 35. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) 13Monday, October 29, 12
  36. 36. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) –Where the kids go to school 13Monday, October 29, 12
  37. 37. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) –Where the kids go to school –The place where he/she walks the dog 13Monday, October 29, 12
  38. 38. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) –Where the kids go to school –The place where he/she walks the dog –“Secret” office 13Monday, October 29, 12
  39. 39. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) –Where the kids go to school –The place where he/she walks the dog –“Secret” office 13Monday, October 29, 12
  40. 40. Case Study 1: Twitter •Pictures in Tweets can be geo-tagged •From a technically-savvy celebrity we found: –Home location (several pics) –Where the kids go to school –The place where he/she walks the dog –“Secret” office 13Monday, October 29, 12
  41. 41. Celebs unaware of Geo- Tagging Source: ABC News 14Monday, October 29, 12
  42. 42. Celebs unaware of Geo- Tagging Source: ABC News 14Monday, October 29, 12
  43. 43. Celebs unaware of Geotagging 15Monday, October 29, 12
  44. 44. Google Maps shows Address... 16Monday, October 29, 12
  45. 45. Case Study 2: Craigslist “For Sale” section of Bay Area Craigslist.com: In 4 days: • 68729 pictures total • 1.3% geo-tagged 17Monday, October 29, 12
  46. 46. People are Unaware of Geo- Tagging 18Monday, October 29, 12
  47. 47. People are Unaware of Geo- Tagging •Many ads with geo-location otherwise anonymized 18Monday, October 29, 12
  48. 48. People are Unaware of Geo- Tagging •Many ads with geo-location otherwise anonymized •Sometimes selling high-valued goods, e.g. cars, diamonds 18Monday, October 29, 12
  49. 49. People are Unaware of Geo- Tagging •Many ads with geo-location otherwise anonymized •Sometimes selling high-valued goods, e.g. cars, diamonds •Sometimes “call Sunday after 6pm” 18Monday, October 29, 12
  50. 50. People are Unaware of Geo- Tagging •Many ads with geo-location otherwise anonymized •Sometimes selling high-valued goods, e.g. cars, diamonds •Sometimes “call Sunday after 6pm” •Multiple photos allow interpolation of coordinates for higher accuracy 18Monday, October 29, 12
  51. 51. Craigslist: Real Example 19Monday, October 29, 12
  52. 52. Craigslist: Real Example 19Monday, October 29, 12
  53. 53. Geo-Tagging Resolution iPhone 3G picture Google Street Viewgure 1: 1: Photo a bike taken with an an iPhone 3G and corresponding Google Street View image based onon the storFigure Photo of of a bike taken with iPhone 3G and a a corresponding Google Street View image based the storedordinates. The accuracy of thethe camera location (marked) front of the garage is about +/−1 m. Many classified advertise coordinates. The accuracy of camera location (marked) in in front of the garage is about +/−1 m. Many classified advert Measured accuracy: +/- 1mes contain photos describing objects forfor sale taken home that automatically contain geo-tagging. sites contain photos describing objects sale taken at at home that automatically contain geo-tagging.n would make it easy to to increase the confidence in the in in the second step identifying all other videos frtion would make it easy increase the confidence in the the second step identifying all other videos from 20resultsOctober 29, 12 further.ults further. Monday, corresponding users. 106 ofof these turned out to hav corresponding users. 106 these turned out to have
  54. 54. What about Inference? Valuable OwnerMonday, October 29, 12
  55. 55. Case Study 3: YouTube 22Monday, October 29, 12
  56. 56. Case Study 3: YouTube Recall: 22Monday, October 29, 12
  57. 57. Case Study 3: YouTube Recall: • Once data is published, the Internet keeps it (in potentially many copies). 22Monday, October 29, 12
  58. 58. Case Study 3: YouTube Recall: • Once data is published, the Internet keeps it (in potentially many copies). • APIs are easy to use and allow quick retrieval of large amounts of data 22Monday, October 29, 12
  59. 59. Case Study 3: YouTube Recall: • Once data is published, the Internet keeps it (in potentially many copies). • APIs are easy to use and allow quick retrieval of large amounts of data Can we find people on vacation in YouTube? 22Monday, October 29, 12
  60. 60. Cybercasing on YouTube Experiment: Cybercasing using the YouTube API (240 lines in Python) Location Radius Query Keywords Results Users? Query YouTube Results Time-Frame Distance Filter Cybercasing 23 CandidatesMonday, October 29, 12
  61. 61. Cybercasing on YouTube Input parameters 24Monday, October 29, 12
  62. 62. Cybercasing on YouTube Input parameters Location: 37.869885,-122.270539 Radius: 100km Keywords: kids Distance: 1000km Time-frame: this_week 24Monday, October 29, 12
  63. 63. Cybercasing on YouTube Output 25Monday, October 29, 12
  64. 64. Cybercasing on YouTube Output Initial videos: 1000 (max_res) 25Monday, October 29, 12
  65. 65. Cybercasing on YouTube Output Initial videos: 1000 (max_res) ➡User hull: ~50k videos 25Monday, October 29, 12
  66. 66. Cybercasing on YouTube Output Initial videos: 1000 (max_res) ➡User hull: ~50k videos ➡Vacation hits: 106 25Monday, October 29, 12
  67. 67. Cybercasing on YouTube Output Initial videos: 1000 (max_res) ➡User hull: ~50k videos ➡Vacation hits: 106 ➡Cybercasing targets: >12 25Monday, October 29, 12
  68. 68. Cybercasing on YouTube Output Initial videos: 1000 (max_res) ➡User hull: ~50k videos ➡Vacation hits: 106 ➡Cybercasing targets: >12 25Monday, October 29, 12
  69. 69. • What if I turn off geo-tagging feature?Monday, October 29, 12
  70. 70. Ongoing Work: http://mmle.icsi.berkeley.edu 27Monday, October 29, 12
  71. 71. Multimodal Location Estimation We infer location of a media (video/photo/ document) based on visual, audio, and tags: •Use geo-tagged data as training data •Allows faster search, inference, and intelligence gathering even without GPS. 28Monday, October 29, 12
  72. 72. http://www.multimediaeval.org/ Mediaeval Placing Task - An annual benchmark which provides standardized datasets to the community of researchers for the evaluation of new algorithmsMonday, October 29, 12
  73. 73. Overview of Our Approach {berkeley,  sathergate,   {berkeley,  haas} campanile} Edge:  Correlated  loca7ons   (e.g.  common  tag,  visual,   acous7c  feature) Node:  Geoloca7on  of   video k p(xj |{tk }) p(xi |{ti }) j p(xi , xj |{tk } i {tk }) j {campanile} {campanile,  haas} Edge  Poten,al:  Strength  of  an  edge,  (e.g.  posterior   distribu5on  of  loca5ons  given  common  tags) J. Choi, G. Friedland, V. Ekambaram, K. Ramchandran: "Multimodal Location Estimation of Consumer Media: 30 Dealing with Sparse Training Data," in Proceedings of IEEE ICME 2012, Melbourne, Australia, July 2012.Monday, October 29, 12
  74. 74. Results: MediaEval J. Choi, G. Friedland, V. Ekambaram, K. Ramchandran: "The 2012 ICSI/Berkeley Video Location Estimation System," in Proceedings of MediaEval 2012, Pisa, Italy, October 2012.Monday, October 29, 12
  75. 75. YouTube Cybercasing Revisited Old Experiment No Geotags Initial Videos 1000 (max) 107 User Hull ~50k ~2000 Potential Hits 106 112 Actual Targets >12 >12 Even without Geo-Tags, cybercasing on YouTube video is readily possible G. Friedland, and J. Choi, “Semantic Computing and Privacy: a Case Study Using Inferred Geo-Location.” in Int. J. Semantic Computing, Vol. 5, Nr. 1 (2011) , p. 32 79-93.Monday, October 29, 12
  76. 76. Monday, October 29, 12
  77. 77. • But... is this really about Geo-Tags?Monday, October 29, 12
  78. 78. • But... is this really about Geo-Tags? • No, it’s about the privacy implications of multimedia retrieval in general.Monday, October 29, 12
  79. 79. Example 34Monday, October 29, 12
  80. 80. Example Idea: Can one link videos across acounts? 34Monday, October 29, 12
  81. 81. Example Idea: Can one link videos across acounts? (e.g. YouTube linked to Facebook vs anonymized dating site) 34Monday, October 29, 12
  82. 82. Persona Linking using Internet Videos Speaker Recognition System - Given a voice sample, it tells whether it’s from Howard, Gerald, Jae, etc.. City Identification System - Modified from the traditional Speaker Recognition System - Given an audio sample, it tells whether it’s from Seoul, San Francisco, Berlin, etc..Monday, October 29, 12
  83. 83. Experiment - 4869 test videos from Flickr - 500 users in training, 493 hits, 2289 non-hits in test -Audio characteristics : “wild” (70% heavy noise, 50% speech ) H. Lei, J. Choi, A. Janin, and G. Friedland: “Persona Linking: Matching Uploaders of Videos Accross Accounts”, at IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP), Prague, May 2011Monday, October 29, 12
  84. 84. User ID on Flickr videos Even with a preliminary experiment setting, the system performs much better than random. (26.3% < 50% Equal Error Rate)Monday, October 29, 12
  85. 85. Linkage Attacks on SNS • There are methods to link a user’s accounts only by accessing publicly available data. • Your anonymity across different social networking services accounts can be compromised.Monday, October 29, 12
  86. 86. Linkage Attacks •  Multiple accounts on social networks •  Same or different purposes : reviewing ... •  What about the aggregate trace they leave ? 2 Works and slides credit: Oana Goga (http://www-npa.lip6.fr/~goga/)Monday, October 29, 12
  87. 87. De-anonymization Model ? im ilar o ws h Targeted account (YELP users are id’d) Candidate list 7 Works and slides credit: Oana Goga (http://www-npa.lip6.fr/~goga/)Monday, October 29, 12
  88. 88. Where a user is posting - Twitter locations - Yelp locations 5 Works and slides credit: Oana Goga (http://www-npa.lip6.fr/~goga/)Monday, October 29, 12
  89. 89. When a user is posting 6 Works and slides credit: Oana Goga (http://www-npa.lip6.fr/~goga/)Monday, October 29, 12
  90. 90. Performance of matching with location profile 1 Yelp − Twitter 35% of Flickr Flickr and 60% 40% of and Yelp Flickr − Twitter accountsYelp accounts can of can be matched 0.8 to a set of 250 Twitter set of be matched to a •x accounts Twitter accounts 1000 CDF users 0.6 0.4 0.2 0 10 100 250 1000 10000 Rank of the ground truth user 11 Works and slides credit: Oana Goga (http://www-npa.lip6.fr/~goga/)Monday, October 29, 12
  91. 91. Problems ReformulatedMonday, October 29, 12
  92. 92. Problems Reformulated • Many applications are encouraging sharing data heavily and users followMonday, October 29, 12
  93. 93. Problems Reformulated • Many applications are encouraging sharing data heavily and users follow • Multimedia isn’t only a lot of data, it’s also a lot of informationMonday, October 29, 12
  94. 94. Problems Reformulated • Many applications are encouraging sharing data heavily and users follow • Multimedia isn’t only a lot of data, it’s also a lot of information • Users and engineers often unaware of (hidden) retrieval possibilities of shared (multimedia) dataMonday, October 29, 12
  95. 95. Problems Reformulated • Many applications are encouraging sharing data heavily and users follow • Multimedia isn’t only a lot of data, it’s also a lot of information • Users and engineers often unaware of (hidden) retrieval possibilities of shared (multimedia) data • Local anonymization and privacy policies ineffective against cross-site inferenceMonday, October 29, 12
  96. 96. Status QuoMonday, October 29, 12
  97. 97. Status Quo • People will continue to want social networks and location-based servicesMonday, October 29, 12
  98. 98. Status Quo • People will continue to want social networks and location-based services • Industry and research will continue to improve retrieval techniquesMonday, October 29, 12
  99. 99. Status Quo • People will continue to want social networks and location-based services • Industry and research will continue to improve retrieval techniques • Government will continue to do forensics and intelligence gatheringMonday, October 29, 12
  100. 100. What Now? • Research might help to: • quantify and qualify risk factors • visualize and offer choices in UIs • identify privacy breaking informationMonday, October 29, 12
  101. 101. Conclusion • We should continue to explore multimedia retrieval • At the same time we should: • research methods to help mitigate risks and offer choice • develop privacy policies and APIs that take into account multimedia retrieval • educate users and engineers on privacy issuesMonday, October 29, 12
  102. 102. Take Home MessageMonday, October 29, 12
  103. 103. Take Home Message • Be aware of the risks of revealing your personal life onlineMonday, October 29, 12
  104. 104. Take Home Message • Be aware of the risks of revealing your personal life online • Think TWICE before you post something on Facebook/Twitter/...Monday, October 29, 12
  105. 105. Thank You! Questions? Work together with: Robin Sommer, Oana Goga, Venkatesan Ekambaram, Kannan Ramchandran, Luke Gottlieb, Howard Lei, Adam Janin, Oriol Vinyals, Trevor Darrell, Gerald Friedland and many others.. 49Monday, October 29, 12

×