SlideShare a Scribd company logo
1 of 41
Confessions (and Lessons) of a
"Recovering" Data Broker:
Responsible Innovation in the Age of Big Data, Big Brother, and
the Coming Skynet Terminators
Jim Adler
Vice President, Products
Metanautix
jimadler@metanautix.com
@jim_adler
http://jimadler.me
Usenix Security Conference
Washington, DC
Aug 15 2013
About Metanautix
• Mission: Next generation big data management & analysis
– Transparency into the big data supply chain within and across
organizations
• Engineering led, product company
– Team of veterans (10-20+ years experience)
– Built massive data analysis systems at Google, FB, MSFT, AMZN, Pixar
– Solidly funded by top VCs
– Working with lighthouse customers
• Started Nov 2012, slowly emerging from stealth mode
• Stay tuned!
I am not an attorney.Confession
Dork
Nerd
Geek Dweeb
You can often do more from the inside than
the outside.
• 20B public records
• 30M visitors per month
• 50M+ reports sold
Confession
Listen to your toughest criticsLesson
Can I have a little narcissism with my
voyeurism?
• What does my background
check say?
• Privacy controls
– Suppress single address or
phone number
• Comment on your own
public profile
Lesson
Data from Feb 2013
Data from
40,000 BC thru 2002
20
Exabytes
(20M TB)
Lots of data created, transferred, & stored.Confession
The “Public” Data Supply Chain of YouConfession
Search
Blogs
Criminal
Records
Risk
Civil
Suits Marketing
Addresses
Directory
Phone
Numbers
Payments
Background
Resumes
Public
Posts
Name
s
Data Uses
Government
Commercial
Self-Reported
Big Data
Engines
FIND OWNER OF DOG’S
RELATIVE FOR TRANSPLANT
SINGLES CURIOUS ABOUT THE
PEOPLE THEY MEET
PARENTS ENSURING WHO
THEIR KIDS SAFETY
GENEALOGISTS CULTIVATING
THEIR FAMILY TREE
BUSINESSES THAT NEED TO UPDATE CONTACT
INFORMATION ON CUSTOMERS
FINDING LONG-LOST FRIENDS, MILITARY
BUDDIES, ROOMMATES, OR CLASSMATES
ANYONE CURIOUS ABOUT WHO'S
EMAILING OR CALLING THEM
THOSE IN LEGALLY ENTANGLED
LOOKING FOR COURT RECORDS ANYONE WHO NEED ADDRESS
HISTORIES FOR PASSPORTS
SOCIAL NETWORKERS LOOKING TO
EXPAND THEIR FRIENDS LIST
PROFESSIONALS LEARNING ABOUT
COLLEAGUES AT CONFERENCES
RECONNECTING OUT-OF-TOUCH
FAMILY MEMBERS
ONLINE SHOPPERS
VERIFYING ONLINE SELLERS
INVESTIGATIVE JOURNALISTS
RUNNING DOWN LEADS
SALES PROFESSIONALS LOOKING
FOR NEW PROSPECTS
NETWORKERS SEEKING
BUSINESS OPPORTUNITIES
LAW
ENFORCEMENT
NON-PROFIT ORGANIZATIONS
LOOKING FOR SUPPORTERS
FIANCÉS AND THEIR CURIOUS
FAMILY MEMBERS
SOCIAL WORKERS WHO NEED TO KNOW
MORE ABOUT THEIR CLIENTS
CALLER ID OF HARASSING
PHONE CALLS
ALUMNI GROUPS
ARRANGING REUNIONS
ADOPTED KIDS SEEKING THEIR
BIOLOGICAL PARENTS
AIRLINES TRYING TO
RETURN LOST LUGGAGE
CHECKING OUT A PROSPECTIVE SOCIAL
NETWORK CONNECTION
CHECKING OUT A
PROSPECTIVE DATE
CHECKING OUT A
PROSPECTIVE TENANT
FINDING PEOPLE THAT HAVE THE
SAME ILLNESS AS YOU
RESEARCHING A
PROSPECTIVE EMPLOYEE
ANYONE RETRIEVING
COURT RECORDS
REGULATED
Lots of uses for your data … some regulated
LAWYERS NEEDING QUICK ACCESS
TO COURT RECORDS
BANKING
SERVICES
RESEARCH
SHARING
LEARNING ABOUT
A BUSINESS
Confession
Billions of Records
Millions of People
Jim Adler
Houston, TX
Age 70
Jim Adler
Redmond, WA
Age 50
Jim Adler
Denver, CO
Age 48
Jim Adler
McKinney, TX
Age 57
Jim Adler
Canaan, NH
Age 59
Jim Adler
Hastings, NE
Age 32
213 records linked
to the correct 37 Jim Adlers
Philip
Collins
375 People
Jim Adler
213 Records
37 People
Randolph
Hutchins
5 People
Gwen
Fleming
2 PeopleCarol Brooks
9800 Records
1250 People
Confession We don’t know you all that well
Opt-out doesn’t always mean deletionConfession
Jane Hampton 06/23/1998 123 Main Peoria, IL
Jane Hampton 123 Main Peoria, IL jane@facebook.com
Jane Hampton jane@facebook.com
Jane Hampton 06/23/1998 123 Main Peoria, IL
Jane Hampton 123 Main Peoria, IL jane@facebook.com
Jane Hampton jane@facebook.com
When towns were small, personal
anonymity was low …
“The only thing
worse than being
talked about, is
not being talked
about.”
− Oscar Wilde
Lesson
“Good Fences
Make Good
Neighbors”
− Robert Frost
Urban populations grew along with
personal anonymity…
Lesson
0
20
40
60
80
100
120
1850 1890 1930 1970 2010
PrivacyExpectations
“Rockwell” Era “Good Fences” Era “Privacy
Vertigo”
Era
… we’re suffering from Privacy Vertigo.Confession
Urban Density ↓
Personal Anonymity ↓
Privacy is deeply cultural.Lesson
Discretion
Disclosure
EU “Right of Personality”
• Inviolable right of dignity
• Germany: BGB, 1900, post WWII
US: Brandeis & Warren, 1890
• Germany: “Source Right”
• Esra “kiss & tell” plaintiff
won, book banned
US “Privacy Torts”
• Statutory harm
• US: Prosser’s Torts, 1960
• US: Sectorial privacy regime
• Bonome “kiss & tell” case
dismissed
EU Rights versus US Torts
http://paulschwartz.net/pdf/SchwartzPeifer_Prosser_FINAL.pdf
How to unpack Privacy? Think PPP.
PERILS
Lesson
Sometimes you’re in a public place when
you think you’re in a private place.
“Gaydar”
A 2009 MIT study found it was
possible to predict men’s
sexual orientation by analyzing
the gender and sexuality of their
social network contacts – even
if the rest of the information on
their profile was set to private.
Confession
“To Serve Man” is a Cookbook.Confession
“If you’re not
paying for the
product, you are
the product.”
− Claire Wolfe
(paraphrased)
Peer to Peer Corporation &
Customer/Employee
Government &
Citizen
Your God & You
PrivacyRights
Power Disparity 
In privacy contexts, Power matters.Lesson
Target knows you’re pregnant and when
you’re due. So, what’s so perilous?
Confession
Secrets are power equalizers.Confession
DPower µ
1
Trust
µSecrets
Public Places
Powerful Players
Private Places
Powerful Players
Private Places
Weaker Players
Public Places
Weaker Players
M O R E P R I VAT E P L A C E S
MOREPLAYERPOWERGAP
Mapping Places-Players-Perils Cases
M O R E P R I VAT E P L A C E S
MOREPLAYERPOWERGAP
News of the World
phone hacking
Rutgers student
commits suicide
after spied by
webcam
FBI GPS criminal
surveillanceGoogle privacy
policy unification
Target finds out
teen pregnant
before parents
GM OnStar tracks
users
Woman caught
naked by Google
Street View
Actress sues IMDB
over revealing her
age
US deports British
tourists over Tweets
FB user sets fire to
home after de-
friending
"Girls Around Me"
pulled from market
Health orgs use
Twitter to track
illness
NSA internet citizen
surveillance
Georgia teacher
fired after posting
vacation pics
Places-Players-Perils Cases
A head in the clouds < 20 yearsPrediction
$27,100
$13,500
$6,800
$3,400
$1,700
$850
$420
$210
$100
$53
$26
$13
$7
$3
$2
$1
$1
$10
$100
$1,000
$10,000
$100,000
2012 2014 2016 2018 2020 2022 2024 2026 2028 2030 2032 2034 2036 2038 2040 2042
CostperMonth(000s)
Year
• 20,000 TFlops
• 2,500 Terabytes
• Less than $700K per year
Chris Westbury, University of Alberta
“Watch your thoughts, they become words.
Watch your words, they become actions.
Watch your actions, they become habits.
Watch your habits, they become your character.
Watch your character, it becomes your destiny.”
– Lao Tzu
“… the essential crime that
contained all others in itself.
Thoughtcrime, they called it.”
– George Orwell
Big data inferences are not thoughtcrimesLesson
Felon Classifier Overview
ModelLearner
250 M
Defendants Feature
Extraction
15K Labels
15K Predictors
Cleaning
Linking
Sampling
Objective
If someone has minor offenses on their criminal
record, do they also have any felonies?
Today’s Bloomberg piece: http://bloom.bg/1eMtnug
How does the Felon Classifier work?
Gender Eye Color Tattoos Criminal Offenses Score
Over
Threshold
of 3.5?
Likely
Felon?
NO
YES
Hazel (+1.7)
Male Blue 2 + (+1.3) Traffic only
Female (-0.5) Brown < 2 4 or fewer
misdemeanors (+1.9)
YES
Green 8 or fewer
misdemeanors
NO
4.4
Hazel
Male (+0.1) Blue 2 + Traffic only (-0.5)
Female Brown (+1.2) < 2 (+0.1) 4 or fewer
misdemeanors
YES
Green 8 or fewer
misdemeanors
NO
0.9
widget: http://jimadler.me
Classifiers depend on policy as much as
technology
ANARCHY
T Y R A N N Y
0.0%
20.0%
40.0%
60.0%
80.0%
100.0%
0.0% 5.0% 10.0% 15.0% 20.0%
FalseNegativeRate
False Positive Rate
Threshold: 0.66
FP Rate: 5%
FN Rate: 22%
Threshold: 1.1
FP Rate: 1%
FN Rate: 40%
Threshold: -1.82
FP Rate: 19%
FN Rate: 0%
Confession
Privacy, Reasonable Suspicion, & Probable Cause
• Courts have upheld profiling
– US v Sokolow
• Predictive information never enough
1. Reliable
2. Efficient
3. Particularized
4. Detailed
5. Timely
6. Corroborated
• More
• Andrew Guthrie Ferguson, Predictive Policing
http://ssrn.com/abstract_id=2050001
• Bernard Harcourt, Rethinking Racial Profiling
http://www.law.uchicago.edu/files/files/rethinking_racial_profiling.pdf
• The “Not Ready For Prime Time” Classifier
http://jimadler.me/post/47374264398/the-not-ready-for-prime-time-classifier
NYC Stop & Frisk Found UnconstitutionalRuling
“The city … believes that blacks and Hispanics should be stopped at the same
rate as their proportion of the local criminal suspect population.”
− US District Judge Shira Scheindlin
= 2*3%=10%
100% greater chance that a minority
stop is justified over a random stop
P~A|M = 90%
PA|M =
100%
50%
5%
NYC assumes 87%
Minorities in NYC
If it’s not ok to stop & frisk 95% of the general population for nothing,
why is it ok to stop & frisk 90% of minorities for nothing?
PA|M =
PM|A
PM
PA
PA|M = Chance a minority should be arrested
P~A|M= Chance a minority should not be arrested
PM|A = Chance that someone arrested is a minority
PM = Chance someone is a minority
PA = Chance someone is arrested
Bayes’ Rule
M O R E P R I VAT E P L A C E S
MOREPLAYERPOWERGAP
News of the World
phone hacking
Rutgers student
commits suicide
after spied by
webcam
FBI GPS criminal
surveillanceGoogle privacy
policy unification
Target finds out
teen pregnant
before parents
GM OnStar tracks
users
Woman caught
naked by Google
Street View
Actress sues IMDB
over revealing her
age
US deports British
tourists over Tweets
FB user sets fire to
home after de-
friending
"Girls Around Me"
pulled from market
Health orgs use
Twitter to track
illness
NSA internet
citizen
surveillanceGeorgia teacher
fired after posting
vacation pics
Big brother is watching (duh)
“We’re being asked to trust
without being able to verify.”
− Alex Howard
Pres. Obama calls for more
transparency in FISA court and
surveillance laws
NSA chief announces plan to
replace 1,000 sysadmins with
machines
Confession
Technology grows exponentially.
Wisdom grows linearly.
• Gov’t doesn’t trust
people (at least
sysadmins) but does
trust machines
• Little Transparency
• Wisdom is hard to
come by
• Sentient (?) brain in
the cloud in < 20
years
Lesson
Wisdom
Knowledge
Information
Data
Hilary Mason’s Maxim
Math + Code = Awesome
Quants
Making a killing on Wall Street but still can’t impress the chicks
Weakonomics.com
Lesson
Corollary to Mason’s Maxim
Values * (Math + Code) = Awesome
Lesson
Norio Ohga
Sony President
74 min CD
Jeff Jonas
Big Data
Privacy by Design
Mark Zuckerberg
Real Names
Steve Jobs
‘nuff said
Eclectic generalists drive innovation
Richard Feynman
Physics
Lesson
We’re making this up as we go.
Austin Alleman @allemanau
Innocence Frontier Regulation Innovation
Confession
“Can’t we all just get along?”Plea
Social
Entrepreneur
High-Tech
Mercenary
Responsible
Innovator
Traditional
Capitalist
− Rodney King
Lesson “No one here gets out alive.”
− Jim Morrison
Adapt, Inve
nt,
Test
Question, S
crutinize, Cr
iticize
Watch, List
en, Learn Geeks
WonksSuits
Questions!
Jim Adler
www.metanautix.com
jimadler@metanautix.com

More Related Content

What's hot

Audience For Political Blogs
Audience For Political BlogsAudience For Political Blogs
Audience For Political BlogsMarc Pallarès
 
Internet Safety
Internet SafetyInternet Safety
Internet SafetyPHSD
 
3 ways cops are catching crooks
3 ways cops are catching crooks3 ways cops are catching crooks
3 ways cops are catching crookshunterfithen
 
Social Media Content and Discovery Practice
Social Media Content and Discovery Practice Social Media Content and Discovery Practice
Social Media Content and Discovery Practice Kevin O'Shea
 
Dental Access March 2016 Issue
Dental Access March 2016 Issue Dental Access March 2016 Issue
Dental Access March 2016 Issue Armi Cabero
 
Internet Safety For Kids By Tanmay
Internet Safety For Kids By TanmayInternet Safety For Kids By Tanmay
Internet Safety For Kids By Tanmaytsdikshit
 
09/29/09 - FOR TRANSLATION Email To International Olympic Committee
09/29/09  - FOR TRANSLATION Email To International Olympic Committee09/29/09  - FOR TRANSLATION Email To International Olympic Committee
09/29/09 - FOR TRANSLATION Email To International Olympic CommitteeVogelDenise
 
Project powerpoint
Project powerpointProject powerpoint
Project powerpointDconway4
 
Jessica guevara
Jessica guevaraJessica guevara
Jessica guevarajessica97
 
Final paper fys
Final paper fysFinal paper fys
Final paper fyslostwinds
 
Fact-checking in an Era of Fake News and Misinformation
Fact-checking in an Era of Fake News and MisinformationFact-checking in an Era of Fake News and Misinformation
Fact-checking in an Era of Fake News and MisinformationDavid Nzoputa Ofili
 
Darknet: The Other Side
Darknet: The Other SideDarknet: The Other Side
Darknet: The Other Sidejbraindc
 
Gloria flores
Gloria floresGloria flores
Gloria floresyaya700
 
Digital Breadcrumbs- Investigating Internet Crime with Open Source Intellige...
Digital Breadcrumbs-  Investigating Internet Crime with Open Source Intellige...Digital Breadcrumbs-  Investigating Internet Crime with Open Source Intellige...
Digital Breadcrumbs- Investigating Internet Crime with Open Source Intellige...Nicholas Tancredi
 

What's hot (20)

Audience For Political Blogs
Audience For Political BlogsAudience For Political Blogs
Audience For Political Blogs
 
Internet Safety
Internet SafetyInternet Safety
Internet Safety
 
3 ways cops are catching crooks
3 ways cops are catching crooks3 ways cops are catching crooks
3 ways cops are catching crooks
 
Polifluentials Report
Polifluentials ReportPolifluentials Report
Polifluentials Report
 
Website Usability Study
Website Usability StudyWebsite Usability Study
Website Usability Study
 
Ofcom and ASA
Ofcom and ASAOfcom and ASA
Ofcom and ASA
 
Social Media Content and Discovery Practice
Social Media Content and Discovery Practice Social Media Content and Discovery Practice
Social Media Content and Discovery Practice
 
Dental Access March 2016 Issue
Dental Access March 2016 Issue Dental Access March 2016 Issue
Dental Access March 2016 Issue
 
Fys iii
Fys iiiFys iii
Fys iii
 
Internet Safety For Kids By Tanmay
Internet Safety For Kids By TanmayInternet Safety For Kids By Tanmay
Internet Safety For Kids By Tanmay
 
09/29/09 - FOR TRANSLATION Email To International Olympic Committee
09/29/09  - FOR TRANSLATION Email To International Olympic Committee09/29/09  - FOR TRANSLATION Email To International Olympic Committee
09/29/09 - FOR TRANSLATION Email To International Olympic Committee
 
Project powerpoint
Project powerpointProject powerpoint
Project powerpoint
 
Jessica guevara
Jessica guevaraJessica guevara
Jessica guevara
 
Final paper fys
Final paper fysFinal paper fys
Final paper fys
 
Fact-checking in an Era of Fake News and Misinformation
Fact-checking in an Era of Fake News and MisinformationFact-checking in an Era of Fake News and Misinformation
Fact-checking in an Era of Fake News and Misinformation
 
Music
MusicMusic
Music
 
Darknet: The Other Side
Darknet: The Other SideDarknet: The Other Side
Darknet: The Other Side
 
Gloria flores
Gloria floresGloria flores
Gloria flores
 
Digital Breadcrumbs- Investigating Internet Crime with Open Source Intellige...
Digital Breadcrumbs-  Investigating Internet Crime with Open Source Intellige...Digital Breadcrumbs-  Investigating Internet Crime with Open Source Intellige...
Digital Breadcrumbs- Investigating Internet Crime with Open Source Intellige...
 
Cyber Legislation
Cyber LegislationCyber Legislation
Cyber Legislation
 

Similar to Confessions (and Lessons) of a "Recovering" Data Broker

Introduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingIntroduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingJason Hong
 
Houston Johnson - Preventing Undercover Employment Operations
Houston Johnson - Preventing Undercover Employment OperationsHouston Johnson - Preventing Undercover Employment Operations
Houston Johnson - Preventing Undercover Employment OperationsJohn Blue
 
Privacy isdeadgetoveritredux 10.12.2014
Privacy isdeadgetoveritredux 10.12.2014Privacy isdeadgetoveritredux 10.12.2014
Privacy isdeadgetoveritredux 10.12.2014protected7000
 
White Paper: Social Media for Litigation
White Paper: Social Media for LitigationWhite Paper: Social Media for Litigation
White Paper: Social Media for LitigationMedpricer
 
smiAware-WhitePaper-LegalInvestigations
smiAware-WhitePaper-LegalInvestigationssmiAware-WhitePaper-LegalInvestigations
smiAware-WhitePaper-LegalInvestigationsMedpricer
 
Big Data for a Better World
Big Data for a Better WorldBig Data for a Better World
Big Data for a Better Worldleadinghands
 
Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Micah Altman
 
Digital Keepers: Ethics of Saving Online Data About Latin American Social Mo...
Digital Keepers:  Ethics of Saving Online Data About Latin American Social Mo...Digital Keepers:  Ethics of Saving Online Data About Latin American Social Mo...
Digital Keepers: Ethics of Saving Online Data About Latin American Social Mo...Itza Carbajal
 
People Like You Like Presentations Like This
People Like You Like Presentations Like ThisPeople Like You Like Presentations Like This
People Like You Like Presentations Like ThisDavid Millard
 
Big Data Ethics Cjbe july 2021
Big Data Ethics Cjbe july 2021Big Data Ethics Cjbe july 2021
Big Data Ethics Cjbe july 2021andygustafson
 
10 Essay-Writing Tips – Phi Theta Kappa Honor Society
10 Essay-Writing Tips – Phi Theta Kappa Honor Society10 Essay-Writing Tips – Phi Theta Kappa Honor Society
10 Essay-Writing Tips – Phi Theta Kappa Honor SocietyKaren Oliver
 
An Introduction to Maskirovka aka Information Operations
An Introduction to Maskirovka aka Information OperationsAn Introduction to Maskirovka aka Information Operations
An Introduction to Maskirovka aka Information OperationsHeather Vescent
 
Making sense of big data
Making sense of big dataMaking sense of big data
Making sense of big databis_foresight
 
Social Media for Litigators
Social Media for LitigatorsSocial Media for Litigators
Social Media for LitigatorsAntigone Peyton
 
Social Media for Litigators
Social Media for LitigatorsSocial Media for Litigators
Social Media for LitigatorsLawFirmAutopilot
 
An Attorney’S Guide To Managing Social Media Based Evidence 03142011
An Attorney’S Guide To Managing Social Media Based Evidence 03142011An Attorney’S Guide To Managing Social Media Based Evidence 03142011
An Attorney’S Guide To Managing Social Media Based Evidence 03142011larrylieb
 
Examples Of Essay Style Questions
Examples Of Essay Style QuestionsExamples Of Essay Style Questions
Examples Of Essay Style QuestionsCheryl Barry
 
Online Identity- Part 1
Online Identity- Part 1Online Identity- Part 1
Online Identity- Part 1KR_Barker
 

Similar to Confessions (and Lessons) of a "Recovering" Data Broker (20)

Introduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingIntroduction to Privacy and Social Networking
Introduction to Privacy and Social Networking
 
Houston Johnson - Preventing Undercover Employment Operations
Houston Johnson - Preventing Undercover Employment OperationsHouston Johnson - Preventing Undercover Employment Operations
Houston Johnson - Preventing Undercover Employment Operations
 
Privacy isdeadgetoveritredux 10.12.2014
Privacy isdeadgetoveritredux 10.12.2014Privacy isdeadgetoveritredux 10.12.2014
Privacy isdeadgetoveritredux 10.12.2014
 
White Paper: Social Media for Litigation
White Paper: Social Media for LitigationWhite Paper: Social Media for Litigation
White Paper: Social Media for Litigation
 
smiAware-WhitePaper-LegalInvestigations
smiAware-WhitePaper-LegalInvestigationssmiAware-WhitePaper-LegalInvestigations
smiAware-WhitePaper-LegalInvestigations
 
Big Data for a Better World
Big Data for a Better WorldBig Data for a Better World
Big Data for a Better World
 
Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...Making Decisions in a World Awash in Data: We’re going to need a different bo...
Making Decisions in a World Awash in Data: We’re going to need a different bo...
 
Digital Keepers: Ethics of Saving Online Data About Latin American Social Mo...
Digital Keepers:  Ethics of Saving Online Data About Latin American Social Mo...Digital Keepers:  Ethics of Saving Online Data About Latin American Social Mo...
Digital Keepers: Ethics of Saving Online Data About Latin American Social Mo...
 
People Like You Like Presentations Like This
People Like You Like Presentations Like ThisPeople Like You Like Presentations Like This
People Like You Like Presentations Like This
 
4x4 SXSW
4x4 SXSW4x4 SXSW
4x4 SXSW
 
Big Data Ethics Cjbe july 2021
Big Data Ethics Cjbe july 2021Big Data Ethics Cjbe july 2021
Big Data Ethics Cjbe july 2021
 
Altman - Perfectly Anonymous Data is Perfectly Useless Data
Altman - Perfectly Anonymous Data is Perfectly Useless DataAltman - Perfectly Anonymous Data is Perfectly Useless Data
Altman - Perfectly Anonymous Data is Perfectly Useless Data
 
10 Essay-Writing Tips – Phi Theta Kappa Honor Society
10 Essay-Writing Tips – Phi Theta Kappa Honor Society10 Essay-Writing Tips – Phi Theta Kappa Honor Society
10 Essay-Writing Tips – Phi Theta Kappa Honor Society
 
An Introduction to Maskirovka aka Information Operations
An Introduction to Maskirovka aka Information OperationsAn Introduction to Maskirovka aka Information Operations
An Introduction to Maskirovka aka Information Operations
 
Making sense of big data
Making sense of big dataMaking sense of big data
Making sense of big data
 
Social Media for Litigators
Social Media for LitigatorsSocial Media for Litigators
Social Media for Litigators
 
Social Media for Litigators
Social Media for LitigatorsSocial Media for Litigators
Social Media for Litigators
 
An Attorney’S Guide To Managing Social Media Based Evidence 03142011
An Attorney’S Guide To Managing Social Media Based Evidence 03142011An Attorney’S Guide To Managing Social Media Based Evidence 03142011
An Attorney’S Guide To Managing Social Media Based Evidence 03142011
 
Examples Of Essay Style Questions
Examples Of Essay Style QuestionsExamples Of Essay Style Questions
Examples Of Essay Style Questions
 
Online Identity- Part 1
Online Identity- Part 1Online Identity- Part 1
Online Identity- Part 1
 

Recently uploaded

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 

Recently uploaded (20)

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 

Confessions (and Lessons) of a "Recovering" Data Broker

  • 1. Confessions (and Lessons) of a "Recovering" Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators Jim Adler Vice President, Products Metanautix jimadler@metanautix.com @jim_adler http://jimadler.me Usenix Security Conference Washington, DC Aug 15 2013
  • 2. About Metanautix • Mission: Next generation big data management & analysis – Transparency into the big data supply chain within and across organizations • Engineering led, product company – Team of veterans (10-20+ years experience) – Built massive data analysis systems at Google, FB, MSFT, AMZN, Pixar – Solidly funded by top VCs – Working with lighthouse customers • Started Nov 2012, slowly emerging from stealth mode • Stay tuned!
  • 3. I am not an attorney.Confession Dork Nerd Geek Dweeb
  • 4. You can often do more from the inside than the outside. • 20B public records • 30M visitors per month • 50M+ reports sold Confession
  • 5. Listen to your toughest criticsLesson
  • 6. Can I have a little narcissism with my voyeurism? • What does my background check say? • Privacy controls – Suppress single address or phone number • Comment on your own public profile Lesson
  • 7. Data from Feb 2013 Data from 40,000 BC thru 2002 20 Exabytes (20M TB) Lots of data created, transferred, & stored.Confession
  • 8. The “Public” Data Supply Chain of YouConfession Search Blogs Criminal Records Risk Civil Suits Marketing Addresses Directory Phone Numbers Payments Background Resumes Public Posts Name s Data Uses Government Commercial Self-Reported Big Data Engines
  • 9. FIND OWNER OF DOG’S RELATIVE FOR TRANSPLANT SINGLES CURIOUS ABOUT THE PEOPLE THEY MEET PARENTS ENSURING WHO THEIR KIDS SAFETY GENEALOGISTS CULTIVATING THEIR FAMILY TREE BUSINESSES THAT NEED TO UPDATE CONTACT INFORMATION ON CUSTOMERS FINDING LONG-LOST FRIENDS, MILITARY BUDDIES, ROOMMATES, OR CLASSMATES ANYONE CURIOUS ABOUT WHO'S EMAILING OR CALLING THEM THOSE IN LEGALLY ENTANGLED LOOKING FOR COURT RECORDS ANYONE WHO NEED ADDRESS HISTORIES FOR PASSPORTS SOCIAL NETWORKERS LOOKING TO EXPAND THEIR FRIENDS LIST PROFESSIONALS LEARNING ABOUT COLLEAGUES AT CONFERENCES RECONNECTING OUT-OF-TOUCH FAMILY MEMBERS ONLINE SHOPPERS VERIFYING ONLINE SELLERS INVESTIGATIVE JOURNALISTS RUNNING DOWN LEADS SALES PROFESSIONALS LOOKING FOR NEW PROSPECTS NETWORKERS SEEKING BUSINESS OPPORTUNITIES LAW ENFORCEMENT NON-PROFIT ORGANIZATIONS LOOKING FOR SUPPORTERS FIANCÉS AND THEIR CURIOUS FAMILY MEMBERS SOCIAL WORKERS WHO NEED TO KNOW MORE ABOUT THEIR CLIENTS CALLER ID OF HARASSING PHONE CALLS ALUMNI GROUPS ARRANGING REUNIONS ADOPTED KIDS SEEKING THEIR BIOLOGICAL PARENTS AIRLINES TRYING TO RETURN LOST LUGGAGE CHECKING OUT A PROSPECTIVE SOCIAL NETWORK CONNECTION CHECKING OUT A PROSPECTIVE DATE CHECKING OUT A PROSPECTIVE TENANT FINDING PEOPLE THAT HAVE THE SAME ILLNESS AS YOU RESEARCHING A PROSPECTIVE EMPLOYEE ANYONE RETRIEVING COURT RECORDS REGULATED Lots of uses for your data … some regulated LAWYERS NEEDING QUICK ACCESS TO COURT RECORDS BANKING SERVICES RESEARCH SHARING LEARNING ABOUT A BUSINESS Confession
  • 10. Billions of Records Millions of People Jim Adler Houston, TX Age 70 Jim Adler Redmond, WA Age 50 Jim Adler Denver, CO Age 48 Jim Adler McKinney, TX Age 57 Jim Adler Canaan, NH Age 59 Jim Adler Hastings, NE Age 32 213 records linked to the correct 37 Jim Adlers Philip Collins 375 People Jim Adler 213 Records 37 People Randolph Hutchins 5 People Gwen Fleming 2 PeopleCarol Brooks 9800 Records 1250 People Confession We don’t know you all that well
  • 11. Opt-out doesn’t always mean deletionConfession Jane Hampton 06/23/1998 123 Main Peoria, IL Jane Hampton 123 Main Peoria, IL jane@facebook.com Jane Hampton jane@facebook.com Jane Hampton 06/23/1998 123 Main Peoria, IL Jane Hampton 123 Main Peoria, IL jane@facebook.com Jane Hampton jane@facebook.com
  • 12. When towns were small, personal anonymity was low … “The only thing worse than being talked about, is not being talked about.” − Oscar Wilde Lesson
  • 13. “Good Fences Make Good Neighbors” − Robert Frost Urban populations grew along with personal anonymity… Lesson
  • 14. 0 20 40 60 80 100 120 1850 1890 1930 1970 2010 PrivacyExpectations “Rockwell” Era “Good Fences” Era “Privacy Vertigo” Era … we’re suffering from Privacy Vertigo.Confession Urban Density ↓ Personal Anonymity ↓
  • 15. Privacy is deeply cultural.Lesson Discretion Disclosure
  • 16. EU “Right of Personality” • Inviolable right of dignity • Germany: BGB, 1900, post WWII US: Brandeis & Warren, 1890 • Germany: “Source Right” • Esra “kiss & tell” plaintiff won, book banned US “Privacy Torts” • Statutory harm • US: Prosser’s Torts, 1960 • US: Sectorial privacy regime • Bonome “kiss & tell” case dismissed EU Rights versus US Torts http://paulschwartz.net/pdf/SchwartzPeifer_Prosser_FINAL.pdf
  • 17. How to unpack Privacy? Think PPP. PERILS Lesson
  • 18. Sometimes you’re in a public place when you think you’re in a private place. “Gaydar” A 2009 MIT study found it was possible to predict men’s sexual orientation by analyzing the gender and sexuality of their social network contacts – even if the rest of the information on their profile was set to private. Confession
  • 19. “To Serve Man” is a Cookbook.Confession “If you’re not paying for the product, you are the product.” − Claire Wolfe (paraphrased)
  • 20. Peer to Peer Corporation & Customer/Employee Government & Citizen Your God & You PrivacyRights Power Disparity  In privacy contexts, Power matters.Lesson
  • 21. Target knows you’re pregnant and when you’re due. So, what’s so perilous? Confession
  • 22. Secrets are power equalizers.Confession DPower µ 1 Trust µSecrets
  • 23. Public Places Powerful Players Private Places Powerful Players Private Places Weaker Players Public Places Weaker Players M O R E P R I VAT E P L A C E S MOREPLAYERPOWERGAP Mapping Places-Players-Perils Cases
  • 24. M O R E P R I VAT E P L A C E S MOREPLAYERPOWERGAP News of the World phone hacking Rutgers student commits suicide after spied by webcam FBI GPS criminal surveillanceGoogle privacy policy unification Target finds out teen pregnant before parents GM OnStar tracks users Woman caught naked by Google Street View Actress sues IMDB over revealing her age US deports British tourists over Tweets FB user sets fire to home after de- friending "Girls Around Me" pulled from market Health orgs use Twitter to track illness NSA internet citizen surveillance Georgia teacher fired after posting vacation pics Places-Players-Perils Cases
  • 25. A head in the clouds < 20 yearsPrediction $27,100 $13,500 $6,800 $3,400 $1,700 $850 $420 $210 $100 $53 $26 $13 $7 $3 $2 $1 $1 $10 $100 $1,000 $10,000 $100,000 2012 2014 2016 2018 2020 2022 2024 2026 2028 2030 2032 2034 2036 2038 2040 2042 CostperMonth(000s) Year • 20,000 TFlops • 2,500 Terabytes • Less than $700K per year Chris Westbury, University of Alberta
  • 26. “Watch your thoughts, they become words. Watch your words, they become actions. Watch your actions, they become habits. Watch your habits, they become your character. Watch your character, it becomes your destiny.” – Lao Tzu “… the essential crime that contained all others in itself. Thoughtcrime, they called it.” – George Orwell Big data inferences are not thoughtcrimesLesson
  • 27. Felon Classifier Overview ModelLearner 250 M Defendants Feature Extraction 15K Labels 15K Predictors Cleaning Linking Sampling Objective If someone has minor offenses on their criminal record, do they also have any felonies? Today’s Bloomberg piece: http://bloom.bg/1eMtnug
  • 28. How does the Felon Classifier work? Gender Eye Color Tattoos Criminal Offenses Score Over Threshold of 3.5? Likely Felon? NO YES Hazel (+1.7) Male Blue 2 + (+1.3) Traffic only Female (-0.5) Brown < 2 4 or fewer misdemeanors (+1.9) YES Green 8 or fewer misdemeanors NO 4.4 Hazel Male (+0.1) Blue 2 + Traffic only (-0.5) Female Brown (+1.2) < 2 (+0.1) 4 or fewer misdemeanors YES Green 8 or fewer misdemeanors NO 0.9 widget: http://jimadler.me
  • 29. Classifiers depend on policy as much as technology ANARCHY T Y R A N N Y 0.0% 20.0% 40.0% 60.0% 80.0% 100.0% 0.0% 5.0% 10.0% 15.0% 20.0% FalseNegativeRate False Positive Rate Threshold: 0.66 FP Rate: 5% FN Rate: 22% Threshold: 1.1 FP Rate: 1% FN Rate: 40% Threshold: -1.82 FP Rate: 19% FN Rate: 0% Confession
  • 30. Privacy, Reasonable Suspicion, & Probable Cause • Courts have upheld profiling – US v Sokolow • Predictive information never enough 1. Reliable 2. Efficient 3. Particularized 4. Detailed 5. Timely 6. Corroborated • More • Andrew Guthrie Ferguson, Predictive Policing http://ssrn.com/abstract_id=2050001 • Bernard Harcourt, Rethinking Racial Profiling http://www.law.uchicago.edu/files/files/rethinking_racial_profiling.pdf • The “Not Ready For Prime Time” Classifier http://jimadler.me/post/47374264398/the-not-ready-for-prime-time-classifier
  • 31. NYC Stop & Frisk Found UnconstitutionalRuling “The city … believes that blacks and Hispanics should be stopped at the same rate as their proportion of the local criminal suspect population.” − US District Judge Shira Scheindlin = 2*3%=10% 100% greater chance that a minority stop is justified over a random stop P~A|M = 90% PA|M = 100% 50% 5% NYC assumes 87% Minorities in NYC If it’s not ok to stop & frisk 95% of the general population for nothing, why is it ok to stop & frisk 90% of minorities for nothing? PA|M = PM|A PM PA PA|M = Chance a minority should be arrested P~A|M= Chance a minority should not be arrested PM|A = Chance that someone arrested is a minority PM = Chance someone is a minority PA = Chance someone is arrested Bayes’ Rule
  • 32. M O R E P R I VAT E P L A C E S MOREPLAYERPOWERGAP News of the World phone hacking Rutgers student commits suicide after spied by webcam FBI GPS criminal surveillanceGoogle privacy policy unification Target finds out teen pregnant before parents GM OnStar tracks users Woman caught naked by Google Street View Actress sues IMDB over revealing her age US deports British tourists over Tweets FB user sets fire to home after de- friending "Girls Around Me" pulled from market Health orgs use Twitter to track illness NSA internet citizen surveillanceGeorgia teacher fired after posting vacation pics Big brother is watching (duh) “We’re being asked to trust without being able to verify.” − Alex Howard Pres. Obama calls for more transparency in FISA court and surveillance laws NSA chief announces plan to replace 1,000 sysadmins with machines Confession
  • 33. Technology grows exponentially. Wisdom grows linearly. • Gov’t doesn’t trust people (at least sysadmins) but does trust machines • Little Transparency • Wisdom is hard to come by • Sentient (?) brain in the cloud in < 20 years Lesson Wisdom Knowledge Information Data
  • 34. Hilary Mason’s Maxim Math + Code = Awesome Quants Making a killing on Wall Street but still can’t impress the chicks Weakonomics.com Lesson
  • 35. Corollary to Mason’s Maxim Values * (Math + Code) = Awesome Lesson
  • 36.
  • 37. Norio Ohga Sony President 74 min CD Jeff Jonas Big Data Privacy by Design Mark Zuckerberg Real Names Steve Jobs ‘nuff said Eclectic generalists drive innovation Richard Feynman Physics Lesson
  • 38. We’re making this up as we go. Austin Alleman @allemanau Innocence Frontier Regulation Innovation Confession
  • 39. “Can’t we all just get along?”Plea Social Entrepreneur High-Tech Mercenary Responsible Innovator Traditional Capitalist − Rodney King
  • 40. Lesson “No one here gets out alive.” − Jim Morrison Adapt, Inve nt, Test Question, S crutinize, Cr iticize Watch, List en, Learn Geeks WonksSuits