Lise Getoor, "

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Link Mining

Lise Getoor
Li G t
University of Maryland, College Park

August 22, 2012

Alternate Title…..
What
Machine Learning/Statistics/Data Mining
can do for YOU!

1.Predict fut...

So, what’s Link Mining???
 Machine learning when you have graphs (or networks)
 Nodes are entities
• ...

Ex: Social Media Relationships
User-User
Friends
...

Link Mining Tasks
 Node Labeling
 Link Prediction
 Entity Resolution
 G oup etect o
Group Detection

Node Labeling

What is Harry’s
h
political persuasion?

Harry

Natasha

Link Prediction

Friends?

Entity Resolution
 Aka: deduplication, co-reference resolution, record
linkage, reference consolidation, etc.
...

Abstract Problem Statement
Real Digital World
World Records /
Men...

Deduplication Problem Statement
 Cluster the records/mentions that correspond to
same entityy

Deduplication Problem Statement
 Cluster the records/mentions that correspond to
same entityy
 Intensional V...

Record Linkage Problem Statement
 Link records that match across databases

...

Reference Matching Problem
 Match noisy records to clean records in a reference
table

...

InfoVis Co-Author Network Fragment

before after

Group Detection

Link Mining Algorithms
 Node Labeling
 Link Prediction
 Entity Resolution
 G oup etect o
Group Detection

Link Mining Algorithms
 Node Labeling 1. Relational Classifiers
2. Collective Classifiers...

Relational Classifiers
Given: a w
...

Relational Classifiers
 Values are represented as a fixed-length feature
vector

 Instances are treated independ...

Application Case Studies
 Two example applications that use relational
classifiers
 Focus is on types of rel...

Case Study 1:
Predicting Ad Click-Through Rate
Click Through
 Task: Predict the click t...

Relational Features Used
Average CTR Average CTR
CTR?

...

Case Study 2:
Predicting Friendships

 Task: Predict new friendships among users, based
...

Relational Features Used
 “Petworks” - social networks of pets

count, density

...

Key Idea: Feature Construction
 Feature informativeness is key to the success of a
relational classifier

 Featu...

Link Mining Algorithms
 Node Labeling 1. Relational Classifiers
2. Collective Classifiers...

Collective Classification
[Neville & Jensen, SRL00; Lu & Getoor, ICML03, Sen et al. AI Mag08]

 Extends r...

CC: Learning
 label set:

P2
P4
P1
...

CC: Inference (1)

P1

P2
P5

P3
...

CC: Inference (2)

P1

P2
P5

P3
...

CC Key Idea
 Rather than make predictions independently, begin
with relational classifier, and then ‘propagate’
...

Link Mining Algorithms
 Node Labeling
 Link Prediction
 Entity Resolution
 G oup etect o
Group Detection

The Entity Resolution Problem
James
John
...

Relational Identification

Very similar names.
Added evidence from
...

Relational Disambiguation

Very similar names
but no shared
...

Collective Entity Resolution

One resolution
provides evidence
...

P1: “JOSTLE: Partitioning of Unstructured Meshes for
Massively Parallel Machines”, C. Walshaw, M. Cross,
M. G. Eve...

P1: “JOSTLE: Partitioning of Unstructured Meshes for
Massively Parallel Machines”, C. Walshaw, M. Cross,
M. G. Eve...

Relational Clustering (RC-ER)

P1 C. Walshaw M. Cross M. G. Everett S. Johnson

P2 C.
C Walshaw ...

Relational Clustering (RC-ER)

P1 C. Walshaw M. Cross M. G. Everett S. Johnson

P2 C.
C Walshaw ...

Relational Clustering (RC-ER)

P1 C. Walshaw M. Cross M. G. Everett S. Johnson

P2 C.
C Walshaw ...

Relational Clustering (RC-ER)

P1 C. Walshaw M. Cross M. G. Everett S. Johnson

P2 C.
C Walshaw ...

Cut-based Formulation of RC-ER

M. G. Everett S. Johnson M. G. Everett S. Johnson

M. Everett ...

Objective Function
 Minimize:

 w sim
i
i
j
...

Relational Clustering Algorithm
1. Find similar references using ‘blocking’
2. Bootstrap clusters using attributes and...

Evaluation Datasets
 CiteSeer
 1,504 citations to machine learning papers (Lawrence et al.)
 2,892 refere...

Baselines
 A: Pair-wise duplicate decisions w/ attributes only
 Names: Soft-TFIDF with Levenstein, Jaro, Jaro-Wi...

ER over Entire Dataset
Algorithm CiteSeer arXiv BioBase
A 0.980 ...

ER over Entire Dataset
Algorithm CiteSeer arXiv BioBase
A 0.980 0....

Flipside….

Privacy breaches in OSNs
 Identity disclosure
 A mapping from a record Who is ?
...

Other Linqs Projects
 Key Opinion Leader Identification
 Active Surveying in Social Networks
 Ontology Alignment ...

Other Linqs Projects
 Key Opinion Leader Identification
 Active Surveying in Social Networks
 Ontology Alignment ...

Conclusion
 Link mining algorithms can be useful tools for social
media
 Need algorithms that can handle the mul...

http://www.cs.umd.edu/linqs

Work sponsored by the National Science Foundation,
Maryland Industrial Partners (MIPS...

You are reading a preview.

Activate your 30 day free trial to continue reading.

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

LinkedIn
Facebook
Twitter
Email

Replay

Top clipped slide

1 of 55 Ad

1 of 55 Ad