Confidential – Restricted
LEARNING with LIMITED LABELED DATA
Shioulin Sam and Nisha Muktewar
Sanjay Krishnan (University of Chicago), Ines Montani (Explosion AI)
Confidential – Restricted 3
Confidential – Restricted 4
Confidential – Restricted 5
Confidential – Restricted 6
Confidential – Restricted 7
Confidential – Restricted 8
Confidential – Restricted 9
Confidential – Restricted 10
Confidential – Restricted 11
Confidential – Restricted 12
Confidential – Restricted 13
Confidential – Restricted 14
Confidential – Restricted 15
Confidential – Restricted 16
Confidential – Restricted
Choosing what to label
Confidential – Restricted 18
Random Sampling
Confidential – Restricted 19
Uncertainty - Margin Sampling
Confidential – Restricted 20
Uncertainty - Margin Sampling
Confidential – Restricted
Extending to deep learning
Confidential – Restricted 22
Distance from the decision boundary
Computing the distance between the datapoint and the closest neighbor of a different
class
Confidential – Restricted 23
Distance from the decision boundary
Using adversarial perturbations to estimate the distance
Image from https://openai.com/blog/adversarial-example-research/
Confidential – Restricted 24
Distance from the decision boundary
Computing the distance between the datapoint and the decision boundary using
perturbation magnitude
Confidential – Restricted
Demo
Confidential – Restricted 26
Confidential – Restricted 27
Confidential – Restricted 28
Confidential – Restricted 29
Confidential – Restricted 30
Ines Montani
Founder of Explosion AI
Confidential – Restricted 31
Sanjay Krishnan
Assistant Professor of Computer Science,
University of Chicago
Confidential – Restricted 32
Q & A
Confidential – Restricted
THANK YOU
Confidential – Restricted 34
Confidential – Restricted 35
Confidential – Restricted 36

Machine Learning with Limited Labeled Data 4/3/19