The document discusses human-level concept learning through probabilistic program induction. It compares the principles of learning from big data versus human learning. Humans can learn rich concepts from just one or a few examples by using compositional and causal reasoning, as well as learning-to-learn abilities. The document introduces Bayesian Program Learning (BPL), which uses these principles to perform one-shot learning on the Omniglot data set. BPL is evaluated using visual Turing tests and one-shot classification performance to demonstrate human-level concept learning from limited examples.

1. In the name of
God
1

2. 2
Institute for Advanced Studies in Basic Sciences
Human-level concept learning through probabilistic program induction
Mohammad Amid Abbasi
Teacher: Dr.P.Razzaghi
Winter 2018

3. 3
v2015
v378 citation
vScience journal
About paper
Joshua B. Tenenbaum
Brenden Lake
Ruslan Salakhutdinov

4. 4
vIntroduction
vHuman-level concept learning
Contents

5. 5
1) Learn from as much data as
possible
2) Learning simple models often
works
3) Aim for prediction not
understanding
Introduction
Principles of Big Data Principles of Human Learning
1) Learn from just one or a few
examples
2) Learning complex,
compositional models that
support many abilities
3) Aim for rich causal
understanding

6. 6
How do people learn such rich concepts from very little data?

7. 7
Human-level concept learning

8. 8
Human-level concept learning

9. 9
A testbed domain for one-shot learning

10. 10
Omniglot data set

11. 11
Human drawing

12. 12
Bayesian Program Learning (BPL)

13. 13
Principle 1: Compositionality

14. 14
Principle 2: Causality
Neural caption generation model:
“A group
of people
standing
on top of
a beach”

15. 15
Principle 3: Learning-to-learn

16. 16
Bayesian Program Learning (BPL)

17. 17
Bayesian Program Learning (BPL)

18. 18
Bayesian Program Learning (BPL)

19. 19
Bayesian Program Learning (BPL)

20. 20
Bayesian Program Learning (BPL)

21. 21
Turing test

22. 22
Turing test

23. 23
Visual Turing Tests

24. 24
Lesion analysis of key principles

25. 25
One-shot classification performance

26. 26
vhttps://cims.nyu.edu/~brenden/LakeEtAl2015Science.pdf
vhttps://github.com/brendenlake/omniglot
vhttps://www.youtube.com/watch?v=7tJsrILeti0&t=390s
vhttps://www.youtube.com/watch?v=wkWNfyocwQ8&t=9s
vhttps://www.youtube.com/watch?v=p1VpvOFJg6A&t=3s
vhttps://www.youtube.com/watch?v=orAylPDk6fQ&t=1s
Resources

27. 27
Thanks for your attention