Simple does it

1. Simple Does It:Weakly Supervised
Instance and Semantic Segmentation
Author: Anna Khoreva, Rodrigo Benenson, Jan Hosang,
Matthias Hein, Bernt Schiele
Publish: CVPR 2017
Date: July 2017
Group 2
Member : 呂承祐 黃宇晟

2. Fully Supervised Segmentation
Segmentation
network
Input
Label
Output

3. Weakly Supervised Segmentation
Weakly
Supervised
Segmentation
network
Input
Label
Output

4. Weakly Supervised Segmentation
Weakly
Supervised
Segmentation
network
Input
Label
Output
# Horse

5. Result

6. Segmentation
network
Ex: deepLab
Label
NaïveInput
Output

7. Segmentation
network
C1：background
C2：object extend
C3：objectness
Post processing
Box
Ex: deepLab
Label
Input
Output

8. C1：background
C1

9. C2：object extend
C2
bbox’
label
𝑏𝑏𝑜𝑥′𝑖 𝑙𝑎𝑏𝑒𝑙𝑖
𝑏𝑏𝑜𝑥′𝑖 𝑙𝑎𝑏𝑒𝑙𝑖
IoU:

10. C3: objectness
C3
Fully connected CRF

11. Fully connected CRF – machine learning

12. Example
High penalty Low penalty

13. Segmentation
network
C1：background
C2：object extend
C3：objectness
Post processing
Box𝑖
Ex: deepLab
Label
Input
Output

14. Segmentation
network
bbox’
C1：background
C2：object extend
C3：objectness
Post processing
Ex: deepLab
GrabCut+
GrabCut+
Input
Label
Output

15. GrabCut – traditional computer vision

16. Segmentation
network
bbox’
C1：background
C2：object extend
C3：objectness
Post processing
Ex: deepLab
M G+
Output
M G+Input
Label

17. Result

18. Reference
 [1] Anna Khoreva, Rodrigo Benenson, Jan Hosang, Matthias Hein, Bernt Schiele
Simple Does It: Weakly Supervised Instance and Semantic Segmentation. arXiv.
2016
 [2] P. Krähenbühl and V. Koltun. Efficient inference in fully connected crfs with
gaussian edge potentials. In NIPS. 2011.
 [3] Liang-Chieh Chen, George Papandreou, Senior Member, IEEE, Iasonas Kokkinos,
Member, IEEE, Kevin Murphy, and Alan L. Yuille, Fellow. IEEE. DeepLab: Semantic
Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully
Connected CRFs.arXiv. 2017
 [4] C. Rother, V. Kolmogorov, and A. Blake. Grabcut: Interactive foreground extraction
using iterated graph cuts. In ACM Trans. Graphics, 2004.
 [5] J. Pont-Tuset, P. Arbeláez, J. Barron, F. Marques, and J. Malik. Multiscale
combinatorial grouping for image segmentation and object proposal generation. arXiv
preprint arXiv:1503.00848, 2015. 2