論文紹介：Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers
•
0 likes•168 views
Tsung-Wei Ke, Jyh-Jing Hwang, Yunhui Guo, Xudong Wang, Stella X. Yu, "Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers" CVPR2022 https://openaccess.thecvf.com/content/CVPR2022/html/Ke_Unsupervised_Hierarchical_Semantic_Segmentation_With_Multiview_Cosegmentation_and_Clustering_Transformers_CVPR_2022_paper.html
Recommended
More Related Content
What's hot
What's hot (20)
Similar to 論文紹介：Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers
Similar to 論文紹介：Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers (20)
More from Toru Tamaki
More from Toru Tamaki (20)
Recently uploaded
Recently uploaded (20)
論文紹介：Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers
- 1. Unsupervised Hierarchical Semantic Segmentation With Multiview Cosegmentation and Clustering Transformers Tsung-Wei Ke, Jyh-Jing Hwang, Yunhui Guo, Xudong Wang, Stella X. Yu, CVPR2022 2023/05/11
- 2. ◼Hierarchical Segment Grouping (HSG) • • • Multiview Cosegmentation Clustering Transformer
- 3. ◼Hierarchical Segment Grouping (HSG)
- 4. Pixel-Segment Contrastive Feature Learning 1. 𝑉 • 2. • OWT-UCM [Arbelaez+, IEEEPAMI2010] • 3. • 𝑢 ∝ 𝑚𝑒𝑎𝑛 𝑣𝑖: 𝑖 𝑖𝑛 𝑠𝑒𝑔𝑚𝑒𝑛𝑡 𝑠 , 𝑢 = 1 4. 1 2 3
- 5. Consistent Segmentations by View & Hierarchy ◼ • fine~coarse level • Grouping 𝐺𝑒 • OWT-UCM 𝐺0 • Grouping 𝐺𝑙+1 • 𝐺𝑙 • Base-cluster feature 𝑋0 • 𝑉 • Base-cluster feature 𝑋𝑙+1 • 𝑋𝑙 Clustering transformer
- 6. Next-level cluster feature 𝑿𝒍+𝟏 and grouping 𝑮𝒍+𝟏 ◼𝑃𝑙+1 1. • 𝑙 𝑥 𝑎 • 𝑃𝑙 𝑎 = 𝑃𝑟𝑜𝑏(𝐺𝑙 = 𝑎|𝑥) 2. • 𝑙 𝑎 𝑙 + 1 𝑏 • 𝐶𝑙 𝑙+1 𝑎, 𝑏 = 𝑃𝑟𝑜𝑏 𝐺𝑙+1 = 𝑏 𝐺𝑙 = 𝑎 • • 𝑃𝑙+1 𝑏 = σ𝑎 𝑃𝑙 𝑎 ∙ 𝐶𝑙 𝑙+1 𝑎, 𝑏 3. 𝑋0 Pl+1 • 𝑃𝑙+1 = 𝑃𝑙 × 𝐶𝑙 𝑙+1 = 𝑃0 × 𝐶0 1 × 𝐶1 2 ×⋅⋅⋅× 𝐶𝑙 𝑙+1
- 7. Clustering Transformer ◼𝑋𝑙+1 𝐶𝑙+1 • ◼Statistical feature mappings • 𝑌𝑙 fc • 𝑄𝑙 ◼Softmax • 𝐶𝑙 𝑙+1 = 𝑠𝑜𝑓𝑡𝑚𝑎𝑥 1 𝑚 𝑌𝑙 ⊺ 𝑍𝑙+1 • 𝑚:
- 8. Goodness of Grouping ◼ • Modularity maximization [Newman, Phys. Rev2006] • • Collapse regularization • • • maximize centroid separation • • ◼
- 9. Training and Testing ◼ • ◼ • 𝐺𝑙 • pixel feature CNN clustering transformers • OWT-UCM
- 10. ◼ • Moco [He+, CVPR2020] • DenseCL [Wang+, CVPR2021] • Revisit [Gansbeke+, arXiv2021] • SegSort [Hwang+, ICCV2019] • DeepCluster 2018 [Caron+, ECCV2018] • Doersch 2015 [Doersch+, ECCV2015] • [Isora+, arXiv2016] • IIC [Ji+, ICCV2019] • AC [Ouali+, ECCV2020] 47 ◼ • Pascal VOC 2012 [Everingham+, IJCV2010] • MSCOCO [Lin+, ECCV2014] • Cityscapes [Cordts+, CVPR2016] • KITTI-STEP [Weber+, arXiv2021] • COCO-stuff [Caesar+, CVPR2018] • Potsdam [Gerke+, 2014] 17
- 13. Results on unsupervised semantic segmentation ◼ • mIoU, Accuracy
- 14. Results on hierarchical segmentation ◼Normalized Foreground Covering • 𝑠𝑓𝑔: ground truth
- 15. ◼HSG • Multiview Cosegmentation Clustering Transformer • ◼ • •