Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

0

Share

Download to read offline

Scops self supervised co-part segmentation

Download to read offline

Xiaolin Zhang

Related Books

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Scops self supervised co-part segmentation

  1. 1. SCOPS: Self-Supervised Co-Part Segmentation UC Merced, NVIDIA Wei-Chih Hung, Varun Jampani, Sifei Liu, Pavlo Molchanov, Ming-Hsuan Yang, and Jan Kautz
  2. 2. The problem • Fully supervised • Costly for the annotation work • Hard to generalize to unseen categories • Self-supervised • Learn part segmentations that are semantically consistent across different object instances, given only an image collection of the same object category. • Class agnostic
  3. 3. Contributions • Geometric concentration • Geometric Concentration Loss • Robustness to variations • Equivariance Loss • Semantic consistency • Semantic Consistency Loss • Objects as union of parts • Saliency Constraint
  4. 4. Overall Framework • Backbone: DeepLab-V2(ResNet50) • Output: 𝑅 = 𝐹(𝐼; 𝜃𝑓) ∈ [0,1] 𝐾+1 ∗𝐻∗𝑊 • K is the number of parts
  5. 5. Geometric Concentration Loss • Observation: • Pixels belonging to the same object part are spatially concentrated or form a connected component. • Minimize the variance of spatial probability distribution • The part center for a part k along axis u
  6. 6. Equivariance Loss • Random spatial Transform Ts • Random appearance perturbation Ta Transformed part center
  7. 7. Semantic Consistency Loss Pretrained on ILSVRC Avoid the bias towards background

Xiaolin Zhang

Views

Total views

234

On Slideshare

0

From embeds

0

Number of embeds

0

Actions

Downloads

5

Shares

0

Comments

0

Likes

0

×