Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov & Sergey Zagoruyko, "End-to-End Object Detection with Transformers" ECCV2020 https://www.ecva.net/papers/eccv_2020/papers_ECCV/html/832_ECCV_2020_paper.php

1. End-to-End Object Detection
with Transformers
2023/5/11

2. ◼ DETR (DEtection TRansformer)
◼
◼End-to-end
•

3. ◼
• NMS
• Non-Maximum Suppression (NMS)
• Bounding box (bbox)
• bbox
◼
• NMS End-to-End
• bbox

4. DETR
◼2
•
•
•
•
𝐶𝑖 bbox

5. DETR
◼ 3
• CNN
• Transformer
• simple feed forward network (FFN)

6. CNN
◼CNN (Convolutional Neural Network)
•
•

7. Transformer
◼
• 1 1
• positional encoding

8. Transformer
◼
• object queries
• object queries N enbedding
• object queries
•
• Positional Encoding

9. FFN
◼FFN (feed-forward networks)
• ReLU 3
• bbox
• softmax
• N

10. ◼Faster R-CNN [Ren+, PAMI2015]
◼Ablation Study
•
• Positional embedding
•
◼Analysis
•
•
◼
• ID

11. ◼
• COCO 2017
• 118k 5k
◼Optimizer
• AdamW [Ilya&Frank, ICLR2017]
◼
• transformer
• 1e−4
•
• 1e−5
◼
• 1e−4
◼
• ResNet-50 ResNet-101
• DETR,DETR-R101
• ImageNet [Deng+, CVPR2009]
◼dilation
• dilation
• DETR-DC5,DETR-DC5-R101
•

12. Faster R-CNN
◼DETR Faster R-CNN
• FPN [Lin+, CVPR2017]
• 9
◼𝐴𝑃𝑆 𝐴𝑃𝐿
•
•
•
•
•
•
•

13. Ablation Study
◼
•
•
•

14. Ablation Study
◼
• NMS
•
◼ attention
•
•

15. Ablation Study
◼positional encoding
• Spatial positional encoding Output positional encoding(object queries) 2
• attention
• Output positional encoding
• Spatial positional encoding
• attention Spatial pos

16. Ablation Study
◼
• 3
•
• L1
• Generalized IoU (GIoU) [Rezatofighi+, CVPR2019]
•
• L1 GIoU

17. Analysis
◼
• FFN 100 20 val
• bbox
• COCO
•
• bbox
•
• bbox
• bbox
• bbox

18. Analysis
◼
• 13
•
• 24
• object queries

19. ◼
• Faster R-CNN Mask RCNN [He+, ICCV2017]

20. ◼
• (PQ)
• thing
• stuff
◼stuff
• attention

21. ◼End-to-End
• Faster R-CNN
• Faster R-CNN
•
◼