Submit Search
Upload
Fully convolutional networks for semantic segmentation
•
Download as PPTX, PDF
•
0 likes
•
24 views
H
heedaeKwon
Follow
hi
Read less
Read more
Engineering
Report
Share
Report
Share
1 of 10
Download now
Recommended
[2020 CVPR Efficient DET 논문리뷰] 안녕하세요 딥러닝 논문읽기 모임입니다. 오늘 소개드릴 논문은 2020 CVPR에서 발표된, Efficient Net 저자가 발표한 'Efficient DET'입니다. 제목에서 유추 가능하듯 Backbone을 Efficient Net으로 사용하여 Object Detection Task에 적용 했다는 점을 유추할 수 있습니다. 해당 논문은 위 사실을 제외하고, 조금 특별한 Feature Pyramid Network를 적용하여 더욱 성능적으로 향상을 시켰는대요. 이러한 내용을 바탕으로 아직까지도 paperswithcode에 상위권에 랭크되어 있는 논문 입니다. 오늘 논문 이미지처리팀 이찬혁님이 자세하고 디테일한 리뷰를 도와주셨습니다. 많은 관심 미리 감사드립니다! https://youtu.be/Mq4aqDgZ2bI
[2020 CVPR Efficient DET paper review]
[2020 CVPR Efficient DET paper review]
taeseon ryu
#PR12 #PR366 안녕하세요 논문 읽기 모임 PR-12의 366번째 논문리뷰입니다. 올해가 AlexNet이 나온지 10주년이 되는 해네요. AlexNet이 2012년에 혜성처럼 등장한 이후, Solve computer vision problem = Use CNN이 공식처럼 사용되던 2010년대가 가고 2020년대 들어서 ViT의 등장을 시작으로 Transformer 기반의 network들이 CNN의 자리를 위협하고 상당부분 이미 뺏어간 상황입니다. 2020년대에 CNN의 가야할 길은 어디일까요? Inductive bias가 적은 Transformer가 대용량의 데이터로 학습하면 항상 CNN보다 더 낫다는 건 진실일까요? 이 논문에서는 2020년대를 위한 CNN이라는 제목으로 ConvNeXt라는 새로운(?) architecture를 제안합니다. 사실 새로운 건 없고 그동안 있었던 것들과 Transformer에서 적용한 것들을 copy해와서 CNN에 적용해보았는데요, Transformer보다 성능도 좋고 속도도 빠른 결과가 나왔다고 합니다. 결과에 대해서 약간의 논란이 twitter 상에서 나오고 있는데 이 부분 포함해서 자세한 내용은 영상을 통해서 보실 수 있습니다. 늘 재밌게 봐주시고 좋아요 댓글 구독 해주시는 분들께 감사드립니다 :) 논문링크: https://arxiv.org/abs/2201.03545 영상링크: https://youtu.be/Mw7IhO2uBGc
PR-366: A ConvNet for 2020s
PR-366: A ConvNet for 2020s
Jinwon Lee
Deformable Convolution Network V2, DCNV2, object detection
Deformable ConvNets V2, DCNV2
Deformable ConvNets V2, DCNV2
HaiyanWang16
Tensorflow-KR 논문읽기모임 54번째 발표자료입니다 영상링크 : https://youtu.be/pNuBdj53Hbc 논문링크 : https://arxiv.org/abs/1707.01083
ShuffleNet - PR054
ShuffleNet - PR054
Jinwon Lee
PR12 논문읽기 모임에서 발표한 자료입니다 영상은 아래 주소에서 보실 수 있습니다 https://youtu.be/kcPAGIgBGRs
Faster R-CNN - PR012
Faster R-CNN - PR012
Jinwon Lee
#PR12 #PR344 안녕하세요 TensorFlow Korea 논문 읽기 모임 PR-12의 344번째 논문 리뷰입니다. 오늘은 중국과기대와 MSRA에서 나온 A Battle of Network Structures라는 강렬한 제목을 가진 논문입니다. 부제에서 잘 나와있듯이 이 논문은 computer vision에서 CNN, Transformer, MLP에 대해서 같은 환경에서 비교를 통해 어떤 특징들이 있는지를 알아본 논문입니다. 우선 같은 조건에서 실험하기 위하여 SPACH라는 unified framework을 만들고 그 안에 CNN, Transformer, MLP를 넣어서 실험을 합니다. 셋 모두 조건이 잘 갖춰지면 비슷한 성능을 내지만, MLP는 model size가 커지면 overfitting이 발생하고 CNN은 Transformer에 비해서 적은 data에서도 좋은 성능이 나오는 generalization capability가 좋고, Transformer는 model capacity가 커서 data가 충분하고 연산량도 큰 환경에서 잘한다는 것이 실험의 한가지 결과입니다. 또하나는 global receptive field를 갖는 transformer나 MLP의 경우에도 local한 연산을 하는 local model을 같이 써줄때에 성능이 좋아진다는 것입니다. 이런 insight들을 통해서 이 논문에서는 CNN과 Transformer를 결합한 형태의 Hybrid model을 제안하여 SOTA 성능을 낼 수 있음을 보여줍니다. 개인적으로 놀랄만한 insight를 발견한 것은 아니었지만 세가지 network의 특징과 장단점에 대해서 정리해볼 수 있는 그런 논문이라고 평하고 싶습니다. 자세한 내용은 영상을 참고해주세요! 감사합니다 영상링크: https://youtu.be/NVLMZZglx14 논문링크: https://arxiv.org/abs/2108.13002
PR-344: A Battle of Network Structures: An Empirical Study of CNN, Transforme...
PR-344: A Battle of Network Structures: An Empirical Study of CNN, Transforme...
Jinwon Lee
PR-325: Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers paper link: https://arxiv.org/abs/2004.00849 youtube link: https://youtu.be/Kgh88DLHHTo
[PR-325] Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Tran...
[PR-325] Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Tran...
Sunghoon Joo
Explained here: https://youtu.be/aBvDPL1jFnI In Nepali A ConvNet for the 2020s (Zhuang Liu et al.) ComvNeXt paper Deep Learning for Visual Intelligence Sushant Gautam MSCIISE Department of Electronics and Computer Engineering Institute of Engineering, Thapathali Campus 13 March 2022 To all the authors (obviously!!) 1. Jinwon Lee's slides at https://www.slideshare.net/JinwonLee9/pr366-a-convnet-for-2020s?qid=274bc524-23ae-4c13-b03b-0d2416976ad5&v=&b=&from_search=1 2. Letitia from AI Coffee Break: https://www.youtube.com/watch?v=SndHALawoag I even edited some of her hard visual works and put them as a slide. :(
ConvNeXt: A ConvNet for the 2020s explained
ConvNeXt: A ConvNet for the 2020s explained
Sushant Gautam
Recommended
[2020 CVPR Efficient DET 논문리뷰] 안녕하세요 딥러닝 논문읽기 모임입니다. 오늘 소개드릴 논문은 2020 CVPR에서 발표된, Efficient Net 저자가 발표한 'Efficient DET'입니다. 제목에서 유추 가능하듯 Backbone을 Efficient Net으로 사용하여 Object Detection Task에 적용 했다는 점을 유추할 수 있습니다. 해당 논문은 위 사실을 제외하고, 조금 특별한 Feature Pyramid Network를 적용하여 더욱 성능적으로 향상을 시켰는대요. 이러한 내용을 바탕으로 아직까지도 paperswithcode에 상위권에 랭크되어 있는 논문 입니다. 오늘 논문 이미지처리팀 이찬혁님이 자세하고 디테일한 리뷰를 도와주셨습니다. 많은 관심 미리 감사드립니다! https://youtu.be/Mq4aqDgZ2bI
[2020 CVPR Efficient DET paper review]
[2020 CVPR Efficient DET paper review]
taeseon ryu
#PR12 #PR366 안녕하세요 논문 읽기 모임 PR-12의 366번째 논문리뷰입니다. 올해가 AlexNet이 나온지 10주년이 되는 해네요. AlexNet이 2012년에 혜성처럼 등장한 이후, Solve computer vision problem = Use CNN이 공식처럼 사용되던 2010년대가 가고 2020년대 들어서 ViT의 등장을 시작으로 Transformer 기반의 network들이 CNN의 자리를 위협하고 상당부분 이미 뺏어간 상황입니다. 2020년대에 CNN의 가야할 길은 어디일까요? Inductive bias가 적은 Transformer가 대용량의 데이터로 학습하면 항상 CNN보다 더 낫다는 건 진실일까요? 이 논문에서는 2020년대를 위한 CNN이라는 제목으로 ConvNeXt라는 새로운(?) architecture를 제안합니다. 사실 새로운 건 없고 그동안 있었던 것들과 Transformer에서 적용한 것들을 copy해와서 CNN에 적용해보았는데요, Transformer보다 성능도 좋고 속도도 빠른 결과가 나왔다고 합니다. 결과에 대해서 약간의 논란이 twitter 상에서 나오고 있는데 이 부분 포함해서 자세한 내용은 영상을 통해서 보실 수 있습니다. 늘 재밌게 봐주시고 좋아요 댓글 구독 해주시는 분들께 감사드립니다 :) 논문링크: https://arxiv.org/abs/2201.03545 영상링크: https://youtu.be/Mw7IhO2uBGc
PR-366: A ConvNet for 2020s
PR-366: A ConvNet for 2020s
Jinwon Lee
Deformable Convolution Network V2, DCNV2, object detection
Deformable ConvNets V2, DCNV2
Deformable ConvNets V2, DCNV2
HaiyanWang16
Tensorflow-KR 논문읽기모임 54번째 발표자료입니다 영상링크 : https://youtu.be/pNuBdj53Hbc 논문링크 : https://arxiv.org/abs/1707.01083
ShuffleNet - PR054
ShuffleNet - PR054
Jinwon Lee
PR12 논문읽기 모임에서 발표한 자료입니다 영상은 아래 주소에서 보실 수 있습니다 https://youtu.be/kcPAGIgBGRs
Faster R-CNN - PR012
Faster R-CNN - PR012
Jinwon Lee
#PR12 #PR344 안녕하세요 TensorFlow Korea 논문 읽기 모임 PR-12의 344번째 논문 리뷰입니다. 오늘은 중국과기대와 MSRA에서 나온 A Battle of Network Structures라는 강렬한 제목을 가진 논문입니다. 부제에서 잘 나와있듯이 이 논문은 computer vision에서 CNN, Transformer, MLP에 대해서 같은 환경에서 비교를 통해 어떤 특징들이 있는지를 알아본 논문입니다. 우선 같은 조건에서 실험하기 위하여 SPACH라는 unified framework을 만들고 그 안에 CNN, Transformer, MLP를 넣어서 실험을 합니다. 셋 모두 조건이 잘 갖춰지면 비슷한 성능을 내지만, MLP는 model size가 커지면 overfitting이 발생하고 CNN은 Transformer에 비해서 적은 data에서도 좋은 성능이 나오는 generalization capability가 좋고, Transformer는 model capacity가 커서 data가 충분하고 연산량도 큰 환경에서 잘한다는 것이 실험의 한가지 결과입니다. 또하나는 global receptive field를 갖는 transformer나 MLP의 경우에도 local한 연산을 하는 local model을 같이 써줄때에 성능이 좋아진다는 것입니다. 이런 insight들을 통해서 이 논문에서는 CNN과 Transformer를 결합한 형태의 Hybrid model을 제안하여 SOTA 성능을 낼 수 있음을 보여줍니다. 개인적으로 놀랄만한 insight를 발견한 것은 아니었지만 세가지 network의 특징과 장단점에 대해서 정리해볼 수 있는 그런 논문이라고 평하고 싶습니다. 자세한 내용은 영상을 참고해주세요! 감사합니다 영상링크: https://youtu.be/NVLMZZglx14 논문링크: https://arxiv.org/abs/2108.13002
PR-344: A Battle of Network Structures: An Empirical Study of CNN, Transforme...
PR-344: A Battle of Network Structures: An Empirical Study of CNN, Transforme...
Jinwon Lee
PR-325: Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers paper link: https://arxiv.org/abs/2004.00849 youtube link: https://youtu.be/Kgh88DLHHTo
[PR-325] Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Tran...
[PR-325] Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Tran...
Sunghoon Joo
Explained here: https://youtu.be/aBvDPL1jFnI In Nepali A ConvNet for the 2020s (Zhuang Liu et al.) ComvNeXt paper Deep Learning for Visual Intelligence Sushant Gautam MSCIISE Department of Electronics and Computer Engineering Institute of Engineering, Thapathali Campus 13 March 2022 To all the authors (obviously!!) 1. Jinwon Lee's slides at https://www.slideshare.net/JinwonLee9/pr366-a-convnet-for-2020s?qid=274bc524-23ae-4c13-b03b-0d2416976ad5&v=&b=&from_search=1 2. Letitia from AI Coffee Break: https://www.youtube.com/watch?v=SndHALawoag I even edited some of her hard visual works and put them as a slide. :(
ConvNeXt: A ConvNet for the 2020s explained
ConvNeXt: A ConvNet for the 2020s explained
Sushant Gautam
An introduction to Squeeze Excitation Networks, the architecture which won the ImageNet Large Scale Visual Recognition Challenge 2017 (the last ImageNet challenge to be hosted). The key idea is to use "channel attention". Attention originally came from NLP but was adopted for CNNs. This work shows how just applying attention to the channels of a CNN can improve the performance of an architecture dramatically. Moreover, this module can be implemented in any existing CNN architecture with minimal computational overhead. It is thus a very simple but very important idea.
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
Joonhyung Lee
Computer Vision 분야에서 CNN은 과연 살아남을 수 있을까요? 안녕하세요 TensorFlow Korea 논문 읽기 모임 PR-12의 317번째 논문 리뷰입니다. 이번에는 Google Research, Brain Team의 MLP-Mixer: An all-MLP Architecture for Vision을 리뷰해보았습니다. Attention의 공격도 버거운데 이번에는 MLP(Multi-Layer Perceptron)의 공격입니다. MLP만을 사용해서 Image Classification을 하는데 성능도 좋고 속도도 빠르고.... 구조를 간단히 소개해드리면 ViT(Vision Transformer)의 self-attention 부분을 MLP로 변경하였습니다. MLP block 2개를 사용하여 하나는 patch(token)들 간의 연산을 하는데 사용하고, 하나는 patch 내부 연산을 하는데 사용합니다. 사실 MLP를 사용하긴 했지만 논문에도 언급되어 있듯이, 이 부분을 일종의 convolution이라고 볼 수 있는데요... 그래도 transformer 기반의 network이 가질 수밖에 없는 quadratic complexity를 linear로 낮춰주고 convolution의 inductive bias 거의 없이 아주아주 simple한 구조를 활용하여 이렇게 좋은 성능을 보여준 점이 멋집니다. 반면에 역시나 data를 많이 써야 한다거나, MLP의 한계인 fixed length의 input만 받을 수 있다는 점은 단점이라고 생각하는데요, 이 연구를 시작으로 MLP도 다시한번 조명받는 계기가 되면 좋을 것 같네요 비슷한 시점에 나온 비슷한 연구들도 마지막에 간략하게 소개하였습니다. 재미있게 봐주세요. 감사합니다! 논문링크: https://arxiv.org/abs/2105.01601 영상링크: https://youtu.be/KQmZlxdnnuY
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
Jinwon Lee
TensorFlow-KR 논문읽기모임 PR12 155번째 논문 review 입니다. 이번에는 Facebook AI Research에서 최근에 나온(4/2) Exploring Randomly Wired Neural Networks for Image Recognition을 review해 보았습니다. random하게 generation된 network이 그동안 사람들이 온갖 노력을 들여서 만든 network 이상의 성능을 나타낸다는 결과로 많은 사람들에게 충격을 준 논문인데요, 자세한 내용은 자료와 영상을 참고해주세요 논문링크: https://arxiv.org/abs/1904.01569 영상링크: https://youtu.be/NrmLteQ5BC4
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
Jinwon Lee
An introduction to "Rethinking Attention with Performers", from Google Brain on O(N) linear transformers with random orthogonal kernels.
Rethinking Attention with Performers
Rethinking Attention with Performers
Joonhyung Lee
TensorFlow-KR 논문읽기모임 PR12 169번째 논문 review입니다. 이번에 살펴본 논문은 Google에서 발표한 EfficientNet입니다. efficient neural network은 보통 mobile과 같은 제한된 computing power를 가진 edge device를 위한 작은 network 위주로 연구되어왔는데, 이 논문은 성능을 높이기 위해서 일반적으로 network를 점점 더 키워나가는 경우가 많은데, 이 때 어떻게 하면 더 효율적인 방법으로 network을 키울 수 있을지에 대해서 연구한 논문입니다. 자세한 내용은 영상을 참고해주세요 논문링크: https://arxiv.org/abs/1905.11946 영상링크: https://youtu.be/Vhz0quyvR7I
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Jinwon Lee
Tensorflow-KR 논문읽기모임 33번째 발표자료입니다 영상링크 : https://youtu.be/TYDGTnxUGHQ 논문링크 : https://arxiv.org/abs/1611.08588
PVANet - PR033
PVANet - PR033
Jinwon Lee
Basics of Convolutional Neural Networks
Convolutional neural networks
Convolutional neural networks
Roozbeh Sanaei
TensorFlow Korea 논문읽기모임 PR12 197번째 논문 review입니다 (2기 목표 200편까지 이제 3편이 남았습니다) 이번에 제가 발표한 논문은 FAIR(Facebook AI Research)에서 나온 One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers 입니다 한 장의 ticket으로 모든 복권에서 1등을 할 수 있다면 얼마나 좋을까요? 일반적인 network pruning 방법은 pruning 하기 이전에 학습된 network weight를 그대로 사용하면서 fine tuning하는 방법을 사용해왔습니다 pruning한 이후에 network에 weight를 random intialization한 후 학습하면 성능이 잘 나오지 않는 문제가 있었는데요 작년 MIT에서 나온 Lottery ticket hypothesis라는 논문에서는 이렇게 pruning된 이후의 network를 어떻게 random intialization하면 높은 성능을 낼 수 있는지 이 intialization 방법을 공개하며 lottery ticket의 winning ticket이라고 이름붙였습니다. 그런데 이 winning ticket이 혹시 다른 dataset이나 다른 optimizer를 사용하는 경우에도 잘 동작할 수 있을까요? 예를 들어 CIFAR10에서 찾은 winning ticket이 ImageNet에서도 winning ticket의 성능을 나타낼 수 있을까요? 이 논문은 이러한 질문에 대한 답을 실험을 통해서 확인하였고, initialization에 대한 여러가지 insight를 담고 있습니다. 자세한 내용은 발표 영상을 참고해주세요~! 영상링크: https://youtu.be/YmTNpF2OOjA 발표자료링크: https://www.slideshare.net/JinwonLee9/pr197-one-ticket-to-win-them-all-generalizing-lottery-ticket-initializations-across-datasets-and-optimizers 논문링크: https://arxiv.org/abs/1906.02773
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
Jinwon Lee
Tensorflow-KR 논문읽기모임 69번째 발표자료입니다 영상링크 : https://youtu.be/fbCcJaSQPPA 논문링크 : https://arxiv.org/abs/1802.03268
Efficient Neural Architecture Search via Parameter Sharing
Efficient Neural Architecture Search via Parameter Sharing
Jinwon Lee
Tensorflow KR PR-12 season4 slide PR-373: Revisiting ResNets: Improved Training and Scaling Strategies. Reviewer: Sunghoon Joo (VUNO Inc.) Paper link: https://papers.nips.cc/paper/2021/hash/bef4d169d8bddd17d68303877a3ea945-Abstract.html Video presentation link: TBD
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
Sunghoon Joo
hi
Generative adversarial nets
Generative adversarial nets
heedaeKwon
hi
Generating sequences with recurrent neural networks
Generating sequences with recurrent neural networks
heedaeKwon
hi
Feature pyramid networks for object detection
Feature pyramid networks for object detection
heedaeKwon
hi
Attention is all you need
Attention is all you need
heedaeKwon
hi
Se net
Se net
heedaeKwon
hi
Perceptual losses for real time style transfer and super-resolution
Perceptual losses for real time style transfer and super-resolution
heedaeKwon
hi
Localisation network
Localisation network
heedaeKwon
hi
Les net
Les net
heedaeKwon
hi
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
heedaeKwon
hi
Grad cam visual explanations from deep networks via gradient-based localizati...
Grad cam visual explanations from deep networks via gradient-based localizati...
heedaeKwon
hi
Goog lenet
Goog lenet
heedaeKwon
hi
Learning deep features for discriminative localization
Learning deep features for discriminative localization
heedaeKwon
More Related Content
What's hot
An introduction to Squeeze Excitation Networks, the architecture which won the ImageNet Large Scale Visual Recognition Challenge 2017 (the last ImageNet challenge to be hosted). The key idea is to use "channel attention". Attention originally came from NLP but was adopted for CNNs. This work shows how just applying attention to the channels of a CNN can improve the performance of an architecture dramatically. Moreover, this module can be implemented in any existing CNN architecture with minimal computational overhead. It is thus a very simple but very important idea.
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
Joonhyung Lee
Computer Vision 분야에서 CNN은 과연 살아남을 수 있을까요? 안녕하세요 TensorFlow Korea 논문 읽기 모임 PR-12의 317번째 논문 리뷰입니다. 이번에는 Google Research, Brain Team의 MLP-Mixer: An all-MLP Architecture for Vision을 리뷰해보았습니다. Attention의 공격도 버거운데 이번에는 MLP(Multi-Layer Perceptron)의 공격입니다. MLP만을 사용해서 Image Classification을 하는데 성능도 좋고 속도도 빠르고.... 구조를 간단히 소개해드리면 ViT(Vision Transformer)의 self-attention 부분을 MLP로 변경하였습니다. MLP block 2개를 사용하여 하나는 patch(token)들 간의 연산을 하는데 사용하고, 하나는 patch 내부 연산을 하는데 사용합니다. 사실 MLP를 사용하긴 했지만 논문에도 언급되어 있듯이, 이 부분을 일종의 convolution이라고 볼 수 있는데요... 그래도 transformer 기반의 network이 가질 수밖에 없는 quadratic complexity를 linear로 낮춰주고 convolution의 inductive bias 거의 없이 아주아주 simple한 구조를 활용하여 이렇게 좋은 성능을 보여준 점이 멋집니다. 반면에 역시나 data를 많이 써야 한다거나, MLP의 한계인 fixed length의 input만 받을 수 있다는 점은 단점이라고 생각하는데요, 이 연구를 시작으로 MLP도 다시한번 조명받는 계기가 되면 좋을 것 같네요 비슷한 시점에 나온 비슷한 연구들도 마지막에 간략하게 소개하였습니다. 재미있게 봐주세요. 감사합니다! 논문링크: https://arxiv.org/abs/2105.01601 영상링크: https://youtu.be/KQmZlxdnnuY
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
Jinwon Lee
TensorFlow-KR 논문읽기모임 PR12 155번째 논문 review 입니다. 이번에는 Facebook AI Research에서 최근에 나온(4/2) Exploring Randomly Wired Neural Networks for Image Recognition을 review해 보았습니다. random하게 generation된 network이 그동안 사람들이 온갖 노력을 들여서 만든 network 이상의 성능을 나타낸다는 결과로 많은 사람들에게 충격을 준 논문인데요, 자세한 내용은 자료와 영상을 참고해주세요 논문링크: https://arxiv.org/abs/1904.01569 영상링크: https://youtu.be/NrmLteQ5BC4
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
Jinwon Lee
An introduction to "Rethinking Attention with Performers", from Google Brain on O(N) linear transformers with random orthogonal kernels.
Rethinking Attention with Performers
Rethinking Attention with Performers
Joonhyung Lee
TensorFlow-KR 논문읽기모임 PR12 169번째 논문 review입니다. 이번에 살펴본 논문은 Google에서 발표한 EfficientNet입니다. efficient neural network은 보통 mobile과 같은 제한된 computing power를 가진 edge device를 위한 작은 network 위주로 연구되어왔는데, 이 논문은 성능을 높이기 위해서 일반적으로 network를 점점 더 키워나가는 경우가 많은데, 이 때 어떻게 하면 더 효율적인 방법으로 network을 키울 수 있을지에 대해서 연구한 논문입니다. 자세한 내용은 영상을 참고해주세요 논문링크: https://arxiv.org/abs/1905.11946 영상링크: https://youtu.be/Vhz0quyvR7I
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Jinwon Lee
Tensorflow-KR 논문읽기모임 33번째 발표자료입니다 영상링크 : https://youtu.be/TYDGTnxUGHQ 논문링크 : https://arxiv.org/abs/1611.08588
PVANet - PR033
PVANet - PR033
Jinwon Lee
Basics of Convolutional Neural Networks
Convolutional neural networks
Convolutional neural networks
Roozbeh Sanaei
TensorFlow Korea 논문읽기모임 PR12 197번째 논문 review입니다 (2기 목표 200편까지 이제 3편이 남았습니다) 이번에 제가 발표한 논문은 FAIR(Facebook AI Research)에서 나온 One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers 입니다 한 장의 ticket으로 모든 복권에서 1등을 할 수 있다면 얼마나 좋을까요? 일반적인 network pruning 방법은 pruning 하기 이전에 학습된 network weight를 그대로 사용하면서 fine tuning하는 방법을 사용해왔습니다 pruning한 이후에 network에 weight를 random intialization한 후 학습하면 성능이 잘 나오지 않는 문제가 있었는데요 작년 MIT에서 나온 Lottery ticket hypothesis라는 논문에서는 이렇게 pruning된 이후의 network를 어떻게 random intialization하면 높은 성능을 낼 수 있는지 이 intialization 방법을 공개하며 lottery ticket의 winning ticket이라고 이름붙였습니다. 그런데 이 winning ticket이 혹시 다른 dataset이나 다른 optimizer를 사용하는 경우에도 잘 동작할 수 있을까요? 예를 들어 CIFAR10에서 찾은 winning ticket이 ImageNet에서도 winning ticket의 성능을 나타낼 수 있을까요? 이 논문은 이러한 질문에 대한 답을 실험을 통해서 확인하였고, initialization에 대한 여러가지 insight를 담고 있습니다. 자세한 내용은 발표 영상을 참고해주세요~! 영상링크: https://youtu.be/YmTNpF2OOjA 발표자료링크: https://www.slideshare.net/JinwonLee9/pr197-one-ticket-to-win-them-all-generalizing-lottery-ticket-initializations-across-datasets-and-optimizers 논문링크: https://arxiv.org/abs/1906.02773
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
Jinwon Lee
Tensorflow-KR 논문읽기모임 69번째 발표자료입니다 영상링크 : https://youtu.be/fbCcJaSQPPA 논문링크 : https://arxiv.org/abs/1802.03268
Efficient Neural Architecture Search via Parameter Sharing
Efficient Neural Architecture Search via Parameter Sharing
Jinwon Lee
Tensorflow KR PR-12 season4 slide PR-373: Revisiting ResNets: Improved Training and Scaling Strategies. Reviewer: Sunghoon Joo (VUNO Inc.) Paper link: https://papers.nips.cc/paper/2021/hash/bef4d169d8bddd17d68303877a3ea945-Abstract.html Video presentation link: TBD
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
Sunghoon Joo
What's hot
(10)
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
Squeeze Excitation Networks, The simple idea that won the final ImageNet Chal...
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
PR-317: MLP-Mixer: An all-MLP Architecture for Vision
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
PR-155: Exploring Randomly Wired Neural Networks for Image Recognition
Rethinking Attention with Performers
Rethinking Attention with Performers
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
PR-169: EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
PVANet - PR033
PVANet - PR033
Convolutional neural networks
Convolutional neural networks
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
PR-197: One ticket to win them all: generalizing lottery ticket initializatio...
Efficient Neural Architecture Search via Parameter Sharing
Efficient Neural Architecture Search via Parameter Sharing
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
PR-373: Revisiting ResNets: Improved Training and Scaling Strategies.
More from heedaeKwon
hi
Generative adversarial nets
Generative adversarial nets
heedaeKwon
hi
Generating sequences with recurrent neural networks
Generating sequences with recurrent neural networks
heedaeKwon
hi
Feature pyramid networks for object detection
Feature pyramid networks for object detection
heedaeKwon
hi
Attention is all you need
Attention is all you need
heedaeKwon
hi
Se net
Se net
heedaeKwon
hi
Perceptual losses for real time style transfer and super-resolution
Perceptual losses for real time style transfer and super-resolution
heedaeKwon
hi
Localisation network
Localisation network
heedaeKwon
hi
Les net
Les net
heedaeKwon
hi
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
heedaeKwon
hi
Grad cam visual explanations from deep networks via gradient-based localizati...
Grad cam visual explanations from deep networks via gradient-based localizati...
heedaeKwon
hi
Goog lenet
Goog lenet
heedaeKwon
hi
Learning deep features for discriminative localization
Learning deep features for discriminative localization
heedaeKwon
hi
Image net classification with deep convolutional neural networks
Image net classification with deep convolutional neural networks
heedaeKwon
hi
Show, attend and tell
Show, attend and tell
heedaeKwon
hi
Vgg
Vgg
heedaeKwon
hi
A neural image caption generator
A neural image caption generator
heedaeKwon
ai2주차
A.i
A.i
heedaeKwon
first
Ai basic
Ai basic
heedaeKwon
More from heedaeKwon
(18)
Generative adversarial nets
Generative adversarial nets
Generating sequences with recurrent neural networks
Generating sequences with recurrent neural networks
Feature pyramid networks for object detection
Feature pyramid networks for object detection
Attention is all you need
Attention is all you need
Se net
Se net
Perceptual losses for real time style transfer and super-resolution
Perceptual losses for real time style transfer and super-resolution
Localisation network
Localisation network
Les net
Les net
Learning to learn by gradient descent by gradient descent
Learning to learn by gradient descent by gradient descent
Grad cam visual explanations from deep networks via gradient-based localizati...
Grad cam visual explanations from deep networks via gradient-based localizati...
Goog lenet
Goog lenet
Learning deep features for discriminative localization
Learning deep features for discriminative localization
Image net classification with deep convolutional neural networks
Image net classification with deep convolutional neural networks
Show, attend and tell
Show, attend and tell
Vgg
Vgg
A neural image caption generator
A neural image caption generator
A.i
A.i
Ai basic
Ai basic
Recently uploaded
The "Employee Leave Management System" has been developed to override the problems prevailing in the practicing manual system. This software is supported to eliminate and in some cases reduce the hardships faced by this existing system. More over this system is designed for the particular need of the company to carry out operations in a smooth and effective manner.
Employee leave management system project.
Employee leave management system project.
Kamal Acharya
When making accessible products, where do you start, and how do you continuously drive to be better?
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
Quintin Balsdon
From customer value engagements to hands-on production support, our Services span across every stage of our customers digital transformation journey, to help ensure that every customer is successful in their adoption of our solutions. • Implementation, Upgrade, Migration, and Maintenance Services • On-Premises and On-Cloud • COTS Training Services; On-Site and Virtual • Software Support Services; Legacy and 3DEXPERIENCE • Value Engagement & Blueprinting • Specialized Consulting and Support Services • Customized Training Services • Automation and Configuration Services • Technical Resource Augmentation Services • Project Management • Know-how Training (mentoring) and Resource Augmentation
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Arindam Chakraborty, Ph.D., P.E. (CA, TX)
STEAM NOZZLES AND TURBINES Flow of steam through nozzles, shapes of nozzles, effect of friction, critical pressure ratio, supersaturated flow - impulse and reaction principles, velocity diagram, work done and efficiency – types of compounding - governors. AIR COMPRESSORS Classification - working principle - type of compressors, work of compression with and without clearance - volumetric efficiency - isothermal and isentropic efficiency of reciprocating compressors - multistage air compressor with inter cooling.
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
DineshKumar4165
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRLS IN bhubaneswar ESCORT SERVICE❤CALL GIRL No Advance Pay 💋💋 Book Now +91-9777949614 Discover Bhubaneswar Finest Call GirlsY ou're heading to Bhubaneswar for business or pleasure and want to experience the city to the fullest. What better way than in the company of a beautiful, intelligent companion to show you around town? Look no further than Bhubaneswar's finest Call Girls. These lovely ladies know all the hot spots and hidden gems that only locals are privy to. From the top restaurants and bars to the most stunning sights, they'll ensure you make unforgettable memories.
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Call Girls Mumbai
SY(ECT) PTRP Unit 4 ppts for reference
UNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptx
kalpana413121
B.Tech. Petroleum,Mechanical Engineering Technology, Workshop Practices
fitting shop and tools used in fitting shop .ppt
fitting shop and tools used in fitting shop .ppt
AfnanAhmad53
EAM
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
AldoGarca30
💚Trustworthy Call Girls Pune Call Girls Service Just Call 🍑👄6378878445 🍑👄 Top Class Call Girl Service Available WhatsApp Chat :- +91-6378878445 We offer all types of girls of your choice with space. Our escorts are fully cooperative and understand your needs.#K09 All types of call girls like Housewives, College girls,#K09 Russian girls, Muslim girls, Afghani girls, Bengali girls, Working girls, south Indian girls, Punjabi girls, etc. In-Call: — You Can Reach At Our Place in Bangalore Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call: — Service for Out Call You have To Come Pick The Girl From My Place We Also Provide Door-Step Services Hygienic: — Full Ac Neat And Clean Rooms Available In Hotel 24 * 7 Hrs In Bangalore
💚Trustworthy Call Girls Pune Call Girls Service Just Call 🍑👄6378878445 🍑👄 Top...
💚Trustworthy Call Girls Pune Call Girls Service Just Call 🍑👄6378878445 🍑👄 Top...
vershagrag
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
meghakumariji156
Double field revolving theory: According to the double field revolving theory, we can resolve any alternating quantity into two components. Each component has a magnitude equal to half of the maximum magnitude of the alternating quantity, and both these components rotate in the opposite direction to each other
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
BhangaleSonal
Process of Integration the Laser Scan Data into FEA Model and Level 3 Fitness-for-Service Assessment of Critical Assets in Refinery & Process Industries
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
Arindam Chakraborty, Ph.D., P.E. (CA, TX)
This report will provide a great deal of data for planning Pabna Municipality. The source are old but might give a better result in analysis for urban planning. We can have a proper idea of how to plan a municipal area in the future, control urban growth, and increase utility services for betterment of the people living in an urban area
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
Morshed Ahmed Rahath
Mini project for btech
AIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech students
vanyagupta248
Ground Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth Reinforcement
Dr. Deepak Mudgal
Exception Handling and Function Template and Class Templates
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
drmkjayanthikannan
PEMESANAN OBAT ASLI : +6287776558899 Cara Menggugurkan Kandungan usia 1 , 2 , bulan - obat penggugur janin - cara aborsi kandungan - obat penggugur kandungan 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 bulan - bagaimana cara menggugurkan kandungan - tips Cara aborsi kandungan - trik Cara menggugurkan janin - Cara aman bagi ibu menyusui menggugurkan kandungan - klinik apotek jual obat penggugur kandungan - jamu PENGGUGUR KANDUNGAN - WAJIB TAU CARA ABORSI JANIN - GUGURKAN KANDUNGAN AMAN TANPA KURET - CARA Menggugurkan Kandungan tanpa efek samping - rekomendasi dokter obat herbal penggugur kandungan - ABORSI JANIN - aborsi kandungan - jamu herbal Penggugur kandungan - cara Menggugurkan Kandungan yang cacat - tata cara Menggugurkan Kandungan - obat penggugur kandungan di apotik kimia Farma - obat telat datang bulan - obat penggugur kandungan tuntas - obat penggugur kandungan alami - klinik aborsi janin gugurkan kandungan - ©Cytotec ™misoprostol BPOM - OBAT PENGGUGUR KANDUNGAN ®CYTOTEC - aborsi janin dengan pil ©Cytotec - ®Cytotec misoprostol® BPOM 100% - penjual obat penggugur kandungan asli - klinik jual obat aborsi janin - obat penggugur kandungan di klinik k-24 || obat penggugur ™Cytotec di apotek umum || ®CYTOTEC ASLI || obat ©Cytotec yang asli 200mcg || obat penggugur ASLI || pil Cytotec© tablet || cara gugurin kandungan || jual ®Cytotec 200mcg || dokter gugurkan kandungan || cara menggugurkan kandungan dengan cepat selesai dalam 24 jam secara alami buah buahan || usia kandungan 1_2 3_4 5_6 7_8 bulan masih bisa di gugurkan || obat penggugur kandungan ®cytotec dan gastrul || cara gugurkan pembuahan janin secara alami dan cepat || gugurkan kandungan || gugurin janin || cara Menggugurkan janin di luar nikah || contoh aborsi janin yang benar || contoh obat penggugur kandungan asli || contoh cara Menggugurkan Kandungan yang benar || telat haid || obat telat haid || Cara Alami gugurkan kehamilan || obat telat menstruasi || cara Menggugurkan janin anak haram || cara aborsi menggugurkan janin yang tidak berkembang || gugurkan kandungan dengan obat ©Cytotec || obat penggugur kandungan ™Cytotec 100% original || HARGA obat penggugur kandungan || obat telat haid 1 bulan || obat telat menstruasi 1-2 3-4 5-6 7-8 BULAN || obat telat datang bulan || cara Menggugurkan janin 1 bulan || cara Menggugurkan Kandungan yang masih 2 bulan || cara Menggugurkan Kandungan yang masih hitungan Minggu || cara Menggugurkan Kandungan yang masih usia 3 bulan || cara Menggugurkan usia kandungan 4 bulan || cara Menggugurkan janin usia 5 bulan || cara Menggugurkan kehamilan 6 Bulan ________&&&_________&&&_____________&&&_________&&&&____________ Cara Menggugurkan Kandungan Usia Janin 1 | 7 | 8 Bulan Dengan Cepat Dalam Hitungan Jam Secara Alami, Kami Siap Meneriman Pesanan Ke Seluruh Indonesia, Melputi: Ambon, Banda Aceh, Bandung, Banjarbaru, Batam, Bau-Bau, Bengkulu, Binjai, Blitar, Bontang, Cilegon, Cirebon, Depok, Gorontalo, Jakarta, Jayapura, Kendari, Kota Mobagu, Kupang, Lhokseumawe
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Kandungan 087776558899
Motoring and generation Armature circuit equation for motoring and generation, Types of field excitations - separately excited, shunt and series. Open circuit characteristic of separately excited DC generator, back EMF with armature reaction, voltage build-up in a shunt generator, critical field resistance and critical speed. V-I characteristics and torque-speed characteristics of separately excited shunt and series motors. Speed control through armature voltage. Losses, load testing and back-to-back testing of DC machines
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
BhangaleSonal
Jaipur ❤CALL GIRL 0000000000❤CALL GIRLS IN Jaipur ESCORT SERVICE❤CALL GIRL IN We are Providing Contact Simra - 0000000000 WEBSITE FOR RENT : https://happyescortgirl.com/ MAILTO : BOOKKDREAMGIRL@GMAIL.COM HOT & SEXY MODELS // COLLEGE GIRLS AVAILABLE FOR COMPLETE ENJOYMENT WITH HIGH PROFILE INDIAN MODEL AVAILABLE HOTEL & HOME ★ SAFE AND SECURE HIGH CLASS SERVICE AFFORDABLE RATE SATISFACTION,UNLIMITED ENJOYMENT. ★ All Meetings are confidential and no information is provided to any one at any cost. ★ EXCLUSIVE PROFILes Are Safe and Consensual with Most Limits Respected ★ Service Available In: - HOME *Star Hotel Service .In Call & Out call SeRvIcEs : ★ A-Level ★ Strip-tease ★ BBBJ (Bareback Blowjob)Receive advanced sexual techniques in different mode make their life more pleasurable. ★ Spending time in hotel rooms ★ BJ (Blowjob Without a Condom) ★ Completion (Oral to completion) ★ Covered (Covered blowjob Without a Condom)
Jaipur ❤CALL GIRL 0000000000❤CALL GIRLS IN Jaipur ESCORT SERVICE❤CALL GIRL IN...
Jaipur ❤CALL GIRL 0000000000❤CALL GIRLS IN Jaipur ESCORT SERVICE❤CALL GIRL IN...
jabtakhaidam7
Orlando Arnold's case study solved
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
MuhammadAsimMuhammad6
Recently uploaded
(20)
Employee leave management system project.
Employee leave management system project.
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...
UNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptx
fitting shop and tools used in fitting shop .ppt
fitting shop and tools used in fitting shop .ppt
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
💚Trustworthy Call Girls Pune Call Girls Service Just Call 🍑👄6378878445 🍑👄 Top...
💚Trustworthy Call Girls Pune Call Girls Service Just Call 🍑👄6378878445 🍑👄 Top...
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
AIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech students
Ground Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth Reinforcement
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
Jaipur ❤CALL GIRL 0000000000❤CALL GIRLS IN Jaipur ESCORT SERVICE❤CALL GIRL IN...
Jaipur ❤CALL GIRL 0000000000❤CALL GIRLS IN Jaipur ESCORT SERVICE❤CALL GIRL IN...
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Fully convolutional networks for semantic segmentation
1.
Fully Convolutional Networks
for Semantic Segmentation Mar 21, 2021 HeeDae Kwon
2.
contents • Introduction • Related
work • Fully convolution networks • Results
3.
Introduction Use FCN(fully convolution network) Trained
end-to-end Pre-training
4.
Related work Fully convolution networks Dense
prediction with convents
5.
Fully convolution networks •
Adapting classifiers for dense prediction FC layer - vanish spatial coordinates Segmentation Need location information FC layer => FCN
6.
Fully convolution networks •
Upsampling is backwards strided convolution • Patchwise training is loss sampling
7.
Results
8.
Results
9.
Results
10.
감사합니다
Download now