[Paper Review] Deep Residual Learning for Image Recognition
Source CVPR 2016 Paper, Git Kaiming He, Xiang 10 Dec 2015 (UC San Diego, Facebook AI Research) Summary 처음에는 이 논문의 내용을 단순히 residual function이 gradient의 backpropagation을 도...
UiJin's_Blog
[Paper Review] Dropout Reduces Underfitting
Source ICML 2023 Paper, Git Zhuang Liu, Zhiqiu Xu, Joseph Jin, Zhiqiang Shen, Trevor Darrell 2 Mar 2023 (Meta AI, UC Berkeley) Contents 0. Abstract 2012년 Hinton이 소개한 ...
[Paper Review] DeiT III: Revenge of the ViT
Source ECCV 2022 Paper, Git Hugo Touvron, Matthieu Cord, Herve Jegou 14 Apr 2022 (Meta AI, Sorbonne University) Contents 0. Abstract
[Paper Review] Training data-efficient image transformers & distillation through attention
Source ICML 2021 Paper, Git Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, Herve Jegou 23 Dec 2020 (Facebook AI, Sorbonne University) ...
TODO list
The Road Less Scheduled ImageBind: One Embedding Space To Bind Them All Group ViT beyond sight: https://arxiv.org/pdf/2501.04693 SSL 표준 [moco1234, simclr] SwAV: Unsupervised Learning of Vis...
[Paper Review] Vision Transformers Need Registers
Source ICLR 2024 Paper, Git Timothee Darcet, Maxime Oquab, Julien Mairal, Piotr Bojanowski 14 Apr 2023 (Meta AI Research, Inria) Contents 0. Abstract 이 논문에서는 Self-Sup...
[Paper Review] DINOv2: Learning Robust Visual Features without Supervision
Source TMLR 2022 Paper, Git Maxime Oquab, Timothee Darcet, Theo Moutakanni, Huy V.Vo, Marc Szafraniec, Vasil Khalidov 14 Apr 2023 (Meta AI Research, Inria) Contents 0....
[Paper Review] iBOT: Image BERT Pre-Training with Online Tokenizer
Source ICLR 2022 Paper, Git Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong 15 Nov 2021 (ByteDance, Johns Hopkins University, Shanghai Jiao To...
[Paper Review] BEiT: BERT Pre-Training of Image Transformers
Source ICLR 2022 Paper, Git Hangbo Bao, Li Dong, Songhao Piao, Furu Wei 15 Jun 2021 (Harbin Institute of Technology, Microsoft Research) Contents 0. Abstract BEiT(Bidi...