Skip to content

Overview of unsupervised visual representation learning (or self-supervised learning, unsupervised pre-training) methods.

Notifications You must be signed in to change notification settings

zhangyifei01/Unsupervised-Visual-Representation-Learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

41 Commits
ย 
ย 

Repository files navigation

Unsupervised/Self-Supervised-Visual-Representation-Learning

ๆ— ็›‘็ฃ/่‡ช็›‘็ฃ่ง†่ง‰่กจ็คบๅญฆไน 

[ Updating ...... ]

Unsupervised visual representation learning (UVRL) aims at learning generic representations for the initialization of downstream tasks. As stated in MoCo, self-supervised learning is a form of unsupervised learning and their distinction is informal in the existing literature. Therefore, it is more inclined to be called UVRL here. So, which one do you prefer?

We list related papers from conferences and journals such as CVPR, ICCV, ECCV, ICLR, ICML, NeurIPS, AAAI, IJCAI, TPAMI, TIP, TNNLS, TCSVT, TMM etc.

Note that only image-level representation learning methods are listed in this repository. Video-level self-supervision and multi-modal self-supervision are to be sorted out.

Key words: Unsupervised learning, self-supervised learning, representation learning, pre-training, transfer learning, contrastive learning, pretext task

ๅ…ณ้”ฎ่ฏ๏ผš ๆ— ็›‘็ฃๅญฆไน ๏ผŒ่‡ช็›‘็ฃๅญฆไน ๏ผŒ่กจ็คบๅญฆไน ๏ผŒ้ข„่ฎญ็ปƒ๏ผŒ่ฟ็งปๅญฆไน ๏ผŒๅฏนๆฏ”ๅญฆไน ๏ผŒๅ€Ÿๅฃ๏ผˆไปฃ็†๏ผ‰ไปปๅŠก

2023


  • Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations (**** - ICLR23 ) [paper]
    More Info ยท ยท Author(s): Ziyu Jiang, Yinpeng Chen, Mengchen Liu, Dongdong Chen, Xiyang Dai, Lu Yuan, Zicheng Liu, Zhangyang Wang
    ยท ยท Organization(s): Texas A&M University; Microsoft; University of Texas at Austin
    ยท ยท Description:
    ยท ยท Tags: CL, MIM

  • Patch-Level Contrasting without Patch Correspondence for Accurate and Dense Contrastive Representation Learning (ADCLR - ICLR23 ) [paper]
    More Info ยท ยท Author(s): Shaofeng Zhang, Feng Zhu, Rui Zhao, Junchi Yan
    ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Group Limited
    ยท ยท Description:
    ยท ยท Tags: Dense

  • Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning (SNCLR - ICLR23 ) [paper]
    More Info ยท ยท Author(s): Chongjian GE, Jiangliu Wang, Zhan Tong, Shoufa Chen, Yibing Song, Ping Luo
    ยท ยท Organization(s): HongKong University and so on
    ยท ยท Description:
    ยท ยท Tags: Soft neighbor

  • Energy-Inspired Self-Supervised Pretraining for Vision Models (**** - ICLR23 Spotlight ) [paper]
    More Info ยท ยท Author(s): Ze Wang, Jiang Wang, Zicheng Liu, Qiang Qiu
    ยท ยท Organization(s): Purdue University; Microsoft Corporation
    ยท ยท Description:
    ยท ยท Tags: Energy

  • EquiMod: An Equivariance Module to Improve Self-Supervised Learning (EquiMod - ICLR23 ) [paper]
    More Info ยท ยท Author(s): Alexandre DEVILLERS, Mathieu Lefort
    ยท ยท Organization(s): Universitรฉ Claude Bernard
    ยท ยท Description:
    ยท ยท Tags: Equivariance

  • Mosaic Representation Learning for Self-supervised Visual Pre-training (MosRep - ICLR23 Spotlight ) [paper] [code]
    More Info ยท ยท Author(s): Zhaoqing Wang, Ziyu Chen, Yaqian Li, Yandong Guo, Jun Yu, Mingming Gong, Tongliang Liu
    ยท ยท Organization(s): The University of Sydney
    ยท ยท Description:
    ยท ยท Tags:

  • Temperature Schedules for self-supervised contrastive methods on long-tail data (**** - ICLR23 ) [paper]
    More Info ยท ยท Author(s): Anna Kukleva, Moritz Bรถhle, Bernt Schiele, Hilde Kuehne, Christian Rupprecht
    ยท ยท Organization(s): Saarland Informatics Campus, Max-Planck Institute
    ยท ยท Description:
    ยท ยท Tags: Long-tail

2022


  • LPCL: Localized prominence contrastive learning for self-supervised dense visual pre-training (LPCL - PR22) [paper]
    More Info ยท ยท Author(s): Zihan Chen, Hongyuan Zhu, Hao Cheng, Siya Mi, Yu Zhang, Xin Geng
    ยท ยท Organization(s): Southeast University; A*STAR; Purple Mountain Laboratories
    ยท ยท Description:
    ยท ยท Tags: Dense

  • Self-supervised Learning is More Robust to Dataset Imbalance (**** - ICLR22 Spotlight) [paper]
    More Info ยท ยท Author(s): Hong Liu, Jeff Z. HaoChen, Adrien Gaidon, Tengyu Ma
    ยท ยท Organization(s): Stanford University; Toyota Research Institute
    ยท ยท Description:
    ยท ยท Tags: Analysis, Imbalance data

  • Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap (**** - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Yifei Wang, Qi Zhang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
    ยท ยท Organization(s): Peking University; Sun Yat-sen University; Peng Cheng Laboratory
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning (**** - ICLR22) [paper]
    More Info ยท ยท Author(s): Chaoning Zhang, Kang Zhang, Chenshuang Zhang, Trung X. Pham, Chang D. Yoo, In So Kweon
    ยท ยท Organization(s): KAIST
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution (LP-FT - ICLR22 Oral) [paper]
    More Info ยท ยท Author(s): Ananya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma, Percy Liang
    ยท ยท Organization(s): Stanford University
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption (Scarf - ICLR22 Spotlight) [paper]
    More Info ยท ยท Author(s): Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
    ยท ยท Organization(s): Google Research
    ยท ยท Description:
    ยท ยท Tags: Tabular domain

  • Measuring the Interpretability of Unsupervised Representations via Quantized Reversed Probing (QRP - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Iro Laina, Yuki M Asano, Andrea Vedaldi
    ยท ยท Organization(s): University of Oxford; University of Amsterdam
    ยท ยท Description:
    ยท ยท Tags: Interpretability

  • Equivariant Contrastive Learning (Equivariant Self-Supervised Learning: Encouraging Equivariance in Representations) (E-SSL - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Rumen Dangovski, Li Jing, Charlotte Loh, Seungwook Han, Akash Srivastava, Brian Cheung, Pulkit Agrawal, Marin Soljacic
    ยท ยท Organization(s): MIT; FAIR
    ยท ยท Description:
    ยท ยท Tags: Equivariant

  • Divergence-aware Federated Self-Supervised Learning (FedSSL - ICLR22) [paper]
    More Info ยท ยท Author(s): Weiming Zhuang, Yonggang Wen, Shuai Zhang
    ยท ยท Organization(s): NTU; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags: Federal

  • Bag of Instances Aggregation Boosts Self-supervised Distillation (BINGO - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Haohang Xu, Jiemin Fang, XIAOPENG ZHANG, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian
    ยท ยท Organization(s): Shanghai Jiao Tong University; Huawei Inc.; Huazhong University of Science & Technology
    ยท ยท Description:
    ยท ยท Tags: Self-supervised distillation

  • VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning (VICReg - ICLR22) [paper]
    More Info ยท ยท Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
    ยท ยท Organization(s): Facebook AI Research; Inria; New York University
    ยท ยท Description:
    ยท ยท Tags:

  • Zero-CL: Instance and Feature decorrelation for negative-free symmetric contrastive learning (Zero-CL - ICLR22) [paper]
    More Info ยท ยท Author(s): Shaofeng Zhang, Feng Zhu, Junchi Yan, Rui Zhao, Xiaokang Yang
    ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags:

  • BEiT: BERT Pre-Training of Image Transformers (BEiT - ICLR22 Oral) [paper] [code]
    More Info ยท ยท Author(s): Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
    ยท ยท Organization(s): Harbin Institute of Technology; Microsoft Research
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Efficient Self-supervised Vision Transformers for Representation Learning (EsViT - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Hangbo Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
    ยท ยท Organization(s): Microsoft Research at Redmond; Microsoft Cloud + AI
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • iBOT๏ผšImage BERT Pre-Training with Online Tokenizer (iBOT - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
    ยท ยท Organization(s): ByteDance; Johns Hopkins University; Shanghai Jiao Tong University; UC Santa Cruz
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Understanding Dimensional Collapse in Contrastive Self-supervised Learning (**** - ICLR22) [paper]
    More Info ยท ยท Author(s): Li Jing, Pascal Vincent, Yann LeCun, Yuandong Tian
    ยท ยท Organization(s): Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Incremental False Negative Detection for Contrastive Learning (IFND - ICLR22) [paper] [code]
    More Info ยท ยท Author(s): Tsai-Shien Chen, Wei-Chih Hung, Hung-Yu Tseng, Shao-Yi Chien, Ming-Hsuan Yang
    ยท ยท Organization(s): National Taiwan University; Waymo LLC; University of California, Merced; Yonsei University; Google Research
    ยท ยท Description:
    ยท ยท Tags: False negative

  • Self-Supervised Learning via Maximum Entropy Coding (MEC - NeurIPS22) [paper] [code]
    More Info ยท ยท Author(s): Xin Liu, Zhongdao Wang, Yali Li, Shengjin Wang
    ยท ยท Organization(s): Tsinghua University
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Learning Through Efference Copies (S-TEC - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Franz Scherr, Qinghai Guo, Timoleon Moraitis
    ยท ยท Organization(s): Huawei Technologies
    ยท ยท Description:
    ยท ยท Tags:

  • VICRegL: Self-Supervised Learning of Local Visual Features (VICRegL - NeurIPS22) [paper] [code]
    More Info ยท ยท Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
    ยท ยท Organization(s): Meta, FAIR; Inria, ร‰cole normale supรฉrieure, CNRS, PSL Research University; New York University
    ยท ยท Description:
    ยท ยท Tags: local feature

  • An Empirical Study on Disentanglement of Negative-free Contrastive Learning (**** - NeurIPS22) [paper] [code]
    More Info ยท ยท Author(s): Jinkun Cao, Ruiqian Nai, Qing Yang, Jialei Huang, Yang Gao
    ยท ยท Organization(s): Carnegie Mellon University; Tsinghua University; Shanghai Jiao Tong University; Shanghai Qi-Zhi Institute
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods (**** - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Randall Balestriero, Yann LeCun
    ยท ยท Organization(s): Meta AI Research; NYU
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning (**** - NeurIPS22) [paper]
    More Info ยท ยท Author(s): RZixin Wen, Yuanzhi Li
    ยท ยท Organization(s): Carnegie Mellon University
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Improving Self-Supervised Learning by Characterizing Idealized Representations (**** - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Yann Dubois, Tatsunori Hashimoto, Stefano Ermon, Percy Liang
    ยท ยท Organization(s): Stanford University
    ยท ยท Description:
    ยท ยท Tags:

  • MSR: Making Self-supervised learning Robust to Aggressive Augmentations (MSR - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Yingbin Bai, Erkun Yang, Zhaoqing Wang, Yuxuan Du, Bo Han, Cheng Deng, Dadong Wang, Tongliang Liu
    ยท ยท Organization(s): TML Lab, The University of Sydney; Xidian University; JD Explore Academy; Hong Kong Baptist University; CSIRO
    ยท ยท Description:
    ยท ยท Tags:

  • RรฉnyiCL: Contrastive Representation Learning with Skew Rรฉnyi Divergence (RรฉnyiCL - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Kyungmin Lee, Jinwoo Shin
    ยท ยท Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Learning of Group Invariant and Equivariant Representations (**** - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Robin Winter, Marco Bertolini, Tuan Le, Frank Noรฉ, Djork-Arnรฉ Clevert
    ยท ยท Organization(s): Bayer AG; Freie Universitรคt Berlin; Microsoft Research
    ยท ยท Description:
    ยท ยท Tags:

  • Energy-Based Contrastive Learning of Visual Representations (**** - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Beomsu Kim, Jong Chul Ye
    ยท ยท Organization(s): KAIST
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Visual Representation Learning with Semantic Grouping (SlotCon - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Xin Wen, Bingchen Zhao, Anlin Zheng, Xiangyu Zhang, Xiaojuan Qi
    ยท ยท Organization(s): The University of Hong Kong; Tongji University; LunarAI; MEGVII Technology
    ยท ยท Description:
    ยท ยท Tags: Dense

  • ConvMAE: Masked Convolution Meets Masked Autoencoders (ConvMAE - NeurIPS22) [paper] [code]
    More Info ยท ยท Author(s): Peng Gao, Teli Ma, Hongsheng Li, Ziyi Lin, Jifeng Dai, Yu Qiao
    ยท ยท Organization(s): Shanghai AI Laboratory; MMLab, CUHK; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags:

  • Green Hierarchical Vision Transformer for Masked Image Modeling (GreenMIM - NeurIPS22) [paper] [code]
    More Info ยท ยท Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
    ยท ยท Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders (SemMAE - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Gang Li, Heliang Zheng, Daqing Liu, Chaoyue Wang, Bing Su, Changwen Zheng
    ยท ยท Organization(s): Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences; JD Explore Academy; Renmin University of China
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Test-Time Training with Masked Autoencoders (TTT-MAE - NeurIPS22) [paper]
    More Info ยท ยท Author(s): Yossi Gandelsman, Yu Sun, Xinlei Chen, Alexei A. Efros
    ยท ยท Organization(s): UC Berkeley; Meta AI
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning (CMSF - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Kossar Pourahmadi, Akshayvarun Subramanya, Hamed Pirsiavash
    ยท ยท Organization(s): University of California, Davis; University of Maryland
    ยท ยท Description:
    ยท ยท Tags: NN

  • Relative Contrastive Loss for Unsupervised Representation Learning (RCL - ECCV22) [paper]
    More Info ยท ยท Author(s): Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, and Wanli Ouyang
    ยท ยท Organization(s): University of Sydney et.al.
    ยท ยท Description:
    ยท ยท Tags: soft, clustering

  • Improving Self-Supervised Lightweight Model Learning via Hard-Aware Metric Distillation (SMD - ECCV22 Oral) [paper] [code]
    More Info ยท ยท Author(s): Hao Liu, Mang Ye
    ยท ยท Organization(s): Wuhan University; Beijing Institute of Technology
    ยท ยท Description:
    ยท ยท Tags: distillation

  • Revisiting the Critical Factors of Augmentation-Invariant Representation Learning (**** - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Junqiang Huang, Xiangwen Kong, Xiangyu Zhang
    ยท ยท Organization(s): MEGVII Technology
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Towards Efficient and Effective Self-Supervised Learning of Visual Representations (EffSSL - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Sravanti Addepalli, Kaushal Bhogale, Priyam Dey, R.Venkatesh Babu
    ยท ยท Organization(s): Indian Institute of Science
    ยท ยท Description:
    ยท ยท Tags:

  • Understanding Collapse in Non-Contrastive Siamese Representation Learning (**** - ECCV22) [paper]
    More Info ยท ยท Author(s): Alexander C. Li, Alexei A. Efros, Deepak Pathakn
    ยท ยท Organization(s): CMU; UCB
    ยท ยท Description:
    ยท ยท Tags:

  • Masked Siamese Networks for Label-Efficient Learning (MSN - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski, Florian Bordes, Pascal Vincent, Armand Joulin, Michael Rabbat, Nicolas Ballas
    ยท ยท Organization(s): Facebook AI Research; Mila โ€“ Quebec AI Institute; Inria, Univ. Grenoble Alpes; Universite de Montreal; McGill University
    ยท ยท Description:
    ยท ยท Tags:

  • Decoupled Contrastive Learning (DCL - ECCV22) [paper]
    More Info ยท ยท Author(s): Chun-Hsiao Yeh, Cheng-Yao Hong, Yen-Chi Hsu, Tyng-Luh Liu, Yubei Chen, Yann LeCun
    ยท ยท Organization(s): IIS, Academia Sinica; UC Berkeley; National Taiwan University; Meta AI Research; New York University
    ยท ยท Description:
    ยท ยท Tags:

  • Equivariance and Invariance Inductive Bias for Learning from Insufficient Data (EqInv - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Tan Wang, Qianru Sun, Sugiri Pranata, Karlekar Jayashree, Hanwang Zhang
    ยท ยท Organization(s): Nanyang Technological University; Singapore Management University; Panasonic R&D Center Singapore
    ยท ยท Description:
    ยท ยท Tags:

  • Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches (Fast-MoCo - ECCV22) [paper]
    More Info ยท ยท Author(s): Yuanzheng Ci, Chen Lin, Lei Bai, Wanli Ouyang
    ยท ยท Organization(s): The University of Sydney; University of Oxford; Shanghai AI Laboratory
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Visual Representation Learning by Synchronous Momentum Grouping (SMoG - ECCV22) [paper]
    More Info ยท ยท Author(s): Bo Pang, Yifan Zhang, Yaoyi Li, Jia Cai, Cewu Lu
    ยท ยท Organization(s): Shanghai Jiao Tong University; HuaWei
    ยท ยท Description:
    ยท ยท Tags: Clustering, Contrastive Learning

  • Self-Supervision Can Be a Good Few-Shot Learner (UniSiam - ECCV22) [paper]
    More Info ยท ยท Author(s): Yuning Lu, Liangjian Wen, Jianzhuang Liu, Yajing Liu, Xinmei Tian
    ยท ยท Organization(s): University of Science and Technology of China; Huawei Noahโ€™s Ark Lab; Hefei Comprehensive National Science Center
    ยท ยท Description:
    ยท ยท Tags: few-shot

  • ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Images (ConCL - ECCV22) [paper]
    More Info ยท ยท Author(s): Jiawei Yang, Hanbo Chen, Yuan Liang, Junzhou Huang, Lei He, Jianhua Yao
    ยท ยท Organization(s): Tencent AI Lab; UCLA; University of Texas at Arlington
    ยท ยท Description:
    ยท ยท Tags: dense, medical

  • Dense Siamese Network for Dense Unsupervised Learning (DenseSiam - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Wenwei Zhang, Jiangmiao Pang, Kai Chen, Chen Change Loy
    ยท ยท Organization(s): Nanyang Technological University; Shanghai AI Laboratory; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags: dense

  • Bootstrapped Masked Autoencoders for Vision BERT Pretraining (BootMAE - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu
    ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research Asia; Microsoft Cloud + AI
    ยท ยท Description:
    ยท ยท Tags: transformer

  • SdAE: Self-distillated Masked Autoencoder (SdAE - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Yabo Chen, Yuchen Liu, Dongsheng Jiang, Xiaopeng Zhang, Wenrui Dai, Hongkai Xiong, Qi Tian
    ยท ยท Organization(s): Shanghai Jiao Tong University; Huawei Cloud EI
    ยท ยท Description:
    ยท ยท Tags: transformer

  • Contrastive Vision-Language Pre-training with Limited Resources (ZeroVL - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): Quan Cui, Boyan Zhou, Yu Guo, Weidong Yin, Hao Wu, Osamu Yoshie, Yubo Chen
    ยท ยท Organization(s): ByteDance; Waseda University
    ยท ยท Description:
    ยท ยท Tags: VL

  • Tailoring Self-Supervision for Supervised Learning (LoRot - ECCV22) [paper] [code]
    More Info ยท ยท Author(s): WonJun Moon, Ji-Hwan Kim, Jae-Pil Heo
    ยท ยท Organization(s): Sungkyunkwan University
    ยท ยท Description:
    ยท ยท Tags: supervised

  • DisCo: Remedy Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning (DisCo - ECCV22 Oral) [paper] [code]
    More Info ยท ยท Author(s): Yuting Gao, Jia-Xin Zhuang, Shaohui Lin, Hao Cheng, Xing Sun, Ke Li, Chunhua Shen
    ยท ยท Organization(s): Tencent Youtu Lab; Hong Kong University of Science and Technology; East China Normal University; Zhejiang University
    ยท ยท Description:
    ยท ยท Tags: Self-supervised Distillation

  • Object discovery and representation networks (Odin - ECCV22) [paper]
    More Info ยท ยท Author(s): Olivier J. Hรฉnaff, Skanda Koppula, Evan Shelhamer, Daniel Zoran, Andrew Jaegle, Andrew Zisserman, Joรฃo Carreira, Relja Arandjeloviฤ‡
    ยท ยท Organization(s): TDeepMind
    ยท ยท Description:
    ยท ยท Tags: Dense

  • Position Prediction as an Effective Pretraining Strategy (MP3 - ICML22) [paper]
    More Info ยท ยท Author(s): Shuangfei Zhai, Navdeep Jaitly, Jason Ramapuram, Dan Busbridge, Tatiana Likhomanenko, Joseph Y Cheng, Walter Talbott, Chen Huang, Hanlin Goh, Joshua M Susskind
    ยท ยท Organization(s): Apple Inc.
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Boosting Contrastive Learning with Relation Knowledge Distillation (ReKD - AAAI22) [paper]
    More Info ยท ยท Author(s): Kai Zheng, Yuanjiang Wang, Ye Yuan
    ยท ยท Organization(s): Megvii Technology
    ยท ยท Description:
    ยท ยท Tags: distill

  • Masked Autoencoders Are Scalable Vision Learners (MAE - CVPR22 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollรกr, Ross Girshick
    ยท ยท Organization(s): Facebook AI Research (FAIR)
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • SimMIM: A Simple Framework for Masked Image Modeling (SimMIM - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, Han Hu
    ยท ยท Organization(s): Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Crafting Better Contrastive Views for Siamese Representation Learning (ContrastiveCrop - CVPR22 Oral) [paper] [code]
    More Info ยท ยท Author(s): Xiangyu Peng, Kai Wang, Zheng Zhu, Mang Wang, Yang You
    ยท ยท Organization(s): National University of Singapore; Tsinghua University; Alibaba Group
    ยท ยท Description:
    ยท ยท Tags:

  • A Simple Data Mixing Prior for Improving Self-Supervised Learning (SDMP - CVPR22) [paper] [code]
    More Info ยท ยท Author(s): Sucheng Ren, Huiyu Wang, Zhengqi Gao, Shengfeng He, Alan Yuille, Yuyin Zhou, Cihang Xie
    ยท ยท Organization(s): South China University of Technology; Johns Hopkins University; Massachusetts Institute of Technology; UC Santa Cruz
    ยท ยท Description:
    ยท ยท Tags: Interpolation

  • On the Importance of Asymmetry for Siamese Representation Learning (asym-siam - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Xiao Wang, Haoqi Fan, Yuandong Tian, Daisuke Kihara, Xinlei Chen
    ยท ยท Organization(s): Facebook AI Research (FAIR); Purdue University
    ยท ยท Description:
    ยท ยท Tags:

  • HCSC: Hierarchical Contrastive Selective Coding (HCSC - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Yuanfan Guo, Minghao Xu, Jiawen Li, Bingbing Ni, Xuanyu Zhu, Zhenbang Sun, Yi Xu
    ยท ยท Organization(s): MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University; 2Mila - Quยดebec AI Institute, University of Montrยดeal; ByteDance
    ยท ยท Description:
    ยท ยท Tags: Clustering

  • Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning (BURN - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Dahyun Kim, Jonghyun Choi
    ยท ยท Organization(s): Upstage AI Research; NAVER AI Lab.; Yonsei University
    ยท ยท Description:
    ยท ยท Tags:

  • Unleashing Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification (UP-ReID - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Zizheng Yang, Xin Jin, Kecheng Zheng, Feng Zhao
    ยท ยท Organization(s): University of Science and Technology of China
    ยท ยท Description:
    ยท ยท Tags:

  • UniVIP: A Unified Framework for Self-Supervised Visual Pre-training (UniVIP - CVPR22) [paper] [No code]
    More Info ยท ยท Author(s): Zhaowen Li, Yousong Zhu, Fan Yang, Wei Li, Chaoyang Zhao, Yingying Chen, Zhiyang Chen, Jiahao Xie, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
    ยท ยท Organization(s): National Laboratory of Pattern Recognition, Institute of Automation, CAS; School of Artificial Intelligence, University of Chinese Academy of Sciences; SenseTime Research; etc.
    ยท ยท Description:
    ยท ยท Tags:

  • Semantic-Aware Auto-Encoders for Self-supervised Representation Learning (**** - CVPR22) [paper] [code]
    More Info ยท ยท Author(s): Guangrun Wang, Yansong Tang, Liang Lin, Philip H.S. Torr
    ยท ยท Organization(s): University of Oxford; Tsinghua-Berkeley Shenzhen Institute, Tsinghua University; Sun Yat-sen University
    ยท ยท Description:
    ยท ยท Tags:

  • Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views (**** - CVPR22) [paper] [No code]
    More Info ยท ยท Author(s): Junbo Zhang, Kaisheng Ma
    ยท ยท Organization(s): Tsinghua University
    ยท ยท Description:
    ยท ยท Tags:

  • Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy (LoGo - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Tong Zhang, Congpei Qiu, Wei Ke, Sabine Sรผsstrunk, Mathieu Salzmann
    ยท ยท Organization(s): School of Computer and Communication Sciences, EPFL; Xiโ€™an Jiaotong University
    ยท ยท Description:
    ยท ยท Tags:

  • Learning Where to Learn in Cross-View Self-Supervised Learning (LEWEL - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
    ยท ยท Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
    ยท ยท Description:
    ยท ยท Tags:

  • Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework (**** - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Chenxin Tao, Honghui Wang, Xizhou Zhu, Jiahua Dong, Shiji Song, Gao Huang, Jifeng Dai
    ยท ยท Organization(s): Tsinghua University; SenseTime Research; Zhejiang University; Beijing Academy of Artificial Intelligence
    ยท ยท Description:
    ยท ยท Tags:

  • Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo (DT - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Chaoning Zhang, Kang Zhang, Trung X. Pham, Axi Niu, Zhinan Qiao, Chang D. Yoo, In So Kweon
    ยท ยท Organization(s): KAIST; Northwestern Polytechnical University; University of North Texas
    ยท ยท Description:
    ยท ยท Tags:

  • Directional Self-supervised Learning for Heavy Image Augmentations (DSSL - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Yalong Bai, Yifan Yang, Wei Zhang, Tao Mei
    ยท ยท Organization(s): JD AI Research; Peking University
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Visual Representation Learning by Online Constrained K-Means (CoKe - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Qi Qian, Yuanhong Xu, Juhua Hu, Hao Li, Rong Jin
    ยท ยท Organization(s): Alibaba Group, Bellevue; Alibaba Group, Hangzhou; University of Washington
    ยท ยท Description:
    ยท ยท Tags:

  • Align Representations with Base: A New Approach to Self-Supervised Learning (ARB - CVPR22) [paper] [code]
    More Info ยท ยท Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
    ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags:

  • Exploring Set Similarity for Dense Self-supervised Representation Learning (SetSim - CVPR22) [paper] [No code]
    More Info ยท ยท Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
    ยท ยท Organization(s): University of Sydney; Kuaishou Technology; Xidian University; University of Melbourne
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Patch-level Representation Learning for Self-supervised Vision Transformers (SelfPatch - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Sukmin Yun, Hankook Lee, Jaehyung Kim, Jinwoo Shin
    ยท ยท Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Self-Supervised Learning of Object Parts for Semantic Segmentation (Leopart - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Adrian Ziegler, Yuki M. Asano
    ยท ยท Organization(s): Technical University of Munich; QUVA Lab, University of Amsterdam
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Point-Level Region Contrast for Object Detection Pre-Training (**** - CVPR22 Oral) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yutong Bai, Xinlei Chen, Alexander Kirillov, Alan Yuille, Alexander C. Berg
    ยท ยท Organization(s): Facebook AI Research (FAIR); Johns Hopkins University
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Use All The Labels: A Hierarchical Multi-Label Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Shu Zhang, Ran Xu, Caiming Xiong, Chetan Ramaiah
    ยท ยท Organization(s): Salesforce Research
    ยท ยท Description:
    ยท ยท Tags: Label supervision

  • Revisiting the Transferability of Supervised Pretraining: an MLP Perspective (**** - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yizhou Wang, Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, Donglian Qi, Wanli Ouyang
    ยท ยท Organization(s): Zhejiang University; The University of Sydney; SenseTime Research; Shanghai Jiao Tong University
    ยท ยท Description:
    ยท ยท Tags: Label supervision

  • Does Robustness on ImageNet Transfer to Downstream Tasks? (**** - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yutaro Yamada, Mayu Otani
    ยท ยท Organization(s): Yale University; CyberAgent, Inc.
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • When Does Contrastive Visual Representation Learning Work? (**** - CVPR22) [paper] [No code]
    More Info ยท ยท Author(s): Elijah Cole, Xuan Yang, Kimberly Wilber, Oisin Mac Aodha, Serge Belongie
    ยท ยท Organization(s): Caltech; Google; University of Edinburgh; Alan Turing Institute; University of Copenhagen
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Rethinking Minimal Sufficient Representation in Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Haoqing Wang, Xun Guo, Zhi-Hong Deng, Yan Lu
    ยท ยท Organization(s): Peking University; Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning (**** - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Matthew Gwilliam, Abhinav Shrivastava
    ยท ยท Organization(s): University of Maryland, College Park
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • DETReg: Unsupervised Pretraining with Region Priors for Object Detection (DETReg - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Amir Bar, Xin Wang, Vadim Kantorov, Colorado J. Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson
    ยท ยท Organization(s): Tel-Aviv University; Berkeley AI Research; NVIDIA; Bar-Ilan University; Microsoft Research
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Masked Feature Prediction for Self-Supervised Visual Pre-Training (MaskFeat - CVPR22) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Chen Wei, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer
    ยท ยท Organization(s): Facebook AI Research; Johns Hopkins University
    ยท ยท Description:
    ยท ยท Tags: Transformer

  • Self-Taught Metric Learning without Labels (STML - CVPR22) [paper] [code] [supp]
    More Info ยท ยท Author(s): Sungyeon Kim, Dongwon Kim, Minsu Cho, Suha Kwak
    ยท ยท Organization(s): FDept. of CSE, POSTECH; Graduate School of AI, POSTECH
    ยท ยท Description:
    ยท ยท Tags:

  • CoDo: Contrastive Learning with Downstream Background Invariance for Detection (CoDo - CVPRW22) [paper] [No code]
    More Info ยท ยท Author(s): Bing Zhao, Jun Li, Hong Zhu
    ยท ยท Organization(s): Department of AI and HPC Inspur Electronic Information Industry Co., Ltd
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • What Should Be Equivariant In Self-Supervised Learning (**** - CVPRW22) [paper] [No code]
    More Info ยท ยท Author(s): Yuyang Xie, Jianhong Wen, Kin Wai Lau, Yasar Abbas Ur Rehman, Jiajun Shen
    ยท ยท Organization(s): TCL AI Lab; Fuzhou University; City University of Hong Kong
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Where are my Neighbors? Exploiting Patches Relations in Self-Supervised Vision Transformer (**** - CVPRW22?) [paper] [code]
    More Info ยท ยท Author(s): Guglielmo Camporese, Elena Izzo, Lamberto Ballan
    ยท ยท Organization(s): University of Padova, Italy
    ยท ยท Description:
    ยท ยท Tags:

  • Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors (DUPR - TPAMI22) [paper] [No code]
    More Info ยท ยท Author(s): Jian Ding, Enze Xie, Hang Xu, Chenhan Jiang, Zhenguo Li, Ping Luo, Guidong Xia
    ยท ยท Organization(s): Wuhan University; Huawei Noahโ€™s Ark Lab; University of Hong Kong
    ยท ยท Description:
    ยท ยท Tags:

  • Learning Generalized Transformation Equivariant Representations Via AutoEncoding Transformations (**** - TPAMI22) [paper] [No code]
    More Info ยท ยท Author(s): Guo-Jun Qi, Liheng Zhang, Feng Lin, Xiao Wang
    ยท ยท Organization(s): Futurewei Seattle Cloud Lab; University of Central Florida; University of Science and Technology of China; Purdue University
    ยท ยท Description:
    ยท ยท Tags:

2021


  • Improving Transformation Invariance in Contrastive Representation Learning (InvCLR - ICLR21) [paper] [code]
    More Info ยท ยท Author(s): Adam Foster, Rattana Pukdee, Tom Rainforth
    ยท ยท Organization(s): University of Oxford
    ยท ยท Description:
    ยท ยท Tags:

  • Contrastive Learning with Hard Negative Samples (HCL - ICLR21) [paper] [code]
    More Info ยท ยท Author(s): Joshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie Jegelka
    ยท ยท Organization(s): Massachusetts Institute of Technology
    ยท ยท Description:
    ยท ยท Tags: Hard negative

  • Representation Learning via Invariant Causal Mechanisms (ReLIC - ICLR21) [paper]
    More Info ยท ยท Author(s): Jovana Mitrovic, Brian McWilliams, Jacob C Walker, Lars Holger Buesing, Charles Blundell
    ยท ยท Organization(s): DeepMind
    ยท ยท Description:
    ยท ยท Tags: Analysis, Distribution

  • i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning (i-Mix - ICLR21) [paper] [code]
    More Info ยท ยท Author(s): Kibok Lee, Yian Zhu, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin, Honglak Lee
    ยท ยท Organization(s): University of Michigan; Amazon Web Services; Google Cloud AI; KAIST; LG AI Research
    ยท ยท Description:
    ยท ยท Tags: Interpolation

  • What Should Not Be Contrastive in Contrastive Learning (LooC - ICLR21) [paper]
    More Info ยท ยท Author(s): Tete Xiao, Xiaolong Wang, Alexei A Efros, Trevor Darrell
    ยท ยท Organization(s): UC Berkeley; UC San Diego
    ยท ยท Description:
    ยท ยท Tags:

  • CO2: Consistent Contrast for Unsupervised Visual Representation Learning (CO2 - ICLR21) [paper]
    More Info ยท ยท Author(s): Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
    ยท ยท Organization(s): Johns Hopkins University
    ยท ยท Description:
    ยท ยท Tags: Distribution

  • What Makes Instance Discrimination Good for Transfer Learning? (**** - ICLR21) [paper]
    More Info ยท ยท Author(s): Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin
    ยท ยท Organization(s): City University of Hong Kong; Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: Transfer

  • SEED: Self-supervised Distillation For Visual Representation (SEED - ICLR21) [paper]
    More Info ยท ยท Author(s): Zhiyuan Fang, Jianfeng Wang, Lijuan Wang, Lei Zhang, Yezhou Yang, Zicheng Liu
    ยท ยท Organization(s): Arizona State University; Microsoft Corporation
    ยท ยท Description:
    ยท ยท Tags: Self-supervised distillation

  • Prototypical Contrastive Learning of Unsupervised Representations (PCL - ICLR21) [paper] [code]
    More Info ยท ยท Author(s): Junnan Li, Pan Zhou, Caiming Xiong, Steven Hoi
    ยท ยท Organization(s): Salesforce Research
    ยท ยท Description:
    ยท ยท Tags: Clustering

  • Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly (OSS - NeurIPS21) [paper]
    More Info ยท ยท Author(s): Hee Min Choi, Hyoa Kang, Dokwan Oh
    ยท ยท Organization(s): Samsung Advanced Institute of Technology
    ยท ยท Description:
    ยท ยท Tags: distill

  • Aligning Pretraining for Detection via Object-Level Contrastive Learning (SoCo - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Fangyun Wei, Yue Gao, Zhirong Wu, Han Hu, Stephen Lin
    ยท ยท Organization(s): Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: local

  • Unsupervised Object-Level Representation Learning from Scene Images (ORL - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
    ยท ยท Organization(s): Nanyang Technological University; The Chinese University of Hong Kong
    ยท ยท Description:
    ยท ยท Tags: local

  • Object-aware Contrastive Learning for Debiased Scene Representation (ContraCAM - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Sangwoo Mo, Hyunwoo Kang, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin
    ยท ยท Organization(s): KAIST; Google Cloud AI
    ยท ยท Description:
    ยท ยท Tags: contextual bias

  • Intriguing Properties of Contrastive Losses (**** - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Ting Chen, Calvin Luo, Lala Li
    ยท ยท Organization(s): Google Research
    ยท ยท Description:
    ยท ยท Tags:

  • ReSSL: Relational Self-Supervised Learning with Weak Augmentation (ReSSL - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Mingkai Zheng, Shan You, Fei Wang, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
    ยท ยท Organization(s): SenseTime Research; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
    ยท ยท Description:
    ยท ยท Tags:

  • Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning (CARE - NeurIPS21) [paper] [code]
    More Info ยท ยท Author(s): Chongjian GE, Youwei Liang, YIBING SONG, Jianbo Jiao, Jue Wang, Ping Luo
    ยท ยท Organization(s): The University of Hong Kong; Tencent AI Lab; University of Oxford
    ยท ยท Description:
    ยท ยท Tags:

  • Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss (**** - NeurIPS21) [paper]
    More Info ยท ยท Author(s): Jeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu Ma
    ยท ยท Organization(s): Stanford University; Toyota Research Institute
    ยท ยท Description:
    ยท ยท Tags:

  • Improving Self-supervised Learning with Automated Unsupervised Outlier Arbitration (UOTA - NeurIPS21) [paper]
    More Info ยท ยท Author(s): Yu Wang, Jingyang Lin, Jingjing Zou, Yingwei Pan, Ting Yao, Tao Mei
    ยท ยท Organization(s): JD AI Research; Sun Yat-sen University; University of California, San Diego
    ยท ยท Description:
    ยท ยท Tags:

  • Compressive Visual Representations (**** - NeurIPS21) [paper]
    More Info ยท ยท Author(s): Kuang-Huei Lee, Anurag Arnab, Sergio Guadarrama, John Canny, Ian Fischer
    ยท ยท Organization(s): Google Research
    ยท ยท Description:
    ยท ยท Tags: Compress

  • MST: Masked Self-Supervised Transformer for Visual Representation (MST - NeurIPS21) [paper] [supp]
    More Info ยท ยท Author(s): Zhaowen Li, Zhiyang Chen, Fan Yang, Wei Li, Yousong Zhu, Chaoyang Zhao, Rui Deng, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
    ยท ยท Organization(s): Institute of Automation, CAS; UCAS; SenseTime Research; UCLA
    ยท ยท Description:
    ยท ยท Tags: Transformer, MIM

  • Exploring Simple Siamese Representation Learning (SimSiam - CVPR21 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Xinlei Chen, Kaiming He
    ยท ยท Organization(s): Facebook AI Research (FAIR)
    ยท ยท Description:
    ยท ยท Tags: Siamese architecture

  • Jigsaw Clustering for Unsupervised Visual Representation Learning (JigClu - CVPR21 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Pengguang Chen, Shu Liu, Jiaya Jia
    ยท ยท Organization(s): The Chinese University of Hong Kong; SmartMore
    ยท ยท Description:
    ยท ยท Tags: Single branch

  • OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning (OBoW - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Matthieu Cord, Patrick Perez
    ยท ยท Organization(s): valeo.ai; University of Crete; Sorbonne Universitรฉ
    ยท ยท Description:
    ยท ยท Tags:

  • Spatial Assembly Networks for Image Representation Learning (SAN - CVPR21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yang Li, Shichao Kan, Jianhe Yuan, Wenming Cao, Zhihai He
    ยท ยท Organization(s): University of Missouri, MO; Beijing Jiaotong University; Shenzhen University
    ยท ยท Description:
    ยท ยท Tags:

  • SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning (SelfAugment - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Colorado J Reed, Sean Metzger, Aravind Srinivas, Trevor Darrell, Kurt Keutzer
    ยท ยท Organization(s): BAIR, Department of Computer Science, UC Berkeley; Graduate Group in Bioengineering (Berkeley/UCSF), Weill Neurosciences Institute & UCSF Neurological Surgery
    ยท ยท Description:
    ยท ยท Tags:

  • Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement (PSL - CVPR21) [paper] [No code]
    More Info ยท ยท Author(s): Zefan Li, Chenxi Liu, Alan Yuille, Bingbing Ni, Wenjun Zhang, Wen Gao
    ยท ยท Organization(s): Shanghai Jiao Tong University; Johns Hopkins University; Peking University; MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Pre-training for Person Re-identification (**** - CVPR21) [paper]
    More Info ยท ยท Author(s): Dengpan Fu, Dongdong Chen, Jianmin Bao, Hao Yang, Lu Yuan, Lei Zhang, Houqiang Li, Dong Chen
    ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research
    ยท ยท Description:
    ยท ยท Tags: Dataset

  • Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning (PixPro - CVPR21) [paper] [code]
    More Info ยท ยท Author(s): Zhenda Xie, Yutong Lin, Zheng Zhang, Yue Cao, Stephen Lin, Han Hu
    ยท ยท Organization(s): Tsinghua University; Xiโ€™an Jiaotong University; Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • How Well Do Self-Supervised Models Transfer? (**** - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Linus Ericsson, Henry Gouk, Timothy M. Hospedales
    ยท ยท Organization(s): University of Edinburgh; Samsung AI Research, Cambridge
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning (EMAN - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Zhaowei Cai, Avinash Ravichandran, Subhransu Maji, Charless Fowlkes, Zhuowen Tu, Stefano Soatto
    ยท ยท Organization(s): Amazon Web Services
    ยท ยท Description:
    ยท ยท Tags:

  • Dense Contrastive Learning for Self-Supervised Visual Pre-Training (DenseCL - CVPR21 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Xinlong Wang, Rufeng Zhang, Chunhua Shen, Tao Kong, Lei Li
    ยท ยท Organization(s): The University of Adelaide; Tongji University; ByteDance AI Lab
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination (CLD - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Xudong Wang, Ziwei Liu, Stella X. Yu
    ยท ยท Organization(s): UC Berkeley / ICSI; S-Lab, NTU
    ยท ยท Description:
    ยท ยท Tags:

  • AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries (AdCo - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Qianjiang Hu, Xiao Wang, Wei Hu, Guo-Jun Qi
    ยท ยท Organization(s): Peking University; Purdue University; Laboratory for MAchine Perception and LEarning (MAPLE)
    ยท ยท Description:
    ยท ยท Tags:

  • CASTing Your Model: Learning to Localize Improves Self-Supervised Representations (CAST - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Ramprasaath R. Selvaraju, Karan Desai, Justin Johnson, Nikhil Naik
    ยท ยท Organization(s): Salesforce Research; University of Michigan
    ยท ยท Description:
    ยท ยท Tags:

  • Instance Localization for Self-supervised Detection Pretraining (InsLoc - CVPR21) [paper] [code]
    More Info ยท ยท Author(s): Ceyuan Yang, Zhirong Wu, Bolei Zhou, Stephen Lin
    ยท ยท Organization(s): Chinese University of Hong Kong; Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags:

  • PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering (PiCIE - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Jang Hyun Cho, Utkarsh Mall, Kavita Bala, Bharath Hariharan
    ยท ยท Organization(s): University of Texas at Austin; Cornell University
    ยท ยท Description:
    ยท ยท Tags: Unsupervised semantic segmentation

  • Self-supervised Augmentation Consistency for Adapting Semantic Segmentation (SAC - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Nikita Araslanov, Stefan Roth
    ยท ยท Organization(s): Department of Computer Science, TU Darmstadt; hessian.AI
    ยท ยท Description:
    ยท ยท Tags: Domain adaptation

  • Spatially Consistent Representation Learning (SCRL - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Byungseok Roh, Wuhyun Shin, Ildoo Kim, Sungwoong Kim
    ยท ยท Organization(s): Kakao Brain
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • UP-DETR: Unsupervised Pre-training for Object Detection with Transformers (UP-DETR - CVPR21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen
    ยท ยท Organization(s): School of Software Engineering, South China University of Technology; Tencent Wechat AI; Key Laboratory of Big Data and Intelligent Robot
    ยท ยท Description:
    ยท ยท Tags:

  • Understanding the Behaviour of Contrastive Loss (**** - CVPR21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Feng Wang, Huaping Liu
    ยท ยท Organization(s): Beijing National Research Center for Information Science and Technology(BNRist), Department of Computer Science and Technology, Tsinghua University
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Unsupervised Hyperbolic Metric Learning (**** - CVPR21) [paper] [code]
    More Info ยท ยท Author(s): Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang
    ยท ยท Organization(s): Xidian University; University of Pittsburgh; JD Finance America Corporation, Mountain View
    ยท ยท Description:
    ยท ยท Tags: Metric Learning

  • Relative Order Analysis and Optimization for Unsupervised Deep Metric Learning (ROUL - CVPR21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Shichao Kan, Yigang Cen, Yang Li, Vladimir Mladenovic, Zhihai He
    ยท ยท Organization(s): Beijing Jiaotong University; Beijing Key Laboratory of Advanced Information Science and Network Technology; University of Missouri; Faculty of Technical Sciences University of Kragujevac
    ยท ยท Description:
    ยท ยท Tags: Metric Learning

  • Distill on the Go: Online Knowledge Distillation in Self-Supervised Learning (DoGo - CVPRW21) [paper]
    More Info ยท ยท Author(s): Prashant Bhat, Elahe Arani, Bahram Zonooz
    ยท ยท Organization(s): Advanced Research Lab, NavInfo Europe, Eindhoven, The Netherlands
    ยท ยท Description:
    ยท ยท Tags: distill

  • DetCo: Unsupervised Contrastive Learning for Object Detection (DetCo - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Enze Xie, Jian Ding, Wenhai Wang, Xiaohang Zhan, Hang Xu, Peize Sun, Zhenguo Li, Ping Luo
    ยท ยท Organization(s): The University of Hong Kong; Huawei Noahโ€™s Ark Lab; Wuhan University; Nanjing University; Chinese University of Hong Kong
    ยท ยท Description:
    ยท ยท Tags:

  • Divide and Contrast: Self-supervised Learning from Uncurated Data (DnC - ICCV21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yonglong Tian, Olivier J. Hรฉnaff, Aรคron van den Oord
    ยท ยท Organization(s): MIT; DeepMind
    ยท ยท Description:
    ยท ยท Tags: Uncurated data

  • Improve Unsupervised Pretraining for Few-label Transfer (**** - ICCV21) [paper] [No code]
    More Info ยท ยท Author(s): Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
    ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Visual Representations Learning by Contrastive Mask Prediction (MaskCo - ICCV21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yucheng Zhao, Guangting Wang, Chong Luo, Wenjun Zeng, Zheng-Jun Zha
    ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research Asia
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Mean Shift for Self-Supervised Learning (MSF - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
    ยท ยท Organization(s): University of Maryland, Baltimore County; University of California, Davis
    ยท ยท Description:
    ยท ยท Tags: Positive discovery

  • On Compositions of Transformations in Contrastive Self-Supervised Learning (GDT - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Mandela Patrick, Yuki M. Asano, Polina Kuznetsova, Ruth Fong, Joรฃo F. Henriques, Geoffrey Zweig, Andrea Vedaldi
    ยท ยท Organization(s): Facebook AI Research; Visual Geometry Group, University of Oxford
    ยท ยท Description:
    ยท ยท Tags:

  • On Feature Decorrelation in Self-Supervised Learning (Shuffled-DBN - ICCV21) [paper] [No code]
    More Info ยท ยท Author(s): Tianyu Hua, Wenxiao Wang, Zihui Xue, Sucheng Ren, Yue Wang, Hang Zhao
    ยท ยท Organization(s): Tsinghua University; Shanghai Qi Zhi Institute; UT Austin; MIT; South China University of Technology
    ยท ยท Description:
    ยท ยท Tags:

  • Self-supervised Product Quantization for Deep Unsupervised Image Retrieval (SPQ - ICCV21) [paper] [code]
    More Info ยท ยท Author(s): Young Kyun Jang, Nam Ik Cho
    ยท ยท Organization(s): Department of ECE, INMC, Seoul National University
    ยท ยท Description:
    ยท ยท Tags:

  • With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations (NNCLR - ICCV21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Debidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet, Andrew Zisserman
    ยท ยท Organization(s): Google Research; DeepMind
    ยท ยท Description:
    ยท ยท Tags:

  • Contrasting Contrastive Self-Supervised Representation Learning Pipelines (ViRB - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
    ยท ยท Organization(s): PRIOR @ Allen Institute for AI; University of Washington
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • ISD: Self-Supervised Learning by Iterative Similarity Distillation (ISD - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Vipin Pillai, Paolo Favaro, Hamed Pirsiavash
    ยท ยท Organization(s): University of Maryland, Baltimore County; University of Bern; University of California, Davis
    ยท ยท Description:
    ยท ยท Tags:

  • CDS: Cross-Domain Self-supervised Pre-training (CDS - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Donghyun Kim, Kuniaki Saito, Tae-Hyun Oh, Bryan A. Plummer, Stan Sclaroff, Kate Saenko
    ยท ยท Organization(s): Boston University; POSTECH; MIT-IBM Watson AI Lab
    ยท ยท Description:
    ยท ยท Tags:

  • Collaborative Unsupervised Visual Representation Learning from Decentralized Data (FedU - ICCV21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang, Shuai Yi
    ยท ยท Organization(s): S-Lab, Nanyang Technological University; Nanyang Technological University; SenseTime Research
    ยท ยท Description:
    ยท ยท Tags:

  • Weakly Supervised Contrastive Learning (WCL - ICCV21) [paper] [code]
    More Info ยท ยท Author(s): Mingkai Zheng, Fei Wang, Shan You, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
    ยท ยท Organization(s): SenseTime Research; University of Science and Technology of China; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Representation Learning from Flow Equivariance (FlowE - ICCV21) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Yuwen Xiong, Mengye Ren, Wenyuan Zeng, Raquel Urtasun
    ยท ยท Organization(s): Waabi; University of Toronto
    ยท ยท Description:
    ยท ยท Tags:

  • Vi2CLR: Video and Image for Visual Contrastive Learning of Representation (Vi2CLR - ICCV21) [paper] [No code]
    More Info ยท ยท Author(s): Ali Diba, Vivek Sharma, Reza Safdari, Dariush Lotfi, Saquib Sarfraz, Rainer Stiefelhagen, Luc Van Gool
    ยท ยท Organization(s): KU Leuven; Sensifai; Karlsruhe Institute of Technology; Daimler TSS; Massachusetts Institute of Technology; Harvard Medical School; ETH Zurich
    ยท ยท Description:
    ยท ยท Tags:

  • Solving Inefficiency of Self-supervised Representation Learning (truncated triplet - ICCV21) [paper] [code]
    More Info ยท ยท Author(s): Guangrun Wang, Keze Wang, Guangcong Wang, Philip H.S. Torr, Liang Lin
    ยท ยท Organization(s): Sun Yat-sen University; University of Oxford; Nanyang Technological University; DarkMatter AI Research
    ยท ยท Description:
    ยท ยท Tags:

  • Instance Similarity Learning for Unsupervised Feature Representation (ISL - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Ziwei Wang, Yunsong Wang, Ziyi Wu, Jiwen Lu, Jie Zhou
    ยท ยท Organization(s): Tsinghua University; State Key Lab of Intelligent Technologies and Systems; Beijing National Research Center for Information Science and Technology
    ยท ยท Description:
    ยท ยท Tags:

  • Improving Contrastive Learning by Visualizing Feature Transformation (**** - ICCV21 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun, Chang Wen Chen
    ยท ยท Organization(s): The Chinese University of HongKong, Shenzhen; JD AI Research; Tongji University; The Hong Kong Polytechnic University
    ยท ยท Description:
    ยท ยท Tags:

  • Temporal Knowledge Consistency for Unsupervised Visual Representation Learning (TKC - ICCV21 Oral) [paper] [No code] [supp]
    More Info ยท ยท Author(s): Weixin Feng, Yuanjiang Wang, Lihua Ma, Ye Yuan, Chi Zhang
    ยท ยท Organization(s): Beijing University of Posts and Telecommunications; Megvii Technology
    ยท ยท Description:
    ยท ยท Tags:

  • MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving (MultiSiam - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Kai Chen, Lanqing Hong, Hang Xu, Zhenguo Li, Dit-Yan Yeung
    ยท ยท Organization(s): Hong Kong University of Science and Technology; Huawei Noahโ€™s Ark Lab
    ยท ยท Description:
    ยท ยท Tags: Local representation

  • Region Similarity Representation Learning(ReSim - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Tete Xiao, Colorado J Reed, Xiaolong Wang, Kurt Keutzer, Trevor Darrell
    ยท ยท Organization(s): UC Berkeley; UC San Diego
    ยท ยท Description:
    ยท ยท Tags:

  • Efficient Visual Pretraining With Contrastive Detection(DetCon - ICCV21) [paper] [supp]
    More Info ยท ยท Author(s): Olivier J. Hรฉnaff, Skanda Koppula, Jean-Baptiste Alayrac, Aaron van den Oord, Oriol Vinyals, Joรฃo Carreira
    ยท ยท Organization(s): DeepMind
    ยท ยท Description:
    ยท ยท Tags: Dense

  • An Empirical Study of Training Self-Supervised Vision Transformers(MoCo-v3 - ICCV21) [paper] [unofficial code] [supp]
    More Info ยท ยท Author(s): Xinlei Chen, Saining Xie, Kaiming He
    ยท ยท Organization(s): Facebook AI Research (FAIR)
    ยท ยท Description:
    ยท ยท Tags:

  • Emerging Properties in Self-Supervised Vision Transformers(DINO - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Mathilde Caron, Hugo Touvron, Ishan Misra, Hervรฉ Jรฉgou, Julien Mairal, Piotr Bojanowski, Armand Joulin
    ยท ยท Organization(s): Facebook AI Research; Inriaโˆ—; Sorbonne University
    ยท ยท Description:
    ยท ยท Tags:

  • A Broad Study on the Transferability of Visual Representations with Contrastive Learning (**** - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Ashraful Islam, Chun-Fu (Richard) Chen, Rameswar Panda, Leonid Karlinsky, Richard Radke, Rogerio Feris
    ยท ยท Organization(s): Rensselaer Polytechnic Institute; MIT-IBM Watson AI Lab; IBM Research
    ยท ยท Description:
    ยท ยท Tags:

  • Concept Generalization in Visual Representation Learning (CoG - ICCV21) [paper] [code] [supp]
    More Info ยท ยท Author(s): Mert Bulent Sariyildiz, Yannis Kalantidis, Diane Larlus, Karteek Alahari
    ยท ยท Organization(s): NAVER LABS Europe; Inria
    ยท ยท Description:
    ยท ยท Tags:

  • Concurrent Discrimination and Alignment for Self-Supervised Feature Learning (CODIAL - ICCVW21) [paper] [code]
    More Info ยท ยท Author(s): Anjan Dutta, Massimiliano Mancini, Zeynep Akata
    ยท ยท Organization(s): University of Exeter; University of Tยจubingen
    ยท ยท Description:
    ยท ยท Tags:

2020


  • A critical analysis of self-supervision, or what we can learn from a single image (**** - ICLR20 ) [paper]
    More Info ยท ยท Author(s): Asano YM., Rupprecht C., Vedaldi A.
    ยท ยท Organization(s): VGG, University of Oxford
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • On Mutual Information Maximization for Representation Learning (**** - ICLR20 ) [paper]
    More Info ยท ยท Author(s): Michael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly, Mario Lucic
    ยท ยท Organization(s): Google Research
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • Self-labelling via simultaneous clustering and representation learning (SeLa - ICLR20 Spotlight) [paper] [code]
    More Info ยท ยท Author(s): Asano YM., Rupprecht C., Vedaldi A.
    ยท ยท Organization(s): VGG, University of Oxford
    ยท ยท Description:
    ยท ยท Tags: Clustering

  • Unsupervised Learning of Dense Visual Representations (VADeR - NeurIPS20) [paper]
    More Info ยท ยท Author(s): Pedro O. O. Pinheiro, Amjad Almahairi, Ryan Benmalek, Florian Golemo, Aaron C. Courville
    ยท ยท Organization(s): Element AI; Cornell University; Mila, Universitรฉ de Montrรฉal; CIFAR Fellow
    ยท ยท Description:
    ยท ยท Tags: Dense

  • CompRess: Self-Supervised Learning by Compressing Representations (CompRess - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
    ยท ยท Organization(s): University of Maryland
    ยท ยท Description:
    ยท ยท Tags: self-supervised distillation

  • Unsupervised Representation Learning by Invariance Propagation (InvPro - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Feng Wang, Huaping Liu, Di Guo, Sun Fuchun
    ยท ยท Organization(s): Tsinghua University
    ยท ยท Description:
    ยท ยท Tags:

  • Joint Contrastive Learning with Infinite Possibilities (JCL - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Qi Cai, Yu Wang, Yingwei Pan, Ting Yao, Tao Mei
    ยท ยท Organization(s): University of Science and Technology of China; JD AI Research
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Learning of Visual Features by Contrasting Cluster Assignments (SwAV - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, Armand Joulin
    ยท ยท Organization(s): Inria; Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Visual Representation Learning from Hierarchical Grouping (**** - NeurIPS20) [paper]
    More Info ยท ยท Author(s): Xiao Zhang, Michael Maire
    ยท ยท Organization(s): University of Chicago
    ยท ยท Description:
    ยท ยท Tags: Pixel, Local

  • Parametric Instance Classification for Unsupervised Visual Feature learning (PIC - NeurIPS20) [paper]
    More Info ยท ยท Author(s): Yue Cao, Zhenda Xie, Bin Liu, Yutong Lin, Zheng Zhang, Han Hu
    ยท ยท Organization(s): Microsoft Research Asia; Tsinghua University; Xiโ€™an Jiaotong University
    ยท ยท Description:
    ยท ยท Tags:

  • Hard Negative Mixing for Contrastive Learning (MoCHi - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Yannis Kalantidis, Mert Bulent Sariyildiz, Noe Pion, Philippe Weinzaepfel, Diane Larlus
    ยท ยท Organization(s): NAVER LABS Europe
    ยท ยท Description:
    ยท ยท Tags:

  • What Makes for Good Views for Contrastive Learning? (InfoMin - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, Phillip Isola
    ยท ยท Organization(s): MIT; Google Research
    ยท ยท Description:
    ยท ยท Tags:

  • Debiased Contrastive Learning (DCL - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Ching-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba, Stefanie Jegelka
    ยท ยท Organization(s): Massachusetts Institute of Technology
    ยท ยท Description:
    ยท ยท Tags: False negative

  • Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning (BYOL - NeurIPS20) [paper] [code]
    More Info ยท ยท Author(s): Jean-Bastien Grill, Florian Strub, Florent Altchรฉ, Corentin Tallec, Pierre Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Guo, Mohammad Gheshlaghi Azar, Bilal Piot, koray kavukcuoglu, Remi Munos, Michal Valko
    ยท ยท Organization(s): DeepMind; Imperial College
    ยท ยท Description:
    ยท ยท Tags: Siamese architecture

  • MixCo: Mix-up Contrastive Learning for Visual Representation (MixCo - NeurIPSW20) [paper] [code]
    More Info ยท ยท Author(s): Sungnyun Kim, Gihun Lee, Sangmin Bae, Se-Young Yun
    ยท ยท Organization(s): KAIST
    ยท ยท Description:
    ยท ยท Tags:

  • Improved Baselines with Momentum Contrastive Learning (MoCo v2 - arXiv20) [paper] [code]
    More Info ยท ยท Author(s): Xinlei Chen, Haoqi Fan, Ross Girshick, Kaiming He
    ยท ยท Organization(s): Facebook AI Research (FAIR)
    ยท ยท Description:
    ยท ยท Tags: InfoNCE loss, siamese architecture

  • Momentum Contrast for Unsupervised Visual Representation Learning (MoCo - CVPR20 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick
    ยท ยท Organization(s): Facebook AI Research (FAIR)
    ยท ยท Description: Building a dynamic dictionary with a queue and a moving-averaged encoder
    ยท ยท Tags: InfoNCE loss, siamese architecture

  • Online Deep Clustering for Unsupervised Representation Learning (ODC - CVPR20 Oral) [paper] [code]
    More Info ยท ยท Author(s): Xiaohang Zhan, Jiahao Xie, Ziwei Liu, Yew-Soon Ong, Chen Change Loy
    ยท ยท Organization(s): CUHK - SenseTime Joint Lab, The Chinese University of Hong Kong; Nanyang Technological University; AI3, A*STAR
    ยท ยท Description:
    ยท ยท Tags:

  • Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics (LCI - CVPR20) [paper] [code] [supp]
    More Info ยท ยท Author(s): Simon Jenni, Hailin Jin, Paolo Favaro
    ยท ยท Organization(s): University of Bern; Adobe Research
    ยท ยท Description:
    ยท ยท Tags:

  • Learning Representations by Predicting Bags of Visual Words (BoWNet - CVPR20) [paper] [code] [supp]
    More Info ยท ยท Author(s): Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Perez, Matthieu Cord
    ยท ยท Organization(s): Valeo.ai; University of Crete
    ยท ยท Description:
    ยท ยท Tags:

  • Probabilistic Structural Latent Representation for Unsupervised Embedding (PSLR - CVPR20) [paper] [code]
    More Info ยท ยท Author(s): Mang Ye, Jianbing Shen
    ยท ยท Organization(s): Inception Institute of Artificial Intelligence
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Learning of Pretext-Invariant Representations (PIRL - CVPR20) [paper] [unofficial code]
    More Info ยท ยท Author(s): Ishan Misra, Laurens van der Maaten
    ยท ยท Organization(s): Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags:

  • How Useful is Self-Supervised Pretraining for Visual Tasks? (**** - CVPR20) [paper] [code] [supp]
    More Info ยท ยท Author(s): Alejandro Newell, Jia Deng
    ยท ยท Organization(s): Princeton University
    ยท ยท Description:
    ยท ยท Tags: Analysis

  • SCAN: Learning to Classify Images without Labels (SCAN - ECCV20) [paper] [code] [arxiv]
    More Info ยท ยท Author(s): Wouter Van Gansbeke, Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Luc Van Gool
    ยท ยท Organization(s): KU Leuven/ESAT-PSI; ETH Zurich/CVL, TRACE
    ยท ยท Description:
    ยท ยท Tags:

  • Contrastive Multiview Coding (CMC - ECCV20) [paper] [code] [arxiv]
    More Info ยท ยท Author(s): Yonglong Tian, Dilip Krishnan, Phillip Isola
    ยท ยท Organization(s): MIT CSAIL; Google Research
    ยท ยท Description:
    ยท ยท Tags:

  • Mitigating Embedding and Class Assignment Mismatch in Unsupervised Image Classification (**** - ECCV20) [paper] [code] [No arxiv]
    More Info ยท ยท Author(s): Sungwon Han, Sungwon Park, Sungkyu Park, Sundong Kim, Meeyoung Cha
    ยท ยท Organization(s): Korea Advanced Institute of Science and Technology; Data Science Group, Institute for Basic Science
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Deep Metric Learning with Transformed Attention Consistency and Contrastive Clustering Loss (**** - ECCV20) [paper] [No code]
    More Info ยท ยท Author(s): Yang Li, Shichao Kan, Zhihai He
    ยท ยท Organization(s): University of Missouri; Beijing Jiaotong University
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Image Classification for Deep Representation Learning (**** - ECCVW20) [paper] [No code] [arxiv]
    More Info ยท ยท Author(s): Weijie Chen, Shiliang Pu, Di Xie, Shicai Yang, Yilu Guo, Luojun Lin
    ยท ยท Organization(s): Hikvision Research Institute; School of Electronic and Information Engineering, South China University of Technology
    ยท ยท Description:
    ยท ยท Tags:

2019


  • Learning deep representations by mutual information estimation and maximization (DIM - ICLR19 Oral) [paper]
    More Info ยท ยท Author(s): R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, Yoshua Bengio
    ยท ยท Organization(s): MSR Montreal; MILA; UdeM; IVADO; UNM; U Toronto
    ยท ยท Description:
    ยท ยท Tags:

  • Learning Representations by Maximizing Mutual Information Across Views (AMDIM - NeurIPS19) [paper] [code] More Info ยท ยท Author(s): Philip Bachman, R Devon Hjelm, William Buchwalte
    ยท ยท Organization(s): Microsoft Research
    ยท ยท Description:
    ยท ยท Tags:

  • Large Scale Adversarial Representation Learning (BigBiGAN - NeurIPS19) [paper] More Info ยท ยท Author(s): Jeff Donahue, Karen Simonyan
    ยท ยท Organization(s): DeepMind
    ยท ยท Description:
    ยท ยท Tags: Generative

  • Unsupervised Embedding Learning via Invariant and Spreading Instance Feature (ISIF - CVPR19) [paper] [code]
    More Info ยท ยท Author(s): Mang Ye, Xu Zhang, Pong C. Yuen, Shih-Fu Chang
    ยท ยท Organization(s): Hong Kong Baptist University; Columbia University
    ยท ยท Description: Learning augmentation invariant and instance spread-out features
    ยท ยท Tags: Siamese architecture

  • Self-Supervised Representation Learning by Rotation Feature Decoupling (FeatureDecoupling - CVPR19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Zeyu Feng, Chang Xu, Dacheng Tao
    ยท ยท Organization(s): UBTECH Sydney AI Centre, School of Computer Science; University of Sydney
    ยท ยท Description:
    ยท ยท Tags:

  • Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning (**** - CVPR19) [paper] [No code]
    More Info ยท ยท Author(s): Chen Wei, Lingxi Xie, Xutong Ren, Yingda Xia, Chi Su, Jiaying Liu, Qi Tian, Alan L. Yuille
    ยท ยท Organization(s): Peking University; The Johns Hopkins University; Kingsoft; Huawei Noahโ€™s Ark Lab
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised GANs via Auxiliary Rotation Loss (SS-GAN - CVPR19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
    ยท ยท Organization(s): University of California, Los Angeles; Google Brain
    ยท ยท Description:
    ยท ยท Tags: GAN

  • AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data (AET - CVPR19) [paper] [code]
    More Info ยท ยท Author(s): Liheng Zhang, Guo-Jun Qi, Liqiang Wang, Jiebo Luo
    ยท ยท Organization(s): Huawei Cloud; University of Central Florida; University of Rochester
    ยท ยท Description:
    ยท ยท Tags:

  • Revisiting Self-Supervised Visual Representation Learning (**** - CVPR19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Alexander Kolesnikov, Xiaohua Zhai, Lucas Beyer
    ยท ยท Organization(s): Google Brain
    ยท ยท Description:
    ยท ยท Tags: Revisiting

  • Local Aggregation for Unsupervised Learning of Visual Embeddings (LA - ICCV19 Oral) [paper] [code] [supp]
    More Info ยท ยท Author(s): Chengxu Zhuang, Alex Lin Zhai, Daniel Yamins
    ยท ยท Organization(s): Stanford University
    ยท ยท Description:
    ยท ยท Tags: Clustering

  • S4L: Self-Supervised Semi-Supervised Learning (S4L - ICCV19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, Lucas Beyer
    ยท ยท Organization(s): Google Research, Brain Team
    ยท ยท Description:
    ยท ยท Tags:

  • AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational Transformations (AVT - ICCV19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Guo-Jun Qi, Liheng Zhang, Chang Wen Chen, Qi Tian
    ยท ยท Organization(s): G1Laboratory for MAchine Perception and LEarning (MAPLE); Huawei Cloud; Huawei Noahโ€™s Ark Lab; The Chinese University of Hong Kong at Shenzhen and Peng Cheng Laboratory
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Representation Learning via Neighborhood-Relational Encoding (NRE - ICCV19) [paper] [No code]
    More Info ยท ยท Author(s): Mohammad Sabokrou, Mohammad Khalooei, Ehsan Adeli
    ยท ยท Organization(s): Institute for Research in Fundamental Sciences; Amirkabir University of Tech.; Stanford University
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Pre-Training of Image Features on Non-Curated Data (DeeperCluster - ICCV19) [paper] [code] [supp]
    More Info ยท ยท Author(s): Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin
    ยท ยท Organization(s): Facebook AI Research; Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK
    ยท ยท Description:
    ยท ยท Tags: Clustering

  • Scaling and Benchmarking Self-Supervised Visual Representation Learning (**** - ICCV19) [paper] [code]
    More Info ยท ยท Author(s): Priya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan Misra
    ยท ยท Organization(s): Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags:

2018


  • Unsupervised Representation Learning by Predicting Image Rotations (RotNet - ICLR18) [paper] [code]
    More Info ยท ยท Author(s): Spyros Gidaris, Praveer Singh, Nikos Komodakis
    ยท ยท Organization(s): University Paris-Est; Ecole des Ponts ParisTech
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Feature Learning via Non-Parametric Instance Discrimination ( InsDis - CVPR18 Spotlight) [paper] [code]
    More Info ยท ยท Author(s): Zhirong Wu, Yuanjun Xiong, Stella X. Yu, Dahua Lin
    ยท ยท Organization(s): UC Berkeley/ICSI; Chinese University of Hong Kong; Amazon Rekognition
    ยท ยท Description:
    ยท ยท Tags: Contrastive learning, single branch

  • Improvements to context based self-supervised learning ( **** - CVPR18) [paper] [code] [supp]
    More Info ยท ยท Author(s): T. Nathan Mundhenk, Daniel Ho, Barry Y. Chen
    ยท ยท Organization(s): Lawrence Livermore National Laboratory; University of California, Berkeley
    ยท ยท Description:
    ยท ยท Tags:

  • Self-Supervised Feature Learning by Learning to Spot Artifacts ( **** - CVPR18) [paper] [code]
    More Info ยท ยท Author(s): Simon Jenni, Paolo Favaro
    ยท ยท Organization(s): University of Bern
    ยท ยท Description:
    ยท ยท Tags:

  • Boosting Self-Supervised Learning via Knowledge Transfer ( **** - CVPR18) [paper] [No code]
    More Info ยท ยท Author(s): Mehdi Noroozi, Ananth Vinjimoor, Paolo Favaro, Hamed Pirsiavash
    ยท ยท Organization(s): University of Bern; University of Maryland, Baltimore County
    ยท ยท Description:
    ยท ยท Tags: Self-supervised Distillation

  • Deep Clustering for Unsupervised Learning of Visual Features ( DeepCluster - ECCV18) [paper] [code]
    More Info ยท ยท Author(s): Caron, Mathilde and Bojanowski, Piotr and Joulin, Armand and Douze, Matthijs
    ยท ยท Organization(s): Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags:

2017


  • Adversarial Feature Learning (BiGANs - ICLR18) [paper]
    More Info ยท ยท Author(s): Jeff Donahue, Philipp Krรคhenbรผhl, Trevor Darrell
    ยท ยท Organization(s): University of California, Berkeley; University of Texas, Austin
    ยท ยท Description:
    ยท ยท Tags:

  • Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction (Split-Brain Auto - CVPR17 ) [paper] [code]
    More Info ยท ยท Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
    ยท ยท Organization(s): Berkeley AI Research (BAIR) Laboratory, University of California, Berkeley
    ยท ยท Description:
    ยท ยท Tags: Pretext task

  • Representation Learning by Learning to Count (**** - ICCV17 ) [paper] [unofficial code]
    More Info ยท ยท Author(s): Mehdi Noroozi, Hamed Pirsiavash, Paolo Favaro
    ยท ยท Organization(s): University of Bern; University of Maryland, Baltimore County
    ยท ยท Description:
    ยท ยท Tags: Pretext task

  • Transitive Invariance for Self-supervised Visual Representation Learning (**** - ICCV17 ) [paper] [No code]
    More Info ยท ยท Author(s): Xiaolong Wang, Kaiming He, Abhinav Gupta
    ยท ยท Organization(s): Carnegie Mellon University; Facebook AI Research
    ยท ยท Description:
    ยท ยท Tags:

  • Multi-task Self-Supervised Visual Learning (**** - ICCV17 ) [paper] [code]
    More Info ยท ยท Author(s): Carl Doersch, Andrew Zisserman
    ยท ยท Organization(s): DeepMind; VGG, Department of Engineering Science, University of Oxford
    ยท ยท Description:
    ยท ยท Tags:

2016


  • Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks (ExemplarCNN - TPAMI16 ) [paper]
    More Info ยท ยท Author(s): Alexey Dosovitskiy, Philipp Fischer, Jost Tobias Springenberg, Martin Riedmiller, Thomas Brox
    ยท ยท Organization(s): Computer Science Department, University of Freiburg
    ยท ยท Description:
    ยท ยท Tags: Pretext task, Instance Discrimination

  • Context Encoders: Feature Learning by Inpainting (Inpainting - CVPR16 ) [paper] [unofficial code]
    More Info ยท ยท Author(s): Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, Alexei A. Efros
    ยท ยท Organization(s): University of California, Berkeley
    ยท ยท Description:
    ยท ยท Tags: Pretext task

  • Unsupervised Learning of Discriminative Attributes and Visual Representations (**** - CVPR16 ) [paper] [No code]
    More Info ยท ยท Author(s): Chen Huang, Chen Change Loy, Xiaoou Tang
    ยท ยท Organization(s): The Chinese University of Hong Kong; SenseTime Group Limited; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles (Jigsaw - ECCV16 ) [paper] [unofficial code] [arxiv]
    More Info ยท ยท Author(s): Mehdi Noroozi, Paolo Favaro
    ยท ยท Organization(s): Institute for Informatiks, University of Bern
    ยท ยท Description:
    ยท ยท Tags: Pretext task

  • Unsupervised Visual Representation Learning by Graph-based Consistent Constraints (**** - ECCV16 ) [paper] [No code]
    More Info ยท ยท Author(s): Dong Li, Wei-Chih Hung, Jia-Bin Huang, Shengjin Wang, Narendra Ahuja; Ming-Hsuan Yang
    ยท ยท Organization(s): Tsinghua University; University of California, Merced; University of Illinois, Urbana-Champaign
    ยท ยท Description:
    ยท ยท Tags:

  • Colorful Image Colorization (**** - ECCV16 ) [paper] [code]
    More Info ยท ยท Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
    ยท ยท Organization(s): University of California, Berkeley
    ยท ยท Description:
    ยท ยท Tags:

2015


  • Unsupervised Visual Representation Learning by Context Prediction (Context - ICCV15 ) [paper] [code]
    More Info ยท ยท Author(s): Carl Doersch, Abhinav Gupta, Alexei A. Efros
    ยท ยท Organization(s): Institute for Informatiks, University of Bern
    ยท ยท Description:
    ยท ยท Tags: Pretext task

  • Learning to See by Moving (**** - ICCV15 ) [paper] [code]
    More Info ยท ยท Author(s): Pulkit Agrawal, Joao Carreira, Jitendra Malik
    ยท ยท Organization(s): UC Berkeley
    ยท ยท Description:
    ยท ยท Tags:

  • Unsupervised Learning of Visual Representations using Videos (**** - ICCV15 ) [paper] [unofficial code]
    More Info ยท ยท Author(s): Xiaolong Wang, Abhinav Gupta
    ยท ยท Organization(s): Robotics Institute, Carnegie Mellon University
    ยท ยท Description:
    ยท ยท Tags:

2014


  • Discriminative Unsupervised Feature Learning with Convolutional Neural Networks (ExemplarCNN - NeurIPS14 ) [paper] [unofficial code] [supp]
    More Info ยท ยท Author(s): Alexey Dosovitskiy, Jost Tobias Springenberg, Martin A. Riedmiller, Thomas Brox
    ยท ยท Organization(s): Computer Science Department, University of Freiburg
    ยท ยท Description:
    ยท ยท Tags: Pretext task, Instance Discrimination

UVRL is also closely related to some other research directions, such as Unsupervised Person (Object or Vehicle) Re-Identification, Unsupervised Semantic Segmentation, Unsupervised Domain Adaptation, Knowledge Distillation, Deep Clustering, Unsupervised Metric (Embedding) Learning, Semi-supervised Learning, Novel Categories (Classes) Discovery, etc.

Some Influential Repositories


  • awesome-self-supervised-learning (star 5.6k) [link]

  • Awesome-Knowledge-Distillation (star 2.2k) [link]

  • DeepClustering (star 2.4k) [link]

  • awesome-metric-learning [link]

  • Awesome-Unsupervised-Person-Re-identification [link]

  • Awesome-Novel-Class-Discovery [link]

Thanks for the support of Prof. Yu Zhou.

About

Overview of unsupervised visual representation learning (or self-supervised learning, unsupervised pre-training) methods.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published