[ Updating ...... ]
Unsupervised visual representation learning (UVRL) aims at learning generic representations for the initialization of downstream tasks. As stated in MoCo, self-supervised learning is a form of unsupervised learning and their distinction is informal in the existing literature. Therefore, it is more inclined to be called UVRL here. So, which one do you prefer?
We list related papers from conferences and journals such as CVPR, ICCV, ECCV, ICLR, ICML, NeurIPS, AAAI, IJCAI, TPAMI, TIP, TNNLS, TCSVT, TMM etc.
Note that only image-level representation learning methods are listed in this repository. Video-level self-supervision and multi-modal self-supervision are to be sorted out.
Key words: Unsupervised learning, self-supervised learning, representation learning, pre-training, transfer learning, contrastive learning, pretext task
ๅ ณ้ฎ่ฏ๏ผ ๆ ็็ฃๅญฆไน ๏ผ่ช็็ฃๅญฆไน ๏ผ่กจ็คบๅญฆไน ๏ผ้ข่ฎญ็ป๏ผ่ฟ็งปๅญฆไน ๏ผๅฏนๆฏๅญฆไน ๏ผๅๅฃ๏ผไปฃ็๏ผไปปๅก
- Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations (**** - ICLR23 ) [paper]
More Info
ยท ยท Author(s): Ziyu Jiang, Yinpeng Chen, Mengchen Liu, Dongdong Chen, Xiyang Dai, Lu Yuan, Zicheng Liu, Zhangyang Wang
ยท ยท Organization(s): Texas A&M University; Microsoft; University of Texas at Austin
ยท ยท Description:
ยท ยท Tags: CL, MIM
- Patch-Level Contrasting without Patch Correspondence for Accurate and Dense Contrastive Representation Learning (ADCLR - ICLR23 ) [paper]
More Info
ยท ยท Author(s): Shaofeng Zhang, Feng Zhu, Rui Zhao, Junchi Yan
ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Group Limited
ยท ยท Description:
ยท ยท Tags: Dense
- Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning (SNCLR - ICLR23 ) [paper]
More Info
ยท ยท Author(s): Chongjian GE, Jiangliu Wang, Zhan Tong, Shoufa Chen, Yibing Song, Ping Luo
ยท ยท Organization(s): HongKong University and so on
ยท ยท Description:
ยท ยท Tags: Soft neighbor
- Energy-Inspired Self-Supervised Pretraining for Vision Models (**** - ICLR23 Spotlight ) [paper]
More Info
ยท ยท Author(s): Ze Wang, Jiang Wang, Zicheng Liu, Qiang Qiu
ยท ยท Organization(s): Purdue University; Microsoft Corporation
ยท ยท Description:
ยท ยท Tags: Energy
- EquiMod: An Equivariance Module to Improve Self-Supervised Learning (EquiMod - ICLR23 ) [paper]
More Info
ยท ยท Author(s): Alexandre DEVILLERS, Mathieu Lefort
ยท ยท Organization(s): Universitรฉ Claude Bernard
ยท ยท Description:
ยท ยท Tags: Equivariance
- Mosaic Representation Learning for Self-supervised Visual Pre-training (MosRep - ICLR23 Spotlight ) [paper] [code]
More Info
ยท ยท Author(s): Zhaoqing Wang, Ziyu Chen, Yaqian Li, Yandong Guo, Jun Yu, Mingming Gong, Tongliang Liu
ยท ยท Organization(s): The University of Sydney
ยท ยท Description:
ยท ยท Tags:
- Temperature Schedules for self-supervised contrastive methods on long-tail data (**** - ICLR23 ) [paper]
More Info
ยท ยท Author(s): Anna Kukleva, Moritz Bรถhle, Bernt Schiele, Hilde Kuehne, Christian Rupprecht
ยท ยท Organization(s): Saarland Informatics Campus, Max-Planck Institute
ยท ยท Description:
ยท ยท Tags: Long-tail
- LPCL: Localized prominence contrastive learning for self-supervised dense visual pre-training (LPCL - PR22) [paper]
More Info
ยท ยท Author(s): Zihan Chen, Hongyuan Zhu, Hao Cheng, Siya Mi, Yu Zhang, Xin Geng
ยท ยท Organization(s): Southeast University; A*STAR; Purple Mountain Laboratories
ยท ยท Description:
ยท ยท Tags: Dense
- Self-supervised Learning is More Robust to Dataset Imbalance (**** - ICLR22 Spotlight) [paper]
More Info
ยท ยท Author(s): Hong Liu, Jeff Z. HaoChen, Adrien Gaidon, Tengyu Ma
ยท ยท Organization(s): Stanford University; Toyota Research Institute
ยท ยท Description:
ยท ยท Tags: Analysis, Imbalance data
- Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap (**** - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Yifei Wang, Qi Zhang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
ยท ยท Organization(s): Peking University; Sun Yat-sen University; Peng Cheng Laboratory
ยท ยท Description:
ยท ยท Tags: Analysis
- How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning (**** - ICLR22) [paper]
More Info
ยท ยท Author(s): Chaoning Zhang, Kang Zhang, Chenshuang Zhang, Trung X. Pham, Chang D. Yoo, In So Kweon
ยท ยท Organization(s): KAIST
ยท ยท Description:
ยท ยท Tags: Analysis
- Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution (LP-FT - ICLR22 Oral) [paper]
More Info
ยท ยท Author(s): Ananya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma, Percy Liang
ยท ยท Organization(s): Stanford University
ยท ยท Description:
ยท ยท Tags: Analysis
- Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption (Scarf - ICLR22 Spotlight) [paper]
More Info
ยท ยท Author(s): Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
ยท ยท Organization(s): Google Research
ยท ยท Description:
ยท ยท Tags: Tabular domain
- Measuring the Interpretability of Unsupervised Representations via Quantized Reversed Probing (QRP - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Iro Laina, Yuki M Asano, Andrea Vedaldi
ยท ยท Organization(s): University of Oxford; University of Amsterdam
ยท ยท Description:
ยท ยท Tags: Interpretability
- Equivariant Contrastive Learning (Equivariant Self-Supervised Learning: Encouraging Equivariance in Representations) (E-SSL - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Rumen Dangovski, Li Jing, Charlotte Loh, Seungwook Han, Akash Srivastava, Brian Cheung, Pulkit Agrawal, Marin Soljacic
ยท ยท Organization(s): MIT; FAIR
ยท ยท Description:
ยท ยท Tags: Equivariant
- Divergence-aware Federated Self-Supervised Learning (FedSSL - ICLR22) [paper]
More Info
ยท ยท Author(s): Weiming Zhuang, Yonggang Wen, Shuai Zhang
ยท ยท Organization(s): NTU; SenseTime Research
ยท ยท Description:
ยท ยท Tags: Federal
- Bag of Instances Aggregation Boosts Self-supervised Distillation (BINGO - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Haohang Xu, Jiemin Fang, XIAOPENG ZHANG, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian
ยท ยท Organization(s): Shanghai Jiao Tong University; Huawei Inc.; Huazhong University of Science & Technology
ยท ยท Description:
ยท ยท Tags: Self-supervised distillation
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning (VICReg - ICLR22) [paper]
More Info
ยท ยท Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
ยท ยท Organization(s): Facebook AI Research; Inria; New York University
ยท ยท Description:
ยท ยท Tags:
- Zero-CL: Instance and Feature decorrelation for negative-free symmetric contrastive learning (Zero-CL - ICLR22) [paper]
More Info
ยท ยท Author(s): Shaofeng Zhang, Feng Zhu, Junchi Yan, Rui Zhao, Xiaokang Yang
ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Research
ยท ยท Description:
ยท ยท Tags:
- BEiT: BERT Pre-Training of Image Transformers (BEiT - ICLR22 Oral) [paper] [code]
More Info
ยท ยท Author(s): Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
ยท ยท Organization(s): Harbin Institute of Technology; Microsoft Research
ยท ยท Description:
ยท ยท Tags: Transformer
- Efficient Self-supervised Vision Transformers for Representation Learning (EsViT - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Hangbo Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
ยท ยท Organization(s): Microsoft Research at Redmond; Microsoft Cloud + AI
ยท ยท Description:
ยท ยท Tags: Transformer
- iBOT๏ผImage BERT Pre-Training with Online Tokenizer (iBOT - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
ยท ยท Organization(s): ByteDance; Johns Hopkins University; Shanghai Jiao Tong University; UC Santa Cruz
ยท ยท Description:
ยท ยท Tags: Transformer
- Understanding Dimensional Collapse in Contrastive Self-supervised Learning (**** - ICLR22) [paper]
More Info
ยท ยท Author(s): Li Jing, Pascal Vincent, Yann LeCun, Yuandong Tian
ยท ยท Organization(s): Facebook AI Research
ยท ยท Description:
ยท ยท Tags: Analysis
- Incremental False Negative Detection for Contrastive Learning (IFND - ICLR22) [paper] [code]
More Info
ยท ยท Author(s): Tsai-Shien Chen, Wei-Chih Hung, Hung-Yu Tseng, Shao-Yi Chien, Ming-Hsuan Yang
ยท ยท Organization(s): National Taiwan University; Waymo LLC; University of California, Merced; Yonsei University; Google Research
ยท ยท Description:
ยท ยท Tags: False negative
- Self-Supervised Learning via Maximum Entropy Coding (MEC - NeurIPS22) [paper] [code]
More Info
ยท ยท Author(s): Xin Liu, Zhongdao Wang, Yali Li, Shengjin Wang
ยท ยท Organization(s): Tsinghua University
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Learning Through Efference Copies (S-TEC - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Franz Scherr, Qinghai Guo, Timoleon Moraitis
ยท ยท Organization(s): Huawei Technologies
ยท ยท Description:
ยท ยท Tags:
- VICRegL: Self-Supervised Learning of Local Visual Features (VICRegL - NeurIPS22) [paper] [code]
More Info
ยท ยท Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
ยท ยท Organization(s): Meta, FAIR; Inria, รcole normale supรฉrieure, CNRS, PSL Research University; New York University
ยท ยท Description:
ยท ยท Tags: local feature
- An Empirical Study on Disentanglement of Negative-free Contrastive Learning (**** - NeurIPS22) [paper] [code]
More Info
ยท ยท Author(s): Jinkun Cao, Ruiqian Nai, Qing Yang, Jialei Huang, Yang Gao
ยท ยท Organization(s): Carnegie Mellon University; Tsinghua University; Shanghai Jiao Tong University; Shanghai Qi-Zhi Institute
ยท ยท Description:
ยท ยท Tags: Analysis
- Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods (**** - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Randall Balestriero, Yann LeCun
ยท ยท Organization(s): Meta AI Research; NYU
ยท ยท Description:
ยท ยท Tags: Analysis
- The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning (**** - NeurIPS22) [paper]
More Info
ยท ยท Author(s): RZixin Wen, Yuanzhi Li
ยท ยท Organization(s): Carnegie Mellon University
ยท ยท Description:
ยท ยท Tags: Analysis
- Improving Self-Supervised Learning by Characterizing Idealized Representations (**** - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Yann Dubois, Tatsunori Hashimoto, Stefano Ermon, Percy Liang
ยท ยท Organization(s): Stanford University
ยท ยท Description:
ยท ยท Tags:
- MSR: Making Self-supervised learning Robust to Aggressive Augmentations (MSR - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Yingbin Bai, Erkun Yang, Zhaoqing Wang, Yuxuan Du, Bo Han, Cheng Deng, Dadong Wang, Tongliang Liu
ยท ยท Organization(s): TML Lab, The University of Sydney; Xidian University; JD Explore Academy; Hong Kong Baptist University; CSIRO
ยท ยท Description:
ยท ยท Tags:
- RรฉnyiCL: Contrastive Representation Learning with Skew Rรฉnyi Divergence (RรฉnyiCL - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Kyungmin Lee, Jinwoo Shin
ยท ยท Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Learning of Group Invariant and Equivariant Representations (**** - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Robin Winter, Marco Bertolini, Tuan Le, Frank Noรฉ, Djork-Arnรฉ Clevert
ยท ยท Organization(s): Bayer AG; Freie Universitรคt Berlin; Microsoft Research
ยท ยท Description:
ยท ยท Tags:
- Energy-Based Contrastive Learning of Visual Representations (**** - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Beomsu Kim, Jong Chul Ye
ยท ยท Organization(s): KAIST
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Visual Representation Learning with Semantic Grouping (SlotCon - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Xin Wen, Bingchen Zhao, Anlin Zheng, Xiangyu Zhang, Xiaojuan Qi
ยท ยท Organization(s): The University of Hong Kong; Tongji University; LunarAI; MEGVII Technology
ยท ยท Description:
ยท ยท Tags: Dense
- ConvMAE: Masked Convolution Meets Masked Autoencoders (ConvMAE - NeurIPS22) [paper] [code]
More Info
ยท ยท Author(s): Peng Gao, Teli Ma, Hongsheng Li, Ziyi Lin, Jifeng Dai, Yu Qiao
ยท ยท Organization(s): Shanghai AI Laboratory; MMLab, CUHK; SenseTime Research
ยท ยท Description:
ยท ยท Tags:
- Green Hierarchical Vision Transformer for Masked Image Modeling (GreenMIM - NeurIPS22) [paper] [code]
More Info
ยท ยท Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
ยท ยท Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
ยท ยท Description:
ยท ยท Tags: Transformer
- SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders (SemMAE - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Gang Li, Heliang Zheng, Daqing Liu, Chaoyue Wang, Bing Su, Changwen Zheng
ยท ยท Organization(s): Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences; JD Explore Academy; Renmin University of China
ยท ยท Description:
ยท ยท Tags: Transformer
- Test-Time Training with Masked Autoencoders (TTT-MAE - NeurIPS22) [paper]
More Info
ยท ยท Author(s): Yossi Gandelsman, Yu Sun, Xinlei Chen, Alexei A. Efros
ยท ยท Organization(s): UC Berkeley; Meta AI
ยท ยท Description:
ยท ยท Tags: Transformer
- Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning (CMSF - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Kossar Pourahmadi, Akshayvarun Subramanya, Hamed Pirsiavash
ยท ยท Organization(s): University of California, Davis; University of Maryland
ยท ยท Description:
ยท ยท Tags: NN
- Relative Contrastive Loss for Unsupervised Representation Learning (RCL - ECCV22) [paper]
More Info
ยท ยท Author(s): Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, and Wanli Ouyang
ยท ยท Organization(s): University of Sydney et.al.
ยท ยท Description:
ยท ยท Tags: soft, clustering
- Improving Self-Supervised Lightweight Model Learning via Hard-Aware Metric Distillation (SMD - ECCV22 Oral) [paper] [code]
More Info
ยท ยท Author(s): Hao Liu, Mang Ye
ยท ยท Organization(s): Wuhan University; Beijing Institute of Technology
ยท ยท Description:
ยท ยท Tags: distillation
- Revisiting the Critical Factors of Augmentation-Invariant Representation Learning (**** - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Junqiang Huang, Xiangwen Kong, Xiangyu Zhang
ยท ยท Organization(s): MEGVII Technology
ยท ยท Description:
ยท ยท Tags: Analysis
- Towards Efficient and Effective Self-Supervised Learning of Visual Representations (EffSSL - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Sravanti Addepalli, Kaushal Bhogale, Priyam Dey, R.Venkatesh Babu
ยท ยท Organization(s): Indian Institute of Science
ยท ยท Description:
ยท ยท Tags:
- Understanding Collapse in Non-Contrastive Siamese Representation Learning (**** - ECCV22) [paper]
More Info
ยท ยท Author(s): Alexander C. Li, Alexei A. Efros, Deepak Pathakn
ยท ยท Organization(s): CMU; UCB
ยท ยท Description:
ยท ยท Tags:
- Masked Siamese Networks for Label-Efficient Learning (MSN - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski, Florian Bordes, Pascal Vincent, Armand Joulin, Michael Rabbat, Nicolas Ballas
ยท ยท Organization(s): Facebook AI Research; Mila โ Quebec AI Institute; Inria, Univ. Grenoble Alpes; Universite de Montreal; McGill University
ยท ยท Description:
ยท ยท Tags:
- Decoupled Contrastive Learning (DCL - ECCV22) [paper]
More Info
ยท ยท Author(s): Chun-Hsiao Yeh, Cheng-Yao Hong, Yen-Chi Hsu, Tyng-Luh Liu, Yubei Chen, Yann LeCun
ยท ยท Organization(s): IIS, Academia Sinica; UC Berkeley; National Taiwan University; Meta AI Research; New York University
ยท ยท Description:
ยท ยท Tags:
- Equivariance and Invariance Inductive Bias for
Learning from Insufficient Data (EqInv - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Tan Wang, Qianru Sun, Sugiri Pranata, Karlekar Jayashree, Hanwang Zhang
ยท ยท Organization(s): Nanyang Technological University; Singapore Management University; Panasonic R&D Center Singapore
ยท ยท Description:
ยท ยท Tags:
- Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches (Fast-MoCo - ECCV22) [paper]
More Info
ยท ยท Author(s): Yuanzheng Ci, Chen Lin, Lei Bai, Wanli Ouyang
ยท ยท Organization(s): The University of Sydney; University of Oxford; Shanghai AI Laboratory
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Visual Representation Learning by Synchronous Momentum Grouping (SMoG - ECCV22) [paper]
More Info
ยท ยท Author(s): Bo Pang, Yifan Zhang, Yaoyi Li, Jia Cai, Cewu Lu
ยท ยท Organization(s): Shanghai Jiao Tong University; HuaWei
ยท ยท Description:
ยท ยท Tags: Clustering, Contrastive Learning
- Self-Supervision Can Be a Good Few-Shot Learner (UniSiam - ECCV22) [paper]
More Info
ยท ยท Author(s): Yuning Lu, Liangjian Wen, Jianzhuang Liu, Yajing Liu, Xinmei Tian
ยท ยท Organization(s): University of Science and Technology of China; Huawei Noahโs Ark Lab; Hefei Comprehensive National Science Center
ยท ยท Description:
ยท ยท Tags: few-shot
- ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Images (ConCL - ECCV22) [paper]
More Info
ยท ยท Author(s): Jiawei Yang, Hanbo Chen, Yuan Liang, Junzhou Huang, Lei He, Jianhua Yao
ยท ยท Organization(s): Tencent AI Lab; UCLA; University of Texas at Arlington
ยท ยท Description:
ยท ยท Tags: dense, medical
- Dense Siamese Network for Dense Unsupervised Learning (DenseSiam - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Wenwei Zhang, Jiangmiao Pang, Kai Chen, Chen Change Loy
ยท ยท Organization(s): Nanyang Technological University; Shanghai AI Laboratory; SenseTime Research
ยท ยท Description:
ยท ยท Tags: dense
- Bootstrapped Masked Autoencoders for Vision BERT Pretraining (BootMAE - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu
ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research Asia; Microsoft Cloud + AI
ยท ยท Description:
ยท ยท Tags: transformer
- SdAE: Self-distillated Masked Autoencoder (SdAE - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Yabo Chen, Yuchen Liu, Dongsheng Jiang, Xiaopeng Zhang, Wenrui Dai, Hongkai Xiong, Qi Tian
ยท ยท Organization(s): Shanghai Jiao Tong University; Huawei Cloud EI
ยท ยท Description:
ยท ยท Tags: transformer
- Contrastive Vision-Language Pre-training with Limited Resources (ZeroVL - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): Quan Cui, Boyan Zhou, Yu Guo, Weidong Yin, Hao Wu, Osamu Yoshie, Yubo Chen
ยท ยท Organization(s): ByteDance; Waseda University
ยท ยท Description:
ยท ยท Tags: VL
- Tailoring Self-Supervision for Supervised Learning (LoRot - ECCV22) [paper] [code]
More Info
ยท ยท Author(s): WonJun Moon, Ji-Hwan Kim, Jae-Pil Heo
ยท ยท Organization(s): Sungkyunkwan University
ยท ยท Description:
ยท ยท Tags: supervised
- DisCo: Remedy Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning (DisCo - ECCV22 Oral) [paper] [code]
More Info
ยท ยท Author(s): Yuting Gao, Jia-Xin Zhuang, Shaohui Lin, Hao Cheng, Xing Sun, Ke Li, Chunhua Shen
ยท ยท Organization(s): Tencent Youtu Lab; Hong Kong University of Science and Technology; East China Normal University; Zhejiang University
ยท ยท Description:
ยท ยท Tags: Self-supervised Distillation
- Object discovery and representation networks (Odin - ECCV22) [paper]
More Info
ยท ยท Author(s): Olivier J. Hรฉnaff, Skanda Koppula, Evan Shelhamer, Daniel Zoran, Andrew Jaegle, Andrew Zisserman, Joรฃo Carreira, Relja Arandjeloviฤ
ยท ยท Organization(s): TDeepMind
ยท ยท Description:
ยท ยท Tags: Dense
- Position Prediction as an Effective Pretraining Strategy (MP3 - ICML22) [paper]
More Info
ยท ยท Author(s): Shuangfei Zhai, Navdeep Jaitly, Jason Ramapuram, Dan Busbridge, Tatiana Likhomanenko, Joseph Y Cheng, Walter Talbott, Chen Huang, Hanlin Goh, Joshua M Susskind
ยท ยท Organization(s): Apple Inc.
ยท ยท Description:
ยท ยท Tags: Transformer
- Boosting Contrastive Learning with Relation Knowledge Distillation (ReKD - AAAI22) [paper]
More Info
ยท ยท Author(s): Kai Zheng, Yuanjiang Wang, Ye Yuan
ยท ยท Organization(s): Megvii Technology
ยท ยท Description:
ยท ยท Tags: distill
- Masked Autoencoders Are Scalable Vision Learners (MAE - CVPR22 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollรกr, Ross Girshick
ยท ยท Organization(s): Facebook AI Research (FAIR)
ยท ยท Description:
ยท ยท Tags: Transformer
- SimMIM: A Simple Framework for Masked Image Modeling (SimMIM - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, Han Hu
ยท ยท Organization(s): Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: Transformer
- Crafting Better Contrastive Views for Siamese Representation Learning (ContrastiveCrop - CVPR22 Oral) [paper] [code]
More Info
ยท ยท Author(s): Xiangyu Peng, Kai Wang, Zheng Zhu, Mang Wang, Yang You
ยท ยท Organization(s): National University of Singapore; Tsinghua University; Alibaba Group
ยท ยท Description:
ยท ยท Tags:
- A Simple Data Mixing Prior for Improving Self-Supervised Learning (SDMP - CVPR22) [paper] [code]
More Info
ยท ยท Author(s): Sucheng Ren, Huiyu Wang, Zhengqi Gao, Shengfeng He, Alan Yuille, Yuyin Zhou, Cihang Xie
ยท ยท Organization(s): South China University of Technology; Johns Hopkins University; Massachusetts Institute of Technology; UC Santa Cruz
ยท ยท Description:
ยท ยท Tags: Interpolation
- On the Importance of Asymmetry for Siamese Representation Learning (asym-siam - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Xiao Wang, Haoqi Fan, Yuandong Tian, Daisuke Kihara, Xinlei Chen
ยท ยท Organization(s): Facebook AI Research (FAIR); Purdue University
ยท ยท Description:
ยท ยท Tags:
- HCSC: Hierarchical Contrastive Selective Coding (HCSC - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Yuanfan Guo, Minghao Xu, Jiawen Li, Bingbing Ni, Xuanyu Zhu, Zhenbang Sun, Yi Xu
ยท ยท Organization(s): MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University; 2Mila - Quยดebec AI Institute, University of Montrยดeal; ByteDance
ยท ยท Description:
ยท ยท Tags: Clustering
- Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning (BURN - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Dahyun Kim, Jonghyun Choi
ยท ยท Organization(s): Upstage AI Research; NAVER AI Lab.; Yonsei University
ยท ยท Description:
ยท ยท Tags:
- Unleashing Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification (UP-ReID - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Zizheng Yang, Xin Jin, Kecheng Zheng, Feng Zhao
ยท ยท Organization(s): University of Science and Technology of China
ยท ยท Description:
ยท ยท Tags:
- UniVIP: A Unified Framework for Self-Supervised Visual Pre-training (UniVIP - CVPR22) [paper] [
No code]More Info
ยท ยท Author(s): Zhaowen Li, Yousong Zhu, Fan Yang, Wei Li, Chaoyang Zhao, Yingying Chen, Zhiyang Chen, Jiahao Xie, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
ยท ยท Organization(s): National Laboratory of Pattern Recognition, Institute of Automation, CAS; School of Artificial Intelligence, University of Chinese Academy of Sciences; SenseTime Research; etc.
ยท ยท Description:
ยท ยท Tags:
- Semantic-Aware Auto-Encoders for Self-supervised Representation Learning (**** - CVPR22) [paper] [code]
More Info
ยท ยท Author(s): Guangrun Wang, Yansong Tang, Liang Lin, Philip H.S. Torr
ยท ยท Organization(s): University of Oxford; Tsinghua-Berkeley Shenzhen Institute, Tsinghua University; Sun Yat-sen University
ยท ยท Description:
ยท ยท Tags:
- Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views (**** - CVPR22) [paper] [
No code]More Info
ยท ยท Author(s): Junbo Zhang, Kaisheng Ma
ยท ยท Organization(s): Tsinghua University
ยท ยท Description:
ยท ยท Tags:
- Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy (LoGo - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Tong Zhang, Congpei Qiu, Wei Ke, Sabine Sรผsstrunk, Mathieu Salzmann
ยท ยท Organization(s): School of Computer and Communication Sciences, EPFL; Xiโan Jiaotong University
ยท ยท Description:
ยท ยท Tags:
- Learning Where to Learn in Cross-View Self-Supervised Learning (LEWEL - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
ยท ยท Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
ยท ยท Description:
ยท ยท Tags:
- Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework (**** - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Chenxin Tao, Honghui Wang, Xizhou Zhu, Jiahua Dong, Shiji Song, Gao Huang, Jifeng Dai
ยท ยท Organization(s): Tsinghua University; SenseTime Research; Zhejiang University; Beijing Academy of Artificial Intelligence
ยท ยท Description:
ยท ยท Tags:
- Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo (DT - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Chaoning Zhang, Kang Zhang, Trung X. Pham, Axi Niu, Zhinan Qiao, Chang D. Yoo, In So Kweon
ยท ยท Organization(s): KAIST; Northwestern Polytechnical University; University of North Texas
ยท ยท Description:
ยท ยท Tags:
- Directional Self-supervised Learning for Heavy Image Augmentations (DSSL - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Yalong Bai, Yifan Yang, Wei Zhang, Tao Mei
ยท ยท Organization(s): JD AI Research; Peking University
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Visual Representation Learning by Online Constrained K-Means (CoKe - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Qi Qian, Yuanhong Xu, Juhua Hu, Hao Li, Rong Jin
ยท ยท Organization(s): Alibaba Group, Bellevue; Alibaba Group, Hangzhou; University of Washington
ยท ยท Description:
ยท ยท Tags:
- Align Representations with Base: A New Approach to Self-Supervised Learning (ARB - CVPR22) [paper] [code]
More Info
ยท ยท Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
ยท ยท Organization(s): Shanghai Jiao Tong University; SenseTime Research
ยท ยท Description:
ยท ยท Tags:
- Exploring Set Similarity for Dense Self-supervised Representation Learning (SetSim - CVPR22) [paper] [
No code]More Info
ยท ยท Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
ยท ยท Organization(s): University of Sydney; Kuaishou Technology; Xidian University; University of Melbourne
ยท ยท Description:
ยท ยท Tags: Local representation
- Patch-level Representation Learning for Self-supervised Vision Transformers (SelfPatch - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Sukmin Yun, Hankook Lee, Jaehyung Kim, Jinwoo Shin
ยท ยท Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
ยท ยท Description:
ยท ยท Tags: Local representation
- Self-Supervised Learning of Object Parts for Semantic Segmentation (Leopart - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Adrian Ziegler, Yuki M. Asano
ยท ยท Organization(s): Technical University of Munich; QUVA Lab, University of Amsterdam
ยท ยท Description:
ยท ยท Tags: Local representation
- Point-Level Region Contrast for Object Detection Pre-Training (**** - CVPR22 Oral) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yutong Bai, Xinlei Chen, Alexander Kirillov, Alan Yuille, Alexander C. Berg
ยท ยท Organization(s): Facebook AI Research (FAIR); Johns Hopkins University
ยท ยท Description:
ยท ยท Tags: Local representation
- Use All The Labels: A Hierarchical Multi-Label Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Shu Zhang, Ran Xu, Caiming Xiong, Chetan Ramaiah
ยท ยท Organization(s): Salesforce Research
ยท ยท Description:
ยท ยท Tags: Label supervision
- Revisiting the Transferability of Supervised Pretraining: an MLP Perspective (**** - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yizhou Wang, Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, Donglian Qi, Wanli Ouyang
ยท ยท Organization(s): Zhejiang University; The University of Sydney; SenseTime Research; Shanghai Jiao Tong University
ยท ยท Description:
ยท ยท Tags: Label supervision
- Does Robustness on ImageNet Transfer to Downstream Tasks? (**** - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yutaro Yamada, Mayu Otani
ยท ยท Organization(s): Yale University; CyberAgent, Inc.
ยท ยท Description:
ยท ยท Tags: Analysis
- When Does Contrastive Visual Representation Learning Work? (**** - CVPR22) [paper] [
No code]More Info
ยท ยท Author(s): Elijah Cole, Xuan Yang, Kimberly Wilber, Oisin Mac Aodha, Serge Belongie
ยท ยท Organization(s): Caltech; Google; University of Edinburgh; Alan Turing Institute; University of Copenhagen
ยท ยท Description:
ยท ยท Tags: Analysis
- Rethinking Minimal Sufficient Representation in Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Haoqing Wang, Xun Guo, Zhi-Hong Deng, Yan Lu
ยท ยท Organization(s): Peking University; Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: Analysis
- Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning (**** - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Matthew Gwilliam, Abhinav Shrivastava
ยท ยท Organization(s): University of Maryland, College Park
ยท ยท Description:
ยท ยท Tags: Analysis
- DETReg: Unsupervised Pretraining with
Region Priors for Object Detection (DETReg - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Amir Bar, Xin Wang, Vadim Kantorov, Colorado J. Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson
ยท ยท Organization(s): Tel-Aviv University; Berkeley AI Research; NVIDIA; Bar-Ilan University; Microsoft Research
ยท ยท Description:
ยท ยท Tags: Transformer
- Masked Feature Prediction for Self-Supervised Visual Pre-Training (MaskFeat - CVPR22) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Chen Wei, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer
ยท ยท Organization(s): Facebook AI Research; Johns Hopkins University
ยท ยท Description:
ยท ยท Tags: Transformer
- Self-Taught Metric Learning without Labels (STML - CVPR22) [paper] [code] [supp]
More Info
ยท ยท Author(s): Sungyeon Kim, Dongwon Kim, Minsu Cho, Suha Kwak
ยท ยท Organization(s): FDept. of CSE, POSTECH; Graduate School of AI, POSTECH
ยท ยท Description:
ยท ยท Tags:
- CoDo: Contrastive Learning with Downstream Background Invariance for Detection (CoDo - CVPRW22) [paper] [
No code]More Info
ยท ยท Author(s): Bing Zhao, Jun Li, Hong Zhu
ยท ยท Organization(s): Department of AI and HPC Inspur Electronic Information Industry Co., Ltd
ยท ยท Description:
ยท ยท Tags: Local representation
- What Should Be Equivariant In Self-Supervised Learning (**** - CVPRW22) [paper] [
No code]More Info
ยท ยท Author(s): Yuyang Xie, Jianhong Wen, Kin Wai Lau, Yasar Abbas Ur Rehman, Jiajun Shen
ยท ยท Organization(s): TCL AI Lab; Fuzhou University; City University of Hong Kong
ยท ยท Description:
ยท ยท Tags: Analysis
- Where are my Neighbors? Exploiting Patches Relations in Self-Supervised Vision Transformer (**** - CVPRW22?) [paper] [code]
More Info
ยท ยท Author(s): Guglielmo Camporese, Elena Izzo, Lamberto Ballan
ยท ยท Organization(s): University of Padova, Italy
ยท ยท Description:
ยท ยท Tags:
- Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors (DUPR - TPAMI22) [paper] [
No code]More Info
ยท ยท Author(s): Jian Ding, Enze Xie, Hang Xu, Chenhan Jiang, Zhenguo Li, Ping Luo, Guidong Xia
ยท ยท Organization(s): Wuhan University; Huawei Noahโs Ark Lab; University of Hong Kong
ยท ยท Description:
ยท ยท Tags:
- Learning Generalized Transformation Equivariant Representations Via AutoEncoding Transformations (**** - TPAMI22) [paper] [
No code]More Info
ยท ยท Author(s): Guo-Jun Qi, Liheng Zhang, Feng Lin, Xiao Wang
ยท ยท Organization(s): Futurewei Seattle Cloud Lab; University of Central Florida; University of Science and Technology of China; Purdue University
ยท ยท Description:
ยท ยท Tags:
- Improving Transformation Invariance in Contrastive Representation Learning (InvCLR - ICLR21) [paper] [code]
More Info
ยท ยท Author(s): Adam Foster, Rattana Pukdee, Tom Rainforth
ยท ยท Organization(s): University of Oxford
ยท ยท Description:
ยท ยท Tags:
- Contrastive Learning with Hard Negative Samples (HCL - ICLR21) [paper] [code]
More Info
ยท ยท Author(s): Joshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie Jegelka
ยท ยท Organization(s): Massachusetts Institute of Technology
ยท ยท Description:
ยท ยท Tags: Hard negative
- Representation Learning via Invariant Causal Mechanisms (ReLIC - ICLR21) [paper]
More Info
ยท ยท Author(s): Jovana Mitrovic, Brian McWilliams, Jacob C Walker, Lars Holger Buesing, Charles Blundell
ยท ยท Organization(s): DeepMind
ยท ยท Description:
ยท ยท Tags: Analysis, Distribution
- i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning (i-Mix - ICLR21) [paper] [code]
More Info
ยท ยท Author(s): Kibok Lee, Yian Zhu, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin, Honglak Lee
ยท ยท Organization(s): University of Michigan; Amazon Web Services; Google Cloud AI; KAIST; LG AI Research
ยท ยท Description:
ยท ยท Tags: Interpolation
- What Should Not Be Contrastive in Contrastive Learning (LooC - ICLR21) [paper]
More Info
ยท ยท Author(s): Tete Xiao, Xiaolong Wang, Alexei A Efros, Trevor Darrell
ยท ยท Organization(s): UC Berkeley; UC San Diego
ยท ยท Description:
ยท ยท Tags:
- CO2: Consistent Contrast for Unsupervised Visual Representation Learning (CO2 - ICLR21) [paper]
More Info
ยท ยท Author(s): Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
ยท ยท Organization(s): Johns Hopkins University
ยท ยท Description:
ยท ยท Tags: Distribution
- What Makes Instance Discrimination Good for Transfer Learning? (**** - ICLR21) [paper]
More Info
ยท ยท Author(s): Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin
ยท ยท Organization(s): City University of Hong Kong; Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: Transfer
- SEED: Self-supervised Distillation For Visual Representation (SEED - ICLR21) [paper]
More Info
ยท ยท Author(s): Zhiyuan Fang, Jianfeng Wang, Lijuan Wang, Lei Zhang, Yezhou Yang, Zicheng Liu
ยท ยท Organization(s): Arizona State University; Microsoft Corporation
ยท ยท Description:
ยท ยท Tags: Self-supervised distillation
- Prototypical Contrastive Learning of Unsupervised Representations (PCL - ICLR21) [paper] [code]
More Info
ยท ยท Author(s): Junnan Li, Pan Zhou, Caiming Xiong, Steven Hoi
ยท ยท Organization(s): Salesforce Research
ยท ยท Description:
ยท ยท Tags: Clustering
- Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly (OSS - NeurIPS21) [paper]
More Info
ยท ยท Author(s): Hee Min Choi, Hyoa Kang, Dokwan Oh
ยท ยท Organization(s): Samsung Advanced Institute of Technology
ยท ยท Description:
ยท ยท Tags: distill
- Aligning Pretraining for Detection via Object-Level Contrastive Learning (SoCo - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Fangyun Wei, Yue Gao, Zhirong Wu, Han Hu, Stephen Lin
ยท ยท Organization(s): Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: local
- Unsupervised Object-Level Representation Learning
from Scene Images (ORL - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
ยท ยท Organization(s): Nanyang Technological University; The Chinese University of Hong Kong
ยท ยท Description:
ยท ยท Tags: local
- Object-aware Contrastive Learning for Debiased Scene Representation (ContraCAM - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Sangwoo Mo, Hyunwoo Kang, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin
ยท ยท Organization(s): KAIST; Google Cloud AI
ยท ยท Description:
ยท ยท Tags: contextual bias
- Intriguing Properties of Contrastive Losses (**** - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Ting Chen, Calvin Luo, Lala Li
ยท ยท Organization(s): Google Research
ยท ยท Description:
ยท ยท Tags:
- ReSSL: Relational Self-Supervised Learning with Weak Augmentation (ReSSL - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Mingkai Zheng, Shan You, Fei Wang, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
ยท ยท Organization(s): SenseTime Research; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
ยท ยท Description:
ยท ยท Tags:
- Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning (CARE - NeurIPS21) [paper] [code]
More Info
ยท ยท Author(s): Chongjian GE, Youwei Liang, YIBING SONG, Jianbo Jiao, Jue Wang, Ping Luo
ยท ยท Organization(s): The University of Hong Kong; Tencent AI Lab; University of Oxford
ยท ยท Description:
ยท ยท Tags:
- Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss (**** - NeurIPS21) [paper]
More Info
ยท ยท Author(s): Jeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu Ma
ยท ยท Organization(s): Stanford University; Toyota Research Institute
ยท ยท Description:
ยท ยท Tags:
- Improving Self-supervised Learning with Automated Unsupervised Outlier Arbitration (UOTA - NeurIPS21) [paper]
More Info
ยท ยท Author(s): Yu Wang, Jingyang Lin, Jingjing Zou, Yingwei Pan, Ting Yao, Tao Mei
ยท ยท Organization(s): JD AI Research; Sun Yat-sen University; University of California, San Diego
ยท ยท Description:
ยท ยท Tags:
- Compressive Visual Representations (**** - NeurIPS21) [paper]
More Info
ยท ยท Author(s): Kuang-Huei Lee, Anurag Arnab, Sergio Guadarrama, John Canny, Ian Fischer
ยท ยท Organization(s): Google Research
ยท ยท Description:
ยท ยท Tags: Compress
- MST: Masked Self-Supervised Transformer for Visual Representation (MST - NeurIPS21) [paper] [supp]
More Info
ยท ยท Author(s): Zhaowen Li, Zhiyang Chen, Fan Yang, Wei Li, Yousong Zhu, Chaoyang Zhao, Rui Deng, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
ยท ยท Organization(s): Institute of Automation, CAS; UCAS; SenseTime Research; UCLA
ยท ยท Description:
ยท ยท Tags: Transformer, MIM
- Exploring Simple Siamese Representation Learning (SimSiam - CVPR21 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Xinlei Chen, Kaiming He
ยท ยท Organization(s): Facebook AI Research (FAIR)
ยท ยท Description:
ยท ยท Tags: Siamese architecture
- Jigsaw Clustering for Unsupervised Visual Representation Learning (JigClu - CVPR21 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Pengguang Chen, Shu Liu, Jiaya Jia
ยท ยท Organization(s): The Chinese University of Hong Kong; SmartMore
ยท ยท Description:
ยท ยท Tags: Single branch
- OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning (OBoW - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Matthieu Cord, Patrick Perez
ยท ยท Organization(s): valeo.ai; University of Crete; Sorbonne Universitรฉ
ยท ยท Description:
ยท ยท Tags:
- Spatial Assembly Networks for Image Representation Learning (SAN - CVPR21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yang Li, Shichao Kan, Jianhe Yuan, Wenming Cao, Zhihai He
ยท ยท Organization(s): University of Missouri, MO; Beijing Jiaotong University; Shenzhen University
ยท ยท Description:
ยท ยท Tags:
- SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning (SelfAugment - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Colorado J Reed, Sean Metzger, Aravind Srinivas, Trevor Darrell, Kurt Keutzer
ยท ยท Organization(s): BAIR, Department of Computer Science, UC Berkeley; Graduate Group in Bioengineering (Berkeley/UCSF), Weill Neurosciences Institute & UCSF Neurological Surgery
ยท ยท Description:
ยท ยท Tags:
- Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement (PSL - CVPR21) [paper] [
No code]More Info
ยท ยท Author(s): Zefan Li, Chenxi Liu, Alan Yuille, Bingbing Ni, Wenjun Zhang, Wen Gao
ยท ยท Organization(s): Shanghai Jiao Tong University; Johns Hopkins University; Peking University; MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Pre-training for Person Re-identification (**** - CVPR21) [paper]
More Info
ยท ยท Author(s): Dengpan Fu, Dongdong Chen, Jianmin Bao, Hao Yang, Lu Yuan, Lei Zhang, Houqiang Li, Dong Chen
ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research
ยท ยท Description:
ยท ยท Tags: Dataset
- Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning (PixPro - CVPR21) [paper] [code]
More Info
ยท ยท Author(s): Zhenda Xie, Yutong Lin, Zheng Zhang, Yue Cao, Stephen Lin, Han Hu
ยท ยท Organization(s): Tsinghua University; Xiโan Jiaotong University; Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: Local representation
- How Well Do Self-Supervised Models Transfer? (**** - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Linus Ericsson, Henry Gouk, Timothy M. Hospedales
ยท ยท Organization(s): University of Edinburgh; Samsung AI Research, Cambridge
ยท ยท Description:
ยท ยท Tags: Analysis
- Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning (EMAN - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Zhaowei Cai, Avinash Ravichandran, Subhransu Maji, Charless Fowlkes, Zhuowen Tu, Stefano Soatto
ยท ยท Organization(s): Amazon Web Services
ยท ยท Description:
ยท ยท Tags:
- Dense Contrastive Learning for Self-Supervised Visual Pre-Training (DenseCL - CVPR21 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Xinlong Wang, Rufeng Zhang, Chunhua Shen, Tao Kong, Lei Li
ยท ยท Organization(s): The University of Adelaide; Tongji University; ByteDance AI Lab
ยท ยท Description:
ยท ยท Tags: Local representation
- Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination (CLD - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Xudong Wang, Ziwei Liu, Stella X. Yu
ยท ยท Organization(s): UC Berkeley / ICSI; S-Lab, NTU
ยท ยท Description:
ยท ยท Tags:
- AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries (AdCo - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Qianjiang Hu, Xiao Wang, Wei Hu, Guo-Jun Qi
ยท ยท Organization(s): Peking University; Purdue University; Laboratory for MAchine Perception and LEarning (MAPLE)
ยท ยท Description:
ยท ยท Tags:
- CASTing Your Model: Learning to Localize Improves Self-Supervised Representations (CAST - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Ramprasaath R. Selvaraju, Karan Desai, Justin Johnson, Nikhil Naik
ยท ยท Organization(s): Salesforce Research; University of Michigan
ยท ยท Description:
ยท ยท Tags:
- Instance Localization for Self-supervised Detection Pretraining (InsLoc - CVPR21) [paper] [code]
More Info
ยท ยท Author(s): Ceyuan Yang, Zhirong Wu, Bolei Zhou, Stephen Lin
ยท ยท Organization(s): Chinese University of Hong Kong; Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags:
- PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering (PiCIE - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Jang Hyun Cho, Utkarsh Mall, Kavita Bala, Bharath Hariharan
ยท ยท Organization(s): University of Texas at Austin; Cornell University
ยท ยท Description:
ยท ยท Tags: Unsupervised semantic segmentation
- Self-supervised Augmentation Consistency for Adapting Semantic Segmentation (SAC - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Nikita Araslanov, Stefan Roth
ยท ยท Organization(s): Department of Computer Science, TU Darmstadt; hessian.AI
ยท ยท Description:
ยท ยท Tags: Domain adaptation
- Spatially Consistent Representation Learning (SCRL - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Byungseok Roh, Wuhyun Shin, Ildoo Kim, Sungwoong Kim
ยท ยท Organization(s): Kakao Brain
ยท ยท Description:
ยท ยท Tags: Local representation
- UP-DETR: Unsupervised Pre-training for Object Detection with Transformers (UP-DETR - CVPR21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen
ยท ยท Organization(s): School of Software Engineering, South China University of Technology; Tencent Wechat AI; Key Laboratory of Big Data and Intelligent Robot
ยท ยท Description:
ยท ยท Tags:
- Understanding the Behaviour of Contrastive Loss (**** - CVPR21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Feng Wang, Huaping Liu
ยท ยท Organization(s): Beijing National Research Center for Information Science and Technology(BNRist), Department of Computer Science and Technology, Tsinghua University
ยท ยท Description:
ยท ยท Tags: Analysis
- Unsupervised Hyperbolic Metric Learning (**** - CVPR21) [paper] [code]
More Info
ยท ยท Author(s): Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang
ยท ยท Organization(s): Xidian University; University of Pittsburgh; JD Finance America Corporation, Mountain View
ยท ยท Description:
ยท ยท Tags: Metric Learning
- Relative Order Analysis and Optimization for Unsupervised Deep Metric Learning (ROUL - CVPR21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Shichao Kan, Yigang Cen, Yang Li, Vladimir Mladenovic, Zhihai He
ยท ยท Organization(s): Beijing Jiaotong University; Beijing Key Laboratory of Advanced Information Science and Network Technology; University of Missouri; Faculty of Technical Sciences University of Kragujevac
ยท ยท Description:
ยท ยท Tags: Metric Learning
- Distill on the Go: Online Knowledge Distillation in Self-Supervised Learning (DoGo - CVPRW21) [paper]
More Info
ยท ยท Author(s): Prashant Bhat, Elahe Arani, Bahram Zonooz
ยท ยท Organization(s): Advanced Research Lab, NavInfo Europe, Eindhoven, The Netherlands
ยท ยท Description:
ยท ยท Tags: distill
- DetCo: Unsupervised Contrastive Learning for Object Detection (DetCo - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Enze Xie, Jian Ding, Wenhai Wang, Xiaohang Zhan, Hang Xu, Peize Sun, Zhenguo Li, Ping Luo
ยท ยท Organization(s): The University of Hong Kong; Huawei Noahโs Ark Lab; Wuhan University; Nanjing University; Chinese University of Hong Kong
ยท ยท Description:
ยท ยท Tags:
- Divide and Contrast: Self-supervised Learning from Uncurated Data (DnC - ICCV21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yonglong Tian, Olivier J. Hรฉnaff, Aรคron van den Oord
ยท ยท Organization(s): MIT; DeepMind
ยท ยท Description:
ยท ยท Tags: Uncurated data
- Improve Unsupervised Pretraining for Few-label Transfer (**** - ICCV21) [paper] [
No code]More Info
ยท ยท Author(s): Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Visual Representations Learning by Contrastive Mask Prediction (MaskCo - ICCV21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yucheng Zhao, Guangting Wang, Chong Luo, Wenjun Zeng, Zheng-Jun Zha
ยท ยท Organization(s): University of Science and Technology of China; Microsoft Research Asia
ยท ยท Description:
ยท ยท Tags: Local representation
- Mean Shift for Self-Supervised Learning (MSF - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
ยท ยท Organization(s): University of Maryland, Baltimore County; University of California, Davis
ยท ยท Description:
ยท ยท Tags: Positive discovery
- On Compositions of Transformations in Contrastive Self-Supervised Learning (GDT - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Mandela Patrick, Yuki M. Asano, Polina Kuznetsova, Ruth Fong, Joรฃo F. Henriques, Geoffrey Zweig, Andrea Vedaldi
ยท ยท Organization(s): Facebook AI Research; Visual Geometry Group, University of Oxford
ยท ยท Description:
ยท ยท Tags:
- On Feature Decorrelation in Self-Supervised Learning (Shuffled-DBN - ICCV21) [paper] [
No code]More Info
ยท ยท Author(s): Tianyu Hua, Wenxiao Wang, Zihui Xue, Sucheng Ren, Yue Wang, Hang Zhao
ยท ยท Organization(s): Tsinghua University; Shanghai Qi Zhi Institute; UT Austin; MIT; South China University of Technology
ยท ยท Description:
ยท ยท Tags:
- Self-supervised Product Quantization for Deep Unsupervised Image Retrieval (SPQ - ICCV21) [paper] [code]
More Info
ยท ยท Author(s): Young Kyun Jang, Nam Ik Cho
ยท ยท Organization(s): Department of ECE, INMC, Seoul National University
ยท ยท Description:
ยท ยท Tags:
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations (NNCLR - ICCV21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Debidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet, Andrew Zisserman
ยท ยท Organization(s): Google Research; DeepMind
ยท ยท Description:
ยท ยท Tags:
- Contrasting Contrastive Self-Supervised Representation Learning Pipelines (ViRB - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
ยท ยท Organization(s): PRIOR @ Allen Institute for AI; University of Washington
ยท ยท Description:
ยท ยท Tags: Analysis
- ISD: Self-Supervised Learning by Iterative Similarity Distillation (ISD - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Vipin Pillai, Paolo Favaro, Hamed Pirsiavash
ยท ยท Organization(s): University of Maryland, Baltimore County; University of Bern; University of California, Davis
ยท ยท Description:
ยท ยท Tags:
- CDS: Cross-Domain Self-supervised Pre-training (CDS - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Donghyun Kim, Kuniaki Saito, Tae-Hyun Oh, Bryan A. Plummer, Stan Sclaroff, Kate Saenko
ยท ยท Organization(s): Boston University; POSTECH; MIT-IBM Watson AI Lab
ยท ยท Description:
ยท ยท Tags:
- Collaborative Unsupervised Visual Representation Learning from Decentralized Data (FedU - ICCV21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang, Shuai Yi
ยท ยท Organization(s): S-Lab, Nanyang Technological University; Nanyang Technological University; SenseTime Research
ยท ยท Description:
ยท ยท Tags:
- Weakly Supervised Contrastive Learning (WCL - ICCV21) [paper] [code]
More Info
ยท ยท Author(s): Mingkai Zheng, Fei Wang, Shan You, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
ยท ยท Organization(s): SenseTime Research; University of Science and Technology of China; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Representation Learning from Flow Equivariance (FlowE - ICCV21) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Yuwen Xiong, Mengye Ren, Wenyuan Zeng, Raquel Urtasun
ยท ยท Organization(s): Waabi; University of Toronto
ยท ยท Description:
ยท ยท Tags:
- Vi2CLR: Video and Image for Visual Contrastive Learning of Representation (Vi2CLR - ICCV21) [paper] [
No code]More Info
ยท ยท Author(s): Ali Diba, Vivek Sharma, Reza Safdari, Dariush Lotfi, Saquib Sarfraz, Rainer Stiefelhagen, Luc Van Gool
ยท ยท Organization(s): KU Leuven; Sensifai; Karlsruhe Institute of Technology; Daimler TSS; Massachusetts Institute of Technology; Harvard Medical School; ETH Zurich
ยท ยท Description:
ยท ยท Tags:
- Solving Inefficiency of Self-supervised Representation Learning (truncated triplet - ICCV21) [paper] [code]
More Info
ยท ยท Author(s): Guangrun Wang, Keze Wang, Guangcong Wang, Philip H.S. Torr, Liang Lin
ยท ยท Organization(s): Sun Yat-sen University; University of Oxford; Nanyang Technological University; DarkMatter AI Research
ยท ยท Description:
ยท ยท Tags:
- Instance Similarity Learning for Unsupervised Feature Representation (ISL - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Ziwei Wang, Yunsong Wang, Ziyi Wu, Jiwen Lu, Jie Zhou
ยท ยท Organization(s): Tsinghua University; State Key Lab of Intelligent Technologies and Systems; Beijing National Research Center for Information Science and Technology
ยท ยท Description:
ยท ยท Tags:
- Improving Contrastive Learning by Visualizing Feature Transformation (**** - ICCV21 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun, Chang Wen Chen
ยท ยท Organization(s): The Chinese University of HongKong, Shenzhen; JD AI Research; Tongji University; The Hong Kong Polytechnic University
ยท ยท Description:
ยท ยท Tags:
- Temporal Knowledge Consistency for Unsupervised Visual Representation Learning (TKC - ICCV21 Oral) [paper] [
No code] [supp]More Info
ยท ยท Author(s): Weixin Feng, Yuanjiang Wang, Lihua Ma, Ye Yuan, Chi Zhang
ยท ยท Organization(s): Beijing University of Posts and Telecommunications; Megvii Technology
ยท ยท Description:
ยท ยท Tags:
- MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving (MultiSiam - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Kai Chen, Lanqing Hong, Hang Xu, Zhenguo Li, Dit-Yan Yeung
ยท ยท Organization(s): Hong Kong University of Science and Technology; Huawei Noahโs Ark Lab
ยท ยท Description:
ยท ยท Tags: Local representation
- Region Similarity Representation Learning(ReSim - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Tete Xiao, Colorado J Reed, Xiaolong Wang, Kurt Keutzer, Trevor Darrell
ยท ยท Organization(s): UC Berkeley; UC San Diego
ยท ยท Description:
ยท ยท Tags:
- Efficient Visual Pretraining With Contrastive Detection(DetCon - ICCV21) [paper] [supp]
More Info
ยท ยท Author(s): Olivier J. Hรฉnaff, Skanda Koppula, Jean-Baptiste Alayrac, Aaron van den Oord, Oriol Vinyals, Joรฃo Carreira
ยท ยท Organization(s): DeepMind
ยท ยท Description:
ยท ยท Tags: Dense
- An Empirical Study of Training Self-Supervised Vision Transformers(MoCo-v3 - ICCV21) [paper] [unofficial code] [supp]
More Info
ยท ยท Author(s): Xinlei Chen, Saining Xie, Kaiming He
ยท ยท Organization(s): Facebook AI Research (FAIR)
ยท ยท Description:
ยท ยท Tags:
- Emerging Properties in Self-Supervised Vision Transformers(DINO - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Mathilde Caron, Hugo Touvron, Ishan Misra, Hervรฉ Jรฉgou, Julien Mairal, Piotr Bojanowski, Armand Joulin
ยท ยท Organization(s): Facebook AI Research; Inriaโ; Sorbonne University
ยท ยท Description:
ยท ยท Tags:
- A Broad Study on the Transferability of Visual Representations with Contrastive Learning (**** - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Ashraful Islam, Chun-Fu (Richard) Chen, Rameswar Panda, Leonid Karlinsky, Richard Radke, Rogerio Feris
ยท ยท Organization(s): Rensselaer Polytechnic Institute; MIT-IBM Watson AI Lab; IBM Research
ยท ยท Description:
ยท ยท Tags:
- Concept Generalization in Visual Representation Learning (CoG - ICCV21) [paper] [code] [supp]
More Info
ยท ยท Author(s): Mert Bulent Sariyildiz, Yannis Kalantidis, Diane Larlus, Karteek Alahari
ยท ยท Organization(s): NAVER LABS Europe; Inria
ยท ยท Description:
ยท ยท Tags:
- Concurrent Discrimination and Alignment for Self-Supervised Feature Learning (CODIAL - ICCVW21) [paper] [code]
More Info
ยท ยท Author(s): Anjan Dutta, Massimiliano Mancini, Zeynep Akata
ยท ยท Organization(s): University of Exeter; University of Tยจubingen
ยท ยท Description:
ยท ยท Tags:
- A critical analysis of self-supervision, or what we can learn from a single image (**** - ICLR20 ) [paper]
More Info
ยท ยท Author(s): Asano YM., Rupprecht C., Vedaldi A.
ยท ยท Organization(s): VGG, University of Oxford
ยท ยท Description:
ยท ยท Tags: Analysis
- On Mutual Information Maximization for Representation Learning (**** - ICLR20 ) [paper]
More Info
ยท ยท Author(s): Michael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly, Mario Lucic
ยท ยท Organization(s): Google Research
ยท ยท Description:
ยท ยท Tags: Analysis
- Self-labelling via simultaneous clustering and representation learning (SeLa - ICLR20 Spotlight) [paper] [code]
More Info
ยท ยท Author(s): Asano YM., Rupprecht C., Vedaldi A.
ยท ยท Organization(s): VGG, University of Oxford
ยท ยท Description:
ยท ยท Tags: Clustering
- Unsupervised Learning of Dense Visual Representations (VADeR - NeurIPS20) [paper]
More Info
ยท ยท Author(s): Pedro O. O. Pinheiro, Amjad Almahairi, Ryan Benmalek, Florian Golemo, Aaron C. Courville
ยท ยท Organization(s): Element AI; Cornell University; Mila, Universitรฉ de Montrรฉal; CIFAR Fellow
ยท ยท Description:
ยท ยท Tags: Dense
- CompRess: Self-Supervised Learning by Compressing Representations (CompRess - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
ยท ยท Organization(s): University of Maryland
ยท ยท Description:
ยท ยท Tags: self-supervised distillation
- Unsupervised Representation Learning by Invariance Propagation (InvPro - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Feng Wang, Huaping Liu, Di Guo, Sun Fuchun
ยท ยท Organization(s): Tsinghua University
ยท ยท Description:
ยท ยท Tags:
- Joint Contrastive Learning with Infinite Possibilities (JCL - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Qi Cai, Yu Wang, Yingwei Pan, Ting Yao, Tao Mei
ยท ยท Organization(s): University of Science and Technology of China; JD AI Research
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Learning of Visual Features by Contrasting Cluster Assignments (SwAV - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, Armand Joulin
ยท ยท Organization(s): Inria; Facebook AI Research
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Visual Representation Learning from Hierarchical Grouping (**** - NeurIPS20) [paper]
More Info
ยท ยท Author(s): Xiao Zhang, Michael Maire
ยท ยท Organization(s): University of Chicago
ยท ยท Description:
ยท ยท Tags: Pixel, Local
- Parametric Instance Classification for Unsupervised Visual Feature learning (PIC - NeurIPS20) [paper]
More Info
ยท ยท Author(s): Yue Cao, Zhenda Xie, Bin Liu, Yutong Lin, Zheng Zhang, Han Hu
ยท ยท Organization(s): Microsoft Research Asia; Tsinghua University; Xiโan Jiaotong University
ยท ยท Description:
ยท ยท Tags:
- Hard Negative Mixing for Contrastive Learning (MoCHi - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Yannis Kalantidis, Mert Bulent Sariyildiz, Noe Pion, Philippe Weinzaepfel, Diane Larlus
ยท ยท Organization(s): NAVER LABS Europe
ยท ยท Description:
ยท ยท Tags:
- What Makes for Good Views for Contrastive Learning? (InfoMin - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, Phillip Isola
ยท ยท Organization(s): MIT; Google Research
ยท ยท Description:
ยท ยท Tags:
- Debiased Contrastive Learning (DCL - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Ching-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba, Stefanie Jegelka
ยท ยท Organization(s): Massachusetts Institute of Technology
ยท ยท Description:
ยท ยท Tags: False negative
- Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning (BYOL - NeurIPS20) [paper] [code]
More Info
ยท ยท Author(s): Jean-Bastien Grill, Florian Strub, Florent Altchรฉ, Corentin Tallec, Pierre Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Guo, Mohammad Gheshlaghi Azar, Bilal Piot, koray kavukcuoglu, Remi Munos, Michal Valko
ยท ยท Organization(s): DeepMind; Imperial College
ยท ยท Description:
ยท ยท Tags: Siamese architecture
- MixCo: Mix-up Contrastive Learning for Visual Representation (MixCo - NeurIPSW20) [paper] [code]
More Info
ยท ยท Author(s): Sungnyun Kim, Gihun Lee, Sangmin Bae, Se-Young Yun
ยท ยท Organization(s): KAIST
ยท ยท Description:
ยท ยท Tags:
- Improved Baselines with Momentum Contrastive Learning (MoCo v2 - arXiv20) [paper] [code]
More Info
ยท ยท Author(s): Xinlei Chen, Haoqi Fan, Ross Girshick, Kaiming He
ยท ยท Organization(s): Facebook AI Research (FAIR)
ยท ยท Description:
ยท ยท Tags: InfoNCE loss, siamese architecture
- Momentum Contrast for Unsupervised Visual Representation Learning (MoCo - CVPR20 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick
ยท ยท Organization(s): Facebook AI Research (FAIR)
ยท ยท Description: Building a dynamic dictionary with a queue and a moving-averaged encoder
ยท ยท Tags: InfoNCE loss, siamese architecture
- Online Deep Clustering for Unsupervised Representation Learning (ODC - CVPR20 Oral) [paper] [code]
More Info
ยท ยท Author(s): Xiaohang Zhan, Jiahao Xie, Ziwei Liu, Yew-Soon Ong, Chen Change Loy
ยท ยท Organization(s): CUHK - SenseTime Joint Lab, The Chinese University of Hong Kong; Nanyang Technological University; AI3, A*STAR
ยท ยท Description:
ยท ยท Tags:
- Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics (LCI - CVPR20) [paper] [code] [supp]
More Info
ยท ยท Author(s): Simon Jenni, Hailin Jin, Paolo Favaro
ยท ยท Organization(s): University of Bern; Adobe Research
ยท ยท Description:
ยท ยท Tags:
- Learning Representations by Predicting Bags of Visual Words (BoWNet - CVPR20) [paper] [code] [supp]
More Info
ยท ยท Author(s): Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Perez, Matthieu Cord
ยท ยท Organization(s): Valeo.ai; University of Crete
ยท ยท Description:
ยท ยท Tags:
- Probabilistic Structural Latent Representation for Unsupervised Embedding (PSLR - CVPR20) [paper] [code]
More Info
ยท ยท Author(s): Mang Ye, Jianbing Shen
ยท ยท Organization(s): Inception Institute of Artificial Intelligence
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Learning of Pretext-Invariant Representations (PIRL - CVPR20) [paper] [unofficial code]
More Info
ยท ยท Author(s): Ishan Misra, Laurens van der Maaten
ยท ยท Organization(s): Facebook AI Research
ยท ยท Description:
ยท ยท Tags:
- How Useful is Self-Supervised Pretraining for Visual Tasks? (**** - CVPR20) [paper] [code] [supp]
More Info
ยท ยท Author(s): Alejandro Newell, Jia Deng
ยท ยท Organization(s): Princeton University
ยท ยท Description:
ยท ยท Tags: Analysis
- SCAN: Learning to Classify Images without Labels (SCAN - ECCV20) [paper] [code] [arxiv]
More Info
ยท ยท Author(s): Wouter Van Gansbeke, Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Luc Van Gool
ยท ยท Organization(s): KU Leuven/ESAT-PSI; ETH Zurich/CVL, TRACE
ยท ยท Description:
ยท ยท Tags:
- Contrastive Multiview Coding (CMC - ECCV20) [paper] [code] [arxiv]
More Info
ยท ยท Author(s): Yonglong Tian, Dilip Krishnan, Phillip Isola
ยท ยท Organization(s): MIT CSAIL; Google Research
ยท ยท Description:
ยท ยท Tags:
- Mitigating Embedding and Class Assignment Mismatch in Unsupervised Image Classification (**** - ECCV20) [paper] [code] [
No arxiv]More Info
ยท ยท Author(s): Sungwon Han, Sungwon Park, Sungkyu Park, Sundong Kim, Meeyoung Cha
ยท ยท Organization(s): Korea Advanced Institute of Science and Technology; Data Science Group, Institute for Basic Science
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Deep Metric Learning with Transformed Attention Consistency and Contrastive Clustering Loss (**** - ECCV20) [paper] [
No code]More Info
ยท ยท Author(s): Yang Li, Shichao Kan, Zhihai He
ยท ยท Organization(s): University of Missouri; Beijing Jiaotong University
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Image Classification for Deep
Representation Learning (**** - ECCVW20) [paper] [
No code] [arxiv]More Info
ยท ยท Author(s): Weijie Chen, Shiliang Pu, Di Xie, Shicai Yang, Yilu Guo, Luojun Lin
ยท ยท Organization(s): Hikvision Research Institute; School of Electronic and Information Engineering, South China University of Technology
ยท ยท Description:
ยท ยท Tags:
- Learning deep representations by mutual information estimation and maximization (DIM - ICLR19 Oral) [paper]
More Info
ยท ยท Author(s): R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, Yoshua Bengio
ยท ยท Organization(s): MSR Montreal; MILA; UdeM; IVADO; UNM; U Toronto
ยท ยท Description:
ยท ยท Tags:
- Learning Representations by Maximizing Mutual Information Across Views (AMDIM - NeurIPS19) [paper] [code]
More Info ยท ยท Author(s): Philip Bachman, R Devon Hjelm, William Buchwalte
ยท ยท Organization(s): Microsoft Research
ยท ยท Description:
ยท ยท Tags:
- Large Scale Adversarial Representation Learning (BigBiGAN - NeurIPS19) [paper]
More Info ยท ยท Author(s): Jeff Donahue, Karen Simonyan
ยท ยท Organization(s): DeepMind
ยท ยท Description:
ยท ยท Tags: Generative
- Unsupervised Embedding Learning via Invariant and Spreading Instance Feature (ISIF - CVPR19) [paper] [code]
More Info
ยท ยท Author(s): Mang Ye, Xu Zhang, Pong C. Yuen, Shih-Fu Chang
ยท ยท Organization(s): Hong Kong Baptist University; Columbia University
ยท ยท Description: Learning augmentation invariant and instance spread-out features
ยท ยท Tags: Siamese architecture
- Self-Supervised Representation Learning by Rotation Feature Decoupling (FeatureDecoupling - CVPR19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Zeyu Feng, Chang Xu, Dacheng Tao
ยท ยท Organization(s): UBTECH Sydney AI Centre, School of Computer Science; University of Sydney
ยท ยท Description:
ยท ยท Tags:
- Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning (**** - CVPR19) [paper] [
No code]More Info
ยท ยท Author(s): Chen Wei, Lingxi Xie, Xutong Ren, Yingda Xia, Chi Su, Jiaying Liu, Qi Tian, Alan L. Yuille
ยท ยท Organization(s): Peking University; The Johns Hopkins University; Kingsoft; Huawei Noahโs Ark Lab
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised GANs via Auxiliary Rotation Loss (SS-GAN - CVPR19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
ยท ยท Organization(s): University of California, Los Angeles; Google Brain
ยท ยท Description:
ยท ยท Tags: GAN
- AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data (AET - CVPR19) [paper] [code]
More Info
ยท ยท Author(s): Liheng Zhang, Guo-Jun Qi, Liqiang Wang, Jiebo Luo
ยท ยท Organization(s): Huawei Cloud; University of Central Florida; University of Rochester
ยท ยท Description:
ยท ยท Tags:
- Revisiting Self-Supervised Visual Representation Learning (**** - CVPR19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Alexander Kolesnikov, Xiaohua Zhai, Lucas Beyer
ยท ยท Organization(s): Google Brain
ยท ยท Description:
ยท ยท Tags: Revisiting
- Local Aggregation for Unsupervised Learning of Visual Embeddings (LA - ICCV19 Oral) [paper] [code] [supp]
More Info
ยท ยท Author(s): Chengxu Zhuang, Alex Lin Zhai, Daniel Yamins
ยท ยท Organization(s): Stanford University
ยท ยท Description:
ยท ยท Tags: Clustering
- S4L: Self-Supervised Semi-Supervised Learning (S4L - ICCV19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, Lucas Beyer
ยท ยท Organization(s): Google Research, Brain Team
ยท ยท Description:
ยท ยท Tags:
- AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational Transformations (AVT - ICCV19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Guo-Jun Qi, Liheng Zhang, Chang Wen Chen, Qi Tian
ยท ยท Organization(s): G1Laboratory for MAchine Perception and LEarning (MAPLE); Huawei Cloud; Huawei Noahโs Ark Lab; The Chinese University of Hong Kong at Shenzhen and Peng Cheng Laboratory
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Representation Learning via Neighborhood-Relational Encoding (NRE - ICCV19) [paper] [
No code]More Info
ยท ยท Author(s): Mohammad Sabokrou, Mohammad Khalooei, Ehsan Adeli
ยท ยท Organization(s): Institute for Research in Fundamental Sciences; Amirkabir University of Tech.; Stanford University
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Pre-Training of Image Features on Non-Curated Data (DeeperCluster - ICCV19) [paper] [code] [supp]
More Info
ยท ยท Author(s): Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin
ยท ยท Organization(s): Facebook AI Research; Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK
ยท ยท Description:
ยท ยท Tags: Clustering
- Scaling and Benchmarking Self-Supervised Visual Representation Learning (**** - ICCV19) [paper] [code]
More Info
ยท ยท Author(s): Priya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan Misra
ยท ยท Organization(s): Facebook AI Research
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Representation Learning by Predicting Image Rotations (RotNet - ICLR18) [paper] [code]
More Info
ยท ยท Author(s): Spyros Gidaris, Praveer Singh, Nikos Komodakis
ยท ยท Organization(s): University Paris-Est; Ecole des Ponts ParisTech
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Feature Learning via Non-Parametric Instance Discrimination ( InsDis - CVPR18 Spotlight) [paper] [code]
More Info
ยท ยท Author(s): Zhirong Wu, Yuanjun Xiong, Stella X. Yu, Dahua Lin
ยท ยท Organization(s): UC Berkeley/ICSI; Chinese University of Hong Kong; Amazon Rekognition
ยท ยท Description:
ยท ยท Tags: Contrastive learning, single branch
- Improvements to context based self-supervised learning ( **** - CVPR18) [paper] [code] [supp]
More Info
ยท ยท Author(s): T. Nathan Mundhenk, Daniel Ho, Barry Y. Chen
ยท ยท Organization(s): Lawrence Livermore National Laboratory; University of California, Berkeley
ยท ยท Description:
ยท ยท Tags:
- Self-Supervised Feature Learning by Learning to Spot Artifacts ( **** - CVPR18) [paper] [code]
More Info
ยท ยท Author(s): Simon Jenni, Paolo Favaro
ยท ยท Organization(s): University of Bern
ยท ยท Description:
ยท ยท Tags:
- Boosting Self-Supervised Learning via Knowledge Transfer ( **** - CVPR18) [paper] [
No code]More Info
ยท ยท Author(s): Mehdi Noroozi, Ananth Vinjimoor, Paolo Favaro, Hamed Pirsiavash
ยท ยท Organization(s): University of Bern; University of Maryland, Baltimore County
ยท ยท Description:
ยท ยท Tags: Self-supervised Distillation
- Deep Clustering for Unsupervised Learning of Visual Features ( DeepCluster - ECCV18) [paper] [code]
More Info
ยท ยท Author(s): Caron, Mathilde and Bojanowski, Piotr and Joulin, Armand and Douze, Matthijs
ยท ยท Organization(s): Facebook AI Research
ยท ยท Description:
ยท ยท Tags:
- Adversarial Feature Learning (BiGANs - ICLR18) [paper]
More Info
ยท ยท Author(s): Jeff Donahue, Philipp Krรคhenbรผhl, Trevor Darrell
ยท ยท Organization(s): University of California, Berkeley; University of Texas, Austin
ยท ยท Description:
ยท ยท Tags:
- Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction (Split-Brain Auto - CVPR17 ) [paper] [code]
More Info
ยท ยท Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
ยท ยท Organization(s): Berkeley AI Research (BAIR) Laboratory, University of California, Berkeley
ยท ยท Description:
ยท ยท Tags: Pretext task
- Representation Learning by Learning to Count (**** - ICCV17 ) [paper] [unofficial code]
More Info
ยท ยท Author(s): Mehdi Noroozi, Hamed Pirsiavash, Paolo Favaro
ยท ยท Organization(s): University of Bern; University of Maryland, Baltimore County
ยท ยท Description:
ยท ยท Tags: Pretext task
- Transitive Invariance for Self-supervised Visual Representation Learning (**** - ICCV17 ) [paper] [
No code]More Info
ยท ยท Author(s): Xiaolong Wang, Kaiming He, Abhinav Gupta
ยท ยท Organization(s): Carnegie Mellon University; Facebook AI Research
ยท ยท Description:
ยท ยท Tags:
- Multi-task Self-Supervised Visual Learning (**** - ICCV17 ) [paper] [code]
More Info
ยท ยท Author(s): Carl Doersch, Andrew Zisserman
ยท ยท Organization(s): DeepMind; VGG, Department of Engineering Science, University of Oxford
ยท ยท Description:
ยท ยท Tags:
- Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks (ExemplarCNN - TPAMI16 ) [paper]
More Info
ยท ยท Author(s): Alexey Dosovitskiy, Philipp Fischer, Jost Tobias Springenberg, Martin Riedmiller, Thomas Brox
ยท ยท Organization(s): Computer Science Department, University of Freiburg
ยท ยท Description:
ยท ยท Tags: Pretext task, Instance Discrimination
- Context Encoders: Feature Learning by Inpainting (Inpainting - CVPR16 ) [paper] [unofficial code]
More Info
ยท ยท Author(s): Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, Alexei A. Efros
ยท ยท Organization(s): University of California, Berkeley
ยท ยท Description:
ยท ยท Tags: Pretext task
- Unsupervised Learning of Discriminative Attributes and Visual Representations (**** - CVPR16 ) [paper] [
No code]More Info
ยท ยท Author(s): Chen Huang, Chen Change Loy, Xiaoou Tang
ยท ยท Organization(s): The Chinese University of Hong Kong; SenseTime Group Limited; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles (Jigsaw - ECCV16 ) [paper] [unofficial code] [arxiv]
More Info
ยท ยท Author(s): Mehdi Noroozi, Paolo Favaro
ยท ยท Organization(s): Institute for Informatiks, University of Bern
ยท ยท Description:
ยท ยท Tags: Pretext task
- Unsupervised Visual Representation Learning
by Graph-based Consistent Constraints (**** - ECCV16 ) [paper] [
No code]More Info
ยท ยท Author(s): Dong Li, Wei-Chih Hung, Jia-Bin Huang, Shengjin Wang, Narendra Ahuja; Ming-Hsuan Yang
ยท ยท Organization(s): Tsinghua University; University of California, Merced; University of Illinois, Urbana-Champaign
ยท ยท Description:
ยท ยท Tags:
- Colorful Image Colorization (**** - ECCV16 ) [paper] [code]
More Info
ยท ยท Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
ยท ยท Organization(s): University of California, Berkeley
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Visual Representation Learning by Context Prediction (Context - ICCV15 ) [paper] [code]
More Info
ยท ยท Author(s): Carl Doersch, Abhinav Gupta, Alexei A. Efros
ยท ยท Organization(s): Institute for Informatiks, University of Bern
ยท ยท Description:
ยท ยท Tags: Pretext task
- Learning to See by Moving (**** - ICCV15 ) [paper] [code]
More Info
ยท ยท Author(s): Pulkit Agrawal, Joao Carreira, Jitendra Malik
ยท ยท Organization(s): UC Berkeley
ยท ยท Description:
ยท ยท Tags:
- Unsupervised Learning of Visual Representations using Videos (**** - ICCV15 ) [paper] [unofficial code]
More Info
ยท ยท Author(s): Xiaolong Wang, Abhinav Gupta
ยท ยท Organization(s): Robotics Institute, Carnegie Mellon University
ยท ยท Description:
ยท ยท Tags:
- Discriminative Unsupervised Feature Learning with Convolutional Neural Networks (ExemplarCNN - NeurIPS14 ) [paper] [unofficial code] [supp]
More Info
ยท ยท Author(s): Alexey Dosovitskiy, Jost Tobias Springenberg, Martin A. Riedmiller, Thomas Brox
ยท ยท Organization(s): Computer Science Department, University of Freiburg
ยท ยท Description:
ยท ยท Tags: Pretext task, Instance Discrimination
UVRL is also closely related to some other research directions, such as Unsupervised Person (Object or Vehicle) Re-Identification, Unsupervised Semantic Segmentation, Unsupervised Domain Adaptation, Knowledge Distillation, Deep Clustering, Unsupervised Metric (Embedding) Learning, Semi-supervised Learning, Novel Categories (Classes) Discovery, etc.
-
awesome-self-supervised-learning (star 5.6k) [link]
-
Awesome-Knowledge-Distillation (star 2.2k) [link]
-
DeepClustering (star 2.4k) [link]
-
awesome-metric-learning [link]
-
Awesome-Unsupervised-Person-Re-identification [link]
-
Awesome-Novel-Class-Discovery [link]
Thanks for the support of Prof. Yu Zhou.