[
  {
    "path": "README.md",
    "content": "# Awesome-Contrastive-Learning\n\nNote: \"*\" refers to official code.\n\n## Computer Vision\n### 2021\n* [Investigating the Role of Negatives in\nContrastive Representation Learning](https://arxiv.org/abs/2106.09943), Jordan T. Ash, 2021\n* [Contrastive Semi-Supervised Learning for 2D Medical Image Segmentation](https://arxiv.org/abs/2106.06801), Prashant Pandey, MICCAI-2021\n* [Contrastive Learning with Hard Negative Samples](https://arxiv.org/abs/2010.04592), Joshua Robinson, ICLR2021, [[pytorch](https://github.com/joshr17/HCL)*]\n\n### 2020\n* [Contrastive Representation Learning: A Framework and Review](https://arxiv.org/abs/2010.05113), Phuc H. Le-Khac\n* [Supervised Contrastive Learning](https://arxiv.org/abs/2004.11362), Prannay Khosla, 2020, [[pytorch*](https://github.com/HobbitLong/SupContrast)]\n* [A Simple Framework for Contrastive Learning of Visual Representations](https://arxiv.org/abs/2002.05709), Ting Chen, 2020, [[pytroch](https://github.com/sthalles/SimCLR), [tensorflow*](https://github.com/google-research/simclr)]\n* [Improved Baselines with Momentum Contrastive Learning](https://arxiv.org/abs/2003.04297), Xinlei Chen, 2020, [[tensorflow](https://github.com/ppwwyyxx/moco.tensorflow)]\n* [Contrastive Representation Distillation](https://arxiv.org/abs/1910.10699), Yonglong Tian, ICLR-2020 [[pytorch*](https://github.com/HobbitLong/RepDistiller)]\n* [COBRA: Contrastive Bi-Modal Representation Algorithm](https://arxiv.org/ftp/arxiv/papers/2005/2005.03687.pdf), Vishaal Udandarao, 2020\n* [What makes for good views for contrastive learning](https://arxiv.org/abs/2005.10243), Yonglong Tian, 2020\n* [Prototypical Contrastive Learning of Unsupervised Representations](https://arxiv.org/pdf/2005.04966.pdf), Junnan Li, 2020\n* [Contrastive Multi-View Representation Learning on Graphs](https://arxiv.org/abs/2006.05582), Kaveh Hassani, 2020\n* [On Mutual Information in Contrastive Learning for Visual Representations](https://arxiv.org/abs/2005.13149), Mike Wu, 2020\n* [Semi-Supervised Contrastive Learning with Generalized Contrastive Loss and Its Application to Speaker Recognition](https://arxiv.org/abs/2006.04326), Nakamasa Inoue, 2020\n* [Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere](https://arxiv.org/abs/2005.10242),Tongzhou Wang, ICML2020, [[pytorch](https://github.com/SsnL/align_uniform)*]\n\n### 2019\n* [Momentum Contrast for Unsupervised Visual Representation Learning](https://arxiv.org/abs/1911.05722), Kaiming He, 2019, [[pytorch](https://github.com/peisuke/MomentumContrast.pytorch)]\n* [Data-Efficient Image Recognition with Contrastive Predictive Coding](https://arxiv.org/abs/1905.09272), Olivier J. Hénaff, 2019\n* [Contrastive Multiview Coding](https://arxiv.org/abs/1906.05849), Yonglong Tian, 2019, [[pytorch*](https://github.com/HobbitLong/CMC/)]\n* [Learning deep representations by mutual information estimation and maximization](https://arxiv.org/abs/1808.06670), R Devon Hjelm, ICLR-2019, [[pytorch](https://github.com/rdevon/DIM*)]\n* [Contrastive Adaptation Network for Unsupervised Domain Adaptation](http://openaccess.thecvf.com/content_CVPR_2019/papers/Kang_Contrastive_Adaptation_Network_for_Unsupervised_Domain_Adaptation_CVPR_2019_paper.pdf), Guoliang Kang, CVPR-2019\n\n\n### 2018\n* [Representation learning with contrastive predictive coding](https://arxiv.org/abs/1807.03748), Aaron van den Oord, 2018, [[pytorch](https://github.com/jefflai108/Contrastive-Predictive-Coding-PyTorch)]\n* [Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination](https://arxiv.org/abs/1805.01978), Zhirong Wu, CVPR-2018, [[pytorch*](https://github.com/zhirongw/lemniscate.pytorch)]\n* [Adversarial Contrastive Estimation](https://arxiv.org/abs/1805.03642), Avishek Joey Bose, ACL-2018,\n\n\n### 2017\n* [Time-Contrastive Networks: Self-Supervised Learning from Video](https://arxiv.org/abs/1704.06888), Pierre Sermanet, CVPR-2017\n* [Contrastive Learning for Image Captioning](http://papers.nips.cc/paper/6691-contrastive-learning-for-image-captioning), Bo Dai, NeurIPS-2017, [[lua*](https://github.com/doubledaibo/clcaption_nips2017)]\n\n\n### Before 2017\n* [Noise-contrastive estimation for answer selection with deep neural networks](https://dl.acm.org/doi/abs/10.1145/2983323.2983872), Jinfeng Rao, 2016, [[torch](https://github.com/castorini/NCE-CNN-Torch)]\n* [Improved Deep Metric Learning with Multi-class N-pair Loss Objective](https://papers.nips.cc/paper/6200-improved-deep-metric-learning-with-multi-class-n-pair-loss-objective), Kihyuk Sohn, NeurIPS-2016, [[pytorch](https://github.com/ChaofWang/Npair_loss_pytorch)]\n* [Learning word embeddings efficiently with noise-contrastive estimation](http://papers.nips.cc/paper/5165-learning-word-embeddings), Andriy Mnih, NeurIPS-2013, \n* [Noise-contrastive estimation: A new estimation principle for unnormalized statistical models](http://proceedings.mlr.press/v9/gutmann10a/gutmann10a.pdf?source=post_page---------------------------), Michael Gutmann, AISTATS 2010, [[pytorch](https://github.com/demelin/Noise-Contrastive-Estimation-NCE-for-pyTorch)]\n* [Dimensionality Reduction by Learning an Invariant Mapping](http://yann.lecun.com/exdb/publis/pdf/hadsell-chopra-lecun-06.pdf), Raia Hadsell, 2006\n\n## Natural Language Processing\n### 2021  \n* [SimCSE: Simple Contrastive Learning of Sentence Embeddings](https://arxiv.org/abs/2104.08821), Tianyu Gao, 2021, [[pytorch](https://github.com/princeton-nlp/SimCSE)*]\n* [ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer](https://arxiv.org/abs/2105.11741), Yuanmeng Yan, ACL2021, [[pytorch](https://github.com/yym6472/ConSERT)*]\n* [DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations](https://arxiv.org/abs/2006.03659), John Giorgi, ACL2021, [[pytorch](https://github.com/JohnGiorgi/DeCLUTR)*]\n* [Coco-lm: Correcting and contrasting text sequences\nfor language model pretraining](https://arxiv.org/abs/2102.08473), Yu Meng, 2021,  [[pytorch](https://github.com/lucidrains/coco-lm-pytorch)*]\n* [Semantic Re-tuning with Contrastive Tension](https://openreview.net/forum?id=Ov_sMNau-PF), Fredrik Carlsson, ICLR2021, [[Tensorflow](https://github.com/FreddeFrallan/Contrastive-Tension)*]\n\n### 2020\n* [CLEAR: Contrastive Learning for Sentence Representation](https://arxiv.org/abs/2012.15466), Zhuofeng Wu, 2020\n* [An Unsupervised Sentence Embedding Method by Mutual Information Maximization](https://www.aclweb.org/anthology/2020.emnlp-main.124.pdf), Yan Zhang, EMNLP2020, [[pytorch](https://github.com/yanzhangnlp/IS-BERT)*]\n* [Cert: Contrastive self-supervised learning for language under- standing](), \n\n### Before 2017  \n\n* [Efficient estimation of word representations in vector space](https://arxiv.org/abs/1301.3781), Tomas Mikolov, ICLR-Workshop 2013 \n"
  }
]