Tutorial on Self-Supervised Contrastive Representation Learning: Session 2

Tushar Agarwal
Tushar Agarwal
Session 2 of Tutorial on Self-Supervised Contrastive Representation Learning within SENSE-Lab group at Ohio State University. ...
Session 2 of Tutorial on Self-Supervised Contrastive Representation Learning within SENSE-Lab group at Ohio State University.

References:

1. Weng, Lilian, and Jong Wook Kim. “SSL Tutorial by OpenAI at NeurIPS 2021.” December 6, 2021. https://neurips.cc/media/neurips-2021....
2. Jaiswal, Ashish, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, and Fillia Makedon. “A Survey on Contrastive Self-Supervised Learning.” ArXiv:2011.00362 [Cs], February 7, 2021. http://arxiv.org/abs/2011.00362.
3. Zhou, Hang, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, and Ziwei Liu. “Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation.” ArXiv:2104.11116 [Cs, Eess], April 22, 2021. http://arxiv.org/abs/2104.11116.
4. Gideon, John, and Simon Stent. “The Way to My Heart Is Through Contrastive Learning: Remote Photoplethysmography From Unlabelled Video,” 3995–4004, 2021. https://openaccess.thecvf.com/content....
5. Gidaris, Spyros, Praveer Singh, and Nikos Komodakis. “Unsupervised Representation Learning by Predicting Image Rotations.” ArXiv:1803.07728 [Cs], March 20, 2018. http://arxiv.org/abs/1803.07728.
6. Esser, Patrick, Robin Rombach, and Björn Ommer. “Taming Transformers for High-Resolution Image Synthesis.” ArXiv:2012.09841 [Cs], June 23, 2021. http://arxiv.org/abs/2012.09841.
7. Tian, Yonglong, Dilip Krishnan, and Phillip Isola. “Contrastive Multiview Coding.” ArXiv:1906.05849 [Cs], December 18, 2020. http://arxiv.org/abs/1906.05849.
8. Tian, Yonglong. Presentation, “Contrastive Learning: A General Self-Supervised Learning Approach.” June 30, 2020. Yonglong Tian - Contrastive Learning:....
9. Chen, Ting, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. “A Simple Framework for Contrastive Learning of Visual Representations.” ArXiv:2002.05709 [Cs, Stat], June 30, 2020. http://arxiv.org/abs/2002.05709.
10. Sohn, Kihyuk. “Improved Deep Metric Learning with Multi-Class N-Pair Loss Objective.” In Advances in Neural Information Processing Systems, Vol. 29. Curran Associates, Inc., 2016. https://papers.nips.cc/paper/2016/has....
11. Kaya, Mahmut, and Hasan Şakir Bi̇lge. “Deep Metric Learning: A Survey.” Symmetry 11, no. 9 (September 2019): 1066. https://doi.org/10.3390/sym11091066.
12. Oord, Aaron van den, Yazhe Li, and Oriol Vinyals. “Representation Learning with Contrastive Predictive Coding.” ArXiv:1807.03748 [Cs, Stat], January 22, 2019. http://arxiv.org/abs/1807.03748.
13. Wu, Zhirong, Yuanjun Xiong, Stella Yu, and Dahua Lin. “Unsupervised Feature Learning via Non-Parametric Instance-Level Discrimination.” ArXiv:1805.01978 [Cs], May 4, 2018. http://arxiv.org/abs/1805.01978.
14. He, Kaiming, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. “Momentum Contrast for Unsupervised Visual Representation Learning.” ArXiv:1911.05722 [Cs], March 23, 2020. http://arxiv.org/abs/1911.05722.

همه توضیحات ...