Vision Transformers (ViT) for Self-Supervised Representation Learning (Part 1)

Here I am summarizing the recent works done on Vision Transformers (ViT) in the Self-Supervised (SSL) and Unsupervised Learning field to keep you updated. Vision transformers are becoming very popular these days. They are being used in many fields, including object detection, segmentation and representation learning. Therefore, I think it is important to know what has been going on recently. Therefore, I am summarizing some of the works I found on the Internet. However, I cannot include all the details, such as experiments…