README

Ultimate-Awesome-Transformer-Attention 

This repo contains a comprehensive paper list of Vision Transformer & Attention, including papers, codes, and related websites. 
This list is maintained by Min-Hung Chen. (Actively keep updating)

If you find some ignored papers, feel free to create pull requests, open issues, or email me.  
Contributions in any form to make this list more comprehensive are welcome.

If you find this repository useful, please consider citing and ★STARing this list. 
Feel free to share this list with others! 

[Update: January, 2024] Added all the related papers from NeurIPS 2023! 
[Update: December, 2023] Added all the related papers from ICCV 2023! 
[Update: September, 2023] Split the multi-modal paper list to README_multimodal.md 
[Update: June, 2023] Added all the related papers from ICML 2023! 
[Update: June, 2023] Added all the related papers from CVPR 2023! 
[Update: February, 2023] Added all the related papers from ICLR 2023! 
[Update: December, 2022] Added attention-free papers from Networks Beyond Attention (GitHub) made by Jianwei Yang 
[Update: November, 2022] Added all the related papers from NeurIPS 2022! 
[Update: October, 2022] Split the 2nd half of the paper list to README_2.md 
[Update: October, 2022] Added all the related papers from ECCV 2022! 
[Update: September, 2022] Added the Transformer tutorial slides made by Lucas Beyer! 
[Update: June, 2022] Added all the related papers from CVPR 2022!

---
 Overview

- Citation
- Survey
- Image Classification / Backbone
    - Replace Conv w/ Attention
        - Pure Attention
        - Conv-stem + Attention
        - Conv + Attention
    - Vision Transformer
        - General Vision Transformer
        - Efficient Vision Transformer
        - Conv + Transformer
        - Training + Transformer
        - Robustness + Transformer
        - Model Compression + Transformer
    - Attention-Free
        - MLP-Series
        - Other Attention-Free
    - Analysis for Transformer
- Detection
    - Object Detection
    - 3D Object Detection
    - Multi-Modal Detection
    - HOI Detection
    - Salient Object Detection
    - Other Detection Tasks
- Segmentation
    - Semantic Segmentation
    - Depth Estimation
    - Object Segmentation
    - Other Segmentation Tasks
- Video (High-level)
    - Action Recognition
    - Action Detection/Localization
    - Action Prediction/Anticipation
    - Video Object Segmentation
    - Video Instance Segmentation
    - Other Video Tasks
- References
 
------ (The following papers are moved to README_multimodal.md) ------

- Multi-Modality
    - Visual Captioning
    - Visual Question Answering
    - Visual Grounding
    - Multi-Modal Representation Learning
    - Multi-Modal Retrieval
    - Multi-Modal Generation
    - Prompt Learning/Tuning
    - Visual Document Understanding
    - Other Multi-Modal Tasks

------ (The following papers are moved to README_2.md) ------

- Other High-level Vision Tasks
    - Point Cloud / 3D
    - Pose Est