(七十四):A Survey of Visual Transformers
- Abstract
- 1. Introduction
- II. ORIGINAL TRANSFORMER
-
- A. Attention Mechanism
- B. Multi-Head Attention Mechanism
- C. Position-wise Feed-Forward Networks
- D. Positional Encoding
- E. Transformer Model
- III. TRANSFORMER FOR CLASSIFICATION
-
- A. Original Visual Transformer
- B. Transformer Enhanced CNN