Attention Mechanism Transformer-Model Attention Mechanism In transformers Model Types of Attention Mechanism Dot Product Attention. self attention bidirectional attention multihead attention