ultralytics-ascend/docs/reference/nn/modules/transformer.md

description	keywords
Learn about Ultralytics transformer encoder, layer, MLP block, LayerNorm2d and the deformable transformer decoder layer. Expand your understanding of these crucial AI modules.	Ultralytics, Ultralytics documentation, TransformerEncoderLayer, TransformerLayer, MLPBlock, LayerNorm2d, DeformableTransformerDecoderLayer

Reference for ultralytics/nn/modules/transformer.py

!!! note

Full source code for this file is available at [https://github.com/ultralytics/ultralytics/blob/main/ultralytics/nn/modules/transformer.py](https://github.com/ultralytics/ultralytics/blob/main/ultralytics/nn/modules/transformer.py). Help us fix any issues you see by submitting a [Pull Request](/help/contributing/) 🛠️. Thank you 🙏!

---

::: ultralytics.nn.modules.transformer.TransformerEncoderLayer

---

::: ultralytics.nn.modules.transformer.AIFI

---

::: ultralytics.nn.modules.transformer.TransformerLayer

---

::: ultralytics.nn.modules.transformer.TransformerBlock

---

::: ultralytics.nn.modules.transformer.MLPBlock

---

::: ultralytics.nn.modules.transformer.MLP

---

::: ultralytics.nn.modules.transformer.LayerNorm2d

---

::: ultralytics.nn.modules.transformer.MSDeformAttn

---

::: ultralytics.nn.modules.transformer.DeformableTransformerDecoderLayer

---

::: ultralytics.nn.modules.transformer.DeformableTransformerDecoder