Attention Mechanism

Entity Type: Glossary ID: attention-mechanism

Definition: A technique that allows neural networks to focus on specific parts of the input when producing output. Attention mechanisms help models handle long sequences more effectively by learning which parts of the input are most relevant.

Related Terms: - self-attention - multi-head-attention - transformer - sequence-to-sequence

Source Urls: - https://en.wikipedia.org/wiki/Attention_(machine_learning)

Tags: - neural-networks - attention - sequence-modeling

Status: active

Version: 1.0.0

Created At: 2025-08-31

Last Updated: 2025-08-31