AI Glossary
A comprehensive encyclopedia of artificial intelligence and context management terminology — with definitions, in-depth articles, and authoritative sources.
Attention Mechanism
Also known as: Self-Attention, Scaled Dot-Product Attention, Multi-Head Attention
A neural network component that allows models to selectively focus on the most relevant parts of their input, dynamically weighting the importance of different elements in a sequence.
Neural Network
Also known as: ANN, Artificial Neural Network
A computing system inspired by biological neural networks, consisting of interconnected nodes (neurons) organized in layers that process information using learnable weights and activation functions.
Transformer
Also known as: Transformer Architecture, Transformer Model
A neural network architecture based on self-attention mechanisms that processes input sequences in parallel, forming the foundation of virtually all modern large language models.
3 terms under "Architecture"