A dense numerical representation of data (words, images, etc.) in a continuous vector space. Similar items end up close together in this space. Word embeddings capture meaning — 'king' minus 'man' plus 'woman' equals something close to 'queen.' Essential for search, recommendation, and RAG systems.
A database optimized for storing and searching high-dimensional vectors (embeddings).
One of the earliest successful word embedding models, from Google in 2013.
Search that understands meaning and intent rather than just matching keywords.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.