One of the earliest successful word embedding models, from Google in 2013.
One of the earliest successful word embedding models, from Google in 2013. It learned vector representations where similar words have similar vectors. Famous for finding that 'king - man + woman = queen.' While superseded by contextual embeddings, it proved that distributed representations capture meaning.
A dense numerical representation of data (words, images, etc.
Natural Language Processing.
The idea that useful AI comes from learning good internal representations of data.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.