The idea that useful AI comes from learning good internal representations of data.
The idea that useful AI comes from learning good internal representations of data. Instead of hand-crafting features, let the model discover them. Embeddings, latent spaces, and hidden layer activations are all learned representations. The quality of these representations largely determines model performance.
A dense numerical representation of data (words, images, etc.
The process of identifying and pulling out the most important characteristics from raw data.
A subset of machine learning that uses neural networks with many layers (hence 'deep') to learn complex patterns from large amounts of data.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.