Fine-tuning a language model on datasets of instructions paired with appropriate responses.
Fine-tuning a language model on datasets of instructions paired with appropriate responses. This teaches the model to follow directions rather than just predict the next word. The step that transforms a base language model into a useful assistant. InstructGPT was one of the first major examples.
The process of taking a pre-trained model and continuing to train it on a smaller, specific dataset to adapt it for a particular task or domain.
Reinforcement Learning from Human Feedback.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
The research field focused on making sure AI systems do what humans actually want them to do.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.