Technical

Fine-Tuning

The process of further training a pre-trained model on a smaller, task-specific dataset to adapt it for particular use cases.

Explained at five levels

Level 1

Teaching an AI that already knows a lot to be extra good at one special thing — like a dog that learns a new trick.

Level 2

Taking an AI that's already been trained on general stuff and giving it extra training on specific topics so it becomes an expert.

Level 3

The process of further training a pre-trained model on a smaller, task-specific dataset to adapt it for particular use cases.

Level 4

Continued training of a pre-trained foundation model on domain-specific or task-specific data, often with modified learning rates, to specialize its capabilities while preserving general knowledge.

Level 5

Parameter adaptation of a pre-trained model via gradient updates on a downstream objective — encompassing full fine-tuning, LoRA, prefix tuning, and RLHF, each navigating the plasticity-stability tradeoff differently.

Definitions are educational summaries. Terminology can vary by source and context.

Sources