Pre-training

Entity Type: Glossary ID: pre-training

Definition: The initial training phase where a model learns general patterns from large amounts of unlabeled data before being fine-tuned for specific tasks. Pre-training enables transfer learning and is fundamental to modern large language models.

Related Terms: - fine-tuning - transfer-learning - self-supervised-learning - foundation-model

Source Urls: - https://en.wikipedia.org/wiki/Transfer_learning#Pre-training

Tags: - training - transfer-learning - foundation-models

Status: active

Version: 1.0.0

Created At: 2025-08-31

Last Updated: 2025-08-31