179 questions
No questions match those filters.
← All questions
Training & Fine-tuningMedium· SFT· Instruction Tuning· Model Behavior
What does SFT actually change in a pre-trained model?
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansSupervised Fine-Tuning (SFT) primarily modifies the surface properties of the output distribution, including format, register, and task framing. It does not add new world knowledge to the model. Instead, it acts as an installation of routing mechanisms that trigger the latent capabilities already existing within the pre-trained base model. This effect is significant even with small datasets, where quality is more important than quantity.