When you fine-tune, you're adjusting the model's weights to increase probability of your desired outputs. The model learns patterns in your data.
If your data always ends responses with "Let me know if you need anything else," the model learns to do that. If your data uses formal language, the model becomes formal. The model mirrors what you show it. This is why data quality matters more than quantity.