Follow this decision process:
Can prompting solve it? Try - examples in your prompt. If yes, stop here.
Do you need external knowledge? If yes, implement RAG.
Is the problem behavior or style? If yes, fine-tuning is your answer.
Do you have high-quality data? If no, go back to step and improve your prompts.
Can you afford compute and maintenance? If yes, proceed with fine-tuning.