Fine-Tuning vs. Prompting vs. RAG: Choosing the Right Tool

The short version

There is a version of this conversation that stays at the level of frameworks, and a version that deals with what actually happens on a Tuesday afternoon. This is the second kind.

The second-order effects matter more than the first. A change that improves one metric usually degrades another, and the teams that do this well are the ones who name the counter-metric before they start rather than after someone complains.

Where teams get it wrong

Finally, there is the question of who pays and who benefits. When those are different groups, adoption stalls regardless of how good the design is. Aligning them is unglamorous work and it is usually the work that matters.

Scale changes the answer. What works for a fifty-person team fails at five hundred, not because the idea was wrong but because the coordination cost grew faster than the benefit.

A practical approach

The second-order effects matter more than the first. A change that improves one metric usually degrades another, and the teams that do this well are the ones who name the counter-metric before they start rather than after someone complains.

Start with the constraint rather than the ambition. In most Indian organisations the binding constraint is not talent or budget — it is the absence of a clear owner. Once a named person carries the outcome, the sequencing question tends to answer itself.

What to do next

Scale changes the answer. What works for a fifty-person team fails at five hundred, not because the idea was wrong but because the coordination cost grew faster than the benefit.