[{"data":1,"prerenderedAt":457},["ShallowReactive",2],{"post-\u002Fdoes-enterprise-ai-really-need-fine-tuning":3},{"page":4,"translation":325,"nav":327,"related":445,"random":451},{"id":5,"title":6,"body":7,"categories":297,"category":300,"changeHistory":300,"date":301,"description":302,"disclosures":300,"draft":303,"extension":304,"image":305,"imageAlt":306,"kind":307,"lang":308,"meta":309,"navigation":310,"path":311,"publishedAt":300,"readingTime":312,"rights":300,"seo":313,"seoTitle":314,"slug":315,"sources":300,"stem":315,"tags":316,"translationKey":322,"type":323,"updated":300,"__hash__":324},"posts\u002Fdoes-enterprise-ai-really-need-fine-tuning.md","Does Enterprise AI Really Need Fine-Tuning?",{"type":8,"value":9,"toc":288},"minimark",[10,43,46,49,52,55,58,61,76,81,84,87,90,93,97,100,103,106,109,112,116,130,133,136,139,142,146,149,152,161,165,168,246,249,264,272,275,278,281],[11,12,13,21],"blockquote",{},[14,15,16,17],"p",{},"💡 ",[18,19,20],"strong",{},"TL;DR: Key Takeaways",[22,23,24,31,37],"ul",{},[25,26,27,30],"li",{},[18,28,29],{},"Do not put changing facts into model weights."," Use direct context for a few documents, RAG for a large and changing source collection, and an API or database for live records.",[25,32,33,36],{},[18,34,35],{},"Keep explicit business rules in software."," Training a model to reproduce a refund deadline or permission boundary makes an auditable rule unnecessarily uncertain.",[25,38,39,42],{},[18,40,41],{},"Fine-tuning makes sense when the model must learn a durable pattern from examples."," First show that simpler methods fall short, then test the adapted model on held-out data and measure the complete business outcome.",[14,44,45],{},"A customer asks whether a device you sell works at minus 10 degrees. The answer is clearly stated on its one-page technical data sheet.",[14,47,48],{},"Would you fine-tune a model to answer that question?",[14,50,51],{},"You should not. Give the model the relevant data sheet, or the relevant passage, together with the question. If there are two or three source documents, they can go into the same context.",[14,53,54],{},"The situation changes when the document set runs into the thousands, the content changes often, or each user has different access rights. The system must then find the right source before it gives the relevant passage to the model. That search-and-retrieval job is what RAG, or retrieval-augmented generation, is for.",[14,56,57],{},"Neither direct context nor RAG changes the model's training. The model uses a current source while answering. When the data sheet changes, you update the document instead of retraining the model.",[14,59,60],{},"So when does fine-tuning make sense?",[14,62,63,64,67,68,71,72,75],{},"The answer depends on what is missing from the system: ",[18,65,66],{},"information",", an ",[18,69,70],{},"explicit rule",", or a ",[18,73,74],{},"pattern that has to be learned from examples",".",[77,78,80],"h2",{"id":79},"do-not-train-a-model-on-information-that-is-already-in-a-document","Do not train a model on information that is already in a document",[14,82,83],{},"Many enterprise AI systems need access to information. The model may need to know product specifications, a current price, a return policy, or the status of a customer's order.",[14,85,86],{},"When the information sits in one or a few short sources, it can be provided directly. As the number of sources and users grows, RAG, enterprise search, a database query, or an API may become the better option. The right choice depends on where the information lives, how often it changes, and who is allowed to see it.",[14,88,89],{},"Fine-tuning is usually an unnecessary detour here. Information a model saw during training is not guaranteed to be current or used correctly in every answer. Providing the source at the time of the request also makes it easier to see what the answer is based on.",[14,91,92],{},"The same distinction applies to company rules. “Returns are accepted within 30 days” may be information. “If the deadline has passed, route the request to an agent” is an explicit business rule. It may be more reliable and auditable to define that rule in software than to teach it to a model through examples.",[77,94,96],{"id":95},"sometimes-the-answer-is-not-in-a-document","Sometimes the answer is not in a document",[14,98,99],{},"Consider a retailer trying to forecast next month's demand. It may have historical sales, promotions, seasonality, holidays, and stock levels. But no document contains next month's sales figure.",[14,101,102],{},"The system has to learn relationships in past examples and produce a forecast for a new period. Training a model makes sense here. That model may be a time-series model, a classical machine-learning method, or another purpose-built forecasting system. It does not have to be a fine-tuned large language model.",[14,104,105],{},"This distinction matters. “Training a model” and “fine-tuning an LLM” are not the same decision. The first covers any model that learns a pattern from historical data. The second adapts a pretrained model to a narrower task using specific examples.",[14,107,108],{},"Fine-tuning becomes worth considering when a model has the right information and clear instructions, yet keeps making the same behavioural error. It may repeatedly classify incoming text incorrectly, extract required fields inconsistently, or break the requested output structure. Representative input-and-output examples can improve performance on such a narrow task.",[14,110,111],{},"Even then, start with the right model, clear instructions, the necessary context, and a few good examples. If those do not reach the required quality, use a test set that can show whether the failure really comes from model behaviour before evaluating fine-tuning.",[77,113,115],{"id":114},"a-real-example-of-where-fine-tuning-belongs","A real example of where fine-tuning belongs",[14,117,118,129],{},[119,120,128],"a",{"href":121,"rel":122,"target":125,"className":126},"https:\u002F\u002Fwww.nature.com\u002Farticles\u002Fs41591-024-02933-8",[123,124],"nofollow","noopener","_blank",[127],"dofollow","MEDIC",", a system developed to reduce errors in prescription directions at Amazon Pharmacy, draws the boundary well.",[14,131,132],{},"Prescription directions written by clinicians can express the same information in many different ways. The system needs to identify parts such as the use verb, dose, route of administration, and frequency. The answer is not waiting in a single technical document. The system needs to recognise the same fields across many forms of free text.",[14,134,135],{},"The researchers used a small DistilBERT model adapted with roughly one thousand expert-labelled examples for that task. The model extracts the relevant parts of a prescription. Software then checks those parts against pharmacy rules and drug databases. When information is missing or contradictory, the system stops rather than producing a recommendation. Technicians and pharmacists retain the final review.",[14,137,138],{},"During MEDIC's deployment at Amazon Pharmacy, the researchers reported a 33% reduction in prescription-direction near misses: errors caught before an incorrect direction reached the patient. The result is limited to one organisation and task, but it makes an important point. Fine-tuning did not replace a current source of information. It improved the system's ability to extract consistent fields from free-form text.",[14,140,141],{},"Another finding from the study is equally useful. A larger T5 model fine-tuned on 1.5 million examples kept confidently generating directions in difficult cases instead of recognising its limits. MEDIC's result did not come from an adapted model alone. A narrow model task, explicit stopping conditions, verification sources, and human review worked together.",[77,143,145],{"id":144},"rag-and-fine-tuning-are-not-competitors","RAG and fine-tuning are not competitors",[14,147,148],{},"RAG brings relevant information into the system at the time of the answer. Fine-tuning changes how a model behaves for a particular kind of input. A system can use both.",[14,150,151],{},"For example, it may retrieve a current product document with RAG and provide the relevant passage to a model. If the model must then extract fields into the company's schema, and still does that inconsistently despite well-designed instructions, fine-tuning may be worth considering for that narrow task.",[14,153,154,160],{},[119,155,159],{"href":156,"rel":157,"target":125,"className":158},"https:\u002F\u002Fwww.microsoft.com\u002Fen-us\u002Fresearch\u002Fpublication\u002Frag-vs-fine-tuning-pipelines-tradeoffs-and-a-case-study-on-agriculture\u002F",[123,124],[127],"A comparison by Microsoft researchers"," on agricultural questions also found that the two approaches could improve results together. The study is limited to one dataset and particular models. Its useful conclusion is not that every system should combine RAG and fine-tuning. It is that the two approaches can complement each other because they solve different problems.",[77,162,164],{"id":163},"start-with-what-is-actually-missing","Start with what is actually missing",[14,166,167],{},"It is easier to make the decision from the missing component than from a list of method names.",[169,170,171,187],"table",{},[172,173,174],"thead",{},[175,176,177,181,184],"tr",{},[178,179,180],"th",{},"What is missing?",[178,182,183],{},"First option to examine",[178,185,186],{},"Why?",[188,189,190,202,213,224,235],"tbody",{},[175,191,192,196,199],{},[193,194,195],"td",{},"Explicit, current information",[193,197,198],{},"Direct context, RAG, search, database, or API",[193,200,201],{},"The information can be retrieved from its source and updated when the source changes.",[175,203,204,207,210],{},[193,205,206],{},"An explicit business rule",[193,208,209],{},"An instruction or software rule",[193,211,212],{},"The rule can be applied directly and audited.",[175,214,215,218,221],{},[193,216,217],{},"A relationship embedded in historical examples",[193,219,220],{},"Forecasting, classification, or another machine-learning model",[193,222,223],{},"The result is not written in a document; the pattern must be learned from data.",[175,225,226,229,232],{},[193,227,228],{},"Repeated model behaviour failures despite correct information",[193,230,231],{},"Fine-tuning with representative data",[193,233,234],{},"The model may need to perform the same narrow task more consistently.",[175,236,237,240,243],{},[193,238,239],{},"An authority, approval, or safety boundary",[193,241,242],{},"Access controls, software rules, and human approval where needed",[193,244,245],{},"Training a model does not grant authority or create accountability.",[14,247,248],{},"Before moving to fine-tuning, four answers should be clear:",[250,251,252,255,258,261],"ol",{},[25,253,254],{},"On which real inputs does the model repeat which error?",[25,256,257],{},"Do the right source, clearer instructions, or a few examples solve that error?",[25,259,260],{},"Can the improvement be measured on a representative test set that was not used in training?",[25,262,263],{},"Is the quality or cost benefit worth the work of preparing data, tracking model versions, and retraining when needed?",[14,265,266,271],{},[119,267,270],{"href":268,"rel":269,"target":125},"\u002Fstart-with-the-business-problem-not-the-ai-model",[124],"I previously explained why an AI project should not start with model selection",". The fine-tuning decision should follow the same order. First identify why the system is falling short. Then decide which component can close that gap.",[14,273,274],{},"Building an enterprise AI system does not mean putting everything the company knows into a model. Information can be read from its source. Rules can be applied in software. A separate model can learn patterns in historical data. Fine-tuning becomes useful only when the problem is truly repeated model behaviour.",[14,276,277],{},"The first question, then, should not be “RAG or fine-tuning?” Ask instead: is the system missing information, a rule, or a pattern it needs to learn?",[14,279,280],{},"Next, I will look at the line between a workflow whose steps are defined by software and an AI agent that chooses its next step.",[14,282,283,284,75],{},"You can find the other decisions about models, information, authority, and evaluation in the ",[119,285,287],{"href":286},"\u002Fdesigning-ai-systems-for-business","guide to designing an AI system for your business",{"title":289,"searchDepth":290,"depth":290,"links":291},"",2,[292,293,294,295,296],{"id":79,"depth":290,"text":80},{"id":95,"depth":290,"text":96},{"id":114,"depth":290,"text":115},{"id":144,"depth":290,"text":145},{"id":163,"depth":290,"text":164},[298,299],"ai","engineering",null,"2026-08-28","When is providing a document enough, when does RAG help, and when does fine-tuning actually make sense? The decision starts with information, rules, and patterns.",false,"md","\u002Fimages\u002Fhero\u002Ffine-tuning-decision.avif","A blue learned pattern runs beneath an open document and a fixed rule template.","Analysis","en",{},true,"\u002Fdoes-enterprise-ai-really-need-fine-tuning",7,{"title":6,"description":302},"RAG vs Fine-Tuning: What Enterprise AI Actually Needs","does-enterprise-ai-really-need-fine-tuning",[317,318,319,320,321],"fine-tuning","rag","enterprise-ai","ai-architecture","specialized-models","does-enterprise-ai-need-fine-tuning","post","ABE1K3_I-rOtWO1BAhzE9VOiYtwroNSuk-Gpbkd3QyI",{"path":326},"\u002Ftr\u002Fkuruma-ozel-yapay-zeka-icin-fine-tuning-sart-mi",{"prev":328,"next":331,"others":334,"lucky":444,"readingTime":312},{"path":329,"title":330},"\u002Fwhen-process-automation-actually-needs-ai","When Does Process Automation Actually Need AI?",{"path":332,"title":333},"\u002Fwhen-do-you-actually-need-an-ai-agent","When Do You Actually Need an AI Agent?",[335,338,341,342,343,345,348,351,354,357,360,363,366,369,372,375,378,381,384,387,390,393,396,399,402,405,408,411,414,417,420,423,426,429,432,435,438,441],{"path":336,"title":337},"\u002Fwhen-does-enterprise-ai-need-rag","When Does Enterprise AI Actually Need RAG?",{"path":339,"title":340},"\u002Fwhy-sales-and-other-departments-keep-clashing","Why Sales and Other Departments Keep Clashing",{"path":332,"title":333},{"path":329,"title":330},{"path":268,"title":344},"Start With the Business Problem, Not the AI Model",{"path":346,"title":347},"\u002Fhow-to-do-content-pruning-a-real-world-case-study","How to Do Content Pruning: A Real-World Case Study",{"path":349,"title":350},"\u002Fbank-account-api-integration","Integrating One Bank Is Easy. Keeping Forty Running Is Not.",{"path":352,"title":353},"\u002Fai-assisted-rest-api-development","Preserving API Quality in AI-Assisted Development",{"path":355,"title":356},"\u002Ftesting-a-button-treating-an-entire-website-redesign-as-a-sure-thing","Testing a Button, Treating an Entire Website Redesign as a Sure Thing",{"path":358,"title":359},"\u002Fmanaging-technology-and-transforming-the-business-are-not-the-same","Managing Technology and Transforming the Business Are Not the Same Thing",{"path":361,"title":362},"\u002Fturkeys-first-real-time-mystery-shopping-reporting","Turkey's First Real-Time Mystery Shopping Reporting Platform",{"path":364,"title":365},"\u002Fkeeping-customers-happy-isnt-enough","Keeping Customers Happy Isn’t Enough. You Have to Follow Up.",{"path":367,"title":368},"\u002Fdo-ai-visibility-tools-really-work","Do AI Visibility Tools Really Work? What They Actually Measure",{"path":370,"title":371},"\u002Fllms-txt-was-never-the-point","llms.txt Was Never the Point",{"path":373,"title":374},"\u002Fdo-you-know-how-dependent-your-company-is-on-ai","Do You Know How Dependent Your Company Is on AI?",{"path":376,"title":377},"\u002Fthe-ai-productivity-baseline-is-moving-faster-than-we-remember","AI Wasn’t Always This Good. We Just Got Used to It.",{"path":379,"title":380},"\u002Fai-made-code-cheap-verification-is-still-expensive","AI Made Code Cheap. Verification Is Still Expensive.",{"path":382,"title":383},"\u002Faccessing-know-how-is-not-the-same-as-creating-it","Accessing Know-How Is Not the Same as Creating It",{"path":385,"title":386},"\u002Fthe-threshold-collapsed-to-zero","The Threshold Collapsed: What ProductLog Taught Me About Building in Public",{"path":388,"title":389},"\u002Fbuild-in-public-2-0","Build in Public in the AI Era: What to Share and What to Keep Private",{"path":391,"title":392},"\u002Fgoogle-generative-ai-data-ai-citation-timing","AI Visibility Dropped Before Search: The Google Data That Changed My Theory",{"path":394,"title":395},"\u002Fthe-era-of-the-previous-vibe-coder-begins","The Era of the \"Previous Vibe Coder\" Begins: The Invisibility of Clean Code and the Technical Debt Bill of AI",{"path":397,"title":398},"\u002Fone-victory-several-defeats","One Victory, Several Defeats",{"path":400,"title":401},"\u002Fthe-job-ai-wont-take-and-the-five-it-prevents","The Hiring AI Makes Invisible",{"path":403,"title":404},"\u002Fproductlog-the-platform-i-built-for-myself-first","ProductLog: The Platform I Built for Myself First",{"path":406,"title":407},"\u002Fcomprehension-debt-the-bill-comes-due-alone","Comprehension Debt: The Bill Comes Due Alone",{"path":409,"title":410},"\u002Fwordpress-to-nuxt-ai-powered-content-pipeline","From WordPress to Nuxt: Building an AI-Powered Content Pipeline",{"path":412,"title":413},"\u002Fai-visibility-illusion-bing-citation-share","The AI Visibility Illusion: What Bing's Citation Share Data Actually Reveals",{"path":415,"title":416},"\u002F1m-impressions-per-month-0-revenue-a-programmatic-seo-post-mortem","1M Impressions per Month, $0 Revenue: A Programmatic SEO Post-Mortem",{"path":418,"title":419},"\u002Fthe-end-of-coding-or-a-new-renaissance-the-invisible-crisis-of-ai","The End of Coding or a New Renaissance? The Invisible Crisis of AI",{"path":421,"title":422},"\u002Fraising-children-in-the-age-of-artificial-intelligence","Raising Children in the Age of Artificial Intelligence",{"path":424,"title":425},"\u002Fredar-ai-powered-summaries-for-kap-disclosures-and-open-sources","Redar: AI-Powered Summaries for KAP Disclosures and Open Sources",{"path":427,"title":428},"\u002Fpesintaksit-cash-vs-installments-a-turkish-inflation-aware-payment-comparison-tool","Cash or Installments? – The Story Behind PeşinTaksit",{"path":430,"title":431},"\u002Fbeyond-the-bot-lessons-from-building-a-chat-system-for-global-patients","What We Learned Building a Healthcare Chatbot for International Patients",{"path":433,"title":434},"\u002Fhow-i-built-a-modern-infrastructure-using-open-source-tools-and-the-power-of-cloudflare","Why I Run camiler.org on a Single VPS",{"path":436,"title":437},"\u002Ffrom-rules-to-decisions-the-real-time-sales-intelligence-platform-we-built-at-vanity","Medical Tourism Lead Management: How We Moved from Manual Routing to a Real-Time Sales System",{"path":439,"title":440},"\u002Fwhy-im-building-rankextension-making-google-search-console-actually-make-sense","What Happened to RankExtension?",{"path":442,"title":443},"\u002Fan-seo-experiment-in-a-low-competition-serp-with-google-maps-and-openai","Building camiler.org: A Programmatic SEO Experiment with Google Maps and OpenAI",{"path":412,"title":413},[446,448,450],{"path":336,"title":337,"date":447},"2026-08-29",{"path":268,"title":344,"date":449},"2026-08-27",{"path":332,"title":333,"date":301},[452,454,456],{"path":361,"title":362,"date":453},"2026-08-24",{"path":391,"title":392,"date":455},"2026-06-28",{"path":349,"title":350,"date":449},1787963602040]