Practice · 2023–now · AI Present
RAG as default architecture
Retrieval-augmented generation as the answer to every knowledge problem — then "just stuff the window" as the counter-fad. Often right; often Postgres with pgvector would suffice.
RAG-as-default mutated because grounding models in private data is real value, but the cargo cult ships embedding pipelines for FAQs that fit in context — or abandons chunking for long-context cargo cult. It failed when chunk quality and eval gaps produced confident hallucinations with citations. What sticks is retrieval with evals; what fades is RAG on every slide.
Cost of the fad
Teams stood up vector pipelines, chunking strategies, and rerankers before asking if fine-tuning or a SQL query would answer the question. Retrieval infra became the product.
Patterns
Context
Demos consolidate; evals remain
AI pair programming changed how code is typed faster than how it is reviewed. Agent frameworks and standalone vector stores sorted into demos versus durable plumbing; mid-market RAG folded back into Postgres. The permanent layer is familiar: evals that gate deploys, model routing for cost, tool protocols instead of plugin snowflakes, and humans who own production. Autopilot rewrites and vibe-shipped auth middleware are still big-bang migrations with better slides — and a longer on-call.
Compare with
Related
Platform · 2022–now
Vector DB gold rush
Specialized embedding stores sold as the default. Mid-market folded back into Postgres — after the vendor tour.
Framework · 2023–now
LLM app frameworks
LangChain-class glue gave way to vendor SDKs and thin wrappers. The durable pieces are boring: evals, retrieval, and product UX.
Practice · 2023–now
LLM eval pipelines
Regression tests for nondeterministic models that actually fail the build. The unglamorous CI that separates demos from products.
Practice · 2023–now
Embed everything
If it is text, vectorize it. Semantic search cosplay for problems that needed a better filter.
$ Embedding pipelines for tickets, PDFs, Slack, and the cafeteria menu — then nobody measured retrieval quality. Vector bills and reindex jobs became the product.
Practice · 2024–now
Long-context cargo cult
Million-token windows as a substitute for retrieval design. Stuffing PDFs until the model shrugs.
$ "Just put it in the window" replaced chunking, RAG, and information architecture until token bills and lost-in-the-middle hallucinations arrived.