Practice · 2023–now · AI Present
Local inference
Run the model on your laptop or rack. Privacy, cost control, and the refusal to send every token to a vendor.
Why Local inference stuck
Local inference stuck for privacy-sensitive and offline workflows as open weights and IDE-local models matured. It failed as a default for teams that needed frontier quality without GPU ops. The fad was "replace the API tomorrow"; the stuck practice is hybrid — local for routine, cloud for peak.
Case studies
Compare with
Related
Framework · 2023–now
LLM app frameworks
LangChain-class glue mutated into MCP clients and thin wrappers around vendor APIs. The durable pieces are still boring: evals, retrieval, and product UX.
Platform · 2022–now
Vector DB gold rush
Specialized embedding stores sold as the default. Mid-market folded back into Postgres — after the vendor tour.
Practice · 2021–now
AI pair programming
Coding agents that edit the repo — now table stakes. Generation outran review capacity; ownership is the bottleneck.