You don't need to train a model to ship AI
The biggest misconception in software development right now is that building AI features requires a PhD and a GPU cluster. It doesn't. The API economy has made it possible to ship genuinely intelligent features with the same tools you already know.
Here's how to go from zero to a shipped AI feature - practically.
Step 1: Find the boring problem

The best AI features don't feel like AI. They feel like the product is just... smarter. Look for these patterns in your codebase:
- Text that needs summarizing. Long documents, support tickets, meeting notes.
- Content that needs generating. Email drafts, product descriptions, onboarding messages.
- Data that needs classifying. Categorizing support tickets, routing requests, tagging content.
- Search that could be semantic. Finding things by meaning rather than exact keywords.
These are the low-hanging fruit. They're valuable to users, relatively low-risk, and straightforward to implement.
Step 2: Choose your provider
For most features, you're calling an API, not training a model:
- Claude (Anthropic) - strong at nuanced reasoning, long-context analysis, and following complex instructions. Excellent for features that require careful judgment.
- GPT-4 (OpenAI) - broad capabilities, large ecosystem of tooling.
- Gemini (Google) - multimodal by default, strong at understanding images and documents.
Pick one, build a proof of concept, and iterate. Don't spend weeks comparing benchmarks.
Step 3: Design the prompt, not the model

Prompt engineering is the new API design. Your prompt is the interface between your product logic and the AI's capabilities. Treat it with the same rigor you'd give a database schema:
- Be specific about the output format you need (JSON, markdown, plain text).
- Include examples of good and bad outputs.
- Set constraints explicitly: "Do not include information not present in the source text."
- Version your prompts. They're code.
Step 4: Handle the edges
AI outputs are probabilistic. They will sometimes be wrong. Design for this:
- Add confidence signals. If the model isn't sure, surface that to the user.
- Keep humans in the loop. For high-stakes features, make AI output a suggestion, not a decision.
- Log everything. You'll need to debug prompt failures, and you can't do that without seeing what went in and what came out.
- Set rate limits and cost caps. API costs can surprise you at scale.
Step 5: Measure what matters
Don't measure "AI accuracy" in isolation. Measure the user outcome:
- Did the summary save the user time?
- Did the generated draft reduce time-to-send?
- Did the semantic search surface the right document more often?
If the AI feature makes the user's workflow faster or better, it's working. If it's impressive but doesn't change behavior, reconsider.
The builder's mindset
The developers shipping the best AI features aren't ML researchers. They're product engineers who treat AI as a capability - like a database or a CDN - and focus relentlessly on the user problem.
You already have the skills. The models are the easy part. The hard part, as always, is building something people actually want to use.
Share this article



