Why Your Search Results Feel Wrong to Customers
A working note on improving search relevance — what matters, what does not, and where these projects usually go sideways.
improving search relevance rarely arrives as a planned decision. It shows up mid-build, usually the week a deadline gets confirmed. These are the notes we end up repeating to founders and CTOs, written down once.
Where improving search relevance usually goes wrong
The complaint shows up as a symptom. A slow week, an irritated customer, a number moving the wrong way.
The cause normally sits two decisions earlier, in something that was never written down.
Patch the symptom and it returns in different clothes.
Two real shapes this takes
One common pattern we see: the product works and the process around it does not. Nothing in the code needs changing, but three people are doing manual repair work every day.
The other pattern is the reverse. Process is fine, the system cannot hold the shape the business now needs.
The fixes have almost nothing in common, so guessing is expensive.
The mistakes that repeat
A mistake teams often make with improving search relevance is starting from the most complex customer. Build for them and the simple case gets buried in configuration.
- Designing for a customer you have not signed yet.
- Copying a pattern from a company with fifty engineers.
- Deferring the boring part — permissions, exports, error states — until it blocks a deal.
- Measuring activity instead of outcome.
The engineering view
From inside the codebase, improving search relevance reduces to three questions. What happens when a step fails halfway. Who finds out. How you reverse it.
Design for partial failure before you need it. Step three fails after one and two already succeeded, and that is the case people skip.
Give retries a ceiling and some jitter. A retry storm is an outage you built yourself.
How we approach it step by step
- Reproduce the pain with a real case, not a description of it.
- Write the target outcome as a single number.
- Pick the smallest change that could plausibly move that number.
- Build it with a rollback path.
- Release to one team or a slice of traffic.
- Review in two weeks, then widen, revise, or delete.
Deleting is a legitimate result. It happens less often than it should.
Practical guardrails
- Instrument before optimising.
- Cap spend and volume in code, not on the invoice.
- Write down the decision, not only the outcome.
- Keep one named owner with protected hours.
- Set a review date ninety days out and keep it.
Trade-offs worth saying out loud
Speed against flexibility. Managed service against control. Cheap now against cheap later. None of it is free.
This trade-off usually appears when the second customer wants something the first one didn't. That is the moment to revisit improving search relevance, not before.
Where the common advice is wrong
“Do it the way the big companies do.” Their constraint is coordination across many teams. Yours is probably two engineers and a deadline.
“Automate everything.” Automate the repeated, boring, high-volume part. Leave judgement to people.
“Wait until we have more data.” Ship something small and the data arrives.
Frequently asked questions
How do we know whether it worked?
Choose the number before you build — hours saved, error rate, response time, or conversion — then compare a two-week window either side.
When is the right time to revisit the decision?
When a second customer asks for something the first one never needed, or when volume changes by an order of magnitude.
What should we do first?
Write one sentence describing the outcome you want from improving search relevance, then map the workflow it touches. Both take an afternoon and remove most of the guessing.
Do we need to hire someone for this?
Not at the start. One named owner with a few protected hours a week, plus a small build team, is enough to prove value.
Is it cheaper to buy a tool instead?
Often yes for the first version. Build when the workflow is a genuine differentiator or no tool fits the data you already hold.
Conclusion
The useful move on improving search relevance is almost always the smaller one. Ship a narrow slice a real user can touch this month, measure it, then decide what earns the next four weeks.
Everything gets easier once something is live.
Related reading and next steps
- product design and UX — how we run this kind of work.
- AI automations — where this often connects.
- More writing from the team.
Want a second opinion on improving search relevance for your setup? Book a 30-minute call. If it is not worth building, we will say so.
FAQ
Frequently asked questions
How do we know whether it worked?+
Choose the number before you build — hours saved, error rate, response time, or conversion — then compare a two-week window either side.
When is the right time to revisit the decision?+
When a second customer asks for something the first one never needed, or when volume changes by an order of magnitude.
What should we do first?+
Write one sentence describing the outcome you want from improving search relevance, then map the workflow it touches. Both take an afternoon and remove most of the guessing.
Do we need to hire someone for this?+
Not at the start. One named owner with a few protected hours a week, plus a small build team, is enough to prove value.
Is it cheaper to buy a tool instead?+
Often yes for the first version. Build when the workflow is a genuine differentiator or no tool fits the data you already hold.
Building something similar?
Let's talk in 30 minutes.