Choosing a Search Backend Before Your Catalogue Doubles
A working note on choosing a search backend — what matters, what does not, and where these projects usually go sideways.
There is a short answer on choosing a search backend and a useful one. The short answer fits in a Slack message. The useful one depends on three things nobody writes down, so we will write them down.
The problem underneath
Teams don't get choosing a search backend wrong because they lack skill. They get it wrong because the decision gets made in a hurry, by whoever is closest to the ticket.
Nobody documents it. Six weeks later three people have three different mental models.
That gap costs more than the original choice ever did.
Two situations that read identically on a Monday call
In projects like these, one version is local. A single workflow strains, everything else is fine, and two focused weeks clear it.
The other looks the same in a status update, but the strain is systemic. Treat that one as local and you spend a quarter arriving back where you started.
Telling them apart in week one is most of the value anyone brings to the room.
The mistakes that repeat
A mistake teams often make with choosing a search backend is starting from the most complex customer. Build for them and the simple case gets buried in configuration.
- Designing for a customer you have not signed yet.
- Copying a pattern from a company with fifty engineers.
- Deferring the boring part — permissions, exports, error states — until it blocks a deal.
- Measuring activity instead of outcome.
The engineering view
From inside the codebase, choosing a search backend reduces to three questions. What happens when a step fails halfway. Who finds out. How you reverse it.
Design for partial failure before you need it. Step three fails after one and two already succeeded, and that is the case people skip.
Give retries a ceiling and some jitter. A retry storm is an outage you built yourself.
How we approach it step by step
- Reproduce the pain with a real case, not a description of it.
- Write the target outcome as a single number.
- Pick the smallest change that could plausibly move that number.
- Build it with a rollback path.
- Release to one team or a slice of traffic.
- Review in two weeks, then widen, revise, or delete.
Deleting is a legitimate result. It happens less often than it should.
Practical guardrails
- Instrument before optimising.
- Cap spend and volume in code, not on the invoice.
- Write down the decision, not only the outcome.
- Keep one named owner with protected hours.
- Set a review date ninety days out and keep it.
The trade-offs nobody puts in the proposal
Every option here buys you something and charges you elsewhere. Faster now often means a rewrite later, and that can still be the right call.
What matters is naming the bill in advance so it is a decision rather than a surprise.
Where the common advice is wrong
“Do it the way the big companies do.” Their constraint is coordination across many teams. Yours is probably two engineers and a deadline.
“Automate everything.” Automate the repeated, boring, high-volume part. Leave judgement to people.
“Wait until we have more data.” Ship something small and the data arrives.
Frequently asked questions
Is it cheaper to buy a tool instead?
Often yes for the first version. Build when the workflow is a genuine differentiator or no tool fits the data you already hold.
How long does choosing a search backend take to get right?
A narrow first version is usually four to six weeks. Anything quoted at three months with nothing shippable in between is a risk, not a plan.
How do we know whether it worked?
Choose the number before you build — hours saved, error rate, response time, or conversion — then compare a two-week window either side.
What should we do first?
Write one sentence describing the outcome you want from choosing a search backend, then map the workflow it touches. Both take an afternoon and remove most of the guessing.
When is the right time to revisit the decision?
When a second customer asks for something the first one never needed, or when volume changes by an order of magnitude.
Wrapping up
choosing a search backend does not need a perfect answer. It needs a written one, an owner, and a review date.
Pick the version you can run with the team you have today, then revisit it when the constraints change.
Related reading and next steps
- AI automations — how we run this kind of work.
- product design and UX — where this often connects.
- More writing from the team.
Want a second opinion on choosing a search backend for your setup? Book a 30-minute call. If it is not worth building, we will say so.
FAQ
Frequently asked questions
Is it cheaper to buy a tool instead?+
Often yes for the first version. Build when the workflow is a genuine differentiator or no tool fits the data you already hold.
How long does choosing a search backend take to get right?+
A narrow first version is usually four to six weeks. Anything quoted at three months with nothing shippable in between is a risk, not a plan.
How do we know whether it worked?+
Choose the number before you build — hours saved, error rate, response time, or conversion — then compare a two-week window either side.
What should we do first?+
Write one sentence describing the outcome you want from choosing a search backend, then map the workflow it touches. Both take an afternoon and remove most of the guessing.
When is the right time to revisit the decision?+
When a second customer asks for something the first one never needed, or when volume changes by an order of magnitude.
Building something similar?
Let's talk in 30 minutes.