01Three ways to ask the same question
If you want to know what customers want, you have three workhorse methods: send a survey, run user interviews, or mine what people already say in public. They’re often treated as rivals, but they capture genuinely different things — and the smart move is matching the method to the question, not picking a favourite.
02How they compare
No method is “best” — each is strong exactly where another is weak. Forum mining can’t ask a follow-up; an interview can’t reach hundreds; a survey can’t catch what people didn’t think to mention.
03When each one wins
Reach for a survey when you already have an audience and a sharp, closed question — “which of these three do you use?” — and you want it quantified across many people.
Reach for interviews when the why matters more than the how-many: untangling a confusing workflow, understanding a decision, exploring something you can’t yet phrase as a question. Depth is their whole point.
Reach for forum mining first when you don’t have an audience yet, when you need breadth fast and cheap, or when you specifically want what people say unprompted rather than what they tell a researcher.
04They’re better together
The strongest research stacks them. Mine forums to find the real language and the candidate problems, use that to write a survey that asks the right closed questions, then interview a handful of people to understand the why behind the numbers.
Forum mining is usually the cheapest place to start because it needs no recruiting and surfaces the questions worth asking — so the surveys and interviews that follow aren’t built on your guesses about what matters.
Why unprompted talk is different data
The deeper reason forum mining complements the others: it’s closer to revealed preference than to stated.
Revealed vs stated preference →05A worked example: sequencing all three
Read forums to surface candidates
Spend a few hours reading where bookkeepers already complain — unprompted. You leave with a list of eight candidate pains and, just as useful, the exact words they use. This is cheap and needs no recruiting, but it skews toward the loud and frustrated, so you can’t yet tell which pains are common.
Run a survey to size them
Turn those eight candidates into closed questions and send them out: which do you hit weekly, which would you pay to remove. Now you have rough frequencies across a hundred-odd people. The survey fixes the forum’s representativeness gap — but it can’t tell you why the top pain hurts, only that it ranks high.
Interview to probe the winner
Take the one or two pains that scored highest and interview five or six people about them. Here you finally ask follow-ups: what they tried, where it broke, what “fixed” would look like. Interviews fix the survey’s shallowness — but only because the earlier steps told you which question was worth their time.
Frequently asked questions
They answer different questions. Forum mining is cheapest and surfaces unprompted pains and real language, but skews toward the frustrated. Surveys quantify how common something is across many people. Interviews go deepest on the why for a few. Treat them as a sequence — propose, prioritise, explain — rather than rivals you must choose between.
Use a survey when your question is already sharp and closed — “which of these do you use?” — and you want it counted across many people. Use an interview when the why matters more than the how-many, when you need to probe a decision or a confusing workflow, or when you can’t yet phrase the question tightly enough to put it on a form.
Neither is better; they cover different gaps. Forum reading is faster, needs no recruiting, and shows what people say unprompted — closer to behaviour than to a tidy answer. Surveys are better when you need to know how common a pain is across a defined group. The strongest approach uses forum reading to decide what your survey should even ask.
Run them in order, not in parallel. Send the survey first to find which problems rank highest across your sample, then interview people about the top one or two to understand the why behind the numbers. The survey tells you where to point the interviews; the interviews explain results the survey could only count. Forum reading upstream sharpens both.