What are leading questions?
Also called: Leading question
A leading question is worded in a way that suggests the answer the asker expects or wants, so participants drift toward that answer and you learn more about your own assumptions than about their experience.
Updated
The forms leading questions take
- Loaded wording: "How much did you like the new onboarding?" assumes they liked it and only asks how much.
- An embedded assumption: "What slows you down most when building reports?" assumes something does.
- A confirmation tag: "That was pretty straightforward, right?"
- A pitch dressed as a question: "Would you use a feature that saved you an hour every week?"
- An unbalanced scale: Excellent, Very good, Good, Fair, with only one option below the middle.
- Handing over the answer in a usability test: "Were you looking for the export button?"
Before and after
- Before: "How much did you like the new onboarding?" After: "How would you describe your first week with the product?"
- Before: "What slows you down most when building reports?" After: "Walk me through the last report you built."
- Before: "That was pretty straightforward, right?" After: "How did that go?"
- Before: "Were you looking for the export button?" After: "What are you looking for right now?"
- Before: "Don't you think the new pricing is clearer?" After: "What, if anything, is unclear about this pricing page?"
Leading questions in interviews vs surveys
In a survey, a leading question is fixed in print, so it pushes every respondent the same way and skews the whole result. In interviews they creep in live, usually in follow-ups, once the moderator has a hypothesis and starts looking for confirmation. Interview leading questions are harder to spot and vary by session, which makes findings hard to compare across moderators.
How to catch them before they reach participants
- Ask of each question: could someone give the opposite answer without feeling they are contradicting me?
- Strip out adjectives and adverbs such as easy, great, frustrating and quickly, unless the participant used them first.
- Have someone who doesn't know your hypothesis read the survey or discussion guide and say what answer each question seems to want.
- Read back transcripts of your own sessions and highlight every follow-up that contains an answer.
Go deeper
- How to write good survey questions
Leading and other bad survey questions, with rewrites.
- How to write a discussion guide
Building an interview guide that keeps core questions neutral.
- Usability testing guide
Writing tasks and prompts that don't give away the answer.
- Discovery interview template
A starting set of open, neutral interview questions.
Questions
What's the difference between a leading question and a loaded question?
A loaded question carries an assumption the participant may not share, such as "Why do you prefer our app to the competition?" A leading question pushes toward a particular answer. Loaded questions are a common type of leading question, and the fix is the same: ask whether the assumption is true first.
Is "Why did you find that confusing?" a leading question?
Only if the participant hasn't said it was confusing. If they used the word, echoing it back is a good probe. If you are inferring confusion from their behaviour, ask what happened instead: "What were you expecting there?"
Are closed questions leading?
Not by themselves. A yes/no or pick-one question can be neutral if the options are balanced and the wording doesn't favour one. Closed questions become leading when the options are lopsided or the question implies which one is right.
Run the study, not just the method
Great Question handles recruiting from your own customers, scheduling, incentives, interviews, tests and analysis in one place.
No credit card required.
Related terms
Full glossary- Probing questions
Probing questions are follow-ups an interviewer asks in response to what a participant just said, to get the detail, reasons, examples or clarification the first answer left out, without introducing a new topic or suggesting an answer.
- Double-barreled question
A double-barreled question asks about two or more things at once but allows only one answer, so you can't tell which part the respondent was answering, and anyone who feels differently about each part has no accurate option.
- Response bias
Response bias is a systematic pull on what participants say, caused by question wording, who is asking, or how people want to come across, so their answers drift away from what they actually think or do.