What is a double-barreled question?
Also called: Double-barrelled question, Compound question, Stacked question
A double-barreled question asks about two or more things at once but allows only one answer, so you can't tell which part the respondent was answering, and anyone who feels differently about each part has no accurate option.
Updated
How to spot one
- Look for "and", "or" and "and/or" joining two subjects, two attributes or two actions.
- Watch for paired adjectives: "fast and reliable", "clear and useful", "easy and intuitive".
- Check answer options as well as questions. An option such as "I use it daily and rely on it" is double-barreled too.
- In interviews, listen for stacked questions: three questions asked in one breath. Participants usually answer the last one, or the easiest.
Examples, rewritten
- Before: "How easy and fast was it to set up your workspace?" After: "How easy or difficult was it to set up your workspace?" and, separately, "About how long did setup take?"
- Before: "Was the onboarding email clear and useful?" After: "How clear was the onboarding email?" and "How useful was it for getting started?"
- Before: "Do you use the mobile app to check reports and approve requests?" After: "Which of these do you do in the mobile app?" as a multi-select list.
- Before, in an interview: "How do you plan sprints, who's involved, and what tools do you use?" After: ask "How do you plan sprints?", wait, then follow up on people and tools based on what they say.
Why it matters at analysis time
A double-barreled item can't be fixed after the survey closes. If a large share of respondents rate "speed and reliability" as poor, you don't know whether to send the problem to the performance team or the infrastructure team. People who found the product fast but unreliable picked something in the middle, which looks like mild satisfaction and is really two separate opinions averaged together.
When joining two ideas is fine
Not every "and" is a problem. It is fine when the pair is one thing to the respondent, such as "terms and conditions" or a feature called "search and filter". It is also fine when you deliberately want an overall judgement, such as "Overall, how satisfied are you with the product?", as long as you don't later treat the answer as a verdict on one part.
Go deeper
- How to write good survey questions
Double-barreled items alongside other common survey mistakes.
- Types of survey questions
Choosing a question format once you've split the question.
- How to write a discussion guide
Avoiding stacked questions in interviews.
- UX survey questions
Example questions for UX surveys, one topic per item.
Questions
Is every question with "and" double-barreled?
No. The test is whether someone could reasonably feel differently about each part. If they could, split the question. If the two words describe a single thing to the respondent, leave it.
Doesn't splitting questions make surveys longer?
Yes, by one question each time. Make room by cutting questions that don't feed a decision. A shorter survey with clean items gives you more usable data than a longer one with answers you can't interpret.
What do you do if you ask a stacked question in an interview?
Notice it and narrow it: "Sorry, let me ask one at a time. How do you plan sprints?" Then come back to the parts they skipped. Participants rarely mind, and it keeps answers attached to the right question.
Run the study, not just the method
Great Question handles recruiting from your own customers, scheduling, incentives, interviews, tests and analysis in one place.
No credit card required.
Related terms
Full glossary- Leading questions
A leading question is worded in a way that suggests the answer the asker expects or wants, so participants drift toward that answer and you learn more about your own assumptions than about their experience.
- Acquiescence bias
Acquiescence bias is the tendency for survey respondents and interviewees to agree with statements or answer yes regardless of what is being asked, which inflates agreement on agree/disagree items and yes/no questions.
- Survey fatigue
Survey fatigue is the drop in willingness or attention that sets in when people are asked to complete too many surveys, or surveys that are too long, so they stop responding, quit partway through or rush their answers.