What is acquiescence bias?

Also called: Agreement bias, Yea-saying, Acquiescent responding

Acquiescence bias is the tendency for survey respondents and interviewees to agree with statements or answer yes regardless of what is being asked, which inflates agreement on agree/disagree items and yes/no questions.

Updated

Why it happens

Part of it is politeness: agreeing with the person or company asking feels cooperative. Part of it is effort. Weighing a statement and deciding you disagree takes more thought than ticking agree, so the effect grows as people get tired, distracted or rushed. That is why long agree/disagree grids near the end of a survey tend to show it most.

Where it shows up in product research

  • Agree/disagree batteries: "The new reporting page is easy to use." Strongly disagree to strongly agree.
  • Concept tests: "Would this feature be useful to you?" Most people say yes to most features.
  • Usability tests: a moderator asks "Was that clear?" and gets a yes after a visible struggle.
  • Screeners: "Do you use a design tool at work?" People say yes to qualify, especially when there is an incentive.

How to rewrite questions to avoid it

The most reliable fix is to replace agree/disagree statements with item-specific questions, where the answer options describe the thing being measured.

  • Before: "Building a report was easy. (Agree / Disagree)". After: "How easy or difficult was it to build a report? (Very difficult to Very easy)".
  • Before: "Would you use scheduled exports?" After: "How do you share report data with your team today?" followed by a question about how often.
  • Before: "Do you use a design tool at work? (Yes / No)". After: "Which of these tools have you used at work in the last month?" with a list, a "None of these" option and one tool that doesn't exist.
  • Before: "Was that clear?" After: "What do you think that screen was telling you?"

What about mixing positive and negative statements?

Some standard scales, including the System Usability Scale, alternate positively and negatively worded statements so a respondent who agrees with everything produces an inconsistent pattern. This helps you spot acquiescence, but it has a cost: people misread negatively worded items, especially when they are skimming. If you write your own survey, item-specific questions usually work better than reverse-worded statements.

Go deeper

Questions

What's the difference between acquiescence bias and social desirability bias?

Acquiescence bias is agreeing with whatever is put in front of you, whatever its content. Social desirability bias is choosing the answer that makes you look good. A respondent showing acquiescence would agree with a statement and its opposite; one showing social desirability would not.

Should I stop using Likert scales?

Not necessarily. A Likert-type scale with item-specific labels, such as very difficult to very easy, avoids most of the problem. The issue is the agree/disagree format, where the respondent is reacting to your statement instead of describing their own experience.

How can I spot acquiescence bias in data I've already collected?

Look for respondents who agree with nearly every statement, including pairs that contradict each other, and for unusually high agreement on items late in a long grid. Compare those answers with behavioural data before acting on them.

Next step

Run the study, not just the method

Great Question handles recruiting from your own customers, scheduling, incentives, interviews, tests and analysis in one place.

Book a demo

No credit card required.

Related terms

Full glossary
  • Response bias

    Response bias is a systematic pull on what participants say, caused by question wording, who is asking, or how people want to come across, so their answers drift away from what they actually think or do.

  • Social desirability bias

    Social desirability bias is the tendency for research participants to answer in ways that make them look good, overreporting behaviour they think is approved of and underreporting behaviour they think is frowned on.

  • Leading questions

    A leading question is worded in a way that suggests the answer the asker expects or wants, so participants drift toward that answer and you learn more about your own assumptions than about their experience.