UX research glossary
Plain definitions of the research methods and terms product teams run into, with links to the guides that go deeper.
A
- Acquiescence bias
Acquiescence bias is the tendency for survey respondents and interviewees to agree with statements or answer yes regardless of what is being asked, which inflates agreement on agree/disagree items and yes/no questions.
- Atomic research
Atomic research is a way of storing research findings as small, linked units, such as a single observation tied to its source, instead of whole reports, so the evidence can be found, reused and combined across studies.
C
- Cognitive walkthrough
A cognitive walkthrough is a usability inspection method where evaluators step through a specific task in an interface and, at each action, ask whether a new user would know what to do, find the control and understand the result.
- Convenience sampling
Convenience sampling is a non-probability sampling method where you recruit whoever is easiest to reach, such as customers who answer your first email or colleagues down the hall, instead of choosing participants to represent a defined population.
- Critical incident technique
The critical incident technique is a research method where participants describe specific past events that went especially well or badly, what led up to them and what happened next, so you learn from concrete behaviour instead of general opinions.
- Customer effort score
Customer effort score (CES) is a survey metric that asks customers how easy or difficult it was to complete a specific interaction or task, such as resolving a support issue or setting up a feature, and turns their answers into one score.
D
- Data saturation
Data saturation is the point in qualitative research where new interviews or observations stop producing new themes or insights, which tells you that adding more sessions would mostly repeat what you already know.
- Double-barreled question
A double-barreled question asks about two or more things at once but allows only one answer, so you can't tell which part the respondent was answering, and anyone who feels differently about each part has no accurate option.
E
- Evaluative research
Evaluative research tests an existing design, prototype or product against a goal, to find out whether people can use it and whether it does what the team intended. It checks a solution, where generative research looks for the problem.
G
- Generative research
Generative research is research done before there is a solution to test, to understand people's needs, behaviours and problems well enough to decide what to build. It produces opportunities and questions, not a verdict on a design.
H
- HEART framework
The HEART framework is a set of five user experience metric categories from Google: Happiness, Engagement, Adoption, Retention and Task success. Teams use it to choose metrics that show whether a product or feature is working for the people using it.
I
- Inter-rater reliability
Inter-rater reliability is the degree to which two or more researchers, coding or rating the same data independently, reach the same answers. It tells you whether a codebook or rating scale produces consistent results, or depends on who happens to apply it.
L
- Leading questions
A leading question is worded in a way that suggests the answer the asker expects or wants, so participants drift toward that answer and you learn more about your own assumptions than about their experience.
M
- MaxDiff analysis
MaxDiff analysis is a survey method that shows people small sets of items, asks them to pick the most and least important in each set, and uses those choices to rank every item on one scale of relative preference.
- Member checking
Member checking is a qualitative research technique where you take your interpretation of what participants said back to them, so they can confirm, correct or add to it before you treat it as a finding.
- Mixed methods research
Mixed methods research is a research approach that combines qualitative methods, such as interviews, with quantitative methods, such as surveys or product analytics, in one study, so the numbers show how much and the conversations show why.
N
- Nonresponse bias
Nonresponse bias is the error that occurs when the people who don't answer a survey or join a study differ in meaningful ways from the people who do, so results describe the responders instead of the group you meant to study.
P
- Probing questions
Probing questions are follow-ups an interviewer asks in response to what a participant just said, to get the detail, reasons, examples or clarification the first answer left out, without introducing a new topic or suggesting an answer.
- Purposive sampling
Purposive sampling is a non-probability sampling method where the researcher deliberately picks participants because they have characteristics or experiences the study needs, such as admins who just migrated from a competitor, instead of recruiting at random.
Q
- Quota sampling
Quota sampling is a non-probability sampling method where you set a target number of participants for each group that matters, such as plan tier or role, and recruit until each quota is full, so the sample's mix matches the population you care about.
R
- Response bias
Response bias is a systematic pull on what participants say, caused by question wording, who is asking, or how people want to come across, so their answers drift away from what they actually think or do.
S
- Sampling bias
Sampling bias happens when the way you choose participants makes some kinds of people more likely to end up in your study than others, so the sample stops representing the users or customers you want to draw conclusions about.
- Snowball sampling
Snowball sampling is a non-probability recruiting method where each participant refers others who fit the study, so the sample grows through referrals. It is used when the people you need are hard to find through a customer list or panel.
- Social desirability bias
Social desirability bias is the tendency for research participants to answer in ways that make them look good, overreporting behaviour they think is approved of and underreporting behaviour they think is frowned on.
- Survey fatigue
Survey fatigue is the drop in willingness or attention that sets in when people are asked to complete too many surveys, or surveys that are too long, so they stop responding, quit partway through or rush their answers.
T
- Task analysis
Task analysis in UX is the process of breaking down how people accomplish a goal into the steps, decisions, tools and information each step needs, so you can design a product around the work as people actually do it.
- Think-aloud protocol
A think-aloud protocol is a usability research method where participants say what they are thinking, looking at and trying to do while they complete a task, so you hear the reasoning behind each action instead of guessing at it.
- Time on task
Time on task is a usability metric that records how long a participant takes to complete a task, from the moment they start to the moment they finish or give up. It's used to measure efficiency and to compare designs or versions.
- Triangulation
Triangulation is checking a research finding against more than one source, method or researcher, so you only act on it when different kinds of evidence point the same way.
V
- Van Westendorp price sensitivity meter
The Van Westendorp price sensitivity meter is a survey method for pricing research that asks people four questions about when a product would feel too cheap, a bargain, getting expensive and too expensive, then plots the answers to find a range of acceptable prices.