What is convenience sampling?
Also called: Accidental sampling, Availability sampling, Opportunity sampling
Convenience sampling is a non-probability sampling method where you recruit whoever is easiest to reach, such as customers who answer your first email or colleagues down the hall, instead of choosing participants to represent a defined population.
Updated
What it looks like in product research
Most product teams use convenience samples more often than they admit. Common versions:
- Emailing your most active accounts because the customer success team already has a relationship with them.
- Taking the first 8 people who book a slot from an in-app intercept, and closing the study once the calendar is full.
- Running a hallway test with coworkers from sales or support on a new onboarding flow.
- Posting a survey link in your community forum or Slack group and analysing whoever replies.
Why the sample skews
The people who are easy to reach are rarely typical. Customers who answer quickly tend to be engaged, satisfied and comfortable giving feedback. Accounts with an assigned success manager tend to be larger. Coworkers know the product's vocabulary and the reasoning behind its design. Each of these groups will find a flow easier, or like a concept more, than the wider customer base would.
The result is sampling bias that nobody chose on purpose. A study of your friendliest accounts can end up presented as what customers think, with no note on who was left out.
When it's a reasonable choice
- Early, rough checks: spotting obvious usability problems in a prototype before you spend recruiting effort on a proper study.
- Piloting a discussion guide, screener or survey to find confusing questions.
- Questions where almost any user would behave the same way, such as whether a button label is legible.
How to reduce the damage
- Add a short screener even to a convenience sample, so you at least know each participant's role, plan and tenure.
- Compare who took part against your customer base on two or three attributes, and write the gaps into the readout.
- Rotate who you ask. Keep a record of past participation so the same 20 enthusiastic customers don't answer every study.
- When a decision depends on how common a view is, move to quota sampling or a random draw from your customer list.
Go deeper
- Recruit participants from your customer base
Ways to draw participants from your own customers beyond the easiest accounts.
- Screener survey guide
Write a screener that tells you who you actually recruited.
- B2B market research guide
Covers the convenience-sample trap in B2B customer research.
- Research recruitment in Great Question
Recruit and track participants from your own customer list.
Questions
Is convenience sampling bad?
No, but it has a narrow job. It works for quick usability checks and for piloting research materials. It misleads when the findings are presented as representative of all customers, or used to size how common a problem is.
What's the difference between convenience sampling and purposive sampling?
Convenience sampling takes whoever is available. Purposive sampling chooses participants on purpose because they have a trait the study needs, such as admins who set up a specific integration. Both are non-probability methods, but purposive sampling has a stated reason for every person in the sample.
Is an opt-in research panel a convenience sample?
Partly. People who join a panel are self-selected and usually more engaged than average. Screening and quotas within the panel reduce the skew, but it's worth tracking how panel members differ from the rest of your customers.
Run the study, not just the method
Great Question handles recruiting from your own customers, scheduling, incentives, interviews, tests and analysis in one place.
No credit card required.
Related terms
Full glossary- Sampling bias
Sampling bias happens when the way you choose participants makes some kinds of people more likely to end up in your study than others, so the sample stops representing the users or customers you want to draw conclusions about.
- Quota sampling
Quota sampling is a non-probability sampling method where you set a target number of participants for each group that matters, such as plan tier or role, and recruit until each quota is full, so the sample's mix matches the population you care about.
- Purposive sampling
Purposive sampling is a non-probability sampling method where the researcher deliberately picks participants because they have characteristics or experiences the study needs, such as admins who just migrated from a competitor, instead of recruiting at random.