What is quota sampling?

Also called: Quota-based sampling

Quota sampling is a non-probability sampling method where you set a target number of participants for each group that matters, such as plan tier or role, and recruit until each quota is full, so the sample's mix matches the population you care about.

Updated

What it looks like in product research

Say 60% of your accounts are on the starter plan and 40% on business. Left alone, a survey invitation might bring back mostly business customers, because they're more engaged. With quotas you decide up front: 120 starter and 80 business responses, and you close each group when it's full.

For a qualitative study the quotas are smaller and often equal, for example 4 admins, 4 editors and 4 viewers for a usability test, so each role gets enough sessions to show its own problems.

How to set quotas

  • Pick one to three attributes that are likely to change the answer, such as plan, role, tenure or region. More than three and the number of cells grows faster than you can fill them.
  • Decide whether quotas should mirror your customer base (proportional) or give each group an equal voice (equal). Proportional suits surveys you want to report as a whole; equal suits interviews and usability tests.
  • Put the quota attributes in the screener, and close each group automatically once it fills so you don't over-recruit.
  • Watch the hardest cell. If enterprise admins are slow to respond, start their outreach first or plan a separate channel such as account managers.

Quota vs stratified sampling

Both split the population into groups. Stratified sampling then draws people at random within each group, which supports statistical inference. Quota sampling fills each group with whoever responds first, so selection bias can remain inside each cell: the 80 business customers who answered fastest may still be the most engaged ones.

For most product surveys that trade-off is acceptable, as long as the readout says how the sample was built.

Limits

  • Quotas only control the attributes you chose. If tenure matters and you only set quotas on plan, tenure can still skew.
  • Filling a quota doesn't make a group's answers representative of that group.

Go deeper

Questions

Is quota sampling probability or non-probability sampling?

Non-probability. Every person doesn't have a known chance of selection, because each quota is filled by whoever responds. That's the main difference from stratified random sampling.

How do I choose quota sizes for a usability test?

Treat each group that might behave differently as its own small study. Five to eight participants per group is a common starting point for finding usability problems, so three roles means roughly 15 to 24 sessions. If the budget won't stretch, cut the number of groups before cutting sessions per group.

Next step

Run the study, not just the method

Great Question handles recruiting from your own customers, scheduling, incentives, interviews, tests and analysis in one place.

Book a demo

No credit card required.

Related terms

Full glossary
  • Sampling bias

    Sampling bias happens when the way you choose participants makes some kinds of people more likely to end up in your study than others, so the sample stops representing the users or customers you want to draw conclusions about.

  • Convenience sampling

    Convenience sampling is a non-probability sampling method where you recruit whoever is easiest to reach, such as customers who answer your first email or colleagues down the hall, instead of choosing participants to represent a defined population.

  • Purposive sampling

    Purposive sampling is a non-probability sampling method where the researcher deliberately picks participants because they have characteristics or experiences the study needs, such as admins who just migrated from a competitor, instead of recruiting at random.