All posts

Qualitative data analysis with AI: a practical method

Tania ClarkeAugust 17, 202611 min
Composite image of the Crab Nebula supernova remnant in X-ray and infrared light.
Guide

Qualitative Analysis

automation for the repetition, judgment for the rest

Webb · Crab Nebula · 2024 · NASA
On this page

TL;DR

Qualitative data analysis turns unstructured research, such as interview transcripts, open-ended survey responses, usability sessions, and customer feedback, into findings your team can use.

A practical process has six steps: familiarize yourself with the data, code it, cluster related observations, develop themes, interpret what those themes mean, and connect each finding back to evidence.

AI can make several of those steps significantly faster. It is particularly useful for summarizing large amounts of material, applying first-pass codes, grouping related observations, and retrieving supporting evidence.

But speed is not the same as judgment. Researchers still need to decide what matters, investigate contradictions and outliers, interpret findings in context, and determine whether the evidence actually supports a conclusion.

The goal is not to automate qualitative analysis from beginning to end. It is to use AI for repetitive work so researchers can spend more time on the parts that require context and judgment.

What qualitative data analysis actually is

Qualitative data analysis is the process of finding patterns in non-numerical data and turning those patterns into findings you can explain and defend.

The raw material can come from almost anywhere customers speak in their own words: interview transcripts, open-ended survey responses, usability testing sessions, sales calls, support tickets, app reviews, or customer feedback.

Quantitative research helps answer questions about how many, how much, or how often. Qualitative research helps explain what is happening, why it is happening, and what you may not have thought to measure in the first place.

That last part matters. Good qualitative analysis is not simply a summary of what most people said. Sometimes the most useful observation comes from a contradiction, an unexpected behavior, or one participant whose experience challenges the team's assumptions.

Before you analyze anything, though, you need access to the evidence. When interviews live in one tool, survey responses in another, support feedback somewhere else, and research notes in individual documents, your analysis is limited by what you can realistically find and compare.

A research repository gives teams a searchable place to bring that evidence together. Our UX research repository guide goes deeper into how to structure one.

Step 1: Familiarize yourself with the data

Before you start assigning codes, get a feel for the dataset.

Read the transcripts or review the sessions once without trying to categorize every observation. Pay attention to who participated, what surprised you, which topics generated strong reactions, and where participants' experiences differed.

You are building context before breaking the material into pieces.

Where AI helps

AI can make this first pass much faster when you have a large dataset. For example, you can generate a summary for each interview and ask the system to flag unusual responses, contradictions, or sessions that differ significantly from the others.

That gives you a map of the material before you start analyzing it in depth.

But summaries should not become substitutes for the underlying research. AI may flatten differences in intensity. Someone who was mildly inconvenienced and someone who was extremely frustrated could both become a summary such as “experienced difficulty during onboarding.”

Use summaries to orient yourself. Then return to the source material, particularly for sessions that contain surprising or important observations.

If you are starting with recordings, see our guide to transcribing interviews.

Step 2: Code the data

Coding means assigning short labels to relevant pieces of qualitative data. For example:

  • “Cannot find export”
  • “Uses spreadsheet as workaround”
  • “Checks export before sending”
  • “Asks coworker for help”

Good codes describe what is happening rather than jumping immediately to a conclusion.

For example, “doesn't trust the product” is an interpretation. “Checks the export twice before sending” describes an observed behavior. Keeping those separate gives you room to discover what the behavior means later.

There are two common approaches to coding.

Inductive coding works from the bottom up. You read the data and allow codes to emerge from what participants actually said or did. This works particularly well for exploratory research, where you do not want an existing framework to determine what you notice.

Deductive coding starts with categories you have already defined. You might code against journey stages, product areas, jobs to be done, or a codebook from previous research. It is useful when you have specific questions or need to compare findings over time.

Most product research uses some combination of the two.

If you conduct recurring research, maintain a codebook with clear definitions for each code. Stable definitions make it easier to compare findings across studies and track whether a problem is becoming more or less common.

Where AI helps

AI is particularly useful for first-pass coding across large datasets.

Instead of manually applying the same codebook to dozens or hundreds of responses, you can use AI to identify passages that match established categories and suggest new codes when something does not fit.

The important phrase is first pass. Models tend to recognize recurring patterns more easily than unusual ones. That makes low-frequency codes especially important to review manually. A behavior that appeared once or twice may be noise, but it may also reveal an edge case, emerging need, or customer segment your existing framework does not capture.

Great Question's AI research capabilities can help teams analyze qualitative research while keeping the analysis connected to the original source material.

Step 3: Cluster related codes

Once you have coded the data, start grouping related observations.

This is the logic behind affinity mapping. You take individual codes and move them into groups based on relationships you see between them. Imagine your dataset includes:

  • Cannot find export
  • Uses spreadsheet as workaround
  • Checks export before sending
  • Rebuilds report manually
  • Asks coworker whether export is complete

Those observations may belong together, but you do not have to decide what they mean yet. At this stage, you are looking for structure.

Where AI helps

AI can propose clusters quickly, particularly when you have hundreds of coded observations.

One useful approach is to ask for more than one possible grouping. If several clustering attempts produce similar groups, that can point toward a relatively stable pattern. If the same observations move between groups depending on the analysis, that ambiguity is worth examining rather than forcing everything into a clean structure.

Treat AI-generated clusters as proposals, not conclusions.

Step 4: Develop themes

Clusters organize observations. Themes explain what those observations may mean together. For example, a cluster about export problems becomes the theme: customers rebuild reports manually because they are unsure whether exported data is complete.

The second statement gives the team something it can investigate and potentially act on.

A useful theme should be specific enough that the evidence could prove it wrong. “Users want better performance” is too broad to be particularly useful. “Users abandon report generation when processing takes long enough that they are unsure whether the system is still working” gives you something concrete to examine.

As you develop themes, attach evidence counts. Instead of writing that customers do not trust exports, write that nine of 12 participants checked or manually verified exported data before sharing it.

The count does not make a qualitative finding statistically representative. It does show readers how much evidence within your study supports the observation and prevents a memorable comment from accidentally becoming what users think.

Where AI helps

AI can suggest themes from clusters, but this is where researcher involvement becomes increasingly important.

A model can turn a cluster into a polished sentence. That does not necessarily make the sentence insightful.

Review whether the proposed theme explains something meaningful, whether alternative interpretations are possible, and whether the underlying evidence actually supports it.

Step 5: Interpret what the findings mean

Interpretation is where qualitative analysis connects research to a real decision.

Suppose your analysis shows that customers repeatedly verify exports before sending them. What does that mean?

Maybe the export is unreliable. Maybe customers merely believe it is unreliable. Maybe the interface does not communicate when the export is complete. Maybe one previous error taught customers not to trust it.

Those explanations could lead to completely different product decisions. This is why interpretation cannot be reduced to counting themes.

Researchers and product teams need to bring in context: what has already shipped, which customers are affected, what other evidence exists, what constraints the team faces, and what decision the research was intended to inform.

AI can help you challenge an interpretation or surface alternative explanations, but it should not make the product decision for you.

Frequency is evidence. It is not automatically a priority.

A problem mentioned by 20 customers may matter less strategically than one experienced by two customers if those two represent an important audience or the problem prevents them from completing a critical task.

Step 6: Connect every finding to evidence

A finding should always lead back to the evidence that supports it.

That means preserving the relevant transcript passages, clips, observations, or responses rather than allowing the final research report to become detached from its sources.

AI is useful here because retrieval is a search problem. Instead of manually searching 30 transcripts for every reference to an export workflow, you can retrieve the relevant passages quickly.

Choosing which evidence best represents the finding still requires judgment. The most dramatic quote is not necessarily the most representative one. Look for evidence that clearly demonstrates the behavior or problem you are describing without exaggerating what the dataset supports.

This traceability becomes especially important with AI-assisted analysis. Anyone reviewing a generated theme should be able to return to the underlying research and decide whether the interpretation holds up. For more on turning research into defensible findings, see our research synthesis guide.

What AI can miss in qualitative data

AI-assisted qualitative analysis is useful precisely because it can process more material than a researcher could reasonably analyze manually in the same amount of time. But there are several things worth actively checking.

  • Outliers. An unusual workflow may get absorbed into the nearest larger pattern. Review low-frequency codes and participants whose experiences differ significantly from the rest.
  • Intensity. A summary can capture that someone mentioned a problem without preserving how strongly they reacted to it. Return to the recording or transcript when emotional intensity matters.
  • Contradictions. Participants sometimes say one thing and behave differently, or contradict something they said earlier in the session. Those tensions can be more informative than a perfectly consistent answer.
  • Absence. What participants do not mention can sometimes matter too. If nobody brings up the feature your team expected to dominate the conversation, AI will not necessarily flag its absence unless you specifically ask.
  • Confidence. A theme supported by two participants can sound just as polished as one supported by 11. Attach evidence counts and source material so readers can distinguish between them.

The point is not that AI analysis cannot be trusted. It is that its output should remain inspectable.

A quality-check protocol for AI-assisted analysis

Before findings make their way into a product decision or stakeholder presentation, run a few checks.

  • Spot-check the coding. Choose a sample of coded passages and compare the AI-generated codes with how you would code them yourself. If you disagree frequently, revisit the code definitions before scaling the analysis.
  • Run another clustering pass. Ask the system to organize the same codes again or propose an alternative grouping. Patterns that remain stable deserve attention. Patterns that move may require closer examination.
  • Review the tails. Look manually at codes that occur only once or twice. They may be irrelevant edge cases, but they may also contain the most surprising insight in the dataset.
  • Ask what is missing. Identify a few things you expected participants to discuss but did not see in the analysis. Check the original material to determine whether those topics were genuinely absent or simply missed during coding.

These checks do not require redoing the entire analysis manually. They give you targeted ways to test whether automation has hidden something important.

Choosing a qualitative data analysis approach

There is no single qualitative analysis method that works for every research question.

  • Thematic analysis identifies recurring patterns across a dataset. It is a strong default for many product research studies, particularly interviews and open-ended responses.
  • Content analysis uses defined categories to organize and sometimes count qualitative material. It can be useful when you need to compare recurring feedback over time.
  • Framework analysis organizes findings against a predefined structure or matrix. It works well for applied research where several researchers need to analyze material consistently.
  • Grounded theory develops theories iteratively from the data itself. It is designed for deeper exploratory work and typically requires more time and methodological rigor than everyday product research.

For most product teams, choosing the method matters less than applying it consistently and making sure it fits the research question. Our UX research methods guide covers the broader range of approaches available to research teams, and our roundup of qualitative data analysis software covers the tools.

How much qualitative data is enough?

There is no universal number of interviews or responses that guarantees a reliable qualitative finding.

The right amount depends on your research question, how similar your participants are, how complex the behavior is, and how much variation continues to appear in the data.

For exploratory qualitative work, pay attention to whether additional sessions continue producing meaningfully new information.

If new interviews keep introducing new behaviors, needs, or codes, you probably have more to learn. That may also indicate that the audience you thought was one segment actually contains several distinct groups.

If new sessions largely reinforce patterns you have already observed, you may have enough evidence to make the decision in front of you.

Be precise when reporting what you found. Instead of implying that a qualitative study represents your entire customer base, report the evidence within the study: seven of 10 participants struggled to locate the export setting.

If you need to know what percentage of your entire customer population experiences that problem, you need a quantitative study designed to answer that question.

A practical AI-assisted qualitative data analysis workflow

Putting the pieces together, a practical workflow looks like this:

  1. Bring the research into one place. Your analysis can only work across evidence you can access.
  2. Transcribe recordings and review important terminology. Check participant names, product names, acronyms, and specialized language.
  3. Use AI for initial familiarization. Generate per-session summaries and flag unusual responses or contradictions.
  4. Review notable sessions yourself. Return to the full source rather than relying entirely on the summary.
  5. Run first-pass coding. Apply your existing codebook and allow room for new codes to emerge.
  6. Review low-frequency codes. Pay particular attention to observations that do not fit the dominant patterns.
  7. Cluster related observations. Use AI to propose groupings, then review whether those relationships make sense.
  8. Develop themes. Turn clusters into specific statements supported by evidence counts.
  9. Interpret findings with the team. Connect the research to the product decision, business context, and other available evidence.
  10. Preserve the findings and their sources. Store the analysis somewhere searchable so future teams can reuse what you learned.

A centralized research repository makes that final step especially important. Research becomes more valuable when the next team can find it rather than repeating the same study six months later.

Where the time actually goes

It is easy to assume coding is the biggest bottleneck in qualitative analysis because it is one of the most visibly repetitive tasks.

In practice, research teams also lose significant time to work surrounding the analysis: recruiting participants, coordinating studies, moving data between tools, finding previous research, and turning findings into something other teams can use.

That is why speeding up coding alone does not necessarily speed up the entire research process.

Great Question brings recruitment, research, analysis, and the repository into one platform so teams can reduce some of that operational work along with the manual analysis. Asana, for example, reduced recruitment timelines from roughly two weeks to two or three days, and other enterprise teams have cut research turnaround time by more than half.

The broader lesson is that AI works best when it is part of a research workflow rather than another disconnected analysis step. Read more about AI analysis and synthesis or explore Great Question's broader guide to AI in UX research.

Use AI for the work it does well

AI has changed how much qualitative material researchers can realistically analyze.

Tasks that once required hours of manual sorting can now happen much faster. Researchers can search across large datasets, apply first-pass codes, find related observations, and retrieve supporting evidence without rereading every transcript from beginning to end.

That creates an opportunity to spend more time on the work automation does not remove: asking better questions, investigating contradictions, interpreting findings in context, and deciding what matters enough to act on.

The strongest AI-assisted analysis is not the analysis with the least human involvement. It is the analysis where automation handles the repetitive work while the evidence remains visible and people remain responsible for the conclusions.

Book a demo

Frequently asked questions

What is qualitative data analysis?

Qualitative data analysis is the process of finding patterns in non-numerical data, such as interviews, open-ended survey responses, usability sessions, and customer feedback, and turning those patterns into findings that answer a research question.

A practical process includes familiarizing yourself with the data, coding observations, clustering related codes, developing themes, interpreting what those themes mean, and connecting findings back to supporting evidence.

Can AI do qualitative data analysis?

AI can handle several parts of qualitative data analysis effectively, particularly summarization, first-pass coding, clustering, and retrieving relevant source material across large datasets.

Human judgment remains important for interpreting what findings mean, evaluating unusual or contradictory evidence, understanding business context, and deciding which conclusions matter enough to act on.

What is the difference between coding and theming?

Coding labels what is happening in a specific piece of qualitative data. For example, “uses spreadsheet as workaround” could be a code.

Theming connects multiple codes into a broader explanation of what is happening. A theme might be: customers rebuild reports manually because they do not trust exported data to be complete.

How much qualitative data do you need?

There is no universal number. It depends on your research question, participant population, method, and the amount of variation in the data.

For qualitative research, pay attention to whether additional sessions continue producing meaningfully new information. If you need a statistically representative estimate of how common a finding is across a population, use an appropriately designed quantitative study.

What is the difference between inductive and deductive coding?

Inductive coding allows codes to emerge from the data itself and is particularly useful for exploratory research.

Deductive coding starts with predefined categories or a codebook and applies them to the data. It works well when you have specific research questions or need to compare results across studies or over time. Many qualitative research projects combine both approaches.

How do you check the quality of AI-assisted qualitative analysis?

Spot-check a sample of coded passages against the original data, review low-frequency codes and outliers, run alternative clustering passes, and check whether topics you expected to find were genuinely absent or simply missed.

Most importantly, keep AI-generated findings connected to their underlying transcripts, recordings, or responses so researchers can inspect the evidence behind each conclusion.

Share