qualitative methods use research questions and quantitative methods use

Qualitative vs Quantitative Research Methods & Data Analysis

Saul McLeod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul McLeod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Learn about our Editorial Process

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

The main difference between quantitative and qualitative research is the type of data they collect and analyze.

Quantitative data is information about quantities, and therefore numbers, and qualitative data is descriptive, and regards phenomenon which can be observed but not measured, such as language.

• Quantitative research collects numerical data and analyzes it using statistical methods. The aim is to produce objective, empirical data that can be measured and expressed numerically. Quantitative research is often used to test hypotheses, identify patterns, and make predictions.
• Qualitative research gathers non-numerical data (words, images, sounds) to explore subjective experiences and attitudes, often via observation and interviews. It aims to produce detailed descriptions and uncover new insights about the studied phenomenon.

On This Page:

What Is Qualitative Research?

Qualitative research is the process of collecting, analyzing, and interpreting non-numerical data, such as language. Qualitative research can be used to understand how an individual subjectively perceives and gives meaning to their social reality.

Qualitative data is non-numerical data, such as text, video, photographs, or audio recordings. This type of data can be collected using diary accounts or in-depth interviews and analyzed using grounded theory or thematic analysis.

Qualitative research is multimethod in focus, involving an interpretive, naturalistic approach to its subject matter. This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them. Denzin and Lincoln (1994, p. 2)

Interest in qualitative data came about as the result of the dissatisfaction of some psychologists (e.g., Carl Rogers) with the scientific study of psychologists such as behaviorists (e.g., Skinner ).

Since psychologists study people, the traditional approach to science is not seen as an appropriate way of carrying out research since it fails to capture the totality of human experience and the essence of being human.  Exploring participants’ experiences is known as a phenomenological approach (re: Humanism ).

Qualitative research is primarily concerned with meaning, subjectivity, and lived experience. The goal is to understand the quality and texture of people’s experiences, how they make sense of them, and the implications for their lives.

Qualitative research aims to understand the social reality of individuals, groups, and cultures as nearly as possible as participants feel or live it. Thus, people and groups are studied in their natural setting.

Some examples of qualitative research questions are provided, such as what an experience feels like, how people talk about something, how they make sense of an experience, and how events unfold for people.

Research following a qualitative approach is exploratory and seeks to explain ‘how’ and ‘why’ a particular phenomenon, or behavior, operates as it does in a particular context. It can be used to generate hypotheses and theories from the data.

Qualitative Methods

There are different types of qualitative research methods, including diary accounts, in-depth interviews , documents, focus groups , case study research , and ethnography .

The results of qualitative methods provide a deep understanding of how people perceive their social realities and in consequence, how they act within the social world.

The researcher has several methods for collecting empirical materials, ranging from the interview to direct observation, to the analysis of artifacts, documents, and cultural records, to the use of visual materials or personal experience. Denzin and Lincoln (1994, p. 14)

Here are some examples of qualitative data:

Interview transcripts : Verbatim records of what participants said during an interview or focus group. They allow researchers to identify common themes and patterns, and draw conclusions based on the data. Interview transcripts can also be useful in providing direct quotes and examples to support research findings.

Observations : The researcher typically takes detailed notes on what they observe, including any contextual information, nonverbal cues, or other relevant details. The resulting observational data can be analyzed to gain insights into social phenomena, such as human behavior, social interactions, and cultural practices.

Unstructured interviews : generate qualitative data through the use of open questions.  This allows the respondent to talk in some depth, choosing their own words.  This helps the researcher develop a real sense of a person’s understanding of a situation.

Diaries or journals : Written accounts of personal experiences or reflections.

Notice that qualitative data could be much more than just words or text. Photographs, videos, sound recordings, and so on, can be considered qualitative data. Visual data can be used to understand behaviors, environments, and social interactions.

Qualitative Data Analysis

Qualitative research is endlessly creative and interpretive. The researcher does not just leave the field with mountains of empirical data and then easily write up his or her findings.

Qualitative interpretations are constructed, and various techniques can be used to make sense of the data, such as content analysis, grounded theory (Glaser & Strauss, 1967), thematic analysis (Braun & Clarke, 2006), or discourse analysis .

For example, thematic analysis is a qualitative approach that involves identifying implicit or explicit ideas within the data. Themes will often emerge once the data has been coded .

Key Features

• Events can be understood adequately only if they are seen in context. Therefore, a qualitative researcher immerses her/himself in the field, in natural surroundings. The contexts of inquiry are not contrived; they are natural. Nothing is predefined or taken for granted.
• Qualitative researchers want those who are studied to speak for themselves, to provide their perspectives in words and other actions. Therefore, qualitative research is an interactive process in which the persons studied teach the researcher about their lives.
• The qualitative researcher is an integral part of the data; without the active participation of the researcher, no data exists.
• The study’s design evolves during the research and can be adjusted or changed as it progresses. For the qualitative researcher, there is no single reality. It is subjective and exists only in reference to the observer.
• The theory is data-driven and emerges as part of the research process, evolving from the data as they are collected.

Limitations of Qualitative Research

• Because of the time and costs involved, qualitative designs do not generally draw samples from large-scale data sets.
• The problem of adequate validity or reliability is a major criticism. Because of the subjective nature of qualitative data and its origin in single contexts, it is difficult to apply conventional standards of reliability and validity. For example, because of the central role played by the researcher in the generation of data, it is not possible to replicate qualitative studies.
• Also, contexts, situations, events, conditions, and interactions cannot be replicated to any extent, nor can generalizations be made to a wider context than the one studied with confidence.
• The time required for data collection, analysis, and interpretation is lengthy. Analysis of qualitative data is difficult, and expert knowledge of an area is necessary to interpret qualitative data. Great care must be taken when doing so, for example, looking for mental illness symptoms.

Advantages of Qualitative Research

• Because of close researcher involvement, the researcher gains an insider’s view of the field. This allows the researcher to find issues that are often missed (such as subtleties and complexities) by the scientific, more positivistic inquiries.
• Qualitative descriptions can be important in suggesting possible relationships, causes, effects, and dynamic processes.
• Qualitative analysis allows for ambiguities/contradictions in the data, which reflect social reality (Denscombe, 2010).
• Qualitative research uses a descriptive, narrative style; this research might be of particular benefit to the practitioner as she or he could turn to qualitative reports to examine forms of knowledge that might otherwise be unavailable, thereby gaining new insight.

What Is Quantitative Research?

Quantitative research involves the process of objectively collecting and analyzing numerical data to describe, predict, or control variables of interest.

The goals of quantitative research are to test causal relationships between variables , make predictions, and generalize results to wider populations.

Quantitative researchers aim to establish general laws of behavior and phenomenon across different settings/contexts. Research is used to test a theory and ultimately support or reject it.

Quantitative Methods

Experiments typically yield quantitative data, as they are concerned with measuring things.  However, other research methods, such as controlled observations and questionnaires , can produce both quantitative information.

For example, a rating scale or closed questions on a questionnaire would generate quantitative data as these produce either numerical data or data that can be put into categories (e.g., “yes,” “no” answers).

Experimental methods limit how research participants react to and express appropriate social behavior.

Findings are, therefore, likely to be context-bound and simply a reflection of the assumptions that the researcher brings to the investigation.

There are numerous examples of quantitative data in psychological research, including mental health. Here are a few examples:

Another example is the Experience in Close Relationships Scale (ECR), a self-report questionnaire widely used to assess adult attachment styles .

The ECR provides quantitative data that can be used to assess attachment styles and predict relationship outcomes.

Neuroimaging data : Neuroimaging techniques, such as MRI and fMRI, provide quantitative data on brain structure and function.

This data can be analyzed to identify brain regions involved in specific mental processes or disorders.

For example, the Beck Depression Inventory (BDI) is a clinician-administered questionnaire widely used to assess the severity of depressive symptoms in individuals.

The BDI consists of 21 questions, each scored on a scale of 0 to 3, with higher scores indicating more severe depressive symptoms. 

Quantitative Data Analysis

Statistics help us turn quantitative data into useful information to help with decision-making. We can use statistics to summarize our data, describing patterns, relationships, and connections. Statistics can be descriptive or inferential.

Descriptive statistics help us to summarize our data. In contrast, inferential statistics are used to identify statistically significant differences between groups of data (such as intervention and control groups in a randomized control study).

• Quantitative researchers try to control extraneous variables by conducting their studies in the lab.
• The research aims for objectivity (i.e., without bias) and is separated from the data.
• The design of the study is determined before it begins.
• For the quantitative researcher, the reality is objective, exists separately from the researcher, and can be seen by anyone.
• Research is used to test a theory and ultimately support or reject it.

Limitations of Quantitative Research

• Context: Quantitative experiments do not take place in natural settings. In addition, they do not allow participants to explain their choices or the meaning of the questions they may have for those participants (Carr, 1994).
• Researcher expertise: Poor knowledge of the application of statistical analysis may negatively affect analysis and subsequent interpretation (Black, 1999).
• Variability of data quantity: Large sample sizes are needed for more accurate analysis. Small-scale quantitative studies may be less reliable because of the low quantity of data (Denscombe, 2010). This also affects the ability to generalize study findings to wider populations.
• Confirmation bias: The researcher might miss observing phenomena because of focus on theory or hypothesis testing rather than on the theory of hypothesis generation.

Advantages of Quantitative Research

• Scientific objectivity: Quantitative data can be interpreted with statistical analysis, and since statistics are based on the principles of mathematics, the quantitative approach is viewed as scientifically objective and rational (Carr, 1994; Denscombe, 2010).
• Useful for testing and validating already constructed theories.
• Rapid analysis: Sophisticated software removes much of the need for prolonged data analysis, especially with large volumes of data involved (Antonius, 2003).
• Replication: Quantitative data is based on measured values and can be checked by others because numerical data is less open to ambiguities of interpretation.
• Hypotheses can also be tested because of statistical analysis (Antonius, 2003).

Antonius, R. (2003). Interpreting quantitative data with SPSS . Sage.

Black, T. R. (1999). Doing quantitative research in the social sciences: An integrated approach to research design, measurement and statistics . Sage.

Braun, V. & Clarke, V. (2006). Using thematic analysis in psychology . Qualitative Research in Psychology , 3, 77–101.

Carr, L. T. (1994). The strengths and weaknesses of quantitative and qualitative research : what method for nursing? Journal of advanced nursing, 20(4) , 716-721.

Denscombe, M. (2010). The Good Research Guide: for small-scale social research. McGraw Hill.

Denzin, N., & Lincoln. Y. (1994). Handbook of Qualitative Research. Thousand Oaks, CA, US: Sage Publications Inc.

Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968). The discovery of grounded theory; strategies for qualitative research. Nursing research, 17(4) , 364.

Minichiello, V. (1990). In-Depth Interviewing: Researching People. Longman Cheshire.

Punch, K. (1998). Introduction to Social Research: Quantitative and Qualitative Approaches. London: Sage

Further Information

• Mixed methods research
• Designing qualitative research
• Methods of data collection and analysis
• Introduction to quantitative and qualitative research
• Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
• Qualitative research in health care: Analysing qualitative data
• Qualitative data analysis: the framework approach
• Using the framework method for the analysis of
• Qualitative data in multi-disciplinary health research
• Content Analysis
• Grounded Theory
• Thematic Analysis

Educational resources and simple solutions for your research journey

Qualitative vs Quantitative Research: Differences, Examples, and Methods

There are two broad kinds of research approaches: qualitative and quantitative research that are used to study and analyze phenomena in various fields such as natural sciences, social sciences, and humanities. Whether you have realized it or not, your research must have followed either or both research types. In this article we will discuss what qualitative vs quantitative research is, their applications, pros and cons, and when to use qualitative vs quantitative research . Before we get into the details, it is important to understand the differences between the qualitative and quantitative research.     

Table of Contents

Qualitative v s Quantitative Research  

Quantitative research deals with quantity, hence, this research type is concerned with numbers and statistics to prove or disapprove theories or hypothesis. In contrast, qualitative research is all about quality – characteristics, unquantifiable features, and meanings to seek deeper understanding of behavior and phenomenon. These two methodologies serve complementary roles in the research process, each offering unique insights and methods suited to different research questions and objectives.    

Qualitative and quantitative research approaches have their own unique characteristics, drawbacks, advantages, and uses. Where quantitative research is mostly employed to validate theories or assumptions with the goal of generalizing facts to the larger population, qualitative research is used to study concepts, thoughts, or experiences for the purpose of gaining the underlying reasons, motivations, and meanings behind human behavior .   

What Are the Differences Between Qualitative and Quantitative Research  

Qualitative and quantitative research differs in terms of the methods they employ to conduct, collect, and analyze data. For example, qualitative research usually relies on interviews, observations, and textual analysis to explore subjective experiences and diverse perspectives. While quantitative data collection methods include surveys, experiments, and statistical analysis to gather and analyze numerical data. The differences between the two research approaches across various aspects are listed in the table below.    

Data Collection Methods  

There are differences between qualitative and quantitative research when it comes to data collection as they deal with different types of data. Qualitative research is concerned with personal or descriptive accounts to understand human behavior within society. Quantitative research deals with numerical or measurable data to delineate relations among variables. Hence, the qualitative data collection methods differ significantly from quantitative data collection methods due to the nature of data being collected and the research objectives. Below is the list of data collection methods for each research approach:    

Qualitative Research Data Collection  

• Interviews  
• Focus g roups  
• Content a nalysis  
• Literature review  
• Observation  
• Ethnography  

Qualitative research data collection can involve one-on-one group interviews to capture in-depth perspectives of participants using open-ended questions. These interviews could be structured, semi-structured or unstructured depending upon the nature of the study. Focus groups can be used to explore specific topics and generate rich data through discussions among participants. Another qualitative data collection method is content analysis, which involves systematically analyzing text documents, audio, and video files or visual content to uncover patterns, themes, and meanings. This can be done through coding and categorization of raw data to draw meaningful insights. Data can be collected through observation studies where the goal is to simply observe and document behaviors, interaction, and phenomena in natural settings without interference. Lastly, ethnography allows one to immerse themselves in the culture or environment under study for a prolonged period to gain a deep understanding of the social phenomena.   

Quantitative Research Data Collection  

• Surveys/ q uestionnaires  
• Experiments
• Secondary data analysis  
• Structured o bservations  
• Case studies   
• Tests and a ssessments  

Quantitative research data collection approaches comprise of fundamental methods for generating numerical data that can be analyzed using statistical or mathematical tools. The most common quantitative data collection approach is the usage of structured surveys with close-ended questions to collect quantifiable data from a large sample of participants. These can be conducted online, over the phone, or in person.   

Performing experiments is another important data collection approach, in which variables are manipulated under controlled conditions to observe their effects on dependent variables. This often involves random assignment of participants to different conditions or groups. Such experimental settings are employed to gauge cause-and-effect relationships and understand a complex phenomenon. At times, instead of acquiring original data, researchers may deal with secondary data, which is the dataset curated by others, such as government agencies, research organizations, or academic institute. With structured observations, subjects in a natural environment can be studied by controlling the variables which aids in understanding the relationship among various variables. The secondary data is then analyzed to identify patterns and relationships among variables. Observational studies provide a means to systematically observe and record behaviors or phenomena as they occur in controlled environments. Case studies form an interesting study methodology in which a researcher studies a single entity or a small number of entities (individuals or organizations) in detail to understand complex phenomena within a specific context.   

Qualitative vs Quantitative Research Outcomes  

Qualitative research and quantitative research lead to varied research outcomes, each with its own strengths and limitations. For example, qualitative research outcomes provide deep descriptive accounts of human experiences, motivations, and perspectives that allow us to identify themes or narratives and context in which behavior, attitudes, or phenomena occurs.  Quantitative research outcomes on the other hand produce numerical data that is analyzed statistically to establish patterns and relationships objectively, to form generalizations about the larger population and make predictions. This numerical data can be presented in the form of graphs, tables, or charts. Both approaches offer valuable perspectives on complex phenomena, with qualitative research focusing on depth and interpretation, while quantitative research emphasizes numerical analysis and objectivity.  

When to Use Qualitative vs Quantitative Research Approach  

The decision to choose between qualitative and quantitative research depends on various factors, such as the research question, objectives, whether you are taking an inductive or deductive approach, available resources, practical considerations such as time and money, and the nature of the phenomenon under investigation. To simplify, quantitative research can be used if the aim of the research is to prove or test a hypothesis, while qualitative research should be used if the research question is more exploratory and an in-depth understanding of the concepts, behavior, or experiences is needed.     

Qualitative research approach  

Qualitative research approach is used under following scenarios:   

• To study complex phenomena: When the research requires understanding the depth, complexity, and context of a phenomenon.  
• Collecting participant perspectives: When the goal is to understand the why behind a certain behavior, and a need to capture subjective experiences and perceptions of participants.  
• Generating hypotheses or theories: When generating hypotheses, theories, or conceptual frameworks based on exploratory research.  

Example: If you have a research question “What obstacles do expatriate students encounter when acquiring a new language in their host country?”  

This research question can be addressed using the qualitative research approach by conducting in-depth interviews with 15-25 expatriate university students. Ask open-ended questions such as “What are the major challenges you face while attempting to learn the new language?”, “Do you find it difficult to learn the language as an adult?”, and “Do you feel practicing with a native friend or colleague helps the learning process”?  

Based on the findings of these answers, a follow-up questionnaire can be planned to clarify things. Next step will be to transcribe all interviews using transcription software and identify themes and patterns.   

Quantitative research approach  

Quantitative research approach is used under following scenarios:   

• Testing hypotheses or proving theories: When aiming to test hypotheses, establish relationships, or examine cause-and-effect relationships.   
• Generalizability: When needing findings that can be generalized to broader populations using large, representative samples.  
• Statistical analysis: When requiring rigorous statistical analysis to quantify relationships, patterns, or trends in data.   

Example : Considering the above example, you can conduct a survey of 200-300 expatriate university students and ask them specific questions such as: “On a scale of 1-10 how difficult is it to learn a new language?”  

Next, statistical analysis can be performed on the responses to draw conclusions like, on an average expatriate students rated the difficulty of learning a language 6.5 on the scale of 10.    

Mixed methods approach  

In many cases, researchers may opt for a mixed methods approach , combining qualitative and quantitative methods to leverage the strengths of both approaches. Researchers may use qualitative data to explore phenomena in-depth and generate hypotheses, while quantitative data can be used to test these hypotheses and generalize findings to broader populations.  

Example: Both qualitative and quantitative research methods can be used in combination to address the above research question. Through open-ended questions you can gain insights about different perspectives and experiences while quantitative research allows you to test that knowledge and prove/disprove your hypothesis.   

How to Analyze Qualitative and Quantitative Data  

When it comes to analyzing qualitative and quantitative data, the focus is on identifying patterns in the data to highlight the relationship between elements. The best research method for any given study should be chosen based on the study aim. A few methods to analyze qualitative and quantitative data are listed below.  

Analyzing qualitative data  

Qualitative data analysis is challenging as it is not expressed in numbers and consists majorly of texts, images, or videos. Hence, care must be taken while using any analytical approach. Some common approaches to analyze qualitative data include:  

• Organization: The first step is data (transcripts or notes) organization into different categories with similar concepts, themes, and patterns to find inter-relationships.  
• Coding: Data can be arranged in categories based on themes/concepts using coding.  
• Theme development: Utilize higher-level organization to group related codes into broader themes.  
• Interpretation: Explore the meaning behind different emerging themes to understand connections. Use different perspectives like culture, environment, and status to evaluate emerging themes.  
• Reporting: Present findings with quotes or excerpts to illustrate key themes.   

Analyzing quantitative data  

Quantitative data analysis is more direct compared to qualitative data as it primarily deals with numbers. Data can be evaluated using simple math or advanced statistics (descriptive or inferential). Some common approaches to analyze quantitative data include:  

• Processing raw data: Check missing values, outliers, or inconsistencies in raw data.  
• Descriptive statistics: Summarize data with means, standard deviations, or standard error using programs such as Excel, SPSS, or R language.  
• Exploratory data analysis: Usage of visuals to deduce patterns and trends.  
• Hypothesis testing: Apply statistical tests to find significance and test hypothesis (Student’s t-test or ANOVA).  
• Interpretation: Analyze results considering significance and practical implications.  
• Validation: Data validation through replication or literature review.  
• Reporting: Present findings by means of tables, figures, or graphs.   

Benefits and limitations of qualitative vs quantitative research  

There are significant differences between qualitative and quantitative research; we have listed the benefits and limitations of both methods below:  

Benefits of qualitative research  

• Rich insights: As qualitative research often produces information-rich data, it aids in gaining in-depth insights into complex phenomena, allowing researchers to explore nuances and meanings of the topic of study.  
• Flexibility: One of the most important benefits of qualitative research is flexibility in acquiring and analyzing data that allows researchers to adapt to the context and explore more unconventional aspects.  
• Contextual understanding: With descriptive and comprehensive data, understanding the context in which behaviors or phenomena occur becomes accessible.   
• Capturing different perspectives: Qualitative research allows for capturing different participant perspectives with open-ended question formats that further enrich data.   
• Hypothesis/theory generation: Qualitative research is often the first step in generating theory/hypothesis, which leads to future investigation thereby contributing to the field of research.

Limitations of qualitative research  

• Subjectivity: It is difficult to have objective interpretation with qualitative research, as research findings might be influenced by the expertise of researchers. The risk of researcher bias or interpretations affects the reliability and validity of the results.   
• Limited generalizability: Due to the presence of small, non-representative samples, the qualitative data cannot be used to make generalizations to a broader population.  
• Cost and time intensive: Qualitative data collection can be time-consuming and resource-intensive, therefore, it requires strategic planning and commitment.   
• Complex analysis: Analyzing qualitative data needs specialized skills and techniques, hence, it’s challenging for researchers without sufficient training or experience.   
• Potential misinterpretation: There is a risk of sampling bias and misinterpretation in data collection and analysis if researchers lack cultural or contextual understanding.   

Benefits of quantitative research  

• Objectivity: A key benefit of quantitative research approach, this objectivity reduces researcher bias and subjectivity, enhancing the reliability and validity of findings.   
• Generalizability: For quantitative research, the sample size must be large and representative enough to allow for generalization to broader populations.   
• Statistical analysis: Quantitative research enables rigorous statistical analysis (increasing power of the analysis), aiding hypothesis testing and finding patterns or relationship among variables.   
• Efficiency: Quantitative data collection and analysis is usually more efficient compared to the qualitative methods, especially when dealing with large datasets.   
• Clarity and Precision: The findings are usually clear and precise, making it easier to present them as graphs, tables, and figures to convey them to a larger audience.  

Limitations of quantitative research  

• Lacks depth and details: Due to its objective nature, quantitative research might lack the depth and richness of qualitative approaches, potentially overlooking important contextual factors or nuances.   
• Limited exploration: By not considering the subjective experiences of participants in depth , there’s a limited chance to study complex phenomenon in detail.   
• Potential oversimplification: Quantitative research may oversimplify complex phenomena by boiling them down to numbers, which might ignore key nuances.   
• Inflexibility: Quantitative research deals with predecided varibales and measures , which limits the ability of researchers to explore unexpected findings or adjust the research design as new findings become available .  
• Ethical consideration: Quantitative research may raise ethical concerns especially regarding privacy, informed consent, and the potential for harm, when dealing with sensitive topics or vulnerable populations.   

Frequently asked questions  

• What is the difference between qualitative and quantitative research? 

Quantitative methods use numerical data and statistical analysis for objective measurement and hypothesis testing, emphasizing generalizability. Qualitative methods gather non-numerical data to explore subjective experiences and contexts, providing rich, nuanced insights.  

• What are the types of qualitative research? 

Qualitative research methods include interviews, observations, focus groups, and case studies. They provide rich insights into participants’ perspectives and behaviors within their contexts, enabling exploration of complex phenomena.  

• What are the types of quantitative research? 

Quantitative research methods include surveys, experiments, observations, correlational studies, and longitudinal research. They gather numerical data for statistical analysis, aiming for objectivity and generalizability.  

• Can you give me examples for qualitative and quantitative research? 

Qualitative Research Example: 

Research Question: What are the experiences of parents with autistic children in accessing support services?  

Method: Conducting in-depth interviews with parents to explore their perspectives, challenges, and needs.  

Quantitative Research Example: 

Research Question: What is the correlation between sleep duration and academic performance in college students?  

Method: Distributing surveys to a large sample of college students to collect data on their sleep habits and academic performance, then analyzing the data statistically to determine any correlations.  

Editage All Access is a subscription-based platform that unifies the best AI tools and services designed to speed up, simplify, and streamline every step of a researcher’s journey. The Editage All Access Pack is a one-of-a-kind subscription that unlocks full access to an AI writing assistant, literature recommender, journal finder, scientific illustration tool, and exclusive discounts on professional publication services from Editage.  

Based on 22+ years of experience in academia, Editage All Access empowers researchers to put their best research forward and move closer to success. Explore our top AI Tools pack, AI Tools + Publication Services pack, or Build Your Own Plan. Find everything a researcher needs to succeed, all in one place –  Get All Access now starting at just $14 a month !    

Related Posts

Back to School – Lock-in All Access Pack for a Year at the Best Price

Journal Turnaround Time: Researcher.Life and Scholarly Intelligence Join Hands to Empower Researchers with Publication Time Insights 

• Bipolar Disorder
• Therapy Center
• When To See a Therapist
• Types of Therapy
• Best Online Therapy
• Best Couples Therapy
• Managing Stress
• Sleep and Dreaming
• Understanding Emotions
• Self-Improvement
• Healthy Relationships
• Student Resources
• Personality Types
• Sweepstakes
• Guided Meditations
• Verywell Mind Insights
• 2024 Verywell Mind 25
• Mental Health in the Classroom
• Editorial Process
• Meet Our Review Board
• Crisis Support

Quantitative vs. Qualitative Research in Psychology

• Key Differences

Quantitative Research Methods

Qualitative research methods.

• How They Relate

In psychology and other social sciences, researchers are faced with an unresolved question: Can we measure concepts like love or racism the same way we can measure temperature or the weight of a star? Social phenomena⁠—things that happen because of and through human behavior⁠—are especially difficult to grasp with typical scientific models.

At a Glance

Psychologists rely on quantitative and quantitative research to better understand human thought and behavior.

• Qualitative research involves collecting and evaluating non-numerical data in order to understand concepts or subjective opinions.
• Quantitative research involves collecting and evaluating numerical data. 

This article discusses what qualitative and quantitative research are, how they are different, and how they are used in psychology research.

Qualitative Research vs. Quantitative Research

In order to understand qualitative and quantitative psychology research, it can be helpful to look at the methods that are used and when each type is most appropriate.

Psychologists rely on a few methods to measure behavior, attitudes, and feelings. These include:

• Self-reports , like surveys or questionnaires
• Observation (often used in experiments or fieldwork)
• Implicit attitude tests that measure timing in responding to prompts

Most of these are quantitative methods. The result is a number that can be used to assess differences between groups.

However, most of these methods are static, inflexible (you can't change a question because a participant doesn't understand it), and provide a "what" answer rather than a "why" answer.

Sometimes, researchers are more interested in the "why" and the "how." That's where qualitative methods come in.

Qualitative research is about speaking to people directly and hearing their words. It is grounded in the philosophy that the social world is ultimately unmeasurable, that no measure is truly ever "objective," and that how humans make meaning is just as important as how much they score on a standardized test.

Used to develop theories

Takes a broad, complex approach

Answers "why" and "how" questions

Explores patterns and themes

Used to test theories

Takes a narrow, specific approach

Answers "what" questions

Explores statistical relationships

Quantitative methods have existed ever since people have been able to count things. But it is only with the positivist philosophy of Auguste Comte (which maintains that factual knowledge obtained by observation is trustworthy) that it became a "scientific method."

The scientific method follows this general process. A researcher must:

• Generate a theory or hypothesis (i.e., predict what might happen in an experiment) and determine the variables needed to answer their question
• Develop instruments to measure the phenomenon (such as a survey, a thermometer, etc.)
• Develop experiments to manipulate the variables
• Collect empirical (measured) data
• Analyze data

Quantitative methods are about measuring phenomena, not explaining them.

Quantitative research compares two groups of people. There are all sorts of variables you could measure, and many kinds of experiments to run using quantitative methods.

These comparisons are generally explained using graphs, pie charts, and other visual representations that give the researcher a sense of how the various data points relate to one another.

Basic Assumptions

Quantitative methods assume:

• That the world is measurable
• That humans can observe objectively
• That we can know things for certain about the world from observation

In some fields, these assumptions hold true. Whether you measure the size of the sun 2000 years ago or now, it will always be the same. But when it comes to human behavior, it is not so simple.

As decades of cultural and social research have shown, people behave differently (and even think differently) based on historical context, cultural context, social context, and even identity-based contexts like gender , social class, or sexual orientation .

Therefore, quantitative methods applied to human behavior (as used in psychology and some areas of sociology) should always be rooted in their particular context. In other words: there are no, or very few, human universals.

Statistical information is the primary form of quantitative data used in human and social quantitative research. Statistics provide lots of information about tendencies across large groups of people, but they can never describe every case or every experience. In other words, there are always outliers.

Correlation and Causation

A basic principle of statistics is that correlation is not causation. Researchers can only claim a cause-and-effect relationship under certain conditions:

• The study was a true experiment.
• The independent variable can be manipulated (for example, researchers cannot manipulate gender, but they can change the primer a study subject sees, such as a picture of nature or of a building).
• The dependent variable can be measured through a ratio or a scale.

So when you read a report that "gender was linked to" something (like a behavior or an attitude), remember that gender is NOT a cause of the behavior or attitude. There is an apparent relationship, but the true cause of the difference is hidden.

Pitfalls of Quantitative Research

Quantitative methods are one way to approach the measurement and understanding of human and social phenomena. But what's missing from this picture?

As noted above, statistics do not tell us about personal, individual experiences and meanings. While surveys can give a general idea, respondents have to choose between only a few responses. This can make it difficult to understand the subtleties of different experiences.

Quantitative methods can be helpful when making objective comparisons between groups or when looking for relationships between variables. They can be analyzed statistically, which can be helpful when looking for patterns and relationships.

Qualitative data are not made out of numbers but rather of descriptions, metaphors, symbols, quotes, analysis, concepts, and characteristics. This approach uses interviews, written texts, art, photos, and other materials to make sense of human experiences and to understand what these experiences mean to people.

While quantitative methods ask "what" and "how much," qualitative methods ask "why" and "how."

Qualitative methods are about describing and analyzing phenomena from a human perspective. There are many different philosophical views on qualitative methods, but in general, they agree that some questions are too complex or impossible to answer with standardized instruments.

These methods also accept that it is impossible to be completely objective in observing phenomena. Researchers have their own thoughts, attitudes, experiences, and beliefs, and these always color how people interpret results.

Qualitative Approaches

There are many different approaches to qualitative research, with their own philosophical bases. Different approaches are best for different kinds of projects. For example:

• Case studies and narrative studies are best for single individuals. These involve studying every aspect of a person's life in great depth.
• Phenomenology aims to explain experiences. This type of work aims to describe and explore different events as they are consciously and subjectively experienced.
• Grounded theory develops models and describes processes. This approach allows researchers to construct a theory based on data that is collected, analyzed, and compared to reach new discoveries.
• Ethnography describes cultural groups. In this approach, researchers immerse themselves in a community or group in order to observe behavior.

Qualitative researchers must be aware of several different methods and know each thoroughly enough to produce valuable research.

Some researchers specialize in a single method, but others specialize in a topic or content area and use many different methods to explore the topic, providing different information and a variety of points of view.

There is not a single model or method that can be used for every qualitative project. Depending on the research question, the people participating, and the kind of information they want to produce, researchers will choose the appropriate approach.

Interpretation

Qualitative research does not look into causal relationships between variables, but rather into themes, values, interpretations, and meanings. As a rule, then, qualitative research is not generalizable (cannot be applied to people outside the research participants).

The insights gained from qualitative research can extend to other groups with proper attention to specific historical and social contexts.

Relationship Between Qualitative and Quantitative Research

It might sound like quantitative and qualitative research do not play well together. They have different philosophies, different data, and different outputs. However, this could not be further from the truth.

These two general methods complement each other. By using both, researchers can gain a fuller, more comprehensive understanding of a phenomenon.

For example, a psychologist wanting to develop a new survey instrument about sexuality might and ask a few dozen people questions about their sexual experiences (this is qualitative research). This gives the researcher some information to begin developing questions for their survey (which is a quantitative method).

After the survey, the same or other researchers might want to dig deeper into issues brought up by its data. Follow-up questions like "how does it feel when...?" or "what does this mean to you?" or "how did you experience this?" can only be answered by qualitative research.

By using both quantitative and qualitative data, researchers have a more holistic, well-rounded understanding of a particular topic or phenomenon.

Qualitative and quantitative methods both play an important role in psychology. Where quantitative methods can help answer questions about what is happening in a group and to what degree, qualitative methods can dig deeper into the reasons behind why it is happening. By using both strategies, psychology researchers can learn more about human thought and behavior.

Gough B, Madill A. Subjectivity in psychological science: From problem to prospect . Psychol Methods . 2012;17(3):374-384. doi:10.1037/a0029313

Pearce T. “Science organized”: Positivism and the metaphysical club, 1865–1875 . J Hist Ideas . 2015;76(3):441-465.

Adams G. Context in person, person in context: A cultural psychology approach to social-personality psychology . In: Deaux K, Snyder M, eds. The Oxford Handbook of Personality and Social Psychology . Oxford University Press; 2012:182-208.

Brady HE. Causation and explanation in social science . In: Goodin RE, ed. The Oxford Handbook of Political Science. Oxford University Press; 2011. doi:10.1093/oxfordhb/9780199604456.013.0049

Chun Tie Y, Birks M, Francis K. Grounded theory research: A design framework for novice researchers .  SAGE Open Med . 2019;7:2050312118822927. doi:10.1177/2050312118822927

Reeves S, Peller J, Goldman J, Kitto S. Ethnography in qualitative educational research: AMEE Guide No. 80 . Medical Teacher . 2013;35(8):e1365-e1379. doi:10.3109/0142159X.2013.804977

Salkind NJ, ed. Encyclopedia of Research Design . Sage Publishing.

Shaughnessy JJ, Zechmeister EB, Zechmeister JS.  Research Methods in Psychology . McGraw Hill Education.

By Anabelle Bernard Fournier Anabelle Bernard Fournier is a researcher of sexual and reproductive health at the University of Victoria as well as a freelance writer on various health topics.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Methodology
• Qualitative vs Quantitative Research | Examples & Methods

Qualitative vs Quantitative Research | Examples & Methods

Published on 4 April 2022 by Raimo Streefkerk . Revised on 8 May 2023.

When collecting and analysing data, quantitative research deals with numbers and statistics, while qualitative research  deals with words and meanings. Both are important for gaining different kinds of knowledge.

Common quantitative methods include experiments, observations recorded as numbers, and surveys with closed-ended questions. Qualitative research Qualitative research is expressed in words . It is used to understand concepts, thoughts or experiences. This type of research enables you to gather in-depth insights on topics that are not well understood.

Table of contents

The differences between quantitative and qualitative research, data collection methods, when to use qualitative vs quantitative research, how to analyse qualitative and quantitative data, frequently asked questions about qualitative and quantitative research.

Quantitative and qualitative research use different research methods to collect and analyse data, and they allow you to answer different kinds of research questions.

Prevent plagiarism, run a free check.

Quantitative and qualitative data can be collected using various methods. It is important to use a data collection method that will help answer your research question(s).

Many data collection methods can be either qualitative or quantitative. For example, in surveys, observations or case studies , your data can be represented as numbers (e.g. using rating scales or counting frequencies) or as words (e.g. with open-ended questions or descriptions of what you observe).

However, some methods are more commonly used in one type or the other.

Quantitative data collection methods

• Surveys :  List of closed or multiple choice questions that is distributed to a sample (online, in person, or over the phone).
• Experiments : Situation in which variables are controlled and manipulated to establish cause-and-effect relationships.
• Observations: Observing subjects in a natural environment where variables can’t be controlled.

Qualitative data collection methods

• Interviews : Asking open-ended questions verbally to respondents.
• Focus groups: Discussion among a group of people about a topic to gather opinions that can be used for further research.
• Ethnography : Participating in a community or organisation for an extended period of time to closely observe culture and behavior.
• Literature review : Survey of published works by other authors.

A rule of thumb for deciding whether to use qualitative or quantitative data is:

• Use quantitative research if you want to confirm or test something (a theory or hypothesis)
• Use qualitative research if you want to understand something (concepts, thoughts, experiences)

For most research topics you can choose a qualitative, quantitative or mixed methods approach . Which type you choose depends on, among other things, whether you’re taking an inductive vs deductive research approach ; your research question(s) ; whether you’re doing experimental , correlational , or descriptive research ; and practical considerations such as time, money, availability of data, and access to respondents.

Quantitative research approach

You survey 300 students at your university and ask them questions such as: ‘on a scale from 1-5, how satisfied are your with your professors?’

You can perform statistical analysis on the data and draw conclusions such as: ‘on average students rated their professors 4.4’.

Qualitative research approach

You conduct in-depth interviews with 15 students and ask them open-ended questions such as: ‘How satisfied are you with your studies?’, ‘What is the most positive aspect of your study program?’ and ‘What can be done to improve the study program?’

Based on the answers you get you can ask follow-up questions to clarify things. You transcribe all interviews using transcription software and try to find commonalities and patterns.

Mixed methods approach

You conduct interviews to find out how satisfied students are with their studies. Through open-ended questions you learn things you never thought about before and gain new insights. Later, you use a survey to test these insights on a larger scale.

It’s also possible to start with a survey to find out the overall trends, followed by interviews to better understand the reasons behind the trends.

Qualitative or quantitative data by itself can’t prove or demonstrate anything, but has to be analysed to show its meaning in relation to the research questions. The method of analysis differs for each type of data.

Analysing quantitative data

Quantitative data is based on numbers. Simple maths or more advanced statistical analysis is used to discover commonalities or patterns in the data. The results are often reported in graphs and tables.

Applications such as Excel, SPSS, or R can be used to calculate things like:

• Average scores
• The number of times a particular answer was given
• The correlation or causation between two or more variables
• The reliability and validity of the results

Analysing qualitative data

Qualitative data is more difficult to analyse than quantitative data. It consists of text, images or videos instead of numbers.

Some common approaches to analysing qualitative data include:

• Qualitative content analysis : Tracking the occurrence, position and meaning of words or phrases
• Thematic analysis : Closely examining the data to identify the main themes and patterns
• Discourse analysis : Studying how communication works in social contexts

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to test a hypothesis by systematically collecting and analysing data, while qualitative methods allow you to explore ideas and experiences in depth.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

The research methods you use depend on the type of data you need to answer your research question .

• If you want to measure something or test a hypothesis , use quantitative methods . If you want to explore ideas, thoughts, and meanings, use qualitative methods .
• If you want to analyse a large amount of readily available data, use secondary data. If you want data specific to your purposes with control over how they are generated, collect primary data.
• If you want to establish cause-and-effect relationships between variables , use experimental methods. If you want to understand the characteristics of a research subject, use descriptive methods.

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organisations.

There are various approaches to qualitative data analysis , but they all share five steps in common:

• Prepare and organise your data.
• Review and explore your data.
• Develop a data coding system.
• Assign codes to the data.
• Identify recurring themes.

The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

Streefkerk, R. (2023, May 08). Qualitative vs Quantitative Research | Examples & Methods. Scribbr. Retrieved 3 September 2024, from https://www.scribbr.co.uk/research-methods/quantitative-qualitative-research/

Is this article helpful?

Raimo Streefkerk

The differences between qualitative and quantitative research methods

Last updated

15 January 2023

Reviewed by

Two approaches to this systematic information gathering are qualitative and quantitative research. Each of these has its place in data collection, but each one approaches from a different direction. Here's what you need to know about qualitative and quantitative research.

All your data in one place

Analyze your qualitative and quantitative data together in Dovetail and uncover deeper insights

• The differences between quantitative and qualitative research

The main difference between these two approaches is the type of data you collect and how you interpret it. Qualitative research focuses on word-based data, aiming to define and understand ideas. This study allows researchers to collect information in an open-ended way through interviews, ethnography, and observation. You’ll study this information to determine patterns and the interplay of variables.

On the other hand, quantitative research focuses on numerical data and using it to determine relationships between variables. Researchers use easily quantifiable forms of data collection, such as experiments that measure the effect of one or several variables on one another.

• Qualitative vs. quantitative data collection

Focusing on different types of data means that the data collection methods vary. 

Quantitative data collection methods

As previously stated, quantitative data collection focuses on numbers. You gather information through experiments, database reports, or surveys with multiple-choice answers. The goal is to have data you can use in numerical analysis to determine relationships.

Qualitative data collection methods

On the other hand, the data collected for qualitative research is an exploration of a subject's attributes, thoughts, actions, or viewpoints. Researchers will typically conduct interviews , hold focus groups, or observe behavior in a natural setting to assemble this information. Other options include studying personal accounts or cultural records. 

• Qualitative vs. quantitative outcomes

The two approaches naturally produce different types of outcomes. Qualitative research gains a better understanding of the reason something happens. For example, researchers may comb through feedback and statements to ascertain the reasoning behind certain behaviors or actions.

On the other hand, quantitative research focuses on the numerical analysis of data, which may show cause-and-effect relationships. Put another way, qualitative research investigates why something happens, while quantitative research looks at what happens.

• How to analyze qualitative and quantitative data

Because the two research methods focus on different types of information, analyzing the data you've collected will look different, depending on your approach.

Analyzing quantitative data

As this data is often numerical, you’ll likely use statistical analysis to identify patterns. Researchers may use computer programs to generate data such as averages or rate changes, illustrating the results in tables or graphs.

Analyzing qualitative data

Qualitative data is more complex and time-consuming to process as it may include written texts, videos, or images to study. Finding patterns in thinking, actions, and beliefs is more nuanced and subject to interpretation. 

Researchers may use techniques such as thematic analysis , combing through the data to identify core themes or patterns. Another tool is discourse analysis , which studies how communication functions in different contexts.

• When to use qualitative vs. quantitative research

Choosing between the two approaches comes down to understanding what your goal is with the research.

Qualitative research approach

Qualitative research is useful for understanding a concept, such as what people think about certain experiences or how cultural beliefs affect perceptions of events. It can help you formulate a hypothesis or clarify general questions about the topic.

Quantitative research approach

On the other hand, quantitative research verifies or tests a hypothesis you've developed, or you can use it to find answers to those questions. 

Mixed methods approach

Often, researchers use elements of both types of research to provide complex and targeted information. This may look like a survey with multiple-choice and open-ended questions.

• Benefits and limitations

Of course, each type of research has drawbacks and strengths. It's essential to be aware of the pros and cons.

Qualitative studies: Pros and cons

This approach lets you consider your subject creatively and examine big-picture questions. It can advance your global understanding of topics that are challenging to quantify.

On the other hand, the wide-open possibilities of qualitative research can make it tricky to focus effectively on your subject of inquiry. It makes it easier for researchers to skew the data with social biases and personal assumptions. There’s also the tendency for people to behave differently under observation.

It can also be more difficult to get a large sample size because it's generally more complex and expensive to conduct qualitative research. The process usually takes longer, as well. 

Quantitative studies: Pros and cons

The quantitative methodology produces data you can communicate and present without bias. The methods are direct and generally easier to reproduce on a larger scale, enabling researchers to get accurate results. It can be instrumental in pinning down precise facts about a topic. 

It is also a restrictive form of inquiry. Researchers cannot add context to this type of data collection or expand their focus in a different direction within a single study. They must be alert for biases. Quantitative research is more susceptible to selection bias and omitting or incorrectly measuring variables.

• How to balance qualitative and quantitative research

Although people tend to gravitate to one form of inquiry over another, each has its place in studying a subject. Both approaches can identify patterns illustrating the connection between multiple elements, and they can each advance your understanding of subjects in important ways. 

Understanding how each option will serve you will help you decide how and when to use each. Generally, qualitative research can help you develop and refine questions, while quantitative research helps you get targeted answers to those questions. Which element do you need to advance your study of the subject? Can both of them hone your knowledge?

Open-ended vs. close-ended questions

One way to use techniques from both approaches is with open-ended and close-ended questions in surveys. Because quantitative analysis requires defined sets of data that you can represent numerically, the questions must be close-ended. On the other hand, qualitative inquiry is naturally open-ended, allowing room for complex ideas.

An example of this is a survey on the impact of inflation. You could include both multiple-choice questions and open-response questions:

1. How do you compensate for higher prices at the grocery store? (Select all that apply)

A. Purchase fewer items

B. Opt for less expensive choices

C. Take money from other parts of the budget

D. Use a food bank or other charity to fill the gaps

E. Make more food from scratch

2. How do rising prices affect your grocery shopping habits? (Write your answer)

We need qualitative and quantitative forms of research to advance our understanding of the world. Neither is the "right" way to go, but one may be better for you depending on your needs. 

Learn more about qualitative research data analysis software

Should you be using a customer insights hub.

Do you want to discover previous research faster?

Do you share your research findings with others?

Do you analyze research data?

Start for free today, add your research, and get to key insights faster

Editor’s picks

Last updated: 18 April 2023

Last updated: 27 February 2023

Last updated: 22 August 2024

Last updated: 5 February 2023

Last updated: 16 August 2024

Last updated: 9 March 2023

Last updated: 30 April 2024

Last updated: 12 December 2023

Last updated: 11 March 2024

Last updated: 4 July 2024

Last updated: 6 March 2024

Last updated: 5 March 2024

Last updated: 13 May 2024

Latest articles

Related topics, .css-je19u9{-webkit-align-items:flex-end;-webkit-box-align:flex-end;-ms-flex-align:flex-end;align-items:flex-end;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-flex-direction:row;-ms-flex-direction:row;flex-direction:row;-webkit-box-flex-wrap:wrap;-webkit-flex-wrap:wrap;-ms-flex-wrap:wrap;flex-wrap:wrap;-webkit-box-pack:center;-ms-flex-pack:center;-webkit-justify-content:center;justify-content:center;row-gap:0;text-align:center;max-width:671px;}@media (max-width: 1079px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}}@media (max-width: 799px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}} decide what to .css-1kiodld{max-height:56px;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}@media (max-width: 1079px){.css-1kiodld{display:none;}} build next, decide what to build next, log in or sign up.

Get started for free

• Open access
• Published: 27 May 2020

How to use and assess qualitative research methods

• Loraine Busetto   ORCID: orcid.org/0000-0002-9228-7875 1 ,
• Wolfgang Wick 1 , 2 &
• Christoph Gumbinger 1  

Neurological Research and Practice volume  2 , Article number:  14 ( 2020 ) Cite this article

763k Accesses

364 Citations

90 Altmetric

Metrics details

This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions, and focussing on intervention improvement. The most common methods of data collection are document study, (non-) participant observations, semi-structured interviews and focus groups. For data analysis, field-notes and audio-recordings are transcribed into protocols and transcripts, and coded using qualitative data management software. Criteria such as checklists, reflexivity, sampling strategies, piloting, co-coding, member-checking and stakeholder involvement can be used to enhance and assess the quality of the research conducted. Using qualitative in addition to quantitative designs will equip us with better tools to address a greater range of research problems, and to fill in blind spots in current neurological research and practice.

The aim of this paper is to provide an overview of qualitative research methods, including hands-on information on how they can be used, reported and assessed. This article is intended for beginning qualitative researchers in the health sciences as well as experienced quantitative researchers who wish to broaden their understanding of qualitative research.

What is qualitative research?

Qualitative research is defined as “the study of the nature of phenomena”, including “their quality, different manifestations, the context in which they appear or the perspectives from which they can be perceived” , but excluding “their range, frequency and place in an objectively determined chain of cause and effect” [ 1 ]. This formal definition can be complemented with a more pragmatic rule of thumb: qualitative research generally includes data in form of words rather than numbers [ 2 ].

Why conduct qualitative research?

Because some research questions cannot be answered using (only) quantitative methods. For example, one Australian study addressed the issue of why patients from Aboriginal communities often present late or not at all to specialist services offered by tertiary care hospitals. Using qualitative interviews with patients and staff, it found one of the most significant access barriers to be transportation problems, including some towns and communities simply not having a bus service to the hospital [ 3 ]. A quantitative study could have measured the number of patients over time or even looked at possible explanatory factors – but only those previously known or suspected to be of relevance. To discover reasons for observed patterns, especially the invisible or surprising ones, qualitative designs are needed.

While qualitative research is common in other fields, it is still relatively underrepresented in health services research. The latter field is more traditionally rooted in the evidence-based-medicine paradigm, as seen in " research that involves testing the effectiveness of various strategies to achieve changes in clinical practice, preferably applying randomised controlled trial study designs (...) " [ 4 ]. This focus on quantitative research and specifically randomised controlled trials (RCT) is visible in the idea of a hierarchy of research evidence which assumes that some research designs are objectively better than others, and that choosing a "lesser" design is only acceptable when the better ones are not practically or ethically feasible [ 5 , 6 ]. Others, however, argue that an objective hierarchy does not exist, and that, instead, the research design and methods should be chosen to fit the specific research question at hand – "questions before methods" [ 2 , 7 , 8 , 9 ]. This means that even when an RCT is possible, some research problems require a different design that is better suited to addressing them. Arguing in JAMA, Berwick uses the example of rapid response teams in hospitals, which he describes as " a complex, multicomponent intervention – essentially a process of social change" susceptible to a range of different context factors including leadership or organisation history. According to him, "[in] such complex terrain, the RCT is an impoverished way to learn. Critics who use it as a truth standard in this context are incorrect" [ 8 ] . Instead of limiting oneself to RCTs, Berwick recommends embracing a wider range of methods , including qualitative ones, which for "these specific applications, (...) are not compromises in learning how to improve; they are superior" [ 8 ].

Research problems that can be approached particularly well using qualitative methods include assessing complex multi-component interventions or systems (of change), addressing questions beyond “what works”, towards “what works for whom when, how and why”, and focussing on intervention improvement rather than accreditation [ 7 , 9 , 10 , 11 , 12 ]. Using qualitative methods can also help shed light on the “softer” side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress, visibility of illness or out-of-pocket expenses.

How to conduct qualitative research?

Given that qualitative research is characterised by flexibility, openness and responsivity to context, the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research [ 13 , 14 ]. As Fossey puts it : “sampling, data collection, analysis and interpretation are related to each other in a cyclical (iterative) manner, rather than following one after another in a stepwise approach” [ 15 ]. The researcher can make educated decisions with regard to the choice of method, how they are implemented, and to which and how many units they are applied [ 13 ]. As shown in Fig.  1 , this can involve several back-and-forth steps between data collection and analysis where new insights and experiences can lead to adaption and expansion of the original plan. Some insights may also necessitate a revision of the research question and/or the research design as a whole. The process ends when saturation is achieved, i.e. when no relevant new information can be found (see also below: sampling and saturation). For reasons of transparency, it is essential for all decisions as well as the underlying reasoning to be well-documented.

Iterative research process

While it is not always explicitly addressed, qualitative methods reflect a different underlying research paradigm than quantitative research (e.g. constructivism or interpretivism as opposed to positivism). The choice of methods can be based on the respective underlying substantive theory or theoretical framework used by the researcher [ 2 ].

Data collection

The methods of qualitative data collection most commonly used in health research are document study, observations, semi-structured interviews and focus groups [ 1 , 14 , 16 , 17 ].

Document study

Document study (also called document analysis) refers to the review by the researcher of written materials [ 14 ]. These can include personal and non-personal documents such as archives, annual reports, guidelines, policy documents, diaries or letters.

Observations

Observations are particularly useful to gain insights into a certain setting and actual behaviour – as opposed to reported behaviour or opinions [ 13 ]. Qualitative observations can be either participant or non-participant in nature. In participant observations, the observer is part of the observed setting, for example a nurse working in an intensive care unit [ 18 ]. In non-participant observations, the observer is “on the outside looking in”, i.e. present in but not part of the situation, trying not to influence the setting by their presence. Observations can be planned (e.g. for 3 h during the day or night shift) or ad hoc (e.g. as soon as a stroke patient arrives at the emergency room). During the observation, the observer takes notes on everything or certain pre-determined parts of what is happening around them, for example focusing on physician-patient interactions or communication between different professional groups. Written notes can be taken during or after the observations, depending on feasibility (which is usually lower during participant observations) and acceptability (e.g. when the observer is perceived to be judging the observed). Afterwards, these field notes are transcribed into observation protocols. If more than one observer was involved, field notes are taken independently, but notes can be consolidated into one protocol after discussions. Advantages of conducting observations include minimising the distance between the researcher and the researched, the potential discovery of topics that the researcher did not realise were relevant and gaining deeper insights into the real-world dimensions of the research problem at hand [ 18 ].

Semi-structured interviews

Hijmans & Kuyper describe qualitative interviews as “an exchange with an informal character, a conversation with a goal” [ 19 ]. Interviews are used to gain insights into a person’s subjective experiences, opinions and motivations – as opposed to facts or behaviours [ 13 ]. Interviews can be distinguished by the degree to which they are structured (i.e. a questionnaire), open (e.g. free conversation or autobiographical interviews) or semi-structured [ 2 , 13 ]. Semi-structured interviews are characterized by open-ended questions and the use of an interview guide (or topic guide/list) in which the broad areas of interest, sometimes including sub-questions, are defined [ 19 ]. The pre-defined topics in the interview guide can be derived from the literature, previous research or a preliminary method of data collection, e.g. document study or observations. The topic list is usually adapted and improved at the start of the data collection process as the interviewer learns more about the field [ 20 ]. Across interviews the focus on the different (blocks of) questions may differ and some questions may be skipped altogether (e.g. if the interviewee is not able or willing to answer the questions or for concerns about the total length of the interview) [ 20 ]. Qualitative interviews are usually not conducted in written format as it impedes on the interactive component of the method [ 20 ]. In comparison to written surveys, qualitative interviews have the advantage of being interactive and allowing for unexpected topics to emerge and to be taken up by the researcher. This can also help overcome a provider or researcher-centred bias often found in written surveys, which by nature, can only measure what is already known or expected to be of relevance to the researcher. Interviews can be audio- or video-taped; but sometimes it is only feasible or acceptable for the interviewer to take written notes [ 14 , 16 , 20 ].

Focus groups

Focus groups are group interviews to explore participants’ expertise and experiences, including explorations of how and why people behave in certain ways [ 1 ]. Focus groups usually consist of 6–8 people and are led by an experienced moderator following a topic guide or “script” [ 21 ]. They can involve an observer who takes note of the non-verbal aspects of the situation, possibly using an observation guide [ 21 ]. Depending on researchers’ and participants’ preferences, the discussions can be audio- or video-taped and transcribed afterwards [ 21 ]. Focus groups are useful for bringing together homogeneous (to a lesser extent heterogeneous) groups of participants with relevant expertise and experience on a given topic on which they can share detailed information [ 21 ]. Focus groups are a relatively easy, fast and inexpensive method to gain access to information on interactions in a given group, i.e. “the sharing and comparing” among participants [ 21 ]. Disadvantages include less control over the process and a lesser extent to which each individual may participate. Moreover, focus group moderators need experience, as do those tasked with the analysis of the resulting data. Focus groups can be less appropriate for discussing sensitive topics that participants might be reluctant to disclose in a group setting [ 13 ]. Moreover, attention must be paid to the emergence of “groupthink” as well as possible power dynamics within the group, e.g. when patients are awed or intimidated by health professionals.

Choosing the “right” method

As explained above, the school of thought underlying qualitative research assumes no objective hierarchy of evidence and methods. This means that each choice of single or combined methods has to be based on the research question that needs to be answered and a critical assessment with regard to whether or to what extent the chosen method can accomplish this – i.e. the “fit” between question and method [ 14 ]. It is necessary for these decisions to be documented when they are being made, and to be critically discussed when reporting methods and results.

Let us assume that our research aim is to examine the (clinical) processes around acute endovascular treatment (EVT), from the patient’s arrival at the emergency room to recanalization, with the aim to identify possible causes for delay and/or other causes for sub-optimal treatment outcome. As a first step, we could conduct a document study of the relevant standard operating procedures (SOPs) for this phase of care – are they up-to-date and in line with current guidelines? Do they contain any mistakes, irregularities or uncertainties that could cause delays or other problems? Regardless of the answers to these questions, the results have to be interpreted based on what they are: a written outline of what care processes in this hospital should look like. If we want to know what they actually look like in practice, we can conduct observations of the processes described in the SOPs. These results can (and should) be analysed in themselves, but also in comparison to the results of the document analysis, especially as regards relevant discrepancies. Do the SOPs outline specific tests for which no equipment can be observed or tasks to be performed by specialized nurses who are not present during the observation? It might also be possible that the written SOP is outdated, but the actual care provided is in line with current best practice. In order to find out why these discrepancies exist, it can be useful to conduct interviews. Are the physicians simply not aware of the SOPs (because their existence is limited to the hospital’s intranet) or do they actively disagree with them or does the infrastructure make it impossible to provide the care as described? Another rationale for adding interviews is that some situations (or all of their possible variations for different patient groups or the day, night or weekend shift) cannot practically or ethically be observed. In this case, it is possible to ask those involved to report on their actions – being aware that this is not the same as the actual observation. A senior physician’s or hospital manager’s description of certain situations might differ from a nurse’s or junior physician’s one, maybe because they intentionally misrepresent facts or maybe because different aspects of the process are visible or important to them. In some cases, it can also be relevant to consider to whom the interviewee is disclosing this information – someone they trust, someone they are otherwise not connected to, or someone they suspect or are aware of being in a potentially “dangerous” power relationship to them. Lastly, a focus group could be conducted with representatives of the relevant professional groups to explore how and why exactly they provide care around EVT. The discussion might reveal discrepancies (between SOPs and actual care or between different physicians) and motivations to the researchers as well as to the focus group members that they might not have been aware of themselves. For the focus group to deliver relevant information, attention has to be paid to its composition and conduct, for example, to make sure that all participants feel safe to disclose sensitive or potentially problematic information or that the discussion is not dominated by (senior) physicians only. The resulting combination of data collection methods is shown in Fig.  2 .

Possible combination of data collection methods

Attributions for icons: “Book” by Serhii Smirnov, “Interview” by Adrien Coquet, FR, “Magnifying Glass” by anggun, ID, “Business communication” by Vectors Market; all from the Noun Project

The combination of multiple data source as described for this example can be referred to as “triangulation”, in which multiple measurements are carried out from different angles to achieve a more comprehensive understanding of the phenomenon under study [ 22 , 23 ].

Data analysis

To analyse the data collected through observations, interviews and focus groups these need to be transcribed into protocols and transcripts (see Fig.  3 ). Interviews and focus groups can be transcribed verbatim , with or without annotations for behaviour (e.g. laughing, crying, pausing) and with or without phonetic transcription of dialects and filler words, depending on what is expected or known to be relevant for the analysis. In the next step, the protocols and transcripts are coded , that is, marked (or tagged, labelled) with one or more short descriptors of the content of a sentence or paragraph [ 2 , 15 , 23 ]. Jansen describes coding as “connecting the raw data with “theoretical” terms” [ 20 ]. In a more practical sense, coding makes raw data sortable. This makes it possible to extract and examine all segments describing, say, a tele-neurology consultation from multiple data sources (e.g. SOPs, emergency room observations, staff and patient interview). In a process of synthesis and abstraction, the codes are then grouped, summarised and/or categorised [ 15 , 20 ]. The end product of the coding or analysis process is a descriptive theory of the behavioural pattern under investigation [ 20 ]. The coding process is performed using qualitative data management software, the most common ones being InVivo, MaxQDA and Atlas.ti. It should be noted that these are data management tools which support the analysis performed by the researcher(s) [ 14 ].

From data collection to data analysis

Attributions for icons: see Fig. 2 , also “Speech to text” by Trevor Dsouza, “Field Notes” by Mike O’Brien, US, “Voice Record” by ProSymbols, US, “Inspection” by Made, AU, and “Cloud” by Graphic Tigers; all from the Noun Project

How to report qualitative research?

Protocols of qualitative research can be published separately and in advance of the study results. However, the aim is not the same as in RCT protocols, i.e. to pre-define and set in stone the research questions and primary or secondary endpoints. Rather, it is a way to describe the research methods in detail, which might not be possible in the results paper given journals’ word limits. Qualitative research papers are usually longer than their quantitative counterparts to allow for deep understanding and so-called “thick description”. In the methods section, the focus is on transparency of the methods used, including why, how and by whom they were implemented in the specific study setting, so as to enable a discussion of whether and how this may have influenced data collection, analysis and interpretation. The results section usually starts with a paragraph outlining the main findings, followed by more detailed descriptions of, for example, the commonalities, discrepancies or exceptions per category [ 20 ]. Here it is important to support main findings by relevant quotations, which may add information, context, emphasis or real-life examples [ 20 , 23 ]. It is subject to debate in the field whether it is relevant to state the exact number or percentage of respondents supporting a certain statement (e.g. “Five interviewees expressed negative feelings towards XYZ”) [ 21 ].

How to combine qualitative with quantitative research?

Qualitative methods can be combined with other methods in multi- or mixed methods designs, which “[employ] two or more different methods [ …] within the same study or research program rather than confining the research to one single method” [ 24 ]. Reasons for combining methods can be diverse, including triangulation for corroboration of findings, complementarity for illustration and clarification of results, expansion to extend the breadth and range of the study, explanation of (unexpected) results generated with one method with the help of another, or offsetting the weakness of one method with the strength of another [ 1 , 17 , 24 , 25 , 26 ]. The resulting designs can be classified according to when, why and how the different quantitative and/or qualitative data strands are combined. The three most common types of mixed method designs are the convergent parallel design , the explanatory sequential design and the exploratory sequential design. The designs with examples are shown in Fig.  4 .

Three common mixed methods designs

In the convergent parallel design, a qualitative study is conducted in parallel to and independently of a quantitative study, and the results of both studies are compared and combined at the stage of interpretation of results. Using the above example of EVT provision, this could entail setting up a quantitative EVT registry to measure process times and patient outcomes in parallel to conducting the qualitative research outlined above, and then comparing results. Amongst other things, this would make it possible to assess whether interview respondents’ subjective impressions of patients receiving good care match modified Rankin Scores at follow-up, or whether observed delays in care provision are exceptions or the rule when compared to door-to-needle times as documented in the registry. In the explanatory sequential design, a quantitative study is carried out first, followed by a qualitative study to help explain the results from the quantitative study. This would be an appropriate design if the registry alone had revealed relevant delays in door-to-needle times and the qualitative study would be used to understand where and why these occurred, and how they could be improved. In the exploratory design, the qualitative study is carried out first and its results help informing and building the quantitative study in the next step [ 26 ]. If the qualitative study around EVT provision had shown a high level of dissatisfaction among the staff members involved, a quantitative questionnaire investigating staff satisfaction could be set up in the next step, informed by the qualitative study on which topics dissatisfaction had been expressed. Amongst other things, the questionnaire design would make it possible to widen the reach of the research to more respondents from different (types of) hospitals, regions, countries or settings, and to conduct sub-group analyses for different professional groups.

How to assess qualitative research?

A variety of assessment criteria and lists have been developed for qualitative research, ranging in their focus and comprehensiveness [ 14 , 17 , 27 ]. However, none of these has been elevated to the “gold standard” in the field. In the following, we therefore focus on a set of commonly used assessment criteria that, from a practical standpoint, a researcher can look for when assessing a qualitative research report or paper.

Assessors should check the authors’ use of and adherence to the relevant reporting checklists (e.g. Standards for Reporting Qualitative Research (SRQR)) to make sure all items that are relevant for this type of research are addressed [ 23 , 28 ]. Discussions of quantitative measures in addition to or instead of these qualitative measures can be a sign of lower quality of the research (paper). Providing and adhering to a checklist for qualitative research contributes to an important quality criterion for qualitative research, namely transparency [ 15 , 17 , 23 ].

Reflexivity

While methodological transparency and complete reporting is relevant for all types of research, some additional criteria must be taken into account for qualitative research. This includes what is called reflexivity, i.e. sensitivity to the relationship between the researcher and the researched, including how contact was established and maintained, or the background and experience of the researcher(s) involved in data collection and analysis. Depending on the research question and population to be researched this can be limited to professional experience, but it may also include gender, age or ethnicity [ 17 , 27 ]. These details are relevant because in qualitative research, as opposed to quantitative research, the researcher as a person cannot be isolated from the research process [ 23 ]. It may influence the conversation when an interviewed patient speaks to an interviewer who is a physician, or when an interviewee is asked to discuss a gynaecological procedure with a male interviewer, and therefore the reader must be made aware of these details [ 19 ].

Sampling and saturation

The aim of qualitative sampling is for all variants of the objects of observation that are deemed relevant for the study to be present in the sample “ to see the issue and its meanings from as many angles as possible” [ 1 , 16 , 19 , 20 , 27 ] , and to ensure “information-richness [ 15 ]. An iterative sampling approach is advised, in which data collection (e.g. five interviews) is followed by data analysis, followed by more data collection to find variants that are lacking in the current sample. This process continues until no new (relevant) information can be found and further sampling becomes redundant – which is called saturation [ 1 , 15 ] . In other words: qualitative data collection finds its end point not a priori , but when the research team determines that saturation has been reached [ 29 , 30 ].

This is also the reason why most qualitative studies use deliberate instead of random sampling strategies. This is generally referred to as “ purposive sampling” , in which researchers pre-define which types of participants or cases they need to include so as to cover all variations that are expected to be of relevance, based on the literature, previous experience or theory (i.e. theoretical sampling) [ 14 , 20 ]. Other types of purposive sampling include (but are not limited to) maximum variation sampling, critical case sampling or extreme or deviant case sampling [ 2 ]. In the above EVT example, a purposive sample could include all relevant professional groups and/or all relevant stakeholders (patients, relatives) and/or all relevant times of observation (day, night and weekend shift).

Assessors of qualitative research should check whether the considerations underlying the sampling strategy were sound and whether or how researchers tried to adapt and improve their strategies in stepwise or cyclical approaches between data collection and analysis to achieve saturation [ 14 ].

Good qualitative research is iterative in nature, i.e. it goes back and forth between data collection and analysis, revising and improving the approach where necessary. One example of this are pilot interviews, where different aspects of the interview (especially the interview guide, but also, for example, the site of the interview or whether the interview can be audio-recorded) are tested with a small number of respondents, evaluated and revised [ 19 ]. In doing so, the interviewer learns which wording or types of questions work best, or which is the best length of an interview with patients who have trouble concentrating for an extended time. Of course, the same reasoning applies to observations or focus groups which can also be piloted.

Ideally, coding should be performed by at least two researchers, especially at the beginning of the coding process when a common approach must be defined, including the establishment of a useful coding list (or tree), and when a common meaning of individual codes must be established [ 23 ]. An initial sub-set or all transcripts can be coded independently by the coders and then compared and consolidated after regular discussions in the research team. This is to make sure that codes are applied consistently to the research data.

Member checking

Member checking, also called respondent validation , refers to the practice of checking back with study respondents to see if the research is in line with their views [ 14 , 27 ]. This can happen after data collection or analysis or when first results are available [ 23 ]. For example, interviewees can be provided with (summaries of) their transcripts and asked whether they believe this to be a complete representation of their views or whether they would like to clarify or elaborate on their responses [ 17 ]. Respondents’ feedback on these issues then becomes part of the data collection and analysis [ 27 ].

Stakeholder involvement

In those niches where qualitative approaches have been able to evolve and grow, a new trend has seen the inclusion of patients and their representatives not only as study participants (i.e. “members”, see above) but as consultants to and active participants in the broader research process [ 31 , 32 , 33 ]. The underlying assumption is that patients and other stakeholders hold unique perspectives and experiences that add value beyond their own single story, making the research more relevant and beneficial to researchers, study participants and (future) patients alike [ 34 , 35 ]. Using the example of patients on or nearing dialysis, a recent scoping review found that 80% of clinical research did not address the top 10 research priorities identified by patients and caregivers [ 32 , 36 ]. In this sense, the involvement of the relevant stakeholders, especially patients and relatives, is increasingly being seen as a quality indicator in and of itself.

How not to assess qualitative research

The above overview does not include certain items that are routine in assessments of quantitative research. What follows is a non-exhaustive, non-representative, experience-based list of the quantitative criteria often applied to the assessment of qualitative research, as well as an explanation of the limited usefulness of these endeavours.

Protocol adherence

Given the openness and flexibility of qualitative research, it should not be assessed by how well it adheres to pre-determined and fixed strategies – in other words: its rigidity. Instead, the assessor should look for signs of adaptation and refinement based on lessons learned from earlier steps in the research process.

Sample size

For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [ 1 , 14 , 27 , 37 , 38 , 39 ]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was included and why.

Randomisation

While some authors argue that randomisation can be used in qualitative research, this is not commonly the case, as neither its feasibility nor its necessity or usefulness has been convincingly established for qualitative research [ 13 , 27 ]. Relevant disadvantages include the negative impact of a too large sample size as well as the possibility (or probability) of selecting “ quiet, uncooperative or inarticulate individuals ” [ 17 ]. Qualitative studies do not use control groups, either.

Interrater reliability, variability and other “objectivity checks”

The concept of “interrater reliability” is sometimes used in qualitative research to assess to which extent the coding approach overlaps between the two co-coders. However, it is not clear what this measure tells us about the quality of the analysis [ 23 ]. This means that these scores can be included in qualitative research reports, preferably with some additional information on what the score means for the analysis, but it is not a requirement. Relatedly, it is not relevant for the quality or “objectivity” of qualitative research to separate those who recruited the study participants and collected and analysed the data. Experiences even show that it might be better to have the same person or team perform all of these tasks [ 20 ]. First, when researchers introduce themselves during recruitment this can enhance trust when the interview takes place days or weeks later with the same researcher. Second, when the audio-recording is transcribed for analysis, the researcher conducting the interviews will usually remember the interviewee and the specific interview situation during data analysis. This might be helpful in providing additional context information for interpretation of data, e.g. on whether something might have been meant as a joke [ 18 ].

Not being quantitative research

Being qualitative research instead of quantitative research should not be used as an assessment criterion if it is used irrespectively of the research problem at hand. Similarly, qualitative research should not be required to be combined with quantitative research per se – unless mixed methods research is judged as inherently better than single-method research. In this case, the same criterion should be applied for quantitative studies without a qualitative component.

The main take-away points of this paper are summarised in Table 1 . We aimed to show that, if conducted well, qualitative research can answer specific research questions that cannot to be adequately answered using (only) quantitative designs. Seeing qualitative and quantitative methods as equal will help us become more aware and critical of the “fit” between the research problem and our chosen methods: I can conduct an RCT to determine the reasons for transportation delays of acute stroke patients – but should I? It also provides us with a greater range of tools to tackle a greater range of research problems more appropriately and successfully, filling in the blind spots on one half of the methodological spectrum to better address the whole complexity of neurological research and practice.

Availability of data and materials

Not applicable.

Abbreviations

Endovascular treatment

Randomised Controlled Trial

Standard Operating Procedure

Standards for Reporting Qualitative Research

Philipsen, H., & Vernooij-Dassen, M. (2007). Kwalitatief onderzoek: nuttig, onmisbaar en uitdagend. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Qualitative research: useful, indispensable and challenging. In: Qualitative research: Practical methods for medical practice (pp. 5–12). Houten: Bohn Stafleu van Loghum.

Chapter   Google Scholar  

Punch, K. F. (2013). Introduction to social research: Quantitative and qualitative approaches . London: Sage.

Kelly, J., Dwyer, J., Willis, E., & Pekarsky, B. (2014). Travelling to the city for hospital care: Access factors in country aboriginal patient journeys. Australian Journal of Rural Health, 22 (3), 109–113.

Article   Google Scholar  

Nilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013). Never the twain shall meet? - a comparison of implementation science and policy implementation research. Implementation Science, 8 (1), 1–12.

Howick J, Chalmers I, Glasziou, P., Greenhalgh, T., Heneghan, C., Liberati, A., Moschetti, I., Phillips, B., & Thornton, H. (2011). The 2011 Oxford CEBM evidence levels of evidence (introductory document) . Oxford Center for Evidence Based Medicine. https://www.cebm.net/2011/06/2011-oxford-cebm-levels-evidence-introductory-document/ .

Eakin, J. M. (2016). Educating critical qualitative health researchers in the land of the randomized controlled trial. Qualitative Inquiry, 22 (2), 107–118.

May, A., & Mathijssen, J. (2015). Alternatieven voor RCT bij de evaluatie van effectiviteit van interventies!? Eindrapportage. In Alternatives for RCTs in the evaluation of effectiveness of interventions!? Final report .

Google Scholar  

Berwick, D. M. (2008). The science of improvement. Journal of the American Medical Association, 299 (10), 1182–1184.

Article   CAS   Google Scholar  

Christ, T. W. (2014). Scientific-based research and randomized controlled trials, the “gold” standard? Alternative paradigms and mixed methodologies. Qualitative Inquiry, 20 (1), 72–80.

Lamont, T., Barber, N., Jd, P., Fulop, N., Garfield-Birkbeck, S., Lilford, R., Mear, L., Raine, R., & Fitzpatrick, R. (2016). New approaches to evaluating complex health and care systems. BMJ, 352:i154.

Drabble, S. J., & O’Cathain, A. (2015). Moving from Randomized Controlled Trials to Mixed Methods Intervention Evaluation. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 406–425). London: Oxford University Press.

Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science : IS, 8 , 117.

Hak, T. (2007). Waarnemingsmethoden in kwalitatief onderzoek. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Observation methods in qualitative research] (pp. 13–25). Houten: Bohn Stafleu van Loghum.

Russell, C. K., & Gregory, D. M. (2003). Evaluation of qualitative research studies. Evidence Based Nursing, 6 (2), 36–40.

Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating qualitative research. Australian and New Zealand Journal of Psychiatry, 36 , 717–732.

Yanow, D. (2000). Conducting interpretive policy analysis (Vol. 47). Thousand Oaks: Sage University Papers Series on Qualitative Research Methods.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 , 63–75.

van der Geest, S. (2006). Participeren in ziekte en zorg: meer over kwalitatief onderzoek. Huisarts en Wetenschap, 49 (4), 283–287.

Hijmans, E., & Kuyper, M. (2007). Het halfopen interview als onderzoeksmethode. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [The half-open interview as research method (pp. 43–51). Houten: Bohn Stafleu van Loghum.

Jansen, H. (2007). Systematiek en toepassing van de kwalitatieve survey. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Systematics and implementation of the qualitative survey (pp. 27–41). Houten: Bohn Stafleu van Loghum.

Pv, R., & Peremans, L. (2007). Exploreren met focusgroepgesprekken: de ‘stem’ van de groep onder de loep. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Exploring with focus group conversations: the “voice” of the group under the magnifying glass (pp. 53–64). Houten: Bohn Stafleu van Loghum.

Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Oncology Nursing Forum, 41 (5), 545–547.

Boeije H: Analyseren in kwalitatief onderzoek: Denken en doen, [Analysis in qualitative research: Thinking and doing] vol. Den Haag Boom Lemma uitgevers; 2012.

Hunter, A., & Brewer, J. (2015). Designing Multimethod Research. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 185–205). London: Oxford University Press.

Archibald, M. M., Radil, A. I., Zhang, X., & Hanson, W. E. (2015). Current mixed methods practices in qualitative research: A content analysis of leading journals. International Journal of Qualitative Methods, 14 (2), 5–33.

Creswell, J. W., & Plano Clark, V. L. (2011). Choosing a Mixed Methods Design. In Designing and Conducting Mixed Methods Research . Thousand Oaks: SAGE Publications.

Mays, N., & Pope, C. (2000). Assessing quality in qualitative research. BMJ, 320 (7226), 50–52.

O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine : Journal of the Association of American Medical Colleges, 89 (9), 1245–1251.

Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018). Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality and Quantity, 52 (4), 1893–1907.

Moser, A., & Korstjens, I. (2018). Series: Practical guidance to qualitative research. Part 3: Sampling, data collection and analysis. European Journal of General Practice, 24 (1), 9–18.

Marlett, N., Shklarov, S., Marshall, D., Santana, M. J., & Wasylak, T. (2015). Building new roles and relationships in research: A model of patient engagement research. Quality of Life Research : an international journal of quality of life aspects of treatment, care and rehabilitation, 24 (5), 1057–1067.

Demian, M. N., Lam, N. N., Mac-Way, F., Sapir-Pichhadze, R., & Fernandez, N. (2017). Opportunities for engaging patients in kidney research. Canadian Journal of Kidney Health and Disease, 4 , 2054358117703070–2054358117703070.

Noyes, J., McLaughlin, L., Morgan, K., Roberts, A., Stephens, M., Bourne, J., Houlston, M., Houlston, J., Thomas, S., Rhys, R. G., et al. (2019). Designing a co-productive study to overcome known methodological challenges in organ donation research with bereaved family members. Health Expectations . 22(4):824–35.

Piil, K., Jarden, M., & Pii, K. H. (2019). Research agenda for life-threatening cancer. European Journal Cancer Care (Engl), 28 (1), e12935.

Hofmann, D., Ibrahim, F., Rose, D., Scott, D. L., Cope, A., Wykes, T., & Lempp, H. (2015). Expectations of new treatment in rheumatoid arthritis: Developing a patient-generated questionnaire. Health Expectations : an international journal of public participation in health care and health policy, 18 (5), 995–1008.

Jun, M., Manns, B., Laupacis, A., Manns, L., Rehal, B., Crowe, S., & Hemmelgarn, B. R. (2015). Assessing the extent to which current clinical research is consistent with patient priorities: A scoping review using a case study in patients on or nearing dialysis. Canadian Journal of Kidney Health and Disease, 2 , 35.

Elsie Baker, S., & Edwards, R. (2012). How many qualitative interviews is enough? In National Centre for Research Methods Review Paper . National Centre for Research Methods. http://eprints.ncrm.ac.uk/2273/4/how_many_interviews.pdf .

Sandelowski, M. (1995). Sample size in qualitative research. Research in Nursing & Health, 18 (2), 179–183.

Sim, J., Saunders, B., Waterfield, J., & Kingstone, T. (2018). Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology, 21 (5), 619–634.

Download references

Acknowledgements

no external funding.

Author information

Authors and affiliations.

Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120, Heidelberg, Germany

Loraine Busetto, Wolfgang Wick & Christoph Gumbinger

Clinical Cooperation Unit Neuro-Oncology, German Cancer Research Center, Heidelberg, Germany

Wolfgang Wick

You can also search for this author in PubMed   Google Scholar

Contributions

LB drafted the manuscript; WW and CG revised the manuscript; all authors approved the final versions.

Corresponding author

Correspondence to Loraine Busetto .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Busetto, L., Wick, W. & Gumbinger, C. How to use and assess qualitative research methods. Neurol. Res. Pract. 2 , 14 (2020). https://doi.org/10.1186/s42466-020-00059-z

Download citation

Received : 30 January 2020

Accepted : 22 April 2020

Published : 27 May 2020

DOI : https://doi.org/10.1186/s42466-020-00059-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Qualitative research
• Mixed methods
• Quality assessment

Neurological Research and Practice

ISSN: 2524-3489

• Submission enquiries: Access here and click Contact Us
• General enquiries: [email protected]

Root out friction in every digital experience, super-charge conversion rates, and optimize digital self-service

Uncover insights from any interaction, deliver AI-powered agent coaching, and reduce cost to serve

Increase revenue and loyalty with real-time insights and recommendations delivered to teams on the ground

Know how your people feel and empower managers to improve employee engagement, productivity, and retention

Take action in the moments that matter most along the employee journey and drive bottom line growth

Whatever they’re are saying, wherever they’re saying it, know exactly what’s going on with your people

Get faster, richer insights with qual and quant tools that make powerful market research available to everyone

Run concept tests, pricing studies, prototyping + more with fast, powerful studies designed by UX research experts

Track your brand performance 24/7 and act quickly to respond to opportunities and challenges in your market

Explore the platform powering Experience Management

• Free Account
• Product Demos
• For Digital
• For Customer Care
• For Human Resources
• For Researchers
• Financial Services
• All Industries

Popular Use Cases

• Customer Experience
• Employee Experience
• Net Promoter Score
• Voice of Customer
• Customer Success Hub
• Product Documentation
• Training & Certification
• XM Institute
• Popular Resources
• Customer Stories
• Artificial Intelligence

Market Research

• Partnerships
• Marketplace

The annual gathering of the experience leaders at the world’s iconic brands building breakthrough business results, live in Salt Lake City.

• English/AU & NZ
• Español/Europa
• Español/América Latina
• Português Brasileiro
• REQUEST DEMO
• Experience Management
• Qualitative Vs Quantitative Research

Try Qualtrics for free

Qualitative vs quantitative research.

13 min read You’ll use both quantitative and qualitative research methods to gather data in your research projects. So what do qualitative and quantitative mean exactly, and how can you best use them to gain the most accurate insights?

What is qualitative research?

Qualitative research is all about language, expression, body language and other forms of human communication. That covers words, meanings and understanding. Qualitative research is used to describe WHY. Why do people feel the way they do, why do they act in a certain way, what opinions do they have and what motivates them?

Qualitative data is used to understand phenomena – things that happen, situations that exist, and most importantly the meanings associated with them. It can help add a ‘why’ element to factual, objective data.

Qualitative research gives breadth, depth and context to questions, although its linguistic subtleties and subjectivity can mean that results are trickier to analyze than quantitative data.

This qualitative data is called unstructured data by researchers. This is because it has not traditionally had the type of structure that can be processed by computers, until today. It has, until recently at least, been exclusively accessible to human brains. And although our brains are highly sophisticated, they have limited processing power. What can help analyze this structured data to assist computers and the human brain?

Free eBook: Quantitative and qualitative research design

What is quantitative research?

Quantitative data refers to numerical information. Quantitative research gathers information that can be counted, measured, or rated numerically – AKA quantitative data. Scores, measurements, financial records, temperature charts and receipts or ledgers are all examples of quantitative data.

Quantitative data is often structured data, because it follows a consistent, predictable pattern that computers and calculating devices are able to process with ease. Humans can process it too, although we are now able to pass it over to machines to process on our behalf. This is partly what has made quantitative data so important historically, and why quantitative data – sometimes called ‘hard data’ – has dominated over qualitative data in fields like business, finance and economics.

It’s easy to ‘crunch the numbers’ of quantitative data and produce results visually in graphs, tables and on data analysis dashboards. Thanks to today’s abundance and accessibility of processing power, combined with our ability to store huge amounts of information, quantitative data has fuelled the Big Data phenomenon, putting quantitative methods and vast amounts of quantitative data at our fingertips.

As we’ve indicated, quantitative and qualitative data are entirely different and mutually exclusive categories. Here are a few of the differences between them.

1. Data collection

Data collection methods for quantitative data and qualitative data vary, but there are also some places where they overlap.

2. Data analysis

Quantitative data suits statistical analysis techniques like linear regression, T-tests and ANOVA. These are quite easy to automate, and large quantities of quantitative data can be analyzed quickly.

Analyzing qualitative data needs a higher degree of human judgement, since unlike quantitative data, non numerical data of a subjective nature has certain characteristics that inferential statistics can’t perceive. Working at a human scale has historically meant that qualitative data is lower in volume – although it can be richer in insights.

3. Strengths and weaknesses

When weighing up qualitative vs quantitative research, it’s largely a matter of choosing the method appropriate to your research goals. If you’re in the position of having to choose one method over another, it’s worth knowing the strengths and limitations of each, so that you know what to expect from your results.

Qualitative vs quantitative – the role of research questions

How do you know whether you need qualitative or quantitative research techniques? By finding out what kind of data you’re going to be collecting.

You’ll do this as you develop your research question, one of the first steps to any research program. It’s a single sentence that sums up the purpose of your research, who you’re going to gather data from, and what results you’re looking for.

As you formulate your question, you’ll get a sense of the sort of answer you’re working towards, and whether it will be expressed in numerical data or qualitative data.

For example, your research question might be “How often does a poor customer experience cause shoppers to abandon their shopping carts?” – this is a quantitative topic, as you’re looking for numerical values.

Or it might be “What is the emotional impact of a poor customer experience on regular customers in our supermarket?” This is a qualitative topic, concerned with thoughts and feelings and answered in personal, subjective ways that vary between respondents.

Here’s how to evaluate your research question and decide which method to use:

• Qualitative research:

Use this if your goal is to understand something – experiences, problems, ideas.

For example, you may want to understand how poor experiences in a supermarket make your customers feel. You might carry out this research through focus groups or in depth interviews (IDI’s). For a larger scale research method you could start  by surveying supermarket loyalty card holders, asking open text questions, like “How would you describe your experience today?” or “What could be improved about your experience?” This research will provide context and understanding that quantitative research will not.

• Quantitative research:

Use this if your goal is to test or confirm a hypothesis, or to study cause and effect relationships. For example, you want to find out what percentage of your returning customers are happy with the customer experience at your store. You can collect data to answer this via a survey.

For example, you could recruit 1,000 loyalty card holders as participants, asking them, “On a scale of 1-5, how happy are you with our store?” You can then make simple mathematical calculations to find the average score. The larger sample size will help make sure your results aren’t skewed by anomalous data or outliers, so you can draw conclusions with confidence.

Qualitative and quantitative research combined?

Do you always have to choose between qualitative or quantitative data?

In some cases you can get the best of both worlds by combining both quantitative and qualitative data.You could use pre quantitative data to understand the landscape of your research. Here you can gain insights around a topic and propose a hypothesis. Then adopt a quantitative research method to test it out. Here you’ll discover where to focus your survey appropriately or to pre-test your survey, to ensure your questions are understood as you intended. Finally, using a round of qualitative research methods to bring your insights and story to life. This mixed methods approach is becoming increasingly popular with businesses who are looking for in depth insights.

For example, in the supermarket scenario we’ve described, you could start out with a qualitative data collection phase where you use focus groups and conduct interviews with customers. You might find suggestions in your qualitative data that customers would like to be able to buy children’s clothes in the store.

In response, the supermarket might pilot a children’s clothing range. Targeted quantitative research could then reveal whether or not those stores selling children’s clothes achieve higher customer satisfaction scores and a rise in profits for clothing.

Together, qualitative and quantitative data, combined with statistical analysis, have provided important insights about customer experience, and have proven the effectiveness of a solution to business problems.

Qualitative vs quantitative question types

As we’ve noted, surveys are one of the data collection methods suitable for both quantitative and qualitative research. Depending on the types of questions you choose to include, you can generate qualitative and quantitative data. Here we have summarized some of the survey question types you can use for each purpose.

Qualitative data survey questions

There are fewer survey question options for collecting qualitative data, since they all essentially do the same thing – provide the respondent with space to enter information in their own words. Qualitative research is not typically done with surveys alone, and researchers may use a mix of qualitative methods. As well as a survey, they might conduct in depth interviews, use observational studies or hold focus groups.

Open text ‘Other’ box (can be used with multiple choice questions)

Text box (space for short written answer)

Essay box (space for longer, more detailed written answers)

Quantitative data survey questions

These questions will yield quantitative data – i.e. a numerical value.

Net Promoter Score (NPS)

Likert Scale

Radio buttons (respondents choose just one option)

Check boxes (respondents can choose multiple options)

Sliding scale

Star rating

Analyzing data (quantitative or qualitative) using technology

We are currently at an exciting point in the history of qualitative analysis. Digital analysis and other methods that were formerly exclusively used for quantitative data are now used for interpreting non numerical data too.

A rtificial intelligence programs can now be used to analyze open text, and turn qualitative data into structured and semi structured quantitative data that relates to qualitative data topics such as emotion and sentiment, opinion and experience.

Research that in the past would have meant qualitative researchers conducting time-intensive studies using analysis methods like thematic analysis can now be done in a very short space of time. This not only saves time and money, but opens up qualitative data analysis to a much wider range of businesses and organizations.

The most advanced tools can even be used for real-time statistical analysis, forecasting and prediction, making them a powerful asset for businesses.

Qualitative or quantitative – which is better for data analysis?

Historically, quantitative data was much easier to analyze than qualitative data. But as we’ve seen, modern technology is helping qualitative analysis to catch up, making it quicker and less labor-intensive than before.

That means the choice between qualitative and quantitative studies no longer needs to factor in ease of analysis, provided you have the right tools at your disposal. With an integrated platform like Qualtrics, which incorporates data collection, data cleaning, data coding and a powerful suite of analysis tools for both qualitative and quantitative data, you have a wide range of options at your fingertips.

Related resources

Qualitative research questions 11 min read, qualitative research design 12 min read, primary vs secondary research 14 min read, business research methods 12 min read, qualitative research interviews 11 min read, market intelligence 10 min read, marketing insights 11 min read, request demo.

Ready to learn more about Qualtrics?

Qualitative vs. Quantitative Research: Comparing the Methods and Strategies for Education Research

No matter the field of study, all research can be divided into two distinct methodologies: qualitative and quantitative research. Both methodologies offer education researchers important insights.

Education research assesses problems in policy, practices, and curriculum design, and it helps administrators identify solutions. Researchers can conduct small-scale studies to learn more about topics related to instruction or larger-scale ones to gain insight into school systems and investigate how to improve student outcomes.

Education research often relies on the quantitative methodology. Quantitative research in education provides numerical data that can prove or disprove a theory, and administrators can easily share the number-based results with other schools and districts. And while the research may speak to a relatively small sample size, educators and researchers can scale the results from quantifiable data to predict outcomes in larger student populations and groups.

Qualitative vs. Quantitative Research in Education: Definitions

Although there are many overlaps in the objectives of qualitative and quantitative research in education, researchers must understand the fundamental functions of each methodology in order to design and carry out an impactful research study. In addition, they must understand the differences that set qualitative and quantitative research apart in order to determine which methodology is better suited to specific education research topics.

Generate Hypotheses with Qualitative Research

Qualitative research focuses on thoughts, concepts, or experiences. The data collected often comes in narrative form and concentrates on unearthing insights that can lead to testable hypotheses. Educators use qualitative research in a study’s exploratory stages to uncover patterns or new angles.

Form Strong Conclusions with Quantitative Research

Quantitative research in education and other fields of inquiry is expressed in numbers and measurements. This type of research aims to find data to confirm or test a hypothesis.

Differences in Data Collection Methods

Keeping in mind the main distinction in qualitative vs. quantitative research—gathering descriptive information as opposed to numerical data—it stands to reason that there are different ways to acquire data for each research methodology. While certain approaches do overlap, the way researchers apply these collection techniques depends on their goal.

Interviews, for example, are common in both modes of research. An interview with students that features open-ended questions intended to reveal ideas and beliefs around attendance will provide qualitative data. This data may reveal a problem among students, such as a lack of access to transportation, that schools can help address.

An interview can also include questions posed to receive numerical answers. A case in point: how many days a week do students have trouble getting to school, and of those days, how often is a transportation-related issue the cause? In this example, qualitative and quantitative methodologies can lead to similar conclusions, but the research will differ in intent, design, and form.

Taking a look at behavioral observation, another common method used for both qualitative and quantitative research, qualitative data may consider a variety of factors, such as facial expressions, verbal responses, and body language.

On the other hand, a quantitative approach will create a coding scheme for certain predetermined behaviors and observe these in a quantifiable manner.

Qualitative Research Methods

• Case Studies : Researchers conduct in-depth investigations into an individual, group, event, or community, typically gathering data through observation and interviews.
• Focus Groups : A moderator (or researcher) guides conversation around a specific topic among a group of participants.
• Ethnography : Researchers interact with and observe a specific societal or ethnic group in their real-life environment.
• Interviews : Researchers ask participants questions to learn about their perspectives on a particular subject.

Quantitative Research Methods

• Questionnaires and Surveys : Participants receive a list of questions, either closed-ended or multiple choice, which are directed around a particular topic.
• Experiments : Researchers control and test variables to demonstrate cause-and-effect relationships.
• Observations : Researchers look at quantifiable patterns and behavior.
• Structured Interviews : Using a predetermined structure, researchers ask participants a fixed set of questions to acquire numerical data.

Choosing a Research Strategy

When choosing which research strategy to employ for a project or study, a number of considerations apply. One key piece of information to help determine whether to use a qualitative vs. quantitative research method is which phase of development the study is in.

For example, if a project is in its early stages and requires more research to find a testable hypothesis, qualitative research methods might prove most helpful. On the other hand, if the research team has already established a hypothesis or theory, quantitative research methods will provide data that can validate the theory or refine it for further testing.

It’s also important to understand a project’s research goals. For instance, do researchers aim to produce findings that reveal how to best encourage student engagement in math? Or is the goal to determine how many students are passing geometry? These two scenarios require distinct sets of data, which will determine the best methodology to employ.

In some situations, studies will benefit from a mixed-methods approach. Using the goals in the above example, one set of data could find the percentage of students passing geometry, which would be quantitative. The research team could also lead a focus group with the students achieving success to discuss which techniques and teaching practices they find most helpful, which would produce qualitative data.

Learn How to Put Education Research into Action

Those with an interest in learning how to harness research to develop innovative ideas to improve education systems may want to consider pursuing a doctoral degree. American University’s School of Education online offers a Doctor of Education (EdD) in Education Policy and Leadership that prepares future educators, school administrators, and other education professionals to become leaders who effect positive changes in schools. Courses such as Applied Research Methods I: Enacting Critical Research provides students with the techniques and research skills needed to begin conducting research exploring new ways to enhance education. Learn more about American’ University’s EdD in Education Policy and Leadership .

What’s the Difference Between Educational Equity and Equality?

EdD vs. PhD in Education: Requirements, Career Outlook, and Salary

Top Education Technology Jobs for Doctorate in Education Graduates

American University, EdD in Education Policy and Leadership

Edutopia, “2019 Education Research Highlights”

Formplus, “Qualitative vs. Quantitative Data: 15 Key Differences and Similarities”

iMotion, “Qualitative vs. Quantitative Research: What Is What?”

Scribbr, “Qualitative vs. Quantitative Research”

Simply Psychology, “What’s the Difference Between Quantitative and Qualitative Research?”

Typeform, “A Simple Guide to Qualitative and Quantitative Research”

Request Information

AU Program Helper

This AI chatbot provides automated responses, which may not always be accurate. By continuing with this conversation, you agree that the contents of this chat session may be transcribed and retained. You also consent that this chat session and your interactions, including cookie usage, are subject to our  privacy policy .

• Search Menu
• Sign in through your institution
• Advance articles
• Mini-reviews
• ESHRE Pages
• Editor's Choice
• Supplements
• Author Guidelines
• Submission Site
• Reasons to Publish
• Open Access
• Advertising and Corporate Services
• Advertising
• Reprints and ePrints
• Sponsored Supplements
• Branded Books
• Journals Career Network
• About Human Reproduction
• About the European Society of Human Reproduction and Embryology
• Editorial Board
• Self-Archiving Policy
• Dispatch Dates
• Contact ESHRE
• Journals on Oxford Academic
• Books on Oxford Academic

Article Contents

Introduction, when to use qualitative research, how to judge qualitative research, conclusions, authors' roles, conflict of interest.

• < Previous

Qualitative research methods: when to use them and how to judge them

• Article contents
• Figures & tables
• Supplementary Data

K. Hammarberg, M. Kirkman, S. de Lacey, Qualitative research methods: when to use them and how to judge them, Human Reproduction , Volume 31, Issue 3, March 2016, Pages 498–501, https://doi.org/10.1093/humrep/dev334

• Permissions Icon Permissions

In March 2015, an impressive set of guidelines for best practice on how to incorporate psychosocial care in routine infertility care was published by the ESHRE Psychology and Counselling Guideline Development Group ( ESHRE Psychology and Counselling Guideline Development Group, 2015 ). The authors report that the guidelines are based on a comprehensive review of the literature and we congratulate them on their meticulous compilation of evidence into a clinically useful document. However, when we read the methodology section, we were baffled and disappointed to find that evidence from research using qualitative methods was not included in the formulation of the guidelines. Despite stating that ‘qualitative research has significant value to assess the lived experience of infertility and fertility treatment’, the group excluded this body of evidence because qualitative research is ‘not generally hypothesis-driven and not objective/neutral, as the researcher puts him/herself in the position of the participant to understand how the world is from the person's perspective’.

Qualitative and quantitative research methods are often juxtaposed as representing two different world views. In quantitative circles, qualitative research is commonly viewed with suspicion and considered lightweight because it involves small samples which may not be representative of the broader population, it is seen as not objective, and the results are assessed as biased by the researchers' own experiences or opinions. In qualitative circles, quantitative research can be dismissed as over-simplifying individual experience in the cause of generalisation, failing to acknowledge researcher biases and expectations in research design, and requiring guesswork to understand the human meaning of aggregate data.

As social scientists who investigate psychosocial aspects of human reproduction, we use qualitative and quantitative methods, separately or together, depending on the research question. The crucial part is to know when to use what method.

The peer-review process is a pillar of scientific publishing. One of the important roles of reviewers is to assess the scientific rigour of the studies from which authors draw their conclusions. If rigour is lacking, the paper should not be published. As with research using quantitative methods, research using qualitative methods is home to the good, the bad and the ugly. It is essential that reviewers know the difference. Rejection letters are hard to take but more often than not they are based on legitimate critique. However, from time to time it is obvious that the reviewer has little grasp of what constitutes rigour or quality in qualitative research. The first author (K.H.) recently submitted a paper that reported findings from a qualitative study about fertility-related knowledge and information-seeking behaviour among people of reproductive age. In the rejection letter one of the reviewers (not from Human Reproduction ) lamented, ‘Even for a qualitative study, I would expect that some form of confidence interval and paired t-tables analysis, etc. be used to analyse the significance of results'. This comment reveals the reviewer's inappropriate application to qualitative research of criteria relevant only to quantitative research.

In this commentary, we give illustrative examples of questions most appropriately answered using qualitative methods and provide general advice about how to appraise the scientific rigour of qualitative studies. We hope this will help the journal's reviewers and readers appreciate the legitimate place of qualitative research and ensure we do not throw the baby out with the bath water by excluding or rejecting papers simply because they report the results of qualitative studies.

In psychosocial research, ‘quantitative’ research methods are appropriate when ‘factual’ data are required to answer the research question; when general or probability information is sought on opinions, attitudes, views, beliefs or preferences; when variables can be isolated and defined; when variables can be linked to form hypotheses before data collection; and when the question or problem is known, clear and unambiguous. Quantitative methods can reveal, for example, what percentage of the population supports assisted conception, their distribution by age, marital status, residential area and so on, as well as changes from one survey to the next ( Kovacs et al. , 2012 ); the number of donors and donor siblings located by parents of donor-conceived children ( Freeman et al. , 2009 ); and the relationship between the attitude of donor-conceived people to learning of their donor insemination conception and their family ‘type’ (one or two parents, lesbian or heterosexual parents; Beeson et al. , 2011 ).

In contrast, ‘qualitative’ methods are used to answer questions about experience, meaning and perspective, most often from the standpoint of the participant. These data are usually not amenable to counting or measuring. Qualitative research techniques include ‘small-group discussions’ for investigating beliefs, attitudes and concepts of normative behaviour; ‘semi-structured interviews’, to seek views on a focused topic or, with key informants, for background information or an institutional perspective; ‘in-depth interviews’ to understand a condition, experience, or event from a personal perspective; and ‘analysis of texts and documents’, such as government reports, media articles, websites or diaries, to learn about distributed or private knowledge.

Qualitative methods have been used to reveal, for example, potential problems in implementing a proposed trial of elective single embryo transfer, where small-group discussions enabled staff to explain their own resistance, leading to an amended approach ( Porter and Bhattacharya, 2005 ). Small-group discussions among assisted reproductive technology (ART) counsellors were used to investigate how the welfare principle is interpreted and practised by health professionals who must apply it in ART ( de Lacey et al. , 2015 ). When legislative change meant that gamete donors could seek identifying details of people conceived from their gametes, parents needed advice on how best to tell their children. Small-group discussions were convened to ask adolescents (not known to be donor-conceived) to reflect on how they would prefer to be told ( Kirkman et al. , 2007 ).

When a population cannot be identified, such as anonymous sperm donors from the 1980s, a qualitative approach with wide publicity can reach people who do not usually volunteer for research and reveal (for example) their attitudes to proposed legislation to remove anonymity with retrospective effect ( Hammarberg et al. , 2014 ). When researchers invite people to talk about their reflections on experience, they can sometimes learn more than they set out to discover. In describing their responses to proposed legislative change, participants also talked about people conceived as a result of their donations, demonstrating various constructions and expectations of relationships ( Kirkman et al. , 2014 ).

Interviews with parents in lesbian-parented families generated insight into the diverse meanings of the sperm donor in the creation and life of the family ( Wyverkens et al. , 2014 ). Oral and written interviews also revealed the embarrassment and ambivalence surrounding sperm donors evident in participants in donor-assisted conception ( Kirkman, 2004 ). The way in which parents conceptualise unused embryos and why they discard rather than donate was explored and understood via in-depth interviews, showing how and why the meaning of those embryos changed with parenthood ( de Lacey, 2005 ). In-depth interviews were also used to establish the intricate understanding by embryo donors and recipients of the meaning of embryo donation and the families built as a result ( Goedeke et al. , 2015 ).

It is possible to combine quantitative and qualitative methods, although great care should be taken to ensure that the theory behind each method is compatible and that the methods are being used for appropriate reasons. The two methods can be used sequentially (first a quantitative then a qualitative study or vice versa), where the first approach is used to facilitate the design of the second; they can be used in parallel as different approaches to the same question; or a dominant method may be enriched with a small component of an alternative method (such as qualitative interviews ‘nested’ in a large survey). It is important to note that free text in surveys represents qualitative data but does not constitute qualitative research. Qualitative and quantitative methods may be used together for corroboration (hoping for similar outcomes from both methods), elaboration (using qualitative data to explain or interpret quantitative data, or to demonstrate how the quantitative findings apply in particular cases), complementarity (where the qualitative and quantitative results differ but generate complementary insights) or contradiction (where qualitative and quantitative data lead to different conclusions). Each has its advantages and challenges ( Brannen, 2005 ).

Qualitative research is gaining increased momentum in the clinical setting and carries different criteria for evaluating its rigour or quality. Quantitative studies generally involve the systematic collection of data about a phenomenon, using standardized measures and statistical analysis. In contrast, qualitative studies involve the systematic collection, organization, description and interpretation of textual, verbal or visual data. The particular approach taken determines to a certain extent the criteria used for judging the quality of the report. However, research using qualitative methods can be evaluated ( Dixon-Woods et al. , 2006 ; Young et al. , 2014 ) and there are some generic guidelines for assessing qualitative research ( Kitto et al. , 2008 ).

Although the terms ‘reliability’ and ‘validity’ are contentious among qualitative researchers ( Lincoln and Guba, 1985 ) with some preferring ‘verification’, research integrity and robustness are as important in qualitative studies as they are in other forms of research. It is widely accepted that qualitative research should be ethical, important, intelligibly described, and use appropriate and rigorous methods ( Cohen and Crabtree, 2008 ). In research investigating data that can be counted or measured, replicability is essential. When other kinds of data are gathered in order to answer questions of personal or social meaning, we need to be able to capture real-life experiences, which cannot be identical from one person to the next. Furthermore, meaning is culturally determined and subject to evolutionary change. The way of explaining a phenomenon—such as what it means to use donated gametes—will vary, for example, according to the cultural significance of ‘blood’ or genes, interpretations of marital infidelity and religious constructs of sexual relationships and families. Culture may apply to a country, a community, or other actual or virtual group, and a person may be engaged at various levels of culture. In identifying meaning for members of a particular group, consistency may indeed be found from one research project to another. However, individuals within a cultural group may present different experiences and perceptions or transgress cultural expectations. That does not make them ‘wrong’ or invalidate the research. Rather, it offers insight into diversity and adds a piece to the puzzle to which other researchers also contribute.

In qualitative research the objective stance is obsolete, the researcher is the instrument, and ‘subjects’ become ‘participants’ who may contribute to data interpretation and analysis ( Denzin and Lincoln, 1998 ). Qualitative researchers defend the integrity of their work by different means: trustworthiness, credibility, applicability and consistency are the evaluative criteria ( Leininger, 1994 ).

Trustworthiness

A report of a qualitative study should contain the same robust procedural description as any other study. The purpose of the research, how it was conducted, procedural decisions, and details of data generation and management should be transparent and explicit. A reviewer should be able to follow the progression of events and decisions and understand their logic because there is adequate description, explanation and justification of the methodology and methods ( Kitto et al. , 2008 )

Credibility

Credibility is the criterion for evaluating the truth value or internal validity of qualitative research. A qualitative study is credible when its results, presented with adequate descriptions of context, are recognizable to people who share the experience and those who care for or treat them. As the instrument in qualitative research, the researcher defends its credibility through practices such as reflexivity (reflection on the influence of the researcher on the research), triangulation (where appropriate, answering the research question in several ways, such as through interviews, observation and documentary analysis) and substantial description of the interpretation process; verbatim quotations from the data are supplied to illustrate and support their interpretations ( Sandelowski, 1986 ). Where excerpts of data and interpretations are incongruent, the credibility of the study is in doubt.

Applicability

Applicability, or transferability of the research findings, is the criterion for evaluating external validity. A study is considered to meet the criterion of applicability when its findings can fit into contexts outside the study situation and when clinicians and researchers view the findings as meaningful and applicable in their own experiences.

Larger sample sizes do not produce greater applicability. Depth may be sacrificed to breadth or there may be too much data for adequate analysis. Sample sizes in qualitative research are typically small. The term ‘saturation’ is often used in reference to decisions about sample size in research using qualitative methods. Emerging from grounded theory, where filling theoretical categories is considered essential to the robustness of the developing theory, data saturation has been expanded to describe a situation where data tend towards repetition or where data cease to offer new directions and raise new questions ( Charmaz, 2005 ). However, the legitimacy of saturation as a generic marker of sampling adequacy has been questioned ( O'Reilly and Parker, 2013 ). Caution must be exercised to ensure that a commitment to saturation does not assume an ‘essence’ of an experience in which limited diversity is anticipated; each account is likely to be subtly different and each ‘sample’ will contribute to knowledge without telling the whole story. Increasingly, it is expected that researchers will report the kind of saturation they have applied and their criteria for recognising its achievement; an assessor will need to judge whether the choice is appropriate and consistent with the theoretical context within which the research has been conducted.

Sampling strategies are usually purposive, convenient, theoretical or snowballed. Maximum variation sampling may be used to seek representation of diverse perspectives on the topic. Homogeneous sampling may be used to recruit a group of participants with specified criteria. The threat of bias is irrelevant; participants are recruited and selected specifically because they can illuminate the phenomenon being studied. Rather than being predetermined by statistical power analysis, qualitative study samples are dependent on the nature of the data, the availability of participants and where those data take the investigator. Multiple data collections may also take place to obtain maximum insight into sensitive topics. For instance, the question of how decisions are made for embryo disposition may involve sampling within the patient group as well as from scientists, clinicians, counsellors and clinic administrators.

Consistency

Consistency, or dependability of the results, is the criterion for assessing reliability. This does not mean that the same result would necessarily be found in other contexts but that, given the same data, other researchers would find similar patterns. Researchers often seek maximum variation in the experience of a phenomenon, not only to illuminate it but also to discourage fulfilment of limited researcher expectations (for example, negative cases or instances that do not fit the emerging interpretation or theory should be actively sought and explored). Qualitative researchers sometimes describe the processes by which verification of the theoretical findings by another team member takes place ( Morse and Richards, 2002 ).

Research that uses qualitative methods is not, as it seems sometimes to be represented, the easy option, nor is it a collation of anecdotes. It usually involves a complex theoretical or philosophical framework. Rigorous analysis is conducted without the aid of straightforward mathematical rules. Researchers must demonstrate the validity of their analysis and conclusions, resulting in longer papers and occasional frustration with the word limits of appropriate journals. Nevertheless, we need the different kinds of evidence that is generated by qualitative methods. The experience of health, illness and medical intervention cannot always be counted and measured; researchers need to understand what they mean to individuals and groups. Knowledge gained from qualitative research methods can inform clinical practice, indicate how to support people living with chronic conditions and contribute to community education and awareness about people who are (for example) experiencing infertility or using assisted conception.

Each author drafted a section of the manuscript and the manuscript as a whole was reviewed and revised by all authors in consultation.

No external funding was either sought or obtained for this study.

The authors have no conflicts of interest to declare.

Beeson D , Jennings P , Kramer W . Offspring searching for their sperm donors: how family types shape the process . Hum Reprod 2011 ; 26 : 2415 – 2424 .

Google Scholar

Brannen J . Mixing methods: the entry of qualitative and quantitative approaches into the research process . Int J Soc Res Methodol 2005 ; 8 : 173 – 184 .

Charmaz K . Grounded Theory in the 21st century; applications for advancing social justice studies . In: Denzin NK , Lincoln YS (eds). The Sage Handbook of Qualitative Research . California : Sage Publications Inc. , 2005 .

Google Preview

Cohen D , Crabtree B . Evaluative criteria for qualitative research in health care: controversies and recommendations . Ann Fam Med 2008 ; 6 : 331 – 339 .

de Lacey S . Parent identity and ‘virtual’ children: why patients discard rather than donate unused embryos . Hum Reprod 2005 ; 20 : 1661 – 1669 .

de Lacey SL , Peterson K , McMillan J . Child interests in assisted reproductive technology: how is the welfare principle applied in practice? Hum Reprod 2015 ; 30 : 616 – 624 .

Denzin N , Lincoln Y . Entering the field of qualitative research . In: Denzin NK , Lincoln YS (eds). The Landscape of Qualitative Research: Theories and Issues . Thousand Oaks : Sage , 1998 , 1 – 34 .

Dixon-Woods M , Bonas S , Booth A , Jones DR , Miller T , Shaw RL , Smith JA , Young B . How can systematic reviews incorporate qualitative research? A critical perspective . Qual Res 2006 ; 6 : 27 – 44 .

ESHRE Psychology and Counselling Guideline Development Group . Routine Psychosocial Care in Infertility and Medically Assisted Reproduction: A Guide for Fertility Staff , 2015 . http://www.eshre.eu/Guidelines-and-Legal/Guidelines/Psychosocial-care-guideline.aspx .

Freeman T , Jadva V , Kramer W , Golombok S . Gamete donation: parents' experiences of searching for their child's donor siblings or donor . Hum Reprod 2009 ; 24 : 505 – 516 .

Goedeke S , Daniels K , Thorpe M , Du Preez E . Building extended families through embryo donation: the experiences of donors and recipients . Hum Reprod 2015 ; 30 : 2340 – 2350 .

Hammarberg K , Johnson L , Bourne K , Fisher J , Kirkman M . Proposed legislative change mandating retrospective release of identifying information: consultation with donors and Government response . Hum Reprod 2014 ; 29 : 286 – 292 .

Kirkman M . Saviours and satyrs: ambivalence in narrative meanings of sperm provision . Cult Health Sex 2004 ; 6 : 319 – 336 .

Kirkman M , Rosenthal D , Johnson L . Families working it out: adolescents' views on communicating about donor-assisted conception . Hum Reprod 2007 ; 22 : 2318 – 2324 .

Kirkman M , Bourne K , Fisher J , Johnson L , Hammarberg K . Gamete donors' expectations and experiences of contact with their donor offspring . Hum Reprod 2014 ; 29 : 731 – 738 .

Kitto S , Chesters J , Grbich C . Quality in qualitative research . Med J Aust 2008 ; 188 : 243 – 246 .

Kovacs GT , Morgan G , Levine M , McCrann J . The Australian community overwhelmingly approves IVF to treat subfertility, with increasing support over three decades . Aust N Z J Obstetr Gynaecol 2012 ; 52 : 302 – 304 .

Leininger M . Evaluation criteria and critique of qualitative research studies . In: Morse J (ed). Critical Issues in Qualitative Research Methods . Thousand Oaks : Sage , 1994 , 95 – 115 .

Lincoln YS , Guba EG . Naturalistic Inquiry . Newbury Park, CA : Sage Publications , 1985 .

Morse J , Richards L . Readme First for a Users Guide to Qualitative Methods . Thousand Oaks : Sage , 2002 .

O'Reilly M , Parker N . ‘Unsatisfactory saturation’: a critical exploration of the notion of saturated sample sizes in qualitative research . Qual Res 2013 ; 13 : 190 – 197 .

Porter M , Bhattacharya S . Investigation of staff and patients' opinions of a proposed trial of elective single embryo transfer . Hum Reprod 2005 ; 20 : 2523 – 2530 .

Sandelowski M . The problem of rigor in qualitative research . Adv Nurs Sci 1986 ; 8 : 27 – 37 .

Wyverkens E , Provoost V , Ravelingien A , De Sutter P , Pennings G , Buysse A . Beyond sperm cells: a qualitative study on constructed meanings of the sperm donor in lesbian families . Hum Reprod 2014 ; 29 : 1248 – 1254 .

Young K , Fisher J , Kirkman M . Women's experiences of endometriosis: a systematic review of qualitative research . J Fam Plann Reprod Health Care 2014 ; 41 : 225 – 234 .

• conflict of interest
• credibility
• qualitative research
• quantitative methods

Email alerts

Citing articles via.

• Recommend to your Library

Affiliations

• Online ISSN 1460-2350
• Copyright © 2024 European Society of Human Reproduction and Embryology
• About Oxford Academic
• Publish journals with us
• University press partners
• What we publish
• New features  
• Open access
• Institutional account management
• Rights and permissions
• Get help with access
• Accessibility
• Media enquiries
• Oxford University Press
• Oxford Languages
• University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

• Copyright © 2024 Oxford University Press
• Cookie settings
• Cookie policy
• Privacy policy
• Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

• Qualitative vs Quantitative Research: When to Use Each

User research is crucial for understanding the needs, preferences, and behaviours of your users. By directly engaging with and observing real users, you gain invaluable insights that can inform the design and development of your product or service.

There are two main approaches to conducting user research: qualitative and quantitative.

This article will provide an overview of qualitative vs quantitative research. I’ll define what each method is, walk through example scenarios of when you might use one versus the other, highlight the benefits of each, and offer guidelines on when qualitative or quantitative user research is most appropriate.

With a foundational understanding of these two complementary research approaches, you’ll be equipped to choose the right user research method(s) for gaining the insights you need.

Let’s get started.

Table of Contents

What is user research.

User research is the study of target users and their needs, goals, and behaviours. It provides critical insights that inform the design and development of products, services, and experiences.

The goal of user research is to understand users’ motivations and thought processes so that solutions can be crafted to meaningfully address their pain points and desires. Researchers utilize various qualitative and quantitative techniques to uncover users’ attitudes, perceptions, and needs.

The findings from user research drive design decisions, product strategy, and business objectives. By grounding designs in real user data, teams can create solutions that delight users by meeting their needs. User research provides a profound understanding of the problem space so that products resonate with users’ mental models and workflows.

Qualitative User Research

Qualitative user research is a set of exploratory research techniques focused on developing a deep understanding of why and how people behave, think, feel, and make decisions. 

It typically involves open-ended observations, interviews, and analysis based on small sample sizes. 

The goal is to uncover insights into human motivations, attitudes and needs through immersive and conversational research methods. 

Rather than focusing on quantitative metrics or measurements, qualitative user research aims to understand the nuanced human context surrounding products, services, and experiences.

Key characteristics of qualitative research include:

Asking open-ended questions – 

Qualitative research utilizes flexible, open-ended questions that allow users to provide thoughtful and descriptive responses. Questions focus on the “why” and “how” behind bbehaviours not just surface-level preferences. For example, researchers may ask “Can you walk me through how you accomplished that task?” rather than “Did you find that task easy or difficult?”. Open questions lead to deeper psychological insights.

Small but focused sample sizes – 

Qualitative studies recruit a smaller number of users, but they represent the target audience segment. For example, rather than 500 broadly targeted surveys, qualitative research may study 8-12 users who match the persona. Smaller samples enable more time spent discovering each user’s nuanced perspectives.

Naturalistic observations – 

Qualitative research observes users interacting in real environments, like their homes or workplaces. This naturalistic approach reveals authentic behaviours versus what people say. Researchers can shadow users and see real-world contexts.

Immersive techniques – 

Qualitative research utilizes ethnography-inspired techniques. Researchers embed themselves alongside users to empathize with their worldview. In-depth interviews, diary studies, and field visits all facilitate first-hand experience of the user’s journey – Through open and natural dialogue, qualitative research uncovers emotional and social insights difficult to extract via surveys or analytics. The human-to-human approach highlights feelings, relationships, and unarticulated needs.

Common Qualitative Research Methods

1. one-on-one interviews.

Conducting a one-on-one user interview involves an in-depth, conversational session between the researcher and a single user representative of the target audience. The interviewer guides the discussion using flexible, open-ended questions to elicit deep insights into the user’s perspectives, bebehavioursand needs.

One-on-one interviews shine when:

• Granular insights are needed from individuals based on their distinct circumstances and backgrounds.
• Understanding nuanced personal contexts, thought processes, pain points and emotions is critical.
• Users may be more forthcoming when peaking alone versus groups.
• The order and wording of questions benefit from real-time adaptation to the dialogue flow.
• Non-verbal cues and body language provide additional context to verbal answers.

Effective one-on-one interview tips include:

• Establishing rapport helps the user open up honestly. Avoid an interrogation vibe.
• Adapt questions based on responses, probing for richer details. Don’t just stick to a rigid script.
• Remain neutral and avoid leading questions that influence the user’s answers.
• Listen fully not just for what’s said but also what’s unspoken. Note emotions and inconsistencies.
• Thank the user for generously providing their time and perspectives. They feel valued.

One-on-one engagement allows deep discovery of individual motivations and contexts. It requires planning, active listening, and interpreting both verbal and non-verbal cues.

2. Focus Groups

A focus group brings together 6-12 users from the target audience for a moderated, interactive discussion focused on a product, service, or topic. Participants share perspectives and build on each other’s ideas in a conversational setting.

Focus groups are advantageous when:

• Real-time user interaction and feedback on concepts is desired.
• Sparking new ideas across users with different attitudes and behaviors is the goal.
• Observing how users influence each other reveals social dynamics and norms.
• A wider range of feedback is needed in the time available versus 1-on-1 interviews.

Tips for productive focus groups include:

• Recruit users who offer diverse perspectives but fit the target audience.
• Use a skilled, neutral moderator to facilitate constructive discussion and keep it on track.
• Explain ground rules upfront so all participants engage respectfully.
• Guide the flow from general to specific questions, leaving time for open discussion.
• Change up activities and stimuli (images, prototype demos) to sustain energy.
• Send recordings for further analysis of responses, interactions, and nonverbal behaviors.

3. User Diaries

User diaries involve having target audience members self-document and reflect on their experiences related to a product or service over time in an ongoing journal. Diary studies provide rich, longitudinal insights from the user’s perspective.

Diary studies are advantageous when:

• Capturing detailed, nuanced accounts of user journeys, motivations, pain points, and perceptions in a real-world context is needed.
• Users are geographically dispersed making direct observations or interviews impractical.
• Revealing changes over time rather than one-off interactions is the research goal.
• Users can clearly articulate their experiences through written or multimedia diaries.

Tips for productive diary studies include:

• Provide clear instructions and templates detailing what details to capture in diary entries over the study duration. Offer tools like written journals, audio recorders, or online forms.
• Set reasonable time commitments per day/week and study length based on depth required and user willingness.
• Check-in throughout the process to maintain participation, answer questions, and fix issues.
• Incentivize participation by compensating users for time spent journaling.
• Regularly review entries to identify compelling patterns and follow up for more context.
• Analyze entries to uncover key themes, insights, and opportunities related to the research aims.

Well-designed diary studies generate rich qualitative data by tapping into users’ direct experiences in their own words over time.

4. Ethnographic Studies

This involves immersing in users’ real-world environments to observe behaviors, understand contexts, and uncover unarticulated needs. Researchers embed directly in the user experience.

Ethnographies excel when:

• Deep insight into “unsaid” user behaviors, motivations, and pain points is needed.
• Directly observing users interacting in real environments provides more authenticity than interviews.
• Longer-term immersion reveals ingrained habits, rituals, and relationships.
• Users cannot fully or accurately articulate their own behaviors and motivations.

Tips for effective ethnographies:

• Clearly define the cultural/environmental scope for observations. Get necessary access.
• Utilize fly-on-the-wall observation techniques to avoid disrupting natural behaviors.
• Take comprehensive notes on user activities, interactions, tools, and environmental factors.
• Look for patterns in activities, conversations, rituals, artifacts, and relationships.
• Balance active observation with informal interview discussions to add context.
• Keep the human perspective; focus on empathy not just data gathering.

5. User Testing

User testing involves directly observing representative users interact with a product or prototype to identify usability issues and collect feedback. Participants work through realistic scenarios while researchers analyze successes, pain points, emotions, and verbal commentary.

User testing shines when:

• Feedback is needed on whether designs meet user expectations and needs.
• Identifying issues in workflows, navigation, learnability, and comprehension is important.
• Directly observing user behavior provides more reliable insights than what they self-report.
• Testing with iterations is built into the product development process.

Tips for effective user testing:

• Develop realistic usage scenarios and test scripts tailored to key research questions. Avoid bias.
• Recruit users matching target demographics and familiarity with the product domain.
• Set up comfortable testing spaces and moderation that put users at ease.
• Record sessions to capture insights from body language, tones, facial expressions etc.
• Analyze results for trends and outliers in behaviors, problems, emotions. Focus on learning.
• Iterate on solutions based on insights. Retest with new users to validate improvements.

6. Think-Aloud-Protocol

The think-aloud protocol method asks users to continuously verbalize their thoughts, feelings, and opinions while completing tasks with a product or prototype. Researchers observe and listen as users express in-the-moment reactions.

Think-aloud testing is ideal when:

• Understanding users’ in-the-moment decision making process and emotional responses is invaluable.
• Insights into points of confusion, frustration, delight can rapidly inform design iterations.
• Users can competently complete tasks while articulating their thinking concurrently.
• Limited time is available compared to extensive ethnographies or diary studies.

Effective think-aloud tips include:

• Provide clear instructions to share thoughts continuously throughout the session. Reassure users.
• Use open-ended prompts like “Tell me what you’re thinking” to encourage articulation without leading.
• Avoid interfering with the user’s process so their commentary feels natural.
• Have users complete realistic, task-based scenarios representative of the product experience.
• Capture direct quotes and time stamp compelling reactions to inform development priorities.

Think-aloud testing efficiently provides a window into users’ in-the-moment perceptions and decision making during hands-on product experiences

Applications Of Qualitative Research

Early product development stages:.

Qualitative user research is invaluable in the early ideation and discovery phases of product development when the problem space is still being explored.

Methods like interviews, ethnographies, and diary studies help researchers deeply understand user needs even before product ideas exist. Qualitative data informs initial user personas, journeys, and use cases so product concepts address real user problems.

Early qualitative insights ensure the end solution resonates with user contexts, attitudes, behaviors and motivations. This upfront user-centricity pays dividends across the entire product lifecycle.

Understanding user needs:

Qualitative techniques directly engage with end users to reveal not just what they do, but why they do it. Immersive interviews unveil users’ unstated needs because researchers can ask follow-up questions on the spot.

Observational studies capture nuanced behaviors that users themselves may not consciously realize or find important to mention. The qualitative emphasis on unlocking the “why” behind user actions is crucial for identifying needs that statistics alone miss. The human-centered discoveries spark innovation opportunities.

Problem identification:

The flexible and exploratory nature of qualitative research allows people to openly share the frustrations, anxieties, and pain points they experience.

Their candid words and emotions convey the meaning behind problems far better than numbers alone. For example, ethnographies and diaries may reveal users’ biggest problems stem not from one specific functionality issue but from misaligned workflows overall.

Qualitative techniques dig into the impacts of problems. The human perspectives guide better solutions.

Understanding context of use:

Well-designed qualitative studies meet users in their natural environments and daily lives. This enables researchers to observe how products and services integrate within existing ecosystems, habits, relationships, and workflows.

Key contextual insights are revealed that surveys alone could miss. For example, home interviews may show a smart speaker’s role in family dynamics. Contextual understanding ensures products fit seamlessly into users’ worlds.

Benefits Of Qualitative Research

Gaining deep insights:.

Qualitative techniques like long-form interviews, think-aloud protocol, and diary studies uncover not just surface-level behaviors and preferences, but the deeper meaning, motivations and emotions behind users’ actions.

Asking probing open-ended questions during in-depth conversations reveals nuanced perspectives on needs, thought processes, pain points, and ecosystems.

Immersive ethnographic observation also provides a holistic view of ingrained user habits and contexts. The richness of these qualitative findings informs truly human-centered innovation opportunities in a way quantitative data alone cannot.

Understanding user emotions:

Qualitative research effectively captures the wide range of emotional aspects of the user experience. Through ethnographic observation, researchers directly see moments of delight during usability testing or frustration while completing a task.

Diary studies provide outlets for users to express perceptions in their own words over time.

In interviews, asking follow-up questions on reactions and feelings provides more color than rating scales. This emotional intelligence helps designers move beyond functional requirements to empathetically address felt needs like enjoyment, trust, accomplishment, and belonging.

Exploring new ideas:

The flexible, conversational nature of qualitative research facilitates creative ideation.

Interactive sessions like focus groups or participatory design workshops allow people to organically share, build on, and iterate on ideas together.

Moderators can probe concepts through clarifying, non-leading questions to draw out nuance and have participants riff on each other’s thoughts. This process efficiently fosters new directions and uncovers latent needs that traditional surveys may never have identified.

Uncovering underlying reasons:

Asking “why” is fundamental to qualitative inquiry. Researchers go beyond documenting surface patterns to uncover the deeper motivations, contextual influences, ingrained habits, and thought processes driving user behaviours.

Observations combined with follow-up interviews provide well-rounded explanations for why people act as they do. For example, apparent routines may be based on social norms versus personal preferences. Qualitative findings explain behavior in a way quantitative data alone often cannot.

Facilitating empathy:

Approaches like ethnography facilitate stepping into the user’s shoes to immerse in their worldview.

Two-way dialogue through long-form interviews allows candid exchange as fellow humans, not detached research subjects. Insights derived from conversations and observations in real-world contexts inspire greater empathy among researchers for users’ needs, frustrations, delights, and realities. Teams feel connected to the people they aim to understand and serve.

Quantitative User Research

Quantitative research seeks to quantify user behaviors, preferences, and attitudes through numerical and statistical analysis. It emphasizes objective measurements and large sample sizes to uncover insights that can be generalized to the broader population.

Key characteristics of quantitative research include:

Structured methodology: 

Quantitative studies utilize highly structured data collection methods like surveys, structured user observation, and user metrics tracking. Surveys rely on closed-ended questions with predefined response options. Observation uses systematic checklists to tally predefined behaviors. This standardization allows mathematical analysis across all participants.

Numerical and statistical analysis: 

The numerical data gathered through quantitative research is analyzed using statistics, aggregates, regressions, and predictive modeling to draw conclusions. Researchers can analyze response frequencies, statistical relationships between variables, segmentation analyses, and predictive models based on the quantitative data.

Large representative samples: 

Quantitative research prioritizes large sample sizes that aim to be representative of the target population. For surveys, sufficient sample sizes are determined using power analyses to ensure findings are generalizable. Some common samples can be in the hundreds to thousands. This is in contrast to smaller qualitative samples aimed at diving deep into individual experiences.

Rating scales: 

Surveys and questionnaires rely heavily on numerical rating scales to quantify subjective attributes like satisfaction, ease-of-use, urgency, importance etc. Respondents rank options or choose numbers that correspond to stances. This assigns discrete values for comparison and statistical testing.

Objectivity : 

Quantitative research focuses on uncovering factual, observable and measurable truths about user behaviors, needs or perceptions. There is less emphasis on gathering subjective viewpoints, contexts, and detailed narratives which are hallmarks of qualitative research. The goal is objective, generalizable insights.

Common Quantitative Research Methods

1. online surveys.

Online surveys involve asking a sample of users to respond to a standardized set of questions delivered through web forms or email. Surveys gather self-reported data on attitudes, preferences, needs and behaviors that can be statistically analyzed.

Online surveys are ideal when:

• A large sample size is needed to gain representative insights from a population.
• Standardized, quantitative data on usages, perceptions, features etc. is desired.
• Users have the literacy level to understand and thoughtfully complete surveys.
• Stakeholders want quantitative metrics, benchmarks and models based on user data.

Effective online survey tips:

• Limit survey length and design clear, focused questions to maintain engagement.
• Structure questions and response options to enable statistical analysis for trends and relationships.
• Use rating scales to quantify subjective attributes like satisfaction, urgency, importance etc.
• Write simple, unambiguous statements users can assess consistently. Avoid leading or loaded language.
• Test surveys before deployment to refine questions and ensure technical functionality.
• Analyze results with statistics and visualizations to glean actionable, user-centered insights.

2. Usability Benchmarking

Usability benchmarking involves assessing a product’s ease-of-use against quantified performance standards and metrics. Researchers conduct structured usability tests to gather performance data that is compared to benchmarks.

Usability benchmarking is ideal when:

• Quantitative goals exist for critical usability metrics like task completion rate, errors, time-on-task, perceived ease-of-use.
• Comparing usability data to other products, previous versions, or industry standards is desired.
• There is a focus on improving usability measured through standardized objectives versus qualitative insights.

Effective usability benchmarking tips:

• Identify key usage tasks and scenarios that align to business goals to standardize testing.
• Leverage established usability metrics like System Usability Scale (SUS) to enable benchmarking.
• Conduct structured tests with representative users on targeted tasks.
• Analyze metrics using statistical methods to surface enhancements tied to benchmarks.
• Set incremental usability goals and continue testing post-launch to drive improvements.

3. Analytics

Analytics involves collecting and analyzing usage data from products to uncover patterns, metrics, and insights about real customer behaviors. Sources like web analytics, app metrics, and usage logs are common.

Analytics excel when:

• Objective data on how customers are actually using a product is needed to optimize features and workflows.
• Large volumes of real customer usage data are available for analysis.
• Revealing segments based on behavioral differences can inform personalized experiences.
• Improving key performance indicators and quantifying impact is a priority.

Effective analytics tips:

• Identify key questions and metrics aligned to business goals to focus analysis. Common metrics are conversions, engagement, retention etc.
• Leverage tools like Google Analytics to collect event and behavioral data at scale.
• Analyze trends, run statistical tests, and build models to surface insights from noise.
• Make insights actionable by tying to opportunities like improving at-risk customer retention.
• Continuously analyze data over time and across updates to optimize ongoing enhancements.

Applications of Quantitative Research

Validating hypotheses:.

Quantitative studies provide statistically robust methods to validate assumptions and confirm hypotheses related to user behaviors or preferences.

After initial qualitative research like interviews raise theories about user needs or pain points, quantitative experiments can verify if those hypotheses hold true at a larger scale.

For example, A/B testing can validate if a new checkout flow improves conversion rates as hypothesized based on earlier usability studies. Statistical validation boosts confidence that recommended changes will have the expected impact on business goals.

Generalizing findings:

The large, representative sample sizes and standardized methodologies in quantitative studies allow findings to be generalized to the full target population with known confidence intervals.

Proper sampling methods ensure data reflects the intended audience demographics, attitudes, and behaviours.

If certain usability benchmarks hold true across hundreds of participants, they are assumed to apply to similar users across that segment. This enables product improvements to be made for broad groups based on generalizable data.

Tracking granular changes:

Quantitative data enables even subtle changes over time, iterative tweaks, or segmented differences to be precisely tracked using consistent metrics.

Longitudinal surveys can pinpoint if customer satisfaction trends upward or downward month-to-month based on new features.

Web analytics continuously monitor click-through rates over years to optimize paths. Controlled A/B tests discern the isolated impact of iterative enhancements. The reliability of quantitative metrics ensures changes are spotted quickly.

Quantifying problem severity:

Statistical analysis in quantitative research can accurately define the frequency and severity of user problems.

For example, an eye-tracking study might uncover 60% of users miss a key navigation element. Surveys can determine what percentage of customers are highly frustrated by unclear documentation.

Quantifying the scope and business impact of issues in this way allows product teams to confidently prioritize the problems with greatest value to solve first.

Benefits of Quantitative Research

Quantifying user behaviours:.

Quantitative methods like analytics, surveys, and usability metrics capture concrete, observable data on how users interact with products.

Usage metrics quantify engagement levels, conversion rates, task completion times, feature adoption, and more. The numerical data enables statistical analysis to uncover trends, model outcomes, and optimize products based on revealed behaviours versus subjective hunches. Quantification also facilitates benchmarking and goal-setting.

Validating hypotheses rigorously:

Quantitative experiments like A/B tests and controlled usability studies allow assumptions and theories about user behaviors to be validated with statistical rigour.

Significant results provide confidence that patterns are real and not due to chance alone. Teams can test hypotheses raised in past qualitative research to prevent high-risk decisions based on false premises. Statistical validation lends credibility to recommended changes expected to impact key metrics.

Precisely tracking granular trends:

The consistent, standardized metrics in quantitative studies powerfully track usage trends over time, across releases, and between user segments. For example, longitudinal surveys can monitor how satisfaction ratings shift month-to-month based on new features.

Web analytics uncover how click-through rates trend up or down over years as needs evolve. Controlled tests isolate the impact of each iteration. Quantitative data spots subtle changes.

Informed decision-making:

Quantitative data provides concrete, measurable evidence of user behaviours, needs, and pain points for informed decision-making.

Metrics on usage, conversions, completion rates, satisfaction, and more enable teams to identify and prioritize issues based on representative data versus hunches. Leaders can justify decisions using statistical significance, projected optimization gains, and benchmark comparisons.

Mitigating biases:

The focus on objective, observable metrics can reduce biases that may inadvertently influence qualitative findings.

Proper sampling methods, significance testing, and controlled experiments also minimize distortions from individual perspectives. While no research is assumption-free, quantitative techniques substantially limit bias through rigorous design and large sample sizes.

Comparing Qualitative and Quantitative User Research

Here is a comparison of qualitative and quantitative user research in a table format:

When to Use Each Method

When to use qualitative research:.

• Early in the product development lifecycle during the fuzzy front-end stages. Open-ended qualitative research is critical for discovering user needs, pain points, and behaviors when the problems are unclear. Qualitative data provides the rich contextual insights required to guide initial solution ideation and design before quantifying anything. Methods like in-depth interviews and contextual inquiries reveal pain points that pure quantitative data often overlooks.
• When research questions are ambiguous, expansive, or nuanced at the start. Qualitative methods can flexibly follow where the data leads to uncover unexpected themes. The fluid approach adapts to capture unforeseen insights, especially on subjective topics like emotions and motivations that require deep probing. Qualitative approaches excel at understanding complex “why” and “how” aspects behind behaviors.
• If seeking highly vivid, detailed narratives of user motivations, ecosystems, thought processes, and needs. Qualitative data maintains all the situational nuance and color intact, not condensed statistically. User stories and perspectives come through with empathy and emotion versus sterile numbers. This level of detail informs truly human-centered solutions.
• During discovery of new market opportunities, expanding into new segments, or exploringnew capabilities with many unknowns. Flexible qualitative digging uncovers fresh territories before attempting to quantify anything. Fuzzy front-end exploration is suited to qualitative exploration.

When to use quantitative research:

• To validate assumptions, theories, and qualitative insights at scale using statistical rigor. Quantitative data provides the confidence that patterns seen are significant and not just anecdotal findings. Surveys, controlled experiments, and metrics test hypotheses raised during qualitative discovery. The statistics offer credibility.
• If research questions aim to precisely quantify target audience behaviors, attitudes, and preferences. Quantitative methods objectively measure “what” users do without room for fuzzy interpretation. The numerical data acts as a precise compass for decision-making.
• When clear metrics and benchmarks are required to set optimization goals, compare design solutions, and tightly track progress. Quantitative data delivers concrete KPIs to orient teams and chart enhancement impact.
• To isolate the precise impact of changes over time or between design solutions by tracking standardized metrics. Controlled A/B tests discern what improvements unequivocally moved key metrics versus speculation.

Frequently Asked Questions (FAQs)

1. What is the main difference between qualitative and quantitative user research?

The main difference is that qualitative research aims to uncover the “why” behind user behaviors through subjective, non-numerical data like interviews and observations. Quantitative research focuses on quantifying the “what” through objective, numerical data like metrics and statistics.

2. Can qualitative and quantitative user research be used together?

Absolutely. Many researchers use a mixed methods approach that combines both qualitative and quantitative techniques to get comprehensive insights. Qualitative research can uncover problems to quantify, while quantitative testing can validate qualitative theories.

3. How do I choose between qualitative and quantitative user research?

Choose based on your current product stage, questions, timeline, and resources. Qualitative research is best for exploratory discovery, while quantitative confirms hypotheses. Use qualitative first, then quantitative or a mix of both.

4. What are some common tools for conducting qualitative and quantitative user research?

Qualitative tools include interviews, focus groups, surveys, user testing and more. Quantitative tools include web analytics, App store metrics, usability metrics, controlled experiments and surveys.

5. What are the limitations of qualitative and quantitative user research?

Qualitative findings are not statistically representative. Quantitative data lacks rich behavioral details. Using both offsets the weaknesses.

• A/B Testing
• Company News
• Conversion Rate Optimisation
• CRO Tools and Resources
• Experimentation Articles
• Google Analytics
• Personalization
• Usability Testing
• User Research
• The Ultimate Guide To Integrating Voice of the Customer into CRO
• Scaling User Research For Enterprise CRO
• Understanding the Core Concepts of CRO Personalization
• Dynamic Content Personalization: Tips and Best Practices
• The Impact of AB Testing on User Retention
• Open-Ended Questions - A Complete Guide
• Explore vs Exploit: Finding the Balance in CRO
• Post-Launch User Testing: Continuous Improvement Strategies
• Introduction To MultiVariate Testing: A Complete Guide (2023)
• The surprising truth about Amazon and Booking.com's culture of experimentation
• What Is A CRO Test? Definition, Types & Examples
• AB Testing and User Research: Synergies for Success
• One-Tailed vs Two-Tailed Tests: What You Should Know
• The 7Ps Of Marketing

Is your CRO programme delivering the impact you hoped for ?

Benchmark your CRO now for immediate, free report packed with ACTIONABLE insights you and your team can implement today to increase conversion.

Takes only two minutes

If your CRO programme is not delivering the highest ROI of all of your marketing spend, then we should talk.

Before you go...

“The world’s leading companies are using experimentation to generate better results for the whole business.

Download our latest ebook to discover how businesses have made the shift from CRO to experimentation and how you can too.

Join the next one!

Be the first to know about future events with top speakers from the CRO industry.

Service update: Some parts of the Library’s website will be down for maintenance on August 11.

Secondary menu

• Log in to your Library account
• Hours and Maps
• Connect from Off Campus
• UC Berkeley Home

Search form

Research methods--quantitative, qualitative, and more: qualitative research.

• Quantitative Research
• Qualitative Research
• Data Science Methods (Machine Learning, AI, Big Data)
• Text Mining and Computational Text Analysis
• Evidence Synthesis/Systematic Reviews
• Get Data, Get Help!

About Qualitative Data

Qualitative data are data representing information and concepts that are not represented by numbers. They are often gathered from interviews and focus groups, personal diaries and lab notebooks, maps, photographs, and other printed materials or observations. Qualitative data are distinguished from  quantitative data , which focus primarily on data that can be represented with numbers. 

Qualitative data can be analyzed in multiple ways. One common method is data coding, which refers to the process of transforming the raw collected data into a set of meaningful categories that describe essential concepts of the data. Qualitative data and methods may be used more frequently in humanities or social science research and may be collected in descriptive studies.

(From the Data Glossary , National Center for Data Services, National Library of Medicine)

Methods Texts

Below are some methods texts recommended by qualitative workshop leaders from the UC Berkeley Library and the D-Lab: 

Workshops and Training

• Introduction to Qualitative Data Analysis (video) In this video you'll start from scratch, learning how to create and analyze qualitative data, also getting an overview of the user-friendly and free qualitative data analysis tool, Taguette.  From a 2024 University of California Love Data Week workshop.
• Managing qualitative data 101 Tips on managing qualitative materials from your qualitative research librarian.
• D-Lab workshops Free online workshops on quant and qualitative skills, including coding and using qualitative analysis software.
• Institute for the Study of Societal Issues (ISSI) Training Ethnographic methods workshop from a campus institute.
• Qualitative Methods classes Filter to upcoming semesters and look for qualitative methods classes; the Graduate School of Education and School of Public Health offer extensive methods training.

Qualitative Data Analysis Software

Unfortunately, Berkeley does not yet have a sitewide license for any qualitative analysis software.

If you are a student, you can find affordable student licenses with a web search.

If you are a faculty member, instructor, lecturer, or visiting scholar without grant funding, unfortunately software is quite expensive.

You can find reviews of many qualitative software packages at this University of Surrey link:

• Choosing an Appropriate CAQDAS package .

You can also check out the websites of several major options below: 

• Taguette Taguette has fewer features than other qualitative analysis software, but is free and open-source.
• Atlas.ti Atlas.ti is a major qualitative analysis software, and has affordable licenses for students.
• MaxQDA MaxQDA is a major qualitative analysis software, with affordable student licenses. The D-Lab often teaches workshops on this software.
• NVIVO NVIVO is an established QDA software, with affordable student licenses.
• Dedoose Dedoose supports qualitaive and mixed methods research, using an online interface. Students pay $11 per month.

Resources for Qualitative Data Management

• Managing and Sharing Qualitative Data 101 This page from Berkeley's research data management website offers several things to consider.
• Tutorials on Ethnographic Data Management This curricula includes eight presentations and accompanying exercises for you to think through your qualitative data project--or coach others to do the same.
• Support Your Data: Evaluation Rubric Download the evaluation rubric on this page to assess where you are with qualitative data management, and consider areas to explore next.
• The Qualitative Data Repository (QDR) QDR is one of the top US-based repositories focused on the challenges of managing, storing, and sharing qualitative research materials.
• Research Data @ Berkeley Email Research Data for a consultation about how to set up your qualitative data management plan; they can help you locate other resources on campus.

Mixed Methods Research

Interpretations related to mixed (sometimes called merged) methods vary; be wary of jargon!  Gery Ryan, of the Kaiser Permanente School of Medicine, gives these definitions, while arguing that we should be thinking of the purposes of the research rather than the methodological labels:

Mixed methods research : “Combines elements of qualitative and quantitative research approaches (e. g., use of qualitative and quantitative viewpoints, data collection, analysis, inference techniques) for the broad purposes of breadth and depth of understanding and corroboration.”

Multimethod research : “Either solely combine multiple qualitative approaches or solely combine multiple quantitative approaches.”

Data triangulation : “Uses multiple sources of data or multiple approaches to analyzing data to enhance the credibility of a research study.”

(From " Mixed Methods Research Designs and Data Triangulation " by Gery Ryan, Kaiser Permanente School of Medicine)

• << Previous: Quantitative Research
• Next: Data Science Methods (Machine Learning, AI, Big Data) >>
• Last Updated: Sep 5, 2024 11:38 PM
• URL: https://guides.lib.berkeley.edu/researchmethods

This page is not available

We apologize, but we can't find that file or page. You can try searching the APA website  or one of the following links:

APA Directorates and Programs

APA Publications and Databases

Psychology Topics

If you can't find what you're looking for, you can visit Customer Support or Contact APA .

Frequently asked questions

What’s the difference between quantitative and qualitative methods.

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.

Frequently asked questions: Methodology

Attrition refers to participants leaving a study. It always happens to some extent—for example, in randomized controlled trials for medical research.

Differential attrition occurs when attrition or dropout rates differ systematically between the intervention and the control group . As a result, the characteristics of the participants who drop out differ from the characteristics of those who stay in the study. Because of this, study results may be biased .

Action research is conducted in order to solve a particular issue immediately, while case studies are often conducted over a longer period of time and focus more on observing and analyzing a particular ongoing phenomenon.

Action research is focused on solving a problem or informing individual and community-based knowledge in a way that impacts teaching, learning, and other related processes. It is less focused on contributing theoretical input, instead producing actionable input.

Action research is particularly popular with educators as a form of systematic inquiry because it prioritizes reflection and bridges the gap between theory and practice. Educators are able to simultaneously investigate an issue as they solve it, and the method is very iterative and flexible.

A cycle of inquiry is another name for action research . It is usually visualized in a spiral shape following a series of steps, such as “planning → acting → observing → reflecting.”

To make quantitative observations , you need to use instruments that are capable of measuring the quantity you want to observe. For example, you might use a ruler to measure the length of an object or a thermometer to measure its temperature.

Criterion validity and construct validity are both types of measurement validity . In other words, they both show you how accurately a method measures something.

While construct validity is the degree to which a test or other measurement method measures what it claims to measure, criterion validity is the degree to which a test can predictively (in the future) or concurrently (in the present) measure something.

Construct validity is often considered the overarching type of measurement validity . You need to have face validity , content validity , and criterion validity in order to achieve construct validity.

Convergent validity and discriminant validity are both subtypes of construct validity . Together, they help you evaluate whether a test measures the concept it was designed to measure.

• Convergent validity indicates whether a test that is designed to measure a particular construct correlates with other tests that assess the same or similar construct.
• Discriminant validity indicates whether two tests that should not be highly related to each other are indeed not related. This type of validity is also called divergent validity .

You need to assess both in order to demonstrate construct validity. Neither one alone is sufficient for establishing construct validity.

• Discriminant validity indicates whether two tests that should not be highly related to each other are indeed not related

Content validity shows you how accurately a test or other measurement method taps  into the various aspects of the specific construct you are researching.

In other words, it helps you answer the question: “does the test measure all aspects of the construct I want to measure?” If it does, then the test has high content validity.

The higher the content validity, the more accurate the measurement of the construct.

If the test fails to include parts of the construct, or irrelevant parts are included, the validity of the instrument is threatened, which brings your results into question.

Face validity and content validity are similar in that they both evaluate how suitable the content of a test is. The difference is that face validity is subjective, and assesses content at surface level.

When a test has strong face validity, anyone would agree that the test’s questions appear to measure what they are intended to measure.

For example, looking at a 4th grade math test consisting of problems in which students have to add and multiply, most people would agree that it has strong face validity (i.e., it looks like a math test).

On the other hand, content validity evaluates how well a test represents all the aspects of a topic. Assessing content validity is more systematic and relies on expert evaluation. of each question, analyzing whether each one covers the aspects that the test was designed to cover.

A 4th grade math test would have high content validity if it covered all the skills taught in that grade. Experts(in this case, math teachers), would have to evaluate the content validity by comparing the test to the learning objectives.

Snowball sampling is a non-probability sampling method . Unlike probability sampling (which involves some form of random selection ), the initial individuals selected to be studied are the ones who recruit new participants.

Because not every member of the target population has an equal chance of being recruited into the sample, selection in snowball sampling is non-random.

Snowball sampling is a non-probability sampling method , where there is not an equal chance for every member of the population to be included in the sample .

This means that you cannot use inferential statistics and make generalizations —often the goal of quantitative research . As such, a snowball sample is not representative of the target population and is usually a better fit for qualitative research .

Snowball sampling relies on the use of referrals. Here, the researcher recruits one or more initial participants, who then recruit the next ones.

Participants share similar characteristics and/or know each other. Because of this, not every member of the population has an equal chance of being included in the sample, giving rise to sampling bias .

Snowball sampling is best used in the following cases:

• If there is no sampling frame available (e.g., people with a rare disease)
• If the population of interest is hard to access or locate (e.g., people experiencing homelessness)
• If the research focuses on a sensitive topic (e.g., extramarital affairs)

The reproducibility and replicability of a study can be ensured by writing a transparent, detailed method section and using clear, unambiguous language.

Reproducibility and replicability are related terms.

• Reproducing research entails reanalyzing the existing data in the same manner.
• Replicating (or repeating ) the research entails reconducting the entire analysis, including the collection of new data . 
• A successful reproduction shows that the data analyses were conducted in a fair and honest manner.
• A successful replication shows that the reliability of the results is high.

Stratified sampling and quota sampling both involve dividing the population into subgroups and selecting units from each subgroup. The purpose in both cases is to select a representative sample and/or to allow comparisons between subgroups.

The main difference is that in stratified sampling, you draw a random sample from each subgroup ( probability sampling ). In quota sampling you select a predetermined number or proportion of units, in a non-random manner ( non-probability sampling ).

Purposive and convenience sampling are both sampling methods that are typically used in qualitative data collection.

A convenience sample is drawn from a source that is conveniently accessible to the researcher. Convenience sampling does not distinguish characteristics among the participants. On the other hand, purposive sampling focuses on selecting participants possessing characteristics associated with the research study.

The findings of studies based on either convenience or purposive sampling can only be generalized to the (sub)population from which the sample is drawn, and not to the entire population.

Random sampling or probability sampling is based on random selection. This means that each unit has an equal chance (i.e., equal probability) of being included in the sample.

On the other hand, convenience sampling involves stopping people at random, which means that not everyone has an equal chance of being selected depending on the place, time, or day you are collecting your data.

Convenience sampling and quota sampling are both non-probability sampling methods. They both use non-random criteria like availability, geographical proximity, or expert knowledge to recruit study participants.

However, in convenience sampling, you continue to sample units or cases until you reach the required sample size.

In quota sampling, you first need to divide your population of interest into subgroups (strata) and estimate their proportions (quota) in the population. Then you can start your data collection, using convenience sampling to recruit participants, until the proportions in each subgroup coincide with the estimated proportions in the population.

A sampling frame is a list of every member in the entire population . It is important that the sampling frame is as complete as possible, so that your sample accurately reflects your population.

Stratified and cluster sampling may look similar, but bear in mind that groups created in cluster sampling are heterogeneous , so the individual characteristics in the cluster vary. In contrast, groups created in stratified sampling are homogeneous , as units share characteristics.

Relatedly, in cluster sampling you randomly select entire groups and include all units of each group in your sample. However, in stratified sampling, you select some units of all groups and include them in your sample. In this way, both methods can ensure that your sample is representative of the target population .

A systematic review is secondary research because it uses existing research. You don’t collect new data yourself.

The key difference between observational studies and experimental designs is that a well-done observational study does not influence the responses of participants, while experiments do have some sort of treatment condition applied to at least some participants by random assignment .

An observational study is a great choice for you if your research question is based purely on observations. If there are ethical, logistical, or practical concerns that prevent you from conducting a traditional experiment , an observational study may be a good choice. In an observational study, there is no interference or manipulation of the research subjects, as well as no control or treatment groups .

It’s often best to ask a variety of people to review your measurements. You can ask experts, such as other researchers, or laypeople, such as potential participants, to judge the face validity of tests.

While experts have a deep understanding of research methods , the people you’re studying can provide you with valuable insights you may have missed otherwise.

Face validity is important because it’s a simple first step to measuring the overall validity of a test or technique. It’s a relatively intuitive, quick, and easy way to start checking whether a new measure seems useful at first glance.

Good face validity means that anyone who reviews your measure says that it seems to be measuring what it’s supposed to. With poor face validity, someone reviewing your measure may be left confused about what you’re measuring and why you’re using this method.

Face validity is about whether a test appears to measure what it’s supposed to measure. This type of validity is concerned with whether a measure seems relevant and appropriate for what it’s assessing only on the surface.

Statistical analyses are often applied to test validity with data from your measures. You test convergent validity and discriminant validity with correlations to see if results from your test are positively or negatively related to those of other established tests.

You can also use regression analyses to assess whether your measure is actually predictive of outcomes that you expect it to predict theoretically. A regression analysis that supports your expectations strengthens your claim of construct validity .

When designing or evaluating a measure, construct validity helps you ensure you’re actually measuring the construct you’re interested in. If you don’t have construct validity, you may inadvertently measure unrelated or distinct constructs and lose precision in your research.

Construct validity is often considered the overarching type of measurement validity ,  because it covers all of the other types. You need to have face validity , content validity , and criterion validity to achieve construct validity.

Construct validity is about how well a test measures the concept it was designed to evaluate. It’s one of four types of measurement validity , which includes construct validity, face validity , and criterion validity.

There are two subtypes of construct validity.

• Convergent validity : The extent to which your measure corresponds to measures of related constructs
• Discriminant validity : The extent to which your measure is unrelated or negatively related to measures of distinct constructs

Naturalistic observation is a valuable tool because of its flexibility, external validity , and suitability for topics that can’t be studied in a lab setting.

The downsides of naturalistic observation include its lack of scientific control , ethical considerations , and potential for bias from observers and subjects.

Naturalistic observation is a qualitative research method where you record the behaviors of your research subjects in real world settings. You avoid interfering or influencing anything in a naturalistic observation.

You can think of naturalistic observation as “people watching” with a purpose.

A dependent variable is what changes as a result of the independent variable manipulation in experiments . It’s what you’re interested in measuring, and it “depends” on your independent variable.

In statistics, dependent variables are also called:

• Response variables (they respond to a change in another variable)
• Outcome variables (they represent the outcome you want to measure)
• Left-hand-side variables (they appear on the left-hand side of a regression equation)

An independent variable is the variable you manipulate, control, or vary in an experimental study to explore its effects. It’s called “independent” because it’s not influenced by any other variables in the study.

Independent variables are also called:

• Explanatory variables (they explain an event or outcome)
• Predictor variables (they can be used to predict the value of a dependent variable)
• Right-hand-side variables (they appear on the right-hand side of a regression equation).

As a rule of thumb, questions related to thoughts, beliefs, and feelings work well in focus groups. Take your time formulating strong questions, paying special attention to phrasing. Be careful to avoid leading questions , which can bias your responses.

Overall, your focus group questions should be:

• Open-ended and flexible
• Impossible to answer with “yes” or “no” (questions that start with “why” or “how” are often best)
• Unambiguous, getting straight to the point while still stimulating discussion
• Unbiased and neutral

A structured interview is a data collection method that relies on asking questions in a set order to collect data on a topic. They are often quantitative in nature. Structured interviews are best used when: 

• You already have a very clear understanding of your topic. Perhaps significant research has already been conducted, or you have done some prior research yourself, but you already possess a baseline for designing strong structured questions.
• You are constrained in terms of time or resources and need to analyze your data quickly and efficiently.
• Your research question depends on strong parity between participants, with environmental conditions held constant.

More flexible interview options include semi-structured interviews , unstructured interviews , and focus groups .

Social desirability bias is the tendency for interview participants to give responses that will be viewed favorably by the interviewer or other participants. It occurs in all types of interviews and surveys , but is most common in semi-structured interviews , unstructured interviews , and focus groups .

Social desirability bias can be mitigated by ensuring participants feel at ease and comfortable sharing their views. Make sure to pay attention to your own body language and any physical or verbal cues, such as nodding or widening your eyes.

This type of bias can also occur in observations if the participants know they’re being observed. They might alter their behavior accordingly.

The interviewer effect is a type of bias that emerges when a characteristic of an interviewer (race, age, gender identity, etc.) influences the responses given by the interviewee.

There is a risk of an interviewer effect in all types of interviews , but it can be mitigated by writing really high-quality interview questions.

A semi-structured interview is a blend of structured and unstructured types of interviews. Semi-structured interviews are best used when:

• You have prior interview experience. Spontaneous questions are deceptively challenging, and it’s easy to accidentally ask a leading question or make a participant uncomfortable.
• Your research question is exploratory in nature. Participant answers can guide future research questions and help you develop a more robust knowledge base for future research.

An unstructured interview is the most flexible type of interview, but it is not always the best fit for your research topic.

Unstructured interviews are best used when:

• You are an experienced interviewer and have a very strong background in your research topic, since it is challenging to ask spontaneous, colloquial questions.
• Your research question is exploratory in nature. While you may have developed hypotheses, you are open to discovering new or shifting viewpoints through the interview process.
• You are seeking descriptive data, and are ready to ask questions that will deepen and contextualize your initial thoughts and hypotheses.
• Your research depends on forming connections with your participants and making them feel comfortable revealing deeper emotions, lived experiences, or thoughts.

The four most common types of interviews are:

• Structured interviews : The questions are predetermined in both topic and order. 
• Semi-structured interviews : A few questions are predetermined, but other questions aren’t planned.
• Unstructured interviews : None of the questions are predetermined.
• Focus group interviews : The questions are presented to a group instead of one individual.

Deductive reasoning is commonly used in scientific research, and it’s especially associated with quantitative research .

In research, you might have come across something called the hypothetico-deductive method . It’s the scientific method of testing hypotheses to check whether your predictions are substantiated by real-world data.

Deductive reasoning is a logical approach where you progress from general ideas to specific conclusions. It’s often contrasted with inductive reasoning , where you start with specific observations and form general conclusions.

Deductive reasoning is also called deductive logic.

There are many different types of inductive reasoning that people use formally or informally.

Here are a few common types:

• Inductive generalization : You use observations about a sample to come to a conclusion about the population it came from.
• Statistical generalization: You use specific numbers about samples to make statements about populations.
• Causal reasoning: You make cause-and-effect links between different things.
• Sign reasoning: You make a conclusion about a correlational relationship between different things.
• Analogical reasoning: You make a conclusion about something based on its similarities to something else.

Inductive reasoning is a bottom-up approach, while deductive reasoning is top-down.

Inductive reasoning takes you from the specific to the general, while in deductive reasoning, you make inferences by going from general premises to specific conclusions.

In inductive research , you start by making observations or gathering data. Then, you take a broad scan of your data and search for patterns. Finally, you make general conclusions that you might incorporate into theories.

Inductive reasoning is a method of drawing conclusions by going from the specific to the general. It’s usually contrasted with deductive reasoning, where you proceed from general information to specific conclusions.

Inductive reasoning is also called inductive logic or bottom-up reasoning.

A hypothesis states your predictions about what your research will find. It is a tentative answer to your research question that has not yet been tested. For some research projects, you might have to write several hypotheses that address different aspects of your research question.

A hypothesis is not just a guess — it should be based on existing theories and knowledge. It also has to be testable, which means you can support or refute it through scientific research methods (such as experiments, observations and statistical analysis of data).

Triangulation can help:

• Reduce research bias that comes from using a single method, theory, or investigator
• Enhance validity by approaching the same topic with different tools
• Establish credibility by giving you a complete picture of the research problem

But triangulation can also pose problems:

• It’s time-consuming and labor-intensive, often involving an interdisciplinary team.
• Your results may be inconsistent or even contradictory.

There are four main types of triangulation :

• Data triangulation : Using data from different times, spaces, and people
• Investigator triangulation : Involving multiple researchers in collecting or analyzing data
• Theory triangulation : Using varying theoretical perspectives in your research
• Methodological triangulation : Using different methodologies to approach the same topic

Many academic fields use peer review , largely to determine whether a manuscript is suitable for publication. Peer review enhances the credibility of the published manuscript.

However, peer review is also common in non-academic settings. The United Nations, the European Union, and many individual nations use peer review to evaluate grant applications. It is also widely used in medical and health-related fields as a teaching or quality-of-care measure. 

Peer assessment is often used in the classroom as a pedagogical tool. Both receiving feedback and providing it are thought to enhance the learning process, helping students think critically and collaboratively.

Peer review can stop obviously problematic, falsified, or otherwise untrustworthy research from being published. It also represents an excellent opportunity to get feedback from renowned experts in your field. It acts as a first defense, helping you ensure your argument is clear and that there are no gaps, vague terms, or unanswered questions for readers who weren’t involved in the research process.

Peer-reviewed articles are considered a highly credible source due to this stringent process they go through before publication.

In general, the peer review process follows the following steps: 

• First, the author submits the manuscript to the editor.
• Reject the manuscript and send it back to author, or 
• Send it onward to the selected peer reviewer(s) 
• Next, the peer review process occurs. The reviewer provides feedback, addressing any major or minor issues with the manuscript, and gives their advice regarding what edits should be made. 
• Lastly, the edited manuscript is sent back to the author. They input the edits, and resubmit it to the editor for publication.

Exploratory research is often used when the issue you’re studying is new or when the data collection process is challenging for some reason.

You can use exploratory research if you have a general idea or a specific question that you want to study but there is no preexisting knowledge or paradigm with which to study it.

Exploratory research is a methodology approach that explores research questions that have not previously been studied in depth. It is often used when the issue you’re studying is new, or the data collection process is challenging in some way.

Explanatory research is used to investigate how or why a phenomenon occurs. Therefore, this type of research is often one of the first stages in the research process , serving as a jumping-off point for future research.

Exploratory research aims to explore the main aspects of an under-researched problem, while explanatory research aims to explain the causes and consequences of a well-defined problem.

Explanatory research is a research method used to investigate how or why something occurs when only a small amount of information is available pertaining to that topic. It can help you increase your understanding of a given topic.

Clean data are valid, accurate, complete, consistent, unique, and uniform. Dirty data include inconsistencies and errors.

Dirty data can come from any part of the research process, including poor research design , inappropriate measurement materials, or flawed data entry.

Data cleaning takes place between data collection and data analyses. But you can use some methods even before collecting data.

For clean data, you should start by designing measures that collect valid data. Data validation at the time of data entry or collection helps you minimize the amount of data cleaning you’ll need to do.

After data collection, you can use data standardization and data transformation to clean your data. You’ll also deal with any missing values, outliers, and duplicate values.

Every dataset requires different techniques to clean dirty data , but you need to address these issues in a systematic way. You focus on finding and resolving data points that don’t agree or fit with the rest of your dataset.

These data might be missing values, outliers, duplicate values, incorrectly formatted, or irrelevant. You’ll start with screening and diagnosing your data. Then, you’ll often standardize and accept or remove data to make your dataset consistent and valid.

Data cleaning is necessary for valid and appropriate analyses. Dirty data contain inconsistencies or errors , but cleaning your data helps you minimize or resolve these.

Without data cleaning, you could end up with a Type I or II error in your conclusion. These types of erroneous conclusions can be practically significant with important consequences, because they lead to misplaced investments or missed opportunities.

Data cleaning involves spotting and resolving potential data inconsistencies or errors to improve your data quality. An error is any value (e.g., recorded weight) that doesn’t reflect the true value (e.g., actual weight) of something that’s being measured.

In this process, you review, analyze, detect, modify, or remove “dirty” data to make your dataset “clean.” Data cleaning is also called data cleansing or data scrubbing.

Research misconduct means making up or falsifying data, manipulating data analyses, or misrepresenting results in research reports. It’s a form of academic fraud.

These actions are committed intentionally and can have serious consequences; research misconduct is not a simple mistake or a point of disagreement but a serious ethical failure.

Anonymity means you don’t know who the participants are, while confidentiality means you know who they are but remove identifying information from your research report. Both are important ethical considerations .

You can only guarantee anonymity by not collecting any personally identifying information—for example, names, phone numbers, email addresses, IP addresses, physical characteristics, photos, or videos.

You can keep data confidential by using aggregate information in your research report, so that you only refer to groups of participants rather than individuals.

Research ethics matter for scientific integrity, human rights and dignity, and collaboration between science and society. These principles make sure that participation in studies is voluntary, informed, and safe.

Ethical considerations in research are a set of principles that guide your research designs and practices. These principles include voluntary participation, informed consent, anonymity, confidentiality, potential for harm, and results communication.

Scientists and researchers must always adhere to a certain code of conduct when collecting data from others .

These considerations protect the rights of research participants, enhance research validity , and maintain scientific integrity.

In multistage sampling , you can use probability or non-probability sampling methods .

For a probability sample, you have to conduct probability sampling at every stage.

You can mix it up by using simple random sampling , systematic sampling , or stratified sampling to select units at different stages, depending on what is applicable and relevant to your study.

Multistage sampling can simplify data collection when you have large, geographically spread samples, and you can obtain a probability sample without a complete sampling frame.

But multistage sampling may not lead to a representative sample, and larger samples are needed for multistage samples to achieve the statistical properties of simple random samples .

These are four of the most common mixed methods designs :

• Convergent parallel: Quantitative and qualitative data are collected at the same time and analyzed separately. After both analyses are complete, compare your results to draw overall conclusions. 
• Embedded: Quantitative and qualitative data are collected at the same time, but within a larger quantitative or qualitative design. One type of data is secondary to the other.
• Explanatory sequential: Quantitative data is collected and analyzed first, followed by qualitative data. You can use this design if you think your qualitative data will explain and contextualize your quantitative findings.
• Exploratory sequential: Qualitative data is collected and analyzed first, followed by quantitative data. You can use this design if you think the quantitative data will confirm or validate your qualitative findings.

Triangulation in research means using multiple datasets, methods, theories and/or investigators to address a research question. It’s a research strategy that can help you enhance the validity and credibility of your findings.

Triangulation is mainly used in qualitative research , but it’s also commonly applied in quantitative research . Mixed methods research always uses triangulation.

In multistage sampling , or multistage cluster sampling, you draw a sample from a population using smaller and smaller groups at each stage.

This method is often used to collect data from a large, geographically spread group of people in national surveys, for example. You take advantage of hierarchical groupings (e.g., from state to city to neighborhood) to create a sample that’s less expensive and time-consuming to collect data from.

No, the steepness or slope of the line isn’t related to the correlation coefficient value. The correlation coefficient only tells you how closely your data fit on a line, so two datasets with the same correlation coefficient can have very different slopes.

To find the slope of the line, you’ll need to perform a regression analysis .

Correlation coefficients always range between -1 and 1.

The sign of the coefficient tells you the direction of the relationship: a positive value means the variables change together in the same direction, while a negative value means they change together in opposite directions.

The absolute value of a number is equal to the number without its sign. The absolute value of a correlation coefficient tells you the magnitude of the correlation: the greater the absolute value, the stronger the correlation.

These are the assumptions your data must meet if you want to use Pearson’s r :

• Both variables are on an interval or ratio level of measurement
• Data from both variables follow normal distributions
• Your data have no outliers
• Your data is from a random or representative sample
• You expect a linear relationship between the two variables

Quantitative research designs can be divided into two main categories:

• Correlational and descriptive designs are used to investigate characteristics, averages, trends, and associations between variables.
• Experimental and quasi-experimental designs are used to test causal relationships .

Qualitative research designs tend to be more flexible. Common types of qualitative design include case study , ethnography , and grounded theory designs.

A well-planned research design helps ensure that your methods match your research aims, that you collect high-quality data, and that you use the right kind of analysis to answer your questions, utilizing credible sources . This allows you to draw valid , trustworthy conclusions.

The priorities of a research design can vary depending on the field, but you usually have to specify:

• Your research questions and/or hypotheses
• Your overall approach (e.g., qualitative or quantitative )
• The type of design you’re using (e.g., a survey , experiment , or case study )
• Your sampling methods or criteria for selecting subjects
• Your data collection methods (e.g., questionnaires , observations)
• Your data collection procedures (e.g., operationalization , timing and data management)
• Your data analysis methods (e.g., statistical tests  or thematic analysis )

A research design is a strategy for answering your   research question . It defines your overall approach and determines how you will collect and analyze data.

Questionnaires can be self-administered or researcher-administered.

Self-administered questionnaires can be delivered online or in paper-and-pen formats, in person or through mail. All questions are standardized so that all respondents receive the same questions with identical wording.

Researcher-administered questionnaires are interviews that take place by phone, in-person, or online between researchers and respondents. You can gain deeper insights by clarifying questions for respondents or asking follow-up questions.

You can organize the questions logically, with a clear progression from simple to complex, or randomly between respondents. A logical flow helps respondents process the questionnaire easier and quicker, but it may lead to bias. Randomization can minimize the bias from order effects.

Closed-ended, or restricted-choice, questions offer respondents a fixed set of choices to select from. These questions are easier to answer quickly.

Open-ended or long-form questions allow respondents to answer in their own words. Because there are no restrictions on their choices, respondents can answer in ways that researchers may not have otherwise considered.

A questionnaire is a data collection tool or instrument, while a survey is an overarching research method that involves collecting and analyzing data from people using questionnaires.

The third variable and directionality problems are two main reasons why correlation isn’t causation .

The third variable problem means that a confounding variable affects both variables to make them seem causally related when they are not.

The directionality problem is when two variables correlate and might actually have a causal relationship, but it’s impossible to conclude which variable causes changes in the other.

Correlation describes an association between variables : when one variable changes, so does the other. A correlation is a statistical indicator of the relationship between variables.

Causation means that changes in one variable brings about changes in the other (i.e., there is a cause-and-effect relationship between variables). The two variables are correlated with each other, and there’s also a causal link between them.

While causation and correlation can exist simultaneously, correlation does not imply causation. In other words, correlation is simply a relationship where A relates to B—but A doesn’t necessarily cause B to happen (or vice versa). Mistaking correlation for causation is a common error and can lead to false cause fallacy .

Controlled experiments establish causality, whereas correlational studies only show associations between variables.

• In an experimental design , you manipulate an independent variable and measure its effect on a dependent variable. Other variables are controlled so they can’t impact the results.
• In a correlational design , you measure variables without manipulating any of them. You can test whether your variables change together, but you can’t be sure that one variable caused a change in another.

In general, correlational research is high in external validity while experimental research is high in internal validity .

A correlation is usually tested for two variables at a time, but you can test correlations between three or more variables.

A correlation coefficient is a single number that describes the strength and direction of the relationship between your variables.

Different types of correlation coefficients might be appropriate for your data based on their levels of measurement and distributions . The Pearson product-moment correlation coefficient (Pearson’s r ) is commonly used to assess a linear relationship between two quantitative variables.

A correlational research design investigates relationships between two variables (or more) without the researcher controlling or manipulating any of them. It’s a non-experimental type of quantitative research .

A correlation reflects the strength and/or direction of the association between two or more variables.

• A positive correlation means that both variables change in the same direction.
• A negative correlation means that the variables change in opposite directions.
• A zero correlation means there’s no relationship between the variables.

Random error  is almost always present in scientific studies, even in highly controlled settings. While you can’t eradicate it completely, you can reduce random error by taking repeated measurements, using a large sample, and controlling extraneous variables .

You can avoid systematic error through careful design of your sampling , data collection , and analysis procedures. For example, use triangulation to measure your variables using multiple methods; regularly calibrate instruments or procedures; use random sampling and random assignment ; and apply masking (blinding) where possible.

Systematic error is generally a bigger problem in research.

With random error, multiple measurements will tend to cluster around the true value. When you’re collecting data from a large sample , the errors in different directions will cancel each other out.

Systematic errors are much more problematic because they can skew your data away from the true value. This can lead you to false conclusions ( Type I and II errors ) about the relationship between the variables you’re studying.

Random and systematic error are two types of measurement error.

Random error is a chance difference between the observed and true values of something (e.g., a researcher misreading a weighing scale records an incorrect measurement).

Systematic error is a consistent or proportional difference between the observed and true values of something (e.g., a miscalibrated scale consistently records weights as higher than they actually are).

On graphs, the explanatory variable is conventionally placed on the x-axis, while the response variable is placed on the y-axis.

• If you have quantitative variables , use a scatterplot or a line graph.
• If your response variable is categorical, use a scatterplot or a line graph.
• If your explanatory variable is categorical, use a bar graph.

The term “ explanatory variable ” is sometimes preferred over “ independent variable ” because, in real world contexts, independent variables are often influenced by other variables. This means they aren’t totally independent.

Multiple independent variables may also be correlated with each other, so “explanatory variables” is a more appropriate term.

The difference between explanatory and response variables is simple:

• An explanatory variable is the expected cause, and it explains the results.
• A response variable is the expected effect, and it responds to other variables.

In a controlled experiment , all extraneous variables are held constant so that they can’t influence the results. Controlled experiments require:

• A control group that receives a standard treatment, a fake treatment, or no treatment.
• Random assignment of participants to ensure the groups are equivalent.

Depending on your study topic, there are various other methods of controlling variables .

There are 4 main types of extraneous variables :

• Demand characteristics : environmental cues that encourage participants to conform to researchers’ expectations.
• Experimenter effects : unintentional actions by researchers that influence study outcomes.
• Situational variables : environmental variables that alter participants’ behaviors.
• Participant variables : any characteristic or aspect of a participant’s background that could affect study results.

An extraneous variable is any variable that you’re not investigating that can potentially affect the dependent variable of your research study.

A confounding variable is a type of extraneous variable that not only affects the dependent variable, but is also related to the independent variable.

In a factorial design, multiple independent variables are tested.

If you test two variables, each level of one independent variable is combined with each level of the other independent variable to create different conditions.

Within-subjects designs have many potential threats to internal validity , but they are also very statistically powerful .

Advantages:

• Only requires small samples
• Statistically powerful
• Removes the effects of individual differences on the outcomes

Disadvantages:

• Internal validity threats reduce the likelihood of establishing a direct relationship between variables
• Time-related effects, such as growth, can influence the outcomes
• Carryover effects mean that the specific order of different treatments affect the outcomes

While a between-subjects design has fewer threats to internal validity , it also requires more participants for high statistical power than a within-subjects design .

• Prevents carryover effects of learning and fatigue.
• Shorter study duration.
• Needs larger samples for high power.
• Uses more resources to recruit participants, administer sessions, cover costs, etc.
• Individual differences may be an alternative explanation for results.

Yes. Between-subjects and within-subjects designs can be combined in a single study when you have two or more independent variables (a factorial design). In a mixed factorial design, one variable is altered between subjects and another is altered within subjects.

In a between-subjects design , every participant experiences only one condition, and researchers assess group differences between participants in various conditions.

In a within-subjects design , each participant experiences all conditions, and researchers test the same participants repeatedly for differences between conditions.

The word “between” means that you’re comparing different conditions between groups, while the word “within” means you’re comparing different conditions within the same group.

Random assignment is used in experiments with a between-groups or independent measures design. In this research design, there’s usually a control group and one or more experimental groups. Random assignment helps ensure that the groups are comparable.

In general, you should always use random assignment in this type of experimental design when it is ethically possible and makes sense for your study topic.

To implement random assignment , assign a unique number to every member of your study’s sample .

Then, you can use a random number generator or a lottery method to randomly assign each number to a control or experimental group. You can also do so manually, by flipping a coin or rolling a dice to randomly assign participants to groups.

Random selection, or random sampling , is a way of selecting members of a population for your study’s sample.

In contrast, random assignment is a way of sorting the sample into control and experimental groups.

Random sampling enhances the external validity or generalizability of your results, while random assignment improves the internal validity of your study.

In experimental research, random assignment is a way of placing participants from your sample into different groups using randomization. With this method, every member of the sample has a known or equal chance of being placed in a control group or an experimental group.

“Controlling for a variable” means measuring extraneous variables and accounting for them statistically to remove their effects on other variables.

Researchers often model control variable data along with independent and dependent variable data in regression analyses and ANCOVAs . That way, you can isolate the control variable’s effects from the relationship between the variables of interest.

Control variables help you establish a correlational or causal relationship between variables by enhancing internal validity .

If you don’t control relevant extraneous variables , they may influence the outcomes of your study, and you may not be able to demonstrate that your results are really an effect of your independent variable .

A control variable is any variable that’s held constant in a research study. It’s not a variable of interest in the study, but it’s controlled because it could influence the outcomes.

Including mediators and moderators in your research helps you go beyond studying a simple relationship between two variables for a fuller picture of the real world. They are important to consider when studying complex correlational or causal relationships.

Mediators are part of the causal pathway of an effect, and they tell you how or why an effect takes place. Moderators usually help you judge the external validity of your study by identifying the limitations of when the relationship between variables holds.

If something is a mediating variable :

• It’s caused by the independent variable .
• It influences the dependent variable
• When it’s taken into account, the statistical correlation between the independent and dependent variables is higher than when it isn’t considered.

A confounder is a third variable that affects variables of interest and makes them seem related when they are not. In contrast, a mediator is the mechanism of a relationship between two variables: it explains the process by which they are related.

A mediator variable explains the process through which two variables are related, while a moderator variable affects the strength and direction of that relationship.

There are three key steps in systematic sampling :

• Define and list your population , ensuring that it is not ordered in a cyclical or periodic order.
• Decide on your sample size and calculate your interval, k , by dividing your population by your target sample size.
• Choose every k th member of the population as your sample.

Systematic sampling is a probability sampling method where researchers select members of the population at a regular interval – for example, by selecting every 15th person on a list of the population. If the population is in a random order, this can imitate the benefits of simple random sampling .

Yes, you can create a stratified sample using multiple characteristics, but you must ensure that every participant in your study belongs to one and only one subgroup. In this case, you multiply the numbers of subgroups for each characteristic to get the total number of groups.

For example, if you were stratifying by location with three subgroups (urban, rural, or suburban) and marital status with five subgroups (single, divorced, widowed, married, or partnered), you would have 3 x 5 = 15 subgroups.

You should use stratified sampling when your sample can be divided into mutually exclusive and exhaustive subgroups that you believe will take on different mean values for the variable that you’re studying.

Using stratified sampling will allow you to obtain more precise (with lower variance ) statistical estimates of whatever you are trying to measure.

For example, say you want to investigate how income differs based on educational attainment, but you know that this relationship can vary based on race. Using stratified sampling, you can ensure you obtain a large enough sample from each racial group, allowing you to draw more precise conclusions.

In stratified sampling , researchers divide subjects into subgroups called strata based on characteristics that they share (e.g., race, gender, educational attainment).

Once divided, each subgroup is randomly sampled using another probability sampling method.

Cluster sampling is more time- and cost-efficient than other probability sampling methods , particularly when it comes to large samples spread across a wide geographical area.

However, it provides less statistical certainty than other methods, such as simple random sampling , because it is difficult to ensure that your clusters properly represent the population as a whole.

There are three types of cluster sampling : single-stage, double-stage and multi-stage clustering. In all three types, you first divide the population into clusters, then randomly select clusters for use in your sample.

• In single-stage sampling , you collect data from every unit within the selected clusters.
• In double-stage sampling , you select a random sample of units from within the clusters.
• In multi-stage sampling , you repeat the procedure of randomly sampling elements from within the clusters until you have reached a manageable sample.

Cluster sampling is a probability sampling method in which you divide a population into clusters, such as districts or schools, and then randomly select some of these clusters as your sample.

The clusters should ideally each be mini-representations of the population as a whole.

If properly implemented, simple random sampling is usually the best sampling method for ensuring both internal and external validity . However, it can sometimes be impractical and expensive to implement, depending on the size of the population to be studied,

If you have a list of every member of the population and the ability to reach whichever members are selected, you can use simple random sampling.

The American Community Survey  is an example of simple random sampling . In order to collect detailed data on the population of the US, the Census Bureau officials randomly select 3.5 million households per year and use a variety of methods to convince them to fill out the survey.

Simple random sampling is a type of probability sampling in which the researcher randomly selects a subset of participants from a population . Each member of the population has an equal chance of being selected. Data is then collected from as large a percentage as possible of this random subset.

Quasi-experimental design is most useful in situations where it would be unethical or impractical to run a true experiment .

Quasi-experiments have lower internal validity than true experiments, but they often have higher external validity  as they can use real-world interventions instead of artificial laboratory settings.

A quasi-experiment is a type of research design that attempts to establish a cause-and-effect relationship. The main difference with a true experiment is that the groups are not randomly assigned.

Blinding is important to reduce research bias (e.g., observer bias , demand characteristics ) and ensure a study’s internal validity .

If participants know whether they are in a control or treatment group , they may adjust their behavior in ways that affect the outcome that researchers are trying to measure. If the people administering the treatment are aware of group assignment, they may treat participants differently and thus directly or indirectly influence the final results.

• In a single-blind study , only the participants are blinded.
• In a double-blind study , both participants and experimenters are blinded.
• In a triple-blind study , the assignment is hidden not only from participants and experimenters, but also from the researchers analyzing the data.

Blinding means hiding who is assigned to the treatment group and who is assigned to the control group in an experiment .

A true experiment (a.k.a. a controlled experiment) always includes at least one control group that doesn’t receive the experimental treatment.

However, some experiments use a within-subjects design to test treatments without a control group. In these designs, you usually compare one group’s outcomes before and after a treatment (instead of comparing outcomes between different groups).

For strong internal validity , it’s usually best to include a control group if possible. Without a control group, it’s harder to be certain that the outcome was caused by the experimental treatment and not by other variables.

An experimental group, also known as a treatment group, receives the treatment whose effect researchers wish to study, whereas a control group does not. They should be identical in all other ways.

Individual Likert-type questions are generally considered ordinal data , because the items have clear rank order, but don’t have an even distribution.

Overall Likert scale scores are sometimes treated as interval data. These scores are considered to have directionality and even spacing between them.

The type of data determines what statistical tests you should use to analyze your data.

A Likert scale is a rating scale that quantitatively assesses opinions, attitudes, or behaviors. It is made up of 4 or more questions that measure a single attitude or trait when response scores are combined.

To use a Likert scale in a survey , you present participants with Likert-type questions or statements, and a continuum of items, usually with 5 or 7 possible responses, to capture their degree of agreement.

In scientific research, concepts are the abstract ideas or phenomena that are being studied (e.g., educational achievement). Variables are properties or characteristics of the concept (e.g., performance at school), while indicators are ways of measuring or quantifying variables (e.g., yearly grade reports).

The process of turning abstract concepts into measurable variables and indicators is called operationalization .

There are various approaches to qualitative data analysis , but they all share five steps in common:

• Prepare and organize your data.
• Review and explore your data.
• Develop a data coding system.
• Assign codes to the data.
• Identify recurring themes.

The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .

There are five common approaches to qualitative research :

• Grounded theory involves collecting data in order to develop new theories.
• Ethnography involves immersing yourself in a group or organization to understand its culture.
• Narrative research involves interpreting stories to understand how people make sense of their experiences and perceptions.
• Phenomenological research involves investigating phenomena through people’s lived experiences.
• Action research links theory and practice in several cycles to drive innovative changes.

Hypothesis testing is a formal procedure for investigating our ideas about the world using statistics. It is used by scientists to test specific predictions, called hypotheses , by calculating how likely it is that a pattern or relationship between variables could have arisen by chance.

Operationalization means turning abstract conceptual ideas into measurable observations.

For example, the concept of social anxiety isn’t directly observable, but it can be operationally defined in terms of self-rating scores, behavioral avoidance of crowded places, or physical anxiety symptoms in social situations.

Before collecting data , it’s important to consider how you will operationalize the variables that you want to measure.

When conducting research, collecting original data has significant advantages:

• You can tailor data collection to your specific research aims (e.g. understanding the needs of your consumers or user testing your website)
• You can control and standardize the process for high reliability and validity (e.g. choosing appropriate measurements and sampling methods )

However, there are also some drawbacks: data collection can be time-consuming, labor-intensive and expensive. In some cases, it’s more efficient to use secondary data that has already been collected by someone else, but the data might be less reliable.

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organizations.

There are several methods you can use to decrease the impact of confounding variables on your research: restriction, matching, statistical control and randomization.

In restriction , you restrict your sample by only including certain subjects that have the same values of potential confounding variables.

In matching , you match each of the subjects in your treatment group with a counterpart in the comparison group. The matched subjects have the same values on any potential confounding variables, and only differ in the independent variable .

In statistical control , you include potential confounders as variables in your regression .

In randomization , you randomly assign the treatment (or independent variable) in your study to a sufficiently large number of subjects, which allows you to control for all potential confounding variables.

A confounding variable is closely related to both the independent and dependent variables in a study. An independent variable represents the supposed cause , while the dependent variable is the supposed effect . A confounding variable is a third variable that influences both the independent and dependent variables.

Failing to account for confounding variables can cause you to wrongly estimate the relationship between your independent and dependent variables.

To ensure the internal validity of your research, you must consider the impact of confounding variables. If you fail to account for them, you might over- or underestimate the causal relationship between your independent and dependent variables , or even find a causal relationship where none exists.

Yes, but including more than one of either type requires multiple research questions .

For example, if you are interested in the effect of a diet on health, you can use multiple measures of health: blood sugar, blood pressure, weight, pulse, and many more. Each of these is its own dependent variable with its own research question.

You could also choose to look at the effect of exercise levels as well as diet, or even the additional effect of the two combined. Each of these is a separate independent variable .

To ensure the internal validity of an experiment , you should only change one independent variable at a time.

No. The value of a dependent variable depends on an independent variable, so a variable cannot be both independent and dependent at the same time. It must be either the cause or the effect, not both!

You want to find out how blood sugar levels are affected by drinking diet soda and regular soda, so you conduct an experiment .

• The type of soda – diet or regular – is the independent variable .
• The level of blood sugar that you measure is the dependent variable – it changes depending on the type of soda.

Determining cause and effect is one of the most important parts of scientific research. It’s essential to know which is the cause – the independent variable – and which is the effect – the dependent variable.

In non-probability sampling , the sample is selected based on non-random criteria, and not every member of the population has a chance of being included.

Common non-probability sampling methods include convenience sampling , voluntary response sampling, purposive sampling , snowball sampling, and quota sampling .

Probability sampling means that every member of the target population has a known chance of being included in the sample.

Probability sampling methods include simple random sampling , systematic sampling , stratified sampling , and cluster sampling .

Using careful research design and sampling procedures can help you avoid sampling bias . Oversampling can be used to correct undercoverage bias .

Some common types of sampling bias include self-selection bias , nonresponse bias , undercoverage bias , survivorship bias , pre-screening or advertising bias, and healthy user bias.

Sampling bias is a threat to external validity – it limits the generalizability of your findings to a broader group of people.

A sampling error is the difference between a population parameter and a sample statistic .

A statistic refers to measures about the sample , while a parameter refers to measures about the population .

Populations are used when a research question requires data from every member of the population. This is usually only feasible when the population is small and easily accessible.

Samples are used to make inferences about populations . Samples are easier to collect data from because they are practical, cost-effective, convenient, and manageable.

There are seven threats to external validity : selection bias , history, experimenter effect, Hawthorne effect , testing effect, aptitude-treatment and situation effect.

The two types of external validity are population validity (whether you can generalize to other groups of people) and ecological validity (whether you can generalize to other situations and settings).

The external validity of a study is the extent to which you can generalize your findings to different groups of people, situations, and measures.

Cross-sectional studies cannot establish a cause-and-effect relationship or analyze behavior over a period of time. To investigate cause and effect, you need to do a longitudinal study or an experimental study .

Cross-sectional studies are less expensive and time-consuming than many other types of study. They can provide useful insights into a population’s characteristics and identify correlations for further research.

Sometimes only cross-sectional data is available for analysis; other times your research question may only require a cross-sectional study to answer it.

Longitudinal studies can last anywhere from weeks to decades, although they tend to be at least a year long.

The 1970 British Cohort Study , which has collected data on the lives of 17,000 Brits since their births in 1970, is one well-known example of a longitudinal study .

Longitudinal studies are better to establish the correct sequence of events, identify changes over time, and provide insight into cause-and-effect relationships, but they also tend to be more expensive and time-consuming than other types of studies.

Longitudinal studies and cross-sectional studies are two different types of research design . In a cross-sectional study you collect data from a population at a specific point in time; in a longitudinal study you repeatedly collect data from the same sample over an extended period of time.

There are eight threats to internal validity : history, maturation, instrumentation, testing, selection bias , regression to the mean, social interaction and attrition .

Internal validity is the extent to which you can be confident that a cause-and-effect relationship established in a study cannot be explained by other factors.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

The research methods you use depend on the type of data you need to answer your research question .

• If you want to measure something or test a hypothesis , use quantitative methods . If you want to explore ideas, thoughts and meanings, use qualitative methods .
• If you want to analyze a large amount of readily-available data, use secondary data. If you want data specific to your purposes with control over how it is generated, collect primary data.
• If you want to establish cause-and-effect relationships between variables , use experimental methods. If you want to understand the characteristics of a research subject, use descriptive methods.

A confounding variable , also called a confounder or confounding factor, is a third variable in a study examining a potential cause-and-effect relationship.

A confounding variable is related to both the supposed cause and the supposed effect of the study. It can be difficult to separate the true effect of the independent variable from the effect of the confounding variable.

In your research design , it’s important to identify potential confounding variables and plan how you will reduce their impact.

Discrete and continuous variables are two types of quantitative variables :

• Discrete variables represent counts (e.g. the number of objects in a collection).
• Continuous variables represent measurable amounts (e.g. water volume or weight).

Quantitative variables are any variables where the data represent amounts (e.g. height, weight, or age).

Categorical variables are any variables where the data represent groups. This includes rankings (e.g. finishing places in a race), classifications (e.g. brands of cereal), and binary outcomes (e.g. coin flips).

You need to know what type of variables you are working with to choose the right statistical test for your data and interpret your results .

You can think of independent and dependent variables in terms of cause and effect: an independent variable is the variable you think is the cause , while a dependent variable is the effect .

In an experiment, you manipulate the independent variable and measure the outcome in the dependent variable. For example, in an experiment about the effect of nutrients on crop growth:

• The  independent variable  is the amount of nutrients added to the crop field.
• The  dependent variable is the biomass of the crops at harvest time.

Defining your variables, and deciding how you will manipulate and measure them, is an important part of experimental design .

Experimental design means planning a set of procedures to investigate a relationship between variables . To design a controlled experiment, you need:

• A testable hypothesis
• At least one independent variable that can be precisely manipulated
• At least one dependent variable that can be precisely measured

When designing the experiment, you decide:

• How you will manipulate the variable(s)
• How you will control for any potential confounding variables
• How many subjects or samples will be included in the study
• How subjects will be assigned to treatment levels

Experimental design is essential to the internal and external validity of your experiment.

I nternal validity is the degree of confidence that the causal relationship you are testing is not influenced by other factors or variables .

External validity is the extent to which your results can be generalized to other contexts.

The validity of your experiment depends on your experimental design .

Reliability and validity are both about how well a method measures something:

• Reliability refers to the  consistency of a measure (whether the results can be reproduced under the same conditions).
• Validity   refers to the  accuracy of a measure (whether the results really do represent what they are supposed to measure).

If you are doing experimental research, you also have to consider the internal and external validity of your experiment.

A sample is a subset of individuals from a larger population . Sampling means selecting the group that you will actually collect data from in your research. For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.

In statistics, sampling allows you to test a hypothesis about the characteristics of a population.

Methodology refers to the overarching strategy and rationale of your research project . It involves studying the methods used in your field and the theories or principles behind them, in order to develop an approach that matches your objectives.

Methods are the specific tools and procedures you use to collect and analyze data (for example, experiments, surveys , and statistical tests ).

In shorter scientific papers, where the aim is to report the findings of a specific study, you might simply describe what you did in a methods section .

In a longer or more complex research project, such as a thesis or dissertation , you will probably include a methodology section , where you explain your approach to answering the research questions and cite relevant sources to support your choice of methods.

Ask our team

Want to contact us directly? No problem.  We  are always here for you.

• Email [email protected]
• Start live chat
• Call +1 (510) 822-8066
• WhatsApp +31 20 261 6040

Our team helps students graduate by offering:

• A world-class citation generator
• Plagiarism Checker software powered by Turnitin
• Innovative Citation Checker software
• Professional proofreading services
• Over 300 helpful articles about academic writing, citing sources, plagiarism, and more

Scribbr specializes in editing study-related documents . We proofread:

• PhD dissertations
• Research proposals
• Personal statements
• Admission essays
• Motivation letters
• Reflection papers
• Journal articles
• Capstone projects

Scribbr’s Plagiarism Checker is powered by elements of Turnitin’s Similarity Checker , namely the plagiarism detection software and the Internet Archive and Premium Scholarly Publications content databases .

The add-on AI detector is powered by Scribbr’s proprietary software.

The Scribbr Citation Generator is developed using the open-source Citation Style Language (CSL) project and Frank Bennett’s citeproc-js . It’s the same technology used by dozens of other popular citation tools, including Mendeley and Zotero.

You can find all the citation styles and locales used in the Scribbr Citation Generator in our publicly accessible repository on Github .

• Research Process
• Manuscript Preparation
• Manuscript Review
• Publication Process
• Publication Recognition
• Language Editing Services
• Translation Services

Choosing the Right Research Methodology: A Guide for Researchers

• 3 minute read
• 51.2K views

Table of Contents

Choosing an optimal research methodology is crucial for the success of any research project. The methodology you select will determine the type of data you collect, how you collect it, and how you analyse it. Understanding the different types of research methods available along with their strengths and weaknesses, is thus imperative to make an informed decision.

Understanding different research methods:

There are several research methods available depending on the type of study you are conducting, i.e., whether it is laboratory-based, clinical, epidemiological, or survey based . Some common methodologies include qualitative research, quantitative research, experimental research, survey-based research, and action research. Each method can be opted for and modified, depending on the type of research hypotheses and objectives.

Qualitative vs quantitative research:

When deciding on a research methodology, one of the key factors to consider is whether your research will be qualitative or quantitative. Qualitative research is used to understand people’s experiences, concepts, thoughts, or behaviours . Quantitative research, on the contrary, deals with numbers, graphs, and charts, and is used to test or confirm hypotheses, assumptions, and theories. 

Qualitative research methodology:

Qualitative research is often used to examine issues that are not well understood, and to gather additional insights on these topics. Qualitative research methods include open-ended survey questions, observations of behaviours described through words, and reviews of literature that has explored similar theories and ideas. These methods are used to understand how language is used in real-world situations, identify common themes or overarching ideas, and describe and interpret various texts. Data analysis for qualitative research typically includes discourse analysis, thematic analysis, and textual analysis. 

Quantitative research methodology:

The goal of quantitative research is to test hypotheses, confirm assumptions and theories, and determine cause-and-effect relationships. Quantitative research methods include experiments, close-ended survey questions, and countable and numbered observations. Data analysis for quantitative research relies heavily on statistical methods.

Analysing qualitative vs quantitative data:

The methods used for data analysis also differ for qualitative and quantitative research. As mentioned earlier, quantitative data is generally analysed using statistical methods and does not leave much room for speculation. It is more structured and follows a predetermined plan. In quantitative research, the researcher starts with a hypothesis and uses statistical methods to test it. Contrarily, methods used for qualitative data analysis can identify patterns and themes within the data, rather than provide statistical measures of the data. It is an iterative process, where the researcher goes back and forth trying to gauge the larger implications of the data through different perspectives and revising the analysis if required.

When to use qualitative vs quantitative research:

The choice between qualitative and quantitative research will depend on the gap that the research project aims to address, and specific objectives of the study. If the goal is to establish facts about a subject or topic, quantitative research is an appropriate choice. However, if the goal is to understand people’s experiences or perspectives, qualitative research may be more suitable. 

Conclusion:

In conclusion, an understanding of the different research methods available, their applicability, advantages, and disadvantages is essential for making an informed decision on the best methodology for your project. If you need any additional guidance on which research methodology to opt for, you can head over to Elsevier Author Services (EAS). EAS experts will guide you throughout the process and help you choose the perfect methodology for your research goals.

Why is data validation important in research?

When Data Speak, Listen: Importance of Data Collection and Analysis Methods

You may also like.

Descriptive Research Design and Its Myriad Uses

Five Common Mistakes to Avoid When Writing a Biomedical Research Paper

Making Technical Writing in Environmental Engineering Accessible

To Err is Not Human: The Dangers of AI-assisted Academic Writing

Writing a good review article

Scholarly Sources: What are They and Where can You Find Them?

Input your search keywords and press Enter.

'Qualitative' and 'quantitative' methods and approaches across subject fields: implications for research values, assumptions, and practices

• Open access
• Published: 30 September 2023
• Volume 58 , pages 2357–2387, ( 2024 )

Cite this article

You have full access to this open access article

• Nick Pilcher   ORCID: orcid.org/0000-0002-5093-9345 1 &
• Martin Cortazzi 2  

18k Accesses

2 Citations

Explore all metrics

There is considerable literature showing the complexity, connectivity and blurring of 'qualitative' and 'quantitative' methods in research. Yet these concepts are often represented in a binary way as independent dichotomous categories. This is evident in many key textbooks which are used in research methods courses to guide students and newer researchers in their research training. This paper analyses such textbook representations of 'qualitative' and 'quantitative' in 25 key resources published in English (supported by an outline survey of 23 textbooks written in German, Spanish and French). We then compare these with the perceptions, gathered through semi-structured interviews, of university researchers (n = 31) who work in a wide range of arts and science disciplines. The analysis of what the textbooks say compared to what the participants report they do in their practice shows some common features, as might be assumed, but there are significant contrasts and contradictions. The differences tend to align with some other recent literature to underline the complexity and connectivity associated with the terms. We suggest ways in which future research methods courses and newer researchers could question and positively deconstruct such binary representations in order to free up directions for research in practice, so that investigations can use both quantitative or qualitative approaches in more nuanced practices that are appropriate to the specific field and given context of investigations.

Similar content being viewed by others

Qualitative Research and Content Analysis

Designing a Research Question

“Qualitative Research” Is a Moving Target

Avoid common mistakes on your manuscript.

1 Introduction: qualitative and quantitative methods, presentations, and practices

Teaching in research methods courses for undergraduates, postgraduates and newer researchers is commonly supported or guided through textbooks with explanations of 'qualitative' and 'quantitative' methods and cases of how these methods are employed. Student dissertations and theses commonly include methodology chapters closely aligned with these textbook representations. Unexceptionally, dissertations and theses we supervise and examine internationally have methodology chapters and frequently these consider rationales and methods associated with positivist or interpretivist paradigms. Within such positivist or interpretivist frameworks, research approaches are amplified with elaborations of the rationale, the methods, and reasons for their choice over likely alternatives. In an apparent convention, related data are assigned as quantitative or qualitative in nature, with associated labelling as ‘numerical’ or ‘textual'. The different types of data yield different values and interpretive directions, and are clustered conceptually with particular research traditions, approaches, and fields or disciplines. Frequently, these clusters are oriented around 'quantitative' and 'qualitative' conceptualizations.

This paper seeks to show how ‘qualitative’ and ‘quantitative’, whether stereotyped or more nuanced, as binary divisions as presented in textbooks and published resources describing research methods may not always accord with the perceptions and day-to-day practices of university researchers. Such common binary representations of quantitative and qualitative and their associated concepts may hide complexities, some of which are outlined below. Any binary divide between ‘qualitative’ and ‘quantitative’ needs caution to show complexity and awareness of disparities with some researchers’ practices.

To date, as far as the present authors are aware, no study has first identified a range of binary representations of ‘quantitative’ and ‘qualitative’ methods and approaches in a literature review study of the many research methods textbooks and sources which guide students and then, secondly, undertaken an interview study with a range of established participant researchers in widely divergent fields to seek their understandings of ‘quantitative’ and ‘qualitative’ in their own fields. The findings related here complement and extend the complexities and convergences of understanding the concepts in different disciplines. Arguably, this paper demonstrates how students and novice researchers should not be constrained in their studies by any binary representations of ‘quantitative’ and ‘qualitative’ the terms. They should feel free to use either (or neither) or both in strategic combinations, as appropriate to their fields.

1.1 Presentations

Characteristically, presentations in research methods textbooks distinguish postivist and interpretivist approaches or paradigms (e.g. Guba and Lincoln 1994 ; Howe 1988 ; Denzin and Lincoln 2011 ) or ‘two cultures’ (Goertz and Mahoney 2012 ) with associated debates or ‘wars’ (e.g. Creswell 1995 ; Morse 1991 ). Quantitative data are shown as ‘numbers’ gathered through experiments (Moore 2006 ) or mathematical models (Denzin and Lincoln 1998 ), whereas qualitative data are usually words or texts (Punch 2005 ; Goertz and Mahoney 2012 ), characteristically gathered through interviews or life stories (Denzin and Lincoln 2011 ). Regarding analysis, some sources claim that establishing objective causal relationships is key in quantitative analysis (e.g. Goertz and Mahoney 2012 ) whereas qualitative analysis uses more discursive and interpretative procedures.

Thus, much literature presents research in terms of two generally distinct methods—quantitative and qualitative—which many students are taught in research methods courses. The binary divide may seem to be legitimated in the titles of many academic journals. This division prevails as designated strands of separated research methods in courses which apparently handle both (cf. Onwuegbuzie and Leech 2005 ). Consequently, students may follow this seemingly stereotyped binary view or feel uncomfortable to deviate from it. Arguably, PhD candidates need to demonstrate understanding of such concepts and procedures in a viva—or risk failure (cf. Trafford and Leshem 2002 ). The Cambridge Dictionary defines ‘quality’ as “how good or bad something is”; while ‘quantity' is “the amount or number of something, especially that can be measured” (Cambridge 2022 ). But definitions of ‘Qualitative' can be elusive, since “a precise definition of qualitative research, and specifically… its distinctive feature of being “qualitative”, the literature is meager” (Aspers and Corte 2019 , p.139). Some observe a “paradox… that researchers act as if they know what it is, but they cannot formulate a definition” and that “there is no consensus about specific qualitative methods nor… data” (Aspers and Corte 2019 , p40). In general, ‘qualitative research’ is an iterative process to discover more about a phenomenon (ibid.). Elsewhere, 'qualitative’ is defined negatively: "It is research that does not use numbers” (Seale 1999b , p.119). But this oversimplifies and hides possible disciplinary variation. For example, when investigating criminal action, numeric information (quantity) always follows an interpretation (De Gregorio 2014 ), and consequently this is a quantity of a quality (cf. Uher 2022 ).

Indeed, many authorities note the presence of elements of one in the other. For example, in analysis specifically, that what are considered to be quantitative elements such as statistics are used in qualitative analysis (Miles and Huberman 1994 ). More generically, that “a qualitative dimension is present in quantitative work as well” (Aspers and Corte 2019 , p.139). In ‘mixed methods’ research (cf. Tashakkori et al. 1998 ; Johnson et al. 2007 ; Teddlie and Tashakkori 2011 ) many researchers ‘mix’ the two approaches (Seale 1999a ; Mason 2006 ; Dawson 2019 ), either using multiple methods concurrently, or doing so sequentially. Mixed method research logically depends on prior understandings of quantitative and qualitative concepts but this is not always obvious (e.g. De Gregorio 2014 ); for instance Heyvaert et al. ( 2013 ) define mixed methods as combining quantitative and qualitative items, but these key terms are left undefined. Some commentators characterize such mixing as a skin, not a sweater to be changed every day (Marsh and Furlong 2002 , cited in Grix 2004 ). In some disciplines, these terms are often blurred, interchanged or conjoined. In sociology, for instance, “any quality can be quantified. Any quantity is a quality of a social context, quantity versus quality is therefore not a separation” (Hanson 2008 , p.102) and characterizing quantitative as ‘objective’ and qualitative as ‘subjective’ is held to be false when seeking triangulation (Hanson 2008 ). Additionally, approaches to measuring and generating quantitative numerical information can differ in social sciences compared to physics (Uher 2022 ). Indeed, quantity may consist of ‘a multitude’ of divisible aspects and a ‘magnitude’ for indivisible aspects (Uher 2022 ). Notably, “the terms ‘measurement’ and ‘quantification’ have different meanings and are therefore prone to jingle-jangle fallacies” (Uher 2022 ) where individuals use the same words to denote different understandings (cf. Bakhtin 1986 ). Comparatively, the words ‘unit’ and ‘scale’ are multitudinous in different sciences, and the key principles of numerical traceability and data generation traceability arguably need to be applied more to social sciences and psychology (Uher 2022 ). The interdependence of the terms means any quantity is grounded in a quality of something, even if the inverse does not always apply (Uher 2022 ).

1.2 Practices

The present paper compares representations found in research methods textbooks with the reported practices of established researchers given in semi-structured interviews. The differences revealed between what the literature review of methods texts showed and what the interview study showed both underlines and extends this complexity, with implications for how such methodologies are approached and taught. The interview study data (analysed below) show that many participant researchers in disciplines commonly located within an ostensibly ‘positivist’ scientific tradition (e.g. chemistry) are, in fact, using qualitative methods as scientific procedures (contra Tashakkori et al 1998 ; Guba and Lincoln 1994 ; Howe 1988 ; Lincoln and Guba 1985 ; Teddlie and Tashakkori 2011 ; Creswell 1995 ; Morse 1991 ). These interview study data also show that many participant researchers use what they describe as qualitative approaches to provide initial measurements (geotechnics; chemistry) of phenomena before later using quantitative procedures to measure the quantity of a quality (cf. Uher 2022 ). Some participant researchers also say they use quantitative procedures to reveal data for which they subsequently use qualitative approaches to interpret and understand (biology; dendrology) through their creative imaginations or experience (contra e.g. Hammersley, 2013 ). Participant researchers in ostensibly ‘positivist’ areas describe themselves as doubting ‘facts’ measured by machines programmed by humans (thus showing they feel researchers are not outside the world looking in (contra. e.g. Punch 2005 )) or doubting the certainty of quantitative data over time (contra e.g. Punch 2005 ). Critically, the interview study data show that these participant researchers often engage in debate over what a ‘number’ is and the extent to which ‘numbers’ can be considered ‘quantitative’. For example the data show how a mathematician considers that many individuals do not know what they mean by the word ‘quantitative’, and an engineer interprets any numbers involving human judgements as ‘qualitative’. Further, both a chemist and a geotechnician routinely define and use ‘qualitative’ methods and analysis to arrive at numerical values (contra. Davies and Hughes 2014 ; Denzin and Lincoln 2011 ).

Such data refute many textbook and key source representations of quantitative and qualitative as being binary and separately ringfenced entities as shown in the literature review study below (contra e.g. Punch 2005 ; Goertz and Mahoney 2012 ). Nevertheless, they resonate with much recent and current literature in the field (e.g. Uher 2022 ; De Gregorio 2014 ). They also arguably extend the complexities of the terms and approaches. In some disciplines, these participant researchers only do a particular type of research and never need anything other than clear ‘quantitative’ definitions (Mathematics), and some only ever conduct research involving text and never numbers (Literature). Moreover, some participant researchers consider certain aspects lie outside the ‘qualitative’ or ‘quantitative’ (the theoretical in German Literature), or do research which they maintain does not contain ‘knowledge’ (Fine-Art Sculpture), while others outline how they feel they do foundational conceptual research which they believe comes at a stage before any quantity or quality can be assessed (Philosophy). Indeed, of the 31 participant researchers we spoke to, nine of them considered the terms ‘quantitative’ and ‘qualitative’ to be of little relevance for their subject.

1.3 Outline of the two studies

This paper reports and discusses findings from a constructivist grounded approach interview study that interviewed experienced participant researchers (N = 31) in various disciplines (see Table 1 below) about their understandings of ‘qualitative’ and ‘quantitative’ in their subject areas. Findings from this interview study were compared with findings from a research methods literature review study that revealed many disparities with received and often binary presentations of the concepts in much key literature that informs student research methods courses. In this section we outline the review criteria, the method of analysis, and our findings. The findings are grouped according to how the sources reviewed consider ‘quantitative’ and ‘qualitative’ approaches the aspects of positivism and constructivism; the nature of research questions; research methods; analysis; issues of reliability, validity and generalizability; and the value and worth of the different approaches. Following this. We outline the approach, method, and procedure adopted for the interviews with research participants; sampling and saturation; and analysis; beside details of the participant researchers. Subsequently, Theme 2 focuses on contrasts of the interview data with ‘binary’ textbook and key source representations. Theme 3 focuses on what the interview data show about participant researcher perceptions of the value of ‘quantitative’ and ‘qualitative’ methods and approaches. This section outlines where, how, and sometimes why, participant researchers considered ‘quantitative’ and ‘qualitative’ methods approaches to be (or to not be) useful to them. These interview study findings show a surprising range of understandings, usage, and often perceived irrelevance of the terms. In the Discussion section, these findings form the focus of comparison with the literature as well as a consideration of possible implications for approaching and teaching research methods. In the conclusion we summarise the implications for research methods courses, for researchers in different disciplines and interdisciplinary contexts and discuss limitations and suggest future research. Besides adding to the debate on how ‘quantitative’ and ‘qualitative’ are conceptualized and how they are related, the paper appeals to those delivering research methods courses and to novice researchers to consider the concepts as highly complex and overlapping, to loosen constraints, and elaborate nuances of the commonplace binary representations of the terms.

2 Literature review study: some key textbooks and sources for teaching Research Methods.

2.1 review criteria.

To identify how concepts are presented in key materials we undertook a literature review study by consulting research methods course reading lists, library search engines, physically available shelves in institutional libraries, and Google Scholar. We wanted to encompass textbooks and some key texts which are recommended to UG, PG Masters and PhD students., for example, ‘textbooks’ like ‘Doing Your Research Project: A Guide for first-time researchers’ (Bell and Waters 2014 ) and ‘Introduction to Research Methods: A Practical Guide for Anyone Undertaking a Research project (5th Edition)’ (Dawson 2019 ). Such sources were frequently mentioned on reading lists and are freely available in many institutional libraries. We consulted seminal thinkers who have published widely on research methods, such as Denzin and Lincoln, or Cresswell, but we also considered texts which are likely less known such as ‘A tale of two cultures’ (Goertz and Mahoney 2012 ) and key articles such as ‘Five misunderstandings about case-study research’ (Flyvbjerg 2006 ). Students can freely find such sources, and are easily directed to them by supervisors. Although a more comprehensively robust search is possible, we nevertheless followed procedures and standard criteria for literature reviews (Atkinson et al. 2015 ).

3 Method of analysis

We assembled a total of 25 sources to look for a number of key tenets. We examined the sources for occurrence of the following: whether quantitative was described as positivist and qualitative was described as constructivist; whether quantitative was said to be science-based and qualitative was more reflective and non-science based; whether the research questions were presented as predetermined in quantitative methods and initially less focused in qualitative methods; whether quantitative methods were structured and qualitative methods were discussed as less structured; whether quantitative analysis focused on cause-effect type relationships and qualitative analysis was more exploratory; whether reliability, validity and generalizability were achieved through large numbers in quantitative research and through in-depth study in qualitative research; whether for particular subjects such as the sciences quantitative approaches were perceived to be of value (and qualitative was implied to have less value) and whether the converse was the case for other subjects such as history and anthropology; and whether mixed methods were considered possible or not possible. The 25 sources are detailed in Appendix 1 . As a confirmatory but less detailed exercise, and also detailed in Appendix 1 , we checked a further 23 research methods textbooks in German, Spanish and French, authored in those languages (rather than translations from English).

3.1 Findings

Overall, related to what quantitative and qualitative approaches, methods and analysis are, we found many key, often binary representations in this literature review. We outline these here below.

3.2 Positivism and constructivism

Firstly, 20 of the sources we reviewed stated that quantitative is considered positivist, and qualitative constructivist (e.g. Tashakkori et al 1998 ; Guba and Lincoln 1994 ; Howe 1988 ; Lincoln and Guba 1985 ; Teddlie and Tashakkori 2011 ; Creswell 1995 ; Morse 1991 ). Even if not everyone doing quantitative research (e.g. in sociology) consider themselves positivists (Marsh 1979 ), it is generally held quantitative research is positivist. Here, 12 of the sources noted that quantitative is considered ‘scientific’, situating observers outside the world looking in, e.g. through gathering numerical data (Punch 2005 ; Davis and Hughes 2014 ) whereas qualitative “locates the observer in the world” (Denzin and Lincoln 2011 , p.3). Quantitative researchers “collect facts and study the relationship of one set of facts to another”, whereas qualitative researchers “doubt whether social ‘facts’ exist and question whether a ‘scientific’ approach can be used when dealing with human beings” (Bell and Waters 2014 , p. 9).

3.3 The nature of research questions

Secondly, regarding research questions, “qualitative research… typically has… questions and methods… more general at the start, and… more focused as the study progresses” (Punch 2005 , p.28). In contrast, quantitative research uses “numerical data and typically… structured and predetermined research questions, conceptual frameworks and designs” (Punch 2005 , p.28). Of the sources we reviewed, 16 made such assertions. This understanding relates to type, and nature, of data, which is in turn anchored to particular worldviews. Punch ( 2005 , p 3–4) writes of how “in teaching about research, I find it useful to approach the qualitative-quantitative distinction primarily through…. the nature of the data. Later, the distinction can be broadened to include …. ways of conceptualising the reality being studied, and methods.” Here, the nature of data influences approach: numbers are for quantitative, and not-numbers (commonly words) for qualitative. Similarly, for Miles et al. ( 2018 ) “the nature of qualitative data” is “primarily on data in the form of words, that is, language in the form of extended text” (Miles et al. 2018 , no page). These understandings in turn relate to methods used.

Commonly, specific types of methods are said to be related to the type of approach adopted, and 18 of the sources we reviewed presented quantitative methods as being structured, and qualitative methods as less structured. For example, Davies and Hughes ( 2014 , p.23) claim “there are two principal options open to you: 1… quantitative research methods, using the traditions of science. 2… qualitative research, employing a more reflective or exploratory approach.” Here, quantitative methods are “questionnaires or structured interviews” whereas qualitative methods are “such as interviews or focus groups” (Dawson 2019 , no page given). Quantitative methods are more scientific, involve controlling a set of variables, and may involve experiments, something which, “qualitative researchers are agreed in their opposition to this definition of scientific research, or at least its application to social inquiry” (Hammersley 2013 , p. ix). As Punch notes ( 2005 , p.208), “the experiment was seen as the basis for establishing cause-effect relationships between variables, and its outcome (and control) variables had to be measured.”

4.1 Analysis

Such understandings often relate to analysis, and 16 of the sources we reviewed presented quantitative analysis as being statistical and number related, and qualitative analysis as being text based. With quantitative methods, “the data is subjected to statistical analysis, using techniques… likely to produce quantified, and, if possible, generalizable conclusions” (Bell and Waters 2014 , p.281). With qualitative research, however, this “calls for advanced skills in data management and text-driven creativity during the analysis and write-up” (Davies and Hughes 2014 ). Again, the data’s nature is key, and whilst qualitative analysis may condense data, it does not seek numbers. Indeed, “by data condensation, we do not necessarily mean quantification”, however, “occasionally, it may be helpful to convert the data into magnitudes… but this is not always necessary” (Miles et al. 2018 , npg). Qualitative analysis may involve stages such as assigning codes, subsequently sorting and sifting them, isolating patterns, then gradually refining any assertions made and comparing them to other literature (Miles et al. 2018 ). This could involve condensing, displaying, then drawing conclusions from the data (Miles et al. 2018 ). In this respect, some sources consider qualitative and quantitative analysis broadly similar in overall goals, yet different because quantitative analyses use “well-defined, familiar methods; are guided by canons; and are usually more sequential than iterative or cyclical” (Miles et al. 2018 , npg). In contrast, “qualitative researchers are… more fluid and… humanistic” in meaning making (Miles et al. 2018 , npg). Here, both approaches seek causation and may attempt to reveal ‘cause and effect’ but qualitative approaches often seek multiple and interacting influences, and effects and are less rigid (Miles et al. 2018 ). In quantitative inquiry search for causation relates to “causal mechanisms (i.e. how did X cause Y)” whereas in “the human sciences, this distinction relates to causal effects (i.e. whether X causes Y)” (Teddlie and Tashakkori 2011 , p.286). Similarly, that “scientific research in any area… seeks to trace out cause-effect relationships” (Punch 2005 , p.78). In contrast, qualitative research seeks interpretative understandings of human behaviour, “not ‘caused’ in any mechanical way, but… continually constructed and reconstructed” (Punch 2005 , p.126).

4.2 Issues of reliability, validity and generalizability

Regarding reliability, validity and generalizability, 19 of the sources we reviewed presented ideas along the lines that quantitative research is understood to seek large numbers, so quantitative researchers, “use techniques… likely to produce quantified and, if possible, generalizable conclusions (Bell and Waters 2014 , p.9). This means quantitative “research researches many more people” (Dawson 2019 , npg). Given quantitative researchers aim, “to discover answers to questions through the application of scientific procedures” it is anticipated these procedures will “increase the likelihood that the information… will be reliable and unbiased” (Davies and Hughes 2014 , p.9). Conversely, qualitative researchers are considered “more concerned to understand individuals’ perceptions of the world” (Bell and Waters 2014 , p.281) and consequently aim for in-depth data with smaller numbers, “as it is attitudes, behaviour and experiences that are important” (Dawson 2019 , npg). Consequently, generalizability of data is not key, as qualitative research has its “emphasis on a specific case, a focused and bounded phenomenon embedded in its context” (Miles et al. 2018 , npg). Yet, such research is considered generalizable in theoretical insight if not actual data (Flyvbjerg 2006 ).

4.3 The value and worth of the different approaches

Regarding ‘value’ and ‘worth’, many see this related with appropriacy to the question being researched. Thus, if questions involve more quantitative approaches, then these are of value, and if more qualitative, then these are of value, and 6 of the sources we reviewed presented these views (e.g. Bell and Waters 2014 ; Punch 2005 ; Dawson 2019 ). This resonates with disciplinary orientations where choices between given approaches are valued more in specific disciplines. History and Anthropology are seen more qualitative, whereas Economics and Epidemiology may be more quantitative (Kumar 1996 ). Qualitative approaches are valuable to study human behaviour and reveal in-depth pictures of peoples’ lived experience (e.g. Denzin and Lincoln 2011 ; Miles et al. 2018 ). Many consider there to be no real inherent superiority for one approach over another, and “asking whether quantitative or qualitative research is superior to the other is not a useful question” (Goertz and Mahoney 2012 , p.2).

Nevertheless, some give higher pragmatic value to quantitative research for studying individuals and people; neoliberal governments consistently value quantitative over qualitative research (Barone 2007 ; Bloch 2004 ; St Pierre 2004 ). Concomitantly, data produced by qualitative research is criticised by quantitative proponents “because of their problematic generalizability” (Bloor and Wood 2006 , p.179). However, other studies find quantitative researchers see qualitative methods and approaches positively (Pilcher and Cortazzi 2016 ). Some even question the qualitative/quantitative divide, and suggest “a more subtle and realistic set of distinctions that capture variation in research practice better” (Hammersley 2013 , p.99).

The above literature review study of key texts is hardly exhaustive, but shows a general outline of the binary divisions and categorizations that exist in many sources students and newer researchers encounter. Thus, despite the complex and blurred picture as outlined in the introduction above, many key texts students consult and that inform research methods courses often present a binary understanding that quantitative is positivist, focused on determining cause and effect, numerical or magnitude focused, uses experiments, and is grounded in an understanding the world can be observed from the outside in. Conversely, qualitative tends to be constructivist, focused on determining why events occur, is word or textual based (even if these elements are measured by their magnitude in a number or numerical format) and grounded in understanding the researcher is part of the world. The sciences and areas such as economics are said to tend towards the quantitative, and areas such as history and anthropology towards the qualitative.

We also note that in our literature review study we focused on English language textbooks, but we also looked at outline details, descriptions, and contents lists of texts in the languages of German, Spanish and French. We find that these broadly confirm the perception of a division between quantitative and qualitative research, and we detail a number of these in Appendix 1 . These examples are all research methods handbooks and student guides intended for under and post-graduates in social sciences and humanities; many are inter-disciplinary but some are more specifically books devoted to psychology, health care, education, politics, and management. Among the textbooks and handbooks examined in other languages, more recent books pay attention to online research and uses of the internet, social media and sometimes to big data and software for data analysis.

In these sources in languages other than English we find massive predominance of two (quantitative/qualitative) or three approaches (mixed). These are invariably introduced and examined with related theories, examples and cases in exactly that order: quantitative; qualitative; mixed. Here there is perhaps the unexamined implication that this is a historical order of research method development and also of acceptability of use (depending on research purposes). Notably, Molina Marin (2020) is oriented to Latin America and makes the point that most European writing about research methods is in English or German, while there are far fewer publications in Spanish and few with Latin American contextual relevance, which may limit epistemological perspectives. This point is evident in French and Spanish publications (much less the case in German) where bibliographic details seem dominated by English language publications (or translations from them). We now turn to outline our interview study.

5 Interview study

5.1 approach and choice of method.

We approached our interview study from a constructivist standpoint of exploring and investigating different subject specialists’ understandings of quantitative and qualitative. Critically, we were guided by the key constructivist tenet that knowledge is not independent of subjects seeking it (Olssen 1996 ), nor of subjects using it. Extending from this we considered interviews more appropriate than narratives or focus groups. Given the exploratory nature of our study, we considered interviews most suited as we wanted to have a free dialogue (cf. Bakhtin 1981 ) regarding how the terms are understood in their subject contexts as opposed to their neutral dictionary definitions (Bakhtin 1986 ), and not to focus on a specific point with many individuals. Specifically, we used ‘semi’-structured interviews. ‘Semi’ can mean both ‘half in quantity or value’ but also ‘to some extent: partly: incompletely’ (e.g. Merriam Webster 2022 ). Our interviews, following our constructionist and exploratory approach, aligned with the latter definition (see Appendix 2 for the Interview study schedule). This loose ‘semi’ structure was deliberately designed to (and did) lead to interviews directed by the participants, who themselves often specifically asked what was meant by the questions. This created a highly technical dialogue (Buber, 1947) focused on the subject.

5.2 Sampling and saturation

Our sampling combined purposive and snowball sampling (Sharma 2017 ; Levitt et al. 2018 ). Initially, participants were purposively identified by subject given the project sought to understand different subject perspectives of ‘qualitative’ and ‘quantitative.’ Later, a combined purposive and snowball sampling technique was used whereby participants interviewed were asked if they knew others teaching particular subjects. Regarding priorities for participant eligibility, this was done according to subject, although generally participants also had extensive experience (see Table 1 ). For most, English was their first language, where it was not, participants were proficient in English. The language of interview choice was English as it was most familiar to both participants and interviewer (Cortazzi et al. 2011 ).

Regarding saturation, some argue saturation occurs within 12 interviews (Guest et al. 2006 ), others within 17 (Francis et al. 2010 ). Arguably, however, saturation cannot be determined in advance of analysis and is “inescapably situated and subjective” (Braun and Clarke 2021 , p.201). This critical role of subjectivity and context guided how we approached saturation, whereby it was “operationalized in a way consistent with the research question(s) and the theoretical position and analytic framework adopted” (Saunders et al. 2018 , p.1893). We recognise that more could always be found but are satisfied that 31 participants provided sufficient data for our investigation. Indeed, our original intention was to recruit 20 participants, feeling this would provide sufficient saturation (Francis et al. 2010 ; Guest et al. 2006 ) but when we reached 20, and as we had already started analysis (cf. Braun and Clarke 2021 ) as we ourselves transcribed the interviews (Bird 2005 ) we wanted to explore understandings of ‘qualitative’ and ‘quantitative’ with other subject fields. As Table 1 shows, ‘English Literature’, ‘Philosophy, and ‘Sculpture’ were only explored after interview 20. These additional subject fields added significantly (see below) to our data.

5.3 Analysis and participant researcher details

Our analysis followed Braun and Clarke’s ( 2006 ) thematic analysis. Given the study’s exploratory constructionist nature, we combined ‘top down’ deductive type analysis for anticipated themes, and ‘bottom up’ inductive type analysis for any unexpected themes. The latter was similar to a constructivist grounded theory analysis (Charmaz 2010 ) whereby the transcripts were explored through close repeated reading for themes to emerge from the bottom up. We deliberately did not use any CAQDAS software such as NVivo as we wanted to manually read the scripts in one lengthy word document. We recognise that such software could allow us to do this but we were familiar with the approach we used and have found it effective for a number of years. We thus continued to use it here as well. We counted instances of themes through cross-checking after reading transcripts and discussing them, thereby heightening reliability and validity (Golafshani 2003 ). All interviews were undertaken with informed consent and participants were assured all representation was anonymous (Christians 2011 ). The study was approved by relevant ethics committees. Table 1 above shows the subject area, years of experience, and first language of the participant researchers. We also bracket after each subject area whether we consider it to be ‘Science’ or ‘Arts’ or whether we consider them as ‘Arts/Science’ or ‘Science/Arts’. This is of course subjective and in many ways not possible to do, but we were guided in how we categorised these subjects by doing so according to how we feel the methodology sources form the literature review study would categorize them.

5.4 Presentation of the interview study data compared with data from the literature review study

We present our interview study data in the three broad areas that emerged through analysis. Our approach to thematic analysis was to deductively code the interview transcripts manually under the three broad areas of: where data aligns with textbook and key source ‘binary’ representations; where the data contrasts with such representations; and where the data relates to interviewee perceptions of the value of ‘qualitative’ and ‘quantitative’. The latter relates to whether participant researchers expressed views that suggested they considered each approach to be useful, valuable, or not. We also read through the transcripts inductively with a view to being open to emerging and unanticipated themes. For each data citation, we note the subject field to show the range of subject areas. We later discuss these data in terms of their implications for research values, assumptions and practices and for their use when teaching about different methods. We provide illustrative citations and numbers of participant researchers who commented in relation to the key points below, but first provide an overview in Table 2 .

5.4.1 Theme 1: Alignments with ‘binary’ textbook and key source representations

The data often aligned with textbook representations. Seven participant researchers explicitly said, or alluded to the representation that ‘quantitative’ is positivist and seeks objectivity whereas ‘qualitative’ is more constructivist and subjective. For example: “the main distinction… is that qualitative is associated with subjectivity and quantitative being objective.” This was because “traditionally quantitative methods they’ve been associated with the positivist scientific model of research whereas qualitative methods are rooted in the constructivist and interpretivist model” (Psychology). Similarly, “quantitative methods… I see that as more… logical to a scientific mode of generating knowledge so… largely depends on numbers to establish causal relations… qualitative, I want to more broadly summarize that as anything other than numbers” (Communication Studies). One Statistics researcher had “always associated quantitative research more with statistics and numbers… you measure something… I think qualitative… you make a statement… without saying to what extent so… so you run fast but it’s not clear how fast you actually run…. that doesn’t tell you much because it doesn’t tell you how fast.” One mathematics participant researcher said mathematics was “ super quantitative… more beyond quantitative in the sense that not only is there a measurement of size in everything but everything is defined in… really careful terms… in how that quantity kind of interacts with other quantities that are defined so in that sense it’s kind of beyond quantitative.” Further, this applied at pre-data and data integration stages. Conversely, ‘qualitative’ “would be more a kind of verbalistic form of reasoning or… logic.”

Another representation four participant researchers noted was that ‘quantitative ‘ has structured predetermined questions whereas ‘qualitative’ has initially general questions that became more focused as research proceeded. For example, in Tourism, “with qualitative research I would go with open ended questions whereas with quantitative research I would go with closed questions.” This was because ‘qualitative’ was more exploratory: “quantitative methods… I would use when the parameters… are well understood, qualitative research is when I’m dealing with topics where I’m not entirely sure about… the answers.” As one Psychology participant researcher commented: “the main assumption in quantitative… is one single answer… whereas qualitative approaches embrace… multiplicity.”

Nineteen participant researchers considered ‘quantitative’ numbers whereas ‘qualitative’ was anything except numbers. For example, “quantitative research… you’re generating numbers and the analysis is involving numbers… qualitative is… usually… text-based looking for something else… not condensing it down to numbers” (Psychology). Similarly, ‘quantitative’ was “largely… numeric… the arrangement of larger scale patterns” whereas, “in design field, the idea of qualitative…is about the measure… people put against something… not [a] numerical measure” (Design). One participant researcher elaborated about Biology and Ecology, noting that “quantitative it’s a number it’s an amount of something… associated with a numerical dimension… whereas… qualitative data and… observations… in biology…. you’re looking at electron micrographs… you may want to describe those things… purely in… QUALitative terms… and you can do the same in… Ecology” (Human Computer Interaction). One participant researcher also commented on the magnitude of ‘quantitative’ data often involving more than numbers, or having a complex involvement with numbers: “I was thinking… quantitative… just involves numbers…. but it’s not… if… NVivo… counts the occurrence of a word… it’s done in a very structured way…. to the point that you can even… then do statistical analysis” (Logistics).

Regarding mixed methods, data aligned with the textbook representations that there are two distinct ‘camps’ but also that these could be crossed. Six participants felt opposing camps and paradigms existed. For example, in Nursing, that “it does feel quite divided in Nursing I think you’re either a qualitative or a quantitative researcher there’s two different schools… yeah some people in our school would be very anti-qualitative.” Similarly, in Music one participant researcher felt “it is very split and you’ll find… some people position themselves in one or the other of those camps and are reluctant to consider the other side. In Psychology, “yes… they’re quite… territorial and passionately defensive about the rightness of their own approaches so there’s this… narrative that these two paradigms… of positivistic and interpretivist type… cannot be crossed… you need to belong to one camp.” Also, in Communication Studies, “I do think they are kind of mutually exclusive although I accept… they can be combined… but I don’t think they, they fundamentally… speak to each other.” One Linguistics participant researcher felt some Linguists were highly qualitative and never used numbers, but “then you have… the corpus analysts who quantify everything and always under the headline ‘Corpus linguistics finally gets to the point… where we get rid of researcher bias; it objectifies the analysis’ because you have big numbers and you have statistical values and therefore… it’s led by the data not by the researcher.” This participant researcher found such striving for objectivity a “very strange thing” as any choice was based on previously argued ideas, which themselves could not be objective: “because all the decisions that you need to put into which software am I using, which algorithm am I using, which text do I put in…. this is all driven by ideas.”

Nevertheless, three participant researchers felt the approaches not diametrically opposed. For example, the same Psychology participant researcher cited immediately above felt people’s views could change: “some people although highly defensive over time… may soften their view as mixed method approaches become more prominent.” Comparatively flexibly, a Historian commented “I don’t feel very concerned by the division between qualitative and quantitative; I think they’re just two that are separate sometimes complementary approaches to study history.” In Translation and Interpreting, one participant researcher said methods could be quantitative, but have qualitative analysis, saying one project had: “an excellent use of quantitative tools… followed by not a qualitative method but qualitative analysis of what that implied.” Thus, much of the data did align with the binary representations of the key textbooks reviewed above and also the representation that approaches could be combined.

5.4.2 Theme 2: Contrasts with ‘binary’ textbook and key source representations

One recurrent contrast with common textbook representations was where both qualitative and quantitative were used in some sciences; nine participant researchers felt this. For example, in Geotechnics, when ascertaining soil behaviour: “the first check, the Qualitative check is to look whether those [the traditional and new paths of soil direction] bear resemblance, [be] coz if that doesn’t have that shape how can I expect there to be a quantitative comparison or… fit.” Both qualitative and quantitative approaches combined helped “rule out coincidence” and using both represented “a check which moves through qualitative… to quantitative.” Quantitative was a “capital Q for want of a better expression” and consisted of ‘bigger numbers’, which constituted “the quantitative or calculated strength.” However, this ‘capital Q’ quantitative data aimed to quantify a qualitatively measured numerically estimated phenomenon. So both were numerical. Nevertheless, over the long-term, even the quantitative became less certain because: “when you introduce that time element… you create… circumstances in which you need to be careful with the way you define the strength… different people have come up with different values… so the quantitative match has to be done with an element of uncertainty.”

Similarly, in Chemistry, both qualitative and quantitative methods and analysis were used, where “ the qualitative is the first one, and after you have the other ones [I—Right to kind of verify] if… if you need that.” Both were used because, “we need to know what is there and how much of each component is there… and a knowledge of what is there is a qualitative one, how much of each one is a quantitative one.” Moreover, “they are analysed sometimes by the same technique ” which could be quantitative or qualitative: “[I—and chromatography, again… would that be qualitative or quantitative or both?] Both, both… the quantitative is the area of the peak, the qualitative is the position in which this characteristic appears.” Here, both were key, and depending on the research goal: “we… use them according to what we need… sometimes it’s enough to detect [qualitative] … other times you need to know how much [quantitative] ”.

For Biology also, both were key: “quantitative is the facts and… qualitative is the theory you’re trying to make fit to the facts you can’t do it the other way around… the quantitative data… just doesn’t tell you anything without the qualitative imagination of what does it mean?” Inversely, in an area commonly understood as quantitative, Statistics, the qualitative was an initial, hypothetical stage requiring later quantitative testing. For example: “very often the hypothesis is a qualitative hypothesis” and then, “you would test it by putting in all sorts of data and then the test result would give you a p-value… and the p-value of course is quantitative because that’s a number.”

In Engineering, both helped research sound frequencies: “we need to measure the spectrum of the different frequencies… created… all those things were quantifiable, but then we need to get participants to listen and tell us… which one do you prefer?… this is a qualitative answer.” Mathematical Biology also used both: qualitative for change in nature of a state, and quantitative for the magnitude of that change. Here: “quantitative changes the numerical value of the steady state but it doesn’t change its stability… but qualitative change is when you… change the parameters and you either change its stability or you change whether it exists or not… and that point over which you cross to change it from being stable to unstable is called a bifurcation point… that’s where I use quantitative and qualitative the most in my research.”

The idea of ‘quantitative’ involving large data sets was expressed; however, the ‘qualitative’ could help represent these. In Computing Mathematics one participant researcher commented that: “quantitative… I do almost 90% of the time…. calculating metrics… and using significance testing to determine whether the numbers mean anything.” Yet, this participant researcher also used qualitative representations for simplified visual representation of large number sets: “I think for me QUALitative work is almost always about visualizing things in a way that tries to illustrate the trends… so I’m not actually calculating numbers but I’m just saying if I somehow present it in in this way.” Concomitantly, ‘quantitative’ could be smaller scale. For example, in Architecture: “my expectation is it wouldn’t be valid until you have a certain quantity of response but that said [I] have had students use… quantitative analysis on a small sample.” Similarly, in History: “you could have a quantitative study of a small data set or a small… number of statistics I really think it’s determined by the questions… you’re asking.”

Interestingly, two participant researchers questioned their colleagues’ understandings of ‘quantitative’ and of ‘numbers’. For example, one Mathematician considered some researchers did not know what ‘quantitative’ meant, because “when they say quantitative… I think what they mean is the same as qualitative except it’s got numbers in it somewhere.” For example, “I’m talking to a guy who does research in pain and, so I do know now what he means by quantitative research, and what he means is that he doesn’t know what he means [both laugh] and he wants me to define what it means… I think he means he wants some form of modelling with data and… he’s not quite sure how to go about doing that.” For this Mathematician, engineers would, “Mean that purposefully when they talk about quantitative modelling” whereas, “generically you know when politicians [consider these things] quantitative just means there’s a number in it somewhere.”

Three participant researchers felt that when ‘quantitative’ involved human elements or decisions, subjectivity was inevitable. One Logistics participant researcher felt someone doing materials research was “Doing these highly quantitative analyses still there is a degree of subjectivity because… this involves human assessment… they’re using different photometric equipment… taking photos… what is the angle.” Another researcher in Sciences similarly noted, “I don’t know why people believe in machines so much because they’re built by humans and there’s so many errors.” An Engineer commented: “To me, just the involvement of humans… gives it a qualitative element no matter what.” For this researcher, with people’s ‘quantitative’ reaction times and memory recall, “I would call that again qualitative you know… yes we did quantify the reaction time… the correct number of answers, but… it’s a person… I could get somebody else now doing it and not get exactly the same answer, so that uncertainty of human participants to me make it a qualitative approach.” For this participant researcher, anything involving human participants was ‘qualitative’: “I would say anything that is measurable, but by measurable I mean physically measurable… or predictable through numbers is quantitative [and] anything that involves a judgment, therefore human participants… is qualitative.”

‘Qualitative’ was often highly subject-specific. For example, in Film Studies and Media—English, ‘qualitative’ was: “about… the qualities of particular texts…. I’ve read a lot about silence as a texture and a technique in cinema… so silence is a quality, and also what are the qualities of that silence.” One Sciences researcher felt ‘qualitative’ involved experience applied to interpreting data: “Qualitative I would define as using your own experience to see if the data makes sense… and… something that… cannot be measured so far by machine… like the shape of a tree.” One Historian also highlighted the importance of subject-sub-branches, saying, “I’d situate myself in history but I guess you’d probably get a different response depending on… whether that historian saw themselves as a cultural historian or as a social and economic historian or… an intellectual historian.”

A fluidity regarding ‘quantitative’ and ‘qualitative’ was characterized. One Human Computer Interaction participant researcher commented, “I think sometimes people can use both terms quite loosely without really sort of thinking about [them] .” Comparatively, one Psychology participant researcher commented that “even within the Qual[itative] people they disagree about how to do things [laughs] … so you have people talking about doing IPA [Interpretative Phenomenological Analysis] and they’re doing… and presenting it in completely different ways.” Another Psychologist felt using ‘quantitative’ and ‘qualitative’ as an ‘either/or’ binary division erroneously suggested all questions were answerable, whereas: “no method… can… answer this question… and this is something… many people I don’t think are getting is that those different methodologies come with huge limitations… and as a researcher you need… to appreciate… how far your work can go.” One Communication Studies participant researcher even perceived the terms were becoming less used in all disciplines, and that, “we’re certainly in a phase where even these labels now are becoming so arbitrary almost… that they’re not, not carrying a lot of meaning.” However, the terms were considered very context dependent: “I think I’d be very hesitant about… pigeonholing any particular method I’d want to look very closely at the specific context in which that particular method or methodology is being used.” Further, some concepts were considered challenging to align with textbook representations. One German Literature participant researcher, reflecting on how the ‘theoretical’ worked, concluded, “… the theoretical… I’m not sure whether… that is actually within the terms quantitative or qualitative or whether that’s a term… on a different level altogether .” Indeed, many participant researchers (nine in total across many subject areas e.g. Design, Film and Media, Philosophy, Mathematical Biology) confirmed they were fully aware of the commonplace representations, but felt they did not apply to their own research, only using them to communicate with particular audiences (see below).

5.4.3 Theme 3: Perceptions on the value of ‘Quantitative’ and ‘Qualitative’ methods and approaches

As the data above show, many participant researchers valued both ‘quantitative’ and ‘qualitative’, including many scientists (in Geotechnics; Biology, Chemistry, Engineering). Many considered the specific research question key. For example: “I certainly don’t think quantitative bad, qualitative good: it’s horses for courses, yeah” (Tourism). Participant researchers in History and Music Education felt similarly; the latter commenting how “I do feel it’s about using the right tools which is why I wouldn’t want to… enter into this kind of vitriolic negative mud-slinging thing that does happen within the fields because I think people… get too entrenched in one or the other and forget about the fact that these are just various ways to approach inquiry.” Similarly, one Psychologist observed, “I’m always slightly irritated [laughs] when I hear people you know say ‘Oh I’m only doing… qualitative research’ or ‘I’m only doing quantitative research’… I think it’s the research question that should drive the methodological choices.” This participant researcher had “seen good quality in both quantitative and qualitative research.”

Five participant researchers considered quantitative approaches to be of little value if they were applied inappropriately. For example, a Translation and Interpreting participant researcher felt quantitative data-generating eye tracking technology was useful “for marketing,… product placement,… [or] surgeons.” However, for Translation and Interpreting, “I don’t think… it is a method that would yield results… you could find better in a more nuanced manner through other methods, interviews or focus groups, or even ethnographic observation.” One Chemist questioned the value of quantitative methods when the sample was too small. For example, when students were asked about their feedback on classes, and one student in 16 evaluated the classes badly, “4% it was one person [laughs] in 16, one person, but I received that evaluation and I think this is not correct… because sometimes…. I think that one person probably he or she didn’t like me… well, it’s life, so I think these aspects… may happen also but it’s with the precision of the system… the capacity of the system to detect and to measure.” Meaningfulness was held to be key: “When we do the analysis the sample has meaning” . Similarly, a Theoretical Physicist felt quantitative approaches unsuited to education: “in the context of education… we all produce data all the time… we grade students… we assess creativity… people will say… ‘you measure somebody's IQ using this made-up test and you get this kind of statis[tic]..’ and then you realize that all of those things are just bogus… or at least… doesn't measure anything of any real serious significance.” Comparatively, one participant researcher in Design felt ‘quantitative’ had a danger to “lead to stereotypes”; for example, when modern search engines use quantitative data to direct people to particular choices, “There’s potential there to constrain kind of broader behaviours and thinking… and therefore it can become a programmer in its own right.” One Mathematical Biologist commented how statistics can be misused, and how a popular Maths book related “How statistics are a light shone on a particular story from a particular angle to paint a picture that people want you to see but… it’s almost never the whole picture, it’s a half-truth, if you like, at best.”

Seven participant researchers considered that their disciplines valued quantitative over qualitative. This could be non-judgmental, and perhaps inherent in major areas of a discipline, as in Theoretical Physics, where precision is crucial, although this was said not to be ‘disparaging’: “theoretical physics… or physics in general… we… tend to think of ourselves as being very, very quantitative and very precise, and we think of qualitative, I guess… as being a bit vague, right?… which is not disparaging, because sometimes… we have to be a bit vague… and we're working things out.” In Psychology, however, despite “a call to advocate for more qualitative methods”, there, “definitely… is a bias toward quantitative… measures in psychology; all the high impact factor journals advocate for quantitative measures.” In Nursing, quantitative was also deemed paramount, with “the randomized control trial seen as being… you know the apex and… some researchers in our school would absolutely say it’s the only reliable thing… would be very anti-qualitative.”

Yet, four participant researchers were positively oriented towards anything qualitative. For example, one Tourism researcher felt that, “in an uncertain world, such as the one we’re living in today, qualitative research is the way forward.” Also, an Architect highlighted that in one of their studies, “I think the most important finding of my questionnaires was in the subjective comments.” One Music education participant researcher personally favoured qualitative approaches but regretted how their field was biased toward quantitative data, saying they had been informed: “ ‘what journals really care about is that p-value…’ and I remember… thinking… that’s a whole area of humanity… you’re failing to acknowledge.”

Nevertheless, side-stepping this debate, nine researchers considered the terms of little value, and simply irrelevant for their own research. One Film and Media—English participant researcher commented: “I have to say… these are terms I’m obviously familiar with, but… not terms… I… tend to really use in my own research… to describe what I do … mainly because everything that I do is qualitative.” As an English Literature participant researcher noted in email correspondence: “they are not terms we use in literary research, probably because most of what we do is interpretation of texts and substantiating arguments through examples. I have really only encountered these terms in the context of teaching and have never used them myself.” In the interview, this participant researcher commented that “I can imagine… they would be terms… quite common in the sciences and mathematics, but not Social Sciences and Arts.” A German Literature participant researcher felt similarly, commenting that in “German Literature… the term quantitative hadn’t even entered my vocabulary all the way through the PhD [laughs] … because… you could argue the methods in literary research are always qualitative.”

Complementing such perspectives, in Theoretical Physics ‘qualitative’ and ‘quantitative’ was: “not something that ever comes up… I don’t think I read a paper ever that will say we do qualitative research in any way, but I never… or hardly ever handle any data… I just have a bunch of principles that are sort of either taken to be true or are… a model… we’re exploring.” In Mathematics, ‘quantitative’ was simply never used as all mathematics research was quantitative: “I never use the word in the company of my colleagues, never, it’s a non-vocabulary word, for the simple reason that when everything is so well defined why do you need a generic term when you’ve got very specific reference points in the language that you’re using?”.

One Philosopher felt the terms did not fit conceptual analysis in philosophy, given that the object of consideration was uncertain: “I guess… I thought it didn’t fit conceptual analysis… you need to know what you’re dealing with in order to then do the quantitative or qualitative whereas in philosophy it feels like… you don’t quite know what you’re dealing with you’re trying to work out… what are rights?… What is knowledge? What is love?… and then look at its qualities.” For this researcher, Philosophy was tentatively pre-quantitative or pre-qualitative, because philosophy “feels like it’s before then.” The terms were not considered valuable for Philosophy or for the humanities generally: “in philosophy we wouldn’t use the term qualitative or quantitative research… you just use the tools… you need… to develop your argument and so you don’t see the distinction… I would say in the humanities that’s relatively similar.” Further, a Fine Art—Sculpture participant researcher said: “they’re not words I would use… partly because… I’m engaged with… through… research and… teaching… what I’d call practice research… and… my background’s in fine art, predominantly in making sculpture and that doesn’t contain knowledge.” Here, the participant researcher related how they may consider a student’s work hideous but if the student had learned a lot through creating the work, they should be rewarded. This participant researcher spoke of a famous sound artist, concluding, “if you asked him about qualitative and quantitative… it just wouldn’t come into his thing at all…. He doesn’t need to say well there were a thousand visitors plus you know it’s just ‘bang’… he wouldn’t think about those things… not as an artist.”

Six participant researchers said they only ever used the terms for particular audiences. For example, for ‘quantitative’ in Film and Media: “the only time is when it’s been related to public engagement that we’ve ever sort of produced anything that is more along quantitative lines,” and that “it was not complex data we were giving them.” In Fine-Art Sculpture, too, the terms were solely used with a funder, for example, to measure attendance at an exhibition for impact, but “that’s not the type of research that I’m involved with necessarily.” One Logistics participant researcher commented that “it really depends on the audience how you define qualitative or quantitative.” For this researcher, if communicating with “statisticians econometricians or a bunch of people who are number crunchers” then “they will be very precise on what quantitative is and what qualitative is” and would only recognise mathematical techniques as quantitative. Indeed, “they wouldn’t even recognize Excel as quantitative because it’s not that hard.” In contrast, for social scientists, Excel would be quantitative, as would “anything to do with numbers… I suppose you know a questionnaire where you have to analyse responses would be probably classed as quantitative.”

Conversely, a Mathematical Biology participant researcher commented they had been doing far more public outreach work, “using quantitative data so numbers… even with things that might often be treated in a qualitative way… so stuff which… is often treated I think qualitatively we try to quantify… I think partly because it’s easier to make those comparisons when you quantify something.” One researcher in Communication Studies said they advised a student that “it depends on your research objectives; if you are focusing on individual experiences… I think naturally that’s going towards qualitative, but if you’re … doing this research oriented to a leader of … [a] big number of people… for informing policy… then you need some sort of insights that can be standardized… so it’s a choice.”

Another Communication participant researcher felt political shifts in the 1990s and 2000s meant that a ‘third way’ now dominated with a move towards hybridity and a breakdown in ‘qualitative’ and ‘quantitative’ with everything now tied to neoliberalism. Therefore, since “the late 90s and early noughties I’ve seen this kind of hybridity in research methods almost as being in parallel with the third way there seems to be… no longer opposition between left and right everything… just happens to buy into neoliberalism so likewise… with research methods… there’s a breakdown of qual and quant.” Comparatively, a Historian felt underpinning power structures informed approaches, commenting that “the problem is not the terminology it’s the way in which power is working in the society in which we live in that’s the root problem it seems to me and what’s valued and what’s not.” A Philosopher felt numbers appealed to management even when qualitative data were more suitable: “I think management partly… are always more willing to listen to numbers… finding the right number can persuade people of things that actually… you think really a better persuasion would do something more qualitative and in context.” One Fine Art participant researcher felt ‘quantitative’ and ‘qualitative’ only became important when they focused on processes related to the Research Excellence Framework but not for their research as such: “I guess we are using qualitative and quantitative things in the sense of moving ourselves through the process as academics but that’s not what I’d call research.”

6 Discussion: implications for teaching research methods

Research Methods teaching for undergraduate, postgraduate and newer researchers is commonly guided by textbook and seminal text understandings of what constitutes ‘qualitative’ and ‘quantitative’. Often, the two are treated in parallel, or interlinked, and used in combination or sequentially in research. But the relations between these are complex. The above analysis of the interview study with established participant researchers underlines and often extends this complexity, with implications for how such methodologies are approached and taught. Many of these participant researchers in disciplines commonly located within an ostensibly ‘positivist’ scientific tradition are, in fact, using qualitative methods as scientific procedures. They do so to provide initial measurements of phenomena before later using quantitative procedures to measure the quantity of a quality. They also use quantitative procedures to reveal data for which they subsequently use qualitative approaches to interpret and understand through their creative imaginations or experience. Participant researchers in ostensibly positivist disciplines describe themselves as doubting ‘facts’ measured by machines programmed by humans or doubting the certainty of quantitative data over time. Critically, these participant researchers engage in debate over what a ‘number’ is and the extent to which ‘numbers’ can be considered ‘quantitative’. One mathematician spoke of how many individuals do not know what they mean by the word ‘quantitative’, and an engineer interpreted any numbers involving human judgements as ‘qualitative’. Both a chemist and a geotechnician routinely defined and use ‘qualitative’ methods and analysis to arrive at numerical values.

Although this analysis of participant researchers’ reported practices refutes many textbook and key research methods source representations of quantitative and qualitative as being binary and separately ringfenced entities (contra e.g. Punch 2005 ; Goertz and Mahoney 2012 ), they resonate with much recent and current literature in the field (e.g. Uher 2022 ; De Gregorio 2014 ). In some disciplines, participant researchers only do a particular type of research and never need anything other than clear ‘quantitative’ definitions (Mathematics); others only ever conduct research involving text and never numbers (Literature). Further, other participant researchers considered how certain aspects lie outside the ‘qualitative’ or ‘quantitative’ (the ‘theoretical’ in German Literature), or they did research which they maintain does not contain ‘knowledge’ (Fine-Art Sculpture), while others do foundational ‘conceptual’ research which they claim comes at a stage before any quantity or quality can be assessed (Philosophy). Nine researchers considered the terms of little relevance at all to their subject areas.

This leads to subsequent questions. Firstly, do the apparently emerging tensions and contradictions between commonplace textbook and key source presentations and on-the-ground participant researcher practices matter? Secondly, what kind of discourse might reframe the more conventional one?

Regarding whether tensions and contradictions matter: in one practical way, perhaps not, since participant researchers in all these areas continue to be productive in their current research practices. Nevertheless, the foundations of the binary quantitative and qualitative divide are discourse expressions common to research methods courses. These expressions frame how the two terms are understood as the guide for novices to do research. This guiding discourse is evident in specifically designated chapters in research handbooks, in session titles in university research methods modules, and in entries for explanations of research terms within glossaries. The literature review study detailed above illustrates this. ‘Quantitative’ means numbers, ‘qualitative’ means words. ‘Quantitative’ connotes positivist, objective, scientific; ‘qualitative’ implies constructivist, subjective, non-science-based. Arguably, any acceptance of the commonplace research method understanding gives an apparent solidity which can sometimes be a false basis that masks the complexities or inadequacies involved. Such masking can, in turn, allow certain agencies or individuals to claim their policies and practices are based on ‘objective’ numerical data when they are merely framing something as ‘quantitative’ when, as a cited Mathematician participant researcher observed above, it is simply something with a number in it somewhere. Conventionally, limitations are mentioned in research studies, but often they seem ritualized remarks which refer to insufficient numbers, or restricted types of participants, or a constrained focus on a particular area. Rarely do research studies (let alone handbooks and guides for postgraduates) question a taken-for-granted understanding, such as whether the very idea of using numbers with human participants may mean the number is not objective. Ironically, it is the field of Qualitative Inquiry itself in which occasionally some of these issues are mentioned. Concurrently, while the quantitative is promoted as ‘scientific’ and ‘objective evidence’, we find some scientists researching in sciences often question the terms, or consciously set them aside in their practices.

Concerning what could replace the commonplace terms and reframe the research discourse environment: arguably, any discussion of ‘quantitative’/‘qualitative’ should be preceded by key questions of how they are understood by researchers. Hammersley ( 2013 ) has suggested the value of a more nuanced approach. As the Communication Studies participant researcher here commented, the two terms seem to be breaking down somewhat. Nevertheless, alongside the data and arguments here, we see some value in considering things as being ‘quantitative’ or ‘qualitative’, and other value in viewing them as separate. The terms can still be simply outlined, not just as methodological listings of characteristics, but as a critical point, Outlines of methods should include insider practitioner views—illustrations of how they are used and understood by practising researchers in different disciplines (as in Table 2 above). This simple suggestion has benefits. When outlining approaches as qualitative or quantitative, we suggest space is devoted to how this is understood in disciplines, together with the opportunity to question the issues raised by these understandings. This would help to position the understandings of qualitative and quantitative within specific disciplinary contexts, especially in inter-disciplinary fields and, implicitly, it encourages reflection on the objectivity and subjectivity evoked by the terms. Such discussion can be included in research methods texts and in research methods courses, dissertations and frameworks for viva examinations (Cortazzi and Jin 2021 ). Here, rather than start with outlining what the terms mean by using concrete definitions such as ‘Quantitative means X’ the terms should be outlined using subject contextualised phrases such as ‘In the field of X quantitative is understood to mean Y’. In this way, quantitative and qualitative methods and approaches can be seen, understood and contextualised within their subject areas, rather than prescriptively outlined in a generic or common form. Furthermore, if the field is one that has no use for such terms, this can also be stated, to prevent any unnecessary need for their use. Discourse around the terms can be extended if they are seen in line with much current literature and the data above that shows their complexities and overlaps, and goes beyond the binary choices and representations of many textbooks.

7 Conclusion

This paper has presented and discussed data from an interview study with experienced participant researchers (n = 31) regarding their perceptions of ‘qualitative’ and ‘quantitative’ in their research areas. This interview study data was compared with findings from a literature review study of common textbooks and research methods publications (n = 25) that showed often binary and reified representations of the terms and related concepts. The interview study data show many participant researcher understandings do in some ways align with the binary and commonplace representations of ‘qualitative ‘and ‘quantitative’ as shown to be presented in many research methods textbooks and sources from the literature review study. However, the interview study data more often illustrate how such representations are somewhat inaccurate regarding how research is undertaken in the different areas researched by the participant researchers. Rather, they corroborate much of the current literature that shows the blurring and complexity of the terms. Often, they extend this complexity. Sometimes they bypass complexity when these terms are considered irrelevant to their research fields by many researcher participants. For some researchers, the terms are simply valueless. We propose that future research methods courses could present and discuss the data above, perhaps using something akin to Table 2 as a starting point, so that students and novice researchers are able to loosen or break free of the chains of any stereotypical representations of such terms or use them reflectively with awareness of disciplinary specific usage. This could help them to advance their research, recognizing complex caveats related to the boundaries of what they do, what methods they use, and how to conduct research using both quantitative and qualitative approaches, as interpreted and used in their own fields. In multi- or inter-disciplinary research, such reflective awareness seems essential. Future research could also study the impact of the use of the data here in research methods courses so that such courses encompass both qualitative and quantitative methods (cf. Onwuegbuzie and Leech 2005 ) yet also question and contextualise such terms in specific subject areas order to free research from any constraints created by binary representations of the terms.

Whilst we interviewed 31 participant researchers to approach what seems a reasonable level of saturation, clearly future research could add to what we have found here by speaking to a wider range and larger number of researchers. The 25 research methods sources in English (supplemented by 23 sources in German, Spanish and French) examined here can clearly be expanded for a wider analysis of ‘quantitative’ and ‘qualitative’ in other languages for a more comprehensive European perspective. This strategy might ascertain likely asymmetries between the numerous English language texts (and their translations) and relatively smaller numbers of texts written by national or local experts in other languages. As a world-wide consideration, given the relative paucity of published research guidance in many languages, this point is especially significant related to fitting research methods to local contexts and cultures without imposition. Translating and discussing the terms ‘qualitative’ and ‘quantitative’, in and beyond European languages, will need care to avoid binary stereotyped or formulaic expression and to maintain some of the insight, resonances and complexities shown here.

Aspers, P., Corte, U.: What is qualitative in qualitative research. Qual. Sociol. 42 (2), 139–160 (2019)

Article   Google Scholar  

Atkinson, K.M., Koenka, A.C., Sanchez, C.E., Moshontz, H., Cooper, H.: Reporting standards for literature searches and report inclusion criteria: making research syntheses more transparent and easy to replicate. Res. Synth. Methods 6 (1), 87–95 (2015)

Autran, D., Bassel, G.W., Chae, E., Ezer, D., Ferjani, A., Fleck, C., Wolf, S.: What is quantitative plant biology? Quant. Plant Biol. (2021). https://doi.org/10.1017/qpb.2021.8

Bakhtin, M.: The dialogic imagination. University of Texas Press, Austin (1981)

Google Scholar  

Bakhtin, M. M. Speech genres and other late essays. In: Trans. Vern W. McGee; Ed. Caryl Emerson and Michael Holquist. University of Texas Press, Austin, (1986)

Barone, T.: A return to the gold standard? Questioning the future of narrative construction as educational research. Qual. Inq. 13 (4), 454–470 (2007)

Bell, J., Waters, S.: Doing your research project: a guide for first-time researchers (6 th edit.). McGraw-Hill Education, London, (2014)

Bird, C.M.: How I stopped dreading and learned to love transcription. Qual. Inq. 11 (2), 226–248 (2005)

Bloch, M.: A discourse that disciplines, governs, and regulates: The national research c report on scientific research in education. Qual. Inq. 10 (1), 96–110 (2004)

Bloor, M., Wood, F.: Keywords in qualitative methods: A vocabulary of research concepts. Sage, London (2006)

Book   Google Scholar  

Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3 (2), 77–101 (2006). https://doi.org/10.1191/1478088706qp063oa

Braun, V., Clarke, V.: To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qualit. Res. Sport Exer. Health 13 (2), 201–216 (2021)

Cambridge: Cambridge Dictionary. English Dictionary. Available at: https://dictionary.cambridge.org/dictionary/english/ Last Accessed January 2023. (2022)

Chan, E.S., Okumus, F., Chan, W.: What hinders hotels’ adoption of environmental technologies: a quantitative study. Int. J. Hosp. Manag. 84 , 102324 (2020)

Charmaz, K.: Grounded theory. Objectivist and constructivist methods. In W. Luttrell (Ed.), Qualitative educational research: Readings in reflexive methodology and transformative practice (pp. 183–207). Routledge, New York. (2010)

Christians, C.G.: Ethics and politics in qualitative research. In: Denzin, N.K., Lincoln, Y.S. (eds.) The Sage handbook of qualitative research, pp. 61–80. Sage, Thousand Oaks, CA (2011)

Cortazzi, M., Pilcher, N., Jin, L.: Language choices and ‘blind shadows’: investigating interviews with Chinese participants. Qual. Res. 11 (5), 505–535 (2011)

Cortazzi, M., Jin, L.: The doctoral viva: questions for, with and to candidates (or supervisors). Int. J. Educat. Lit. Stud. 9 (4), 2–15 (2021)

Creswell, J.W.: Research design: Qualitative & quantitative approaches. Sage, Thousand Oaks, CA (1995)

Davies, M.B., Hughes, N.: Doing a successful research project: Using qualitative or quantitative methods. Macmillan International Higher Education, London (2014)

Dawson, C.: Introduction to Research Methods: A Practical Guide for Anyone Undertaking a Research Project, 5th edn. Robinson, London (2019)

De Gregorio, E.: Bridging “quality” and “quantity” in the study of criminal action. Qual. Quant. 48 (1), 197–215 (2014)

Denzin, N.K., Lincoln, Y.S. (eds.): The landscape of qualitative research: Theories and issues. Sage, Thousand Oaks (1998)

Denzin, N.K., Lincoln, Y.S. (eds.): The SAGE handbook of qualitative research (4th edit). Sage, Thousand Oaks (2011)

Flyvbjerg, B.: Five misunderstandings about case-study research. Qual. Inq. 12 (2), 219–245 (2006)

Francis, J.J., Johnston, M., Robertson, C., Glidewell, L., Entwistle, V., Eccles, M.P., Grimshaw, J.M.: What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychol. Health 25 (10), 1229–1245 (2010)

Goertz, G., Mahoney, J.: A tale of two cultures. Princeton University Press, New Jersey (2012)

Golafshani, N.: Understanding reliability and validity in qualitative research the qualitative report, vol. 8 no. 4 597–607. (2003). http://www.nova.edu/ssss/QR/QR8-4/golafshani.pd

Grix, J.: The undations of research. Palgrave Macmillan, New York (2004)

Guba, E.G, Lincoln, Y.S: Competing paradigms in qualitative research. In: Denzin, N.K. Lincoln, Y.S. (eds.) Handbook of qualitative research, pp. 105–117. Sage, Thousand Oaks, 1994

Guest, G., Bunce, A., Johnson, L.: How many interviews are enough? An experiment with data saturation and variability. Field Methods 18 (1), 59–82 (2006)

Hammersley, M.: What is qualitative research? Bloomsbury Academic, London (2013)

Hanson, B.: Wither qualitative/quantitative? Grounds for methodological convergence. Qual. Quant. 42 , 97–111 (2008)

Heyvaert, M., Maes, B., Onghena, P.: Mixed methods research synthesis: definition, framework, and potential. Qual. Quant. 47 (2), 659–676 (2013)

Howe, K.R.: Against the quantitative-qualitative incompatibility thesis or dogmas die hard. Educ. Res. 17 (8), 10–16 (1988)

Johnson, R.B., Onwuegbuzie, A.J., Turner, L.A.: Toward a definition of mixed methods research. J. Mixed Methods Res. 1 (2), 112–133 (2007)

Kumar, R.: Research methodologies: a step-by-step guide for beginners. Sage, London (1996)

Levitt, H.M., Bamberg, M., Creswell, J.W., Frost, D.M., Josselson, R., Suarez-Orozco, C.: Journal article reporting standards for qualitative research in psychology: The APA publications and communications board task force report. Am. Psychol. 73 (1), 26–46 (2018)

Lincoln, Y.S., Guba, E.G.: Naturalistic inquiry. Sage, Thousand Oaks (1985)

Marsh, C.: Problems with surveys: method or epistemology? Sociology 13 (2), 293–305 (1979)

Marsh, D., Furlong, P.: A skin, not a sweater: ontology and epistemology in political science. Theory Methods Polit. Sci. 2 (1), 17–41 (2002)

Mason, J.: Mixing methods in a qualitatively driven way. Qual. Res. 6 (1), 9–25 (2006)

Miles, M. B., Huberman, A. M., Saldaña, J.: Qualitative data analysis: A methods sourcebook (4th edit.). Sage, Los Angeles, (2018)

Miles, M.B., Huberman, A.M.: Qualitative data analysis: An expanded sourcebook. Sage, Thousand Oaks (1994)

Moore, N.: How to do research: a practical guide to designing and managing research projects, 3rd edn. Facet, London (2006)

Morse, J.M.: Approaches to qualitative-quantitative methodological triangulation. Nurs. Res. 40 (2), 120–123 (1991)

Olssen, M.: Radical constructivism and its failings: anti-realism and individualism. Br. J. Educ. Stud. 44 (3), 275–295 (1996)

Onwuegbuzie, A.J., Leech, N.L.: Taking the “Q” out of research: teaching research methodology courses without the divide between quantitative and qualitative paradigms. Qual. Quant. 39 (3), 267–295 (2005)

Pilcher, N., Cortazzi, M.: Dialogues: QUANT researchers on QUAL methods. Qual. Report 21 (3), 450–473 (2016)

Punch, K.: Introduction to social research quantitative and qualitative approaches. Sage, Thousand Oaks (2005)

Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Jinks, C.: Saturation in qualitative research: exploring its conceptualization and operationalization. Qualit. Quant. 52 (4), 1893–1907 (2018)

Seale, C.: Quality in qualitative research. Qual. Inq. 5 , 465–478 (1999a)

Seale, C.: The Quality of Qualitative Research. Sage, London (1999b)

Sharma, G.: Pros and cons of different sampling techniques. Int. J. Appl. Res. 3 (7), 749–752 (2017)

St Pierre, E.A.: Refusing alternatives: a science of contestation. Qual. Inq. 10 (1), 130–139 (2004)

Tashakkori, A., Teddlie, C., Teddlie, C.B.: Mixed methodology: Combining qualitative and quantitative approaches. Sage, Thousand Oaks (1998)

Teddlie, C., Tashakkori, A. Mixed methods research. Contemporary Issues in an emerging Field. In Denzin, N.K., Lincoln, Y.S. (eds.) The Sage handbook of qualitative research (4 th edit.), pp. 285–300. Sage, Thousand Oaks, (2011)

Trafford, V., Leshem, S.: Starting at the end to undertake doctoral research: predictable questions as stepping stones. High. Educ. Rev. 35 (1), 31–49 (2002)

Uher, J.: Functions of units, scales and quantitative data: fundamental differences in numerical traceability between sciences. Qual. Quant. 56 (4), 2519–2548 (2022)

Merriam Webster: Definition of ‘semi’. (2022). Available at https://www.merriam-webster.com/dictionary/semi

Download references

The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Author information

Authors and affiliations.

The Business School, Edinburgh Napier University, Edinburgh, UK

Nick Pilcher

University of Warwick, Coventry, UK

Martin Cortazzi

You can also search for this author in PubMed   Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Nick Pilcher and Martin Cortazzi. The first draft of the manuscript was written by NP along with MC and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Nick Pilcher .

Ethics declarations

Conflict of interest.

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix 1: Literature review study

The table below contains details of the binary representations and possibilities in the two columns on the left and in the right it contains the numbers of the key sources that conveyed or adhered to these binary representations. The details of these sources and their respective numbers are listed below.

Table: Textbook and key source binary representations

Bell, J., & Waters, S. (2014). Doing your research Project: A Guide for first-time researchers. McGraw-Hill Education (UK). 6 th edn

Bloor, M., & Wood, F. (2006). Keywords in qualitative methods: A vocabulary of research concepts. London, UK: Sage Publications.

Bryman, A. (2008). Social research methods. Oxford, UK: Oxford University Press. [with caveats for many but still using the divide as ‘useful’]

Bryman, A., & Cramer, D. (2009). Quantitative data analysis with SPSS 14, 15 and 16: A guide for social scientists. London, UK: Routledge.

Ceglowski, D., Bacigalupa, C., & Peck, E. (2011). Aced out: Censorship of qualitative research in the age of "scientifically based research." Qualitative Inquiry, 17(8), 679–686.

Daly, K. J. (2007). Qualitative Methods for Family Studies and Human Development. London, UK: Sage.

Davies, M. B., & Hughes, N. (2014).  Doing a successful research project: Using qualitative or quantitative methods . Bloomsbury Publishing.

Dawson, C. (2019).  Introduction to Research Methods 5th Edition: A Practical Guide for Anyone Undertaking a Research Project . Robinson.

Denzin, N. K., & Lincoln, Y. S. (Eds.). (1998). The landscape of qualitative research: Theories and issues. Thousand Oaks, CA: Sage Publications. [with caveat that original qual was positivist in root but not now]

Denzin and Lincoln (2011) Introduction: The Discipline and Practice of Qualitative Research. In Denzin, N. K., & Lincoln, Y. S. (2011). The Sage handbook of qualitative research . Thousand Oaks, Calif: Sage. Pp1-20

Goertz, G., & Mahoney, J. (2012).  A tale of two cultures . Princeton University Press.

Grix, J. (2004). The foundations of research. New York, NY: Palgrave Macmillan.

Hammersley, M. (2007). The issue of quality in qualitative research. International Journal of Research & Method in Education, 30(3), 287–305.

Hammersley, M. (2013). What is qualitative research? London, UK: Bloomsbury Academic. [caveat that some qual do use causal analysis – and if you mix you abandon key assumptions associated with qualitative work]

Harman, W. W. (1996). The shortcomings of western science. Qualitative Inquiry, 2(1), 30–38.

Howe, K. R. (2011). Mixed methods, mixed causes? Qualitative Inquiry, 17(2), 166–171.

Mason, J. (2006). Mixing methods in a qualitatively driven way. Qualitative Research, 6(1), 9–25.

Miles, M. B., Huberman, A. M., & Saldaña, J. (2018).  Qualitative data analysis: A methods sourcebook . Sage publications.

Punch, K. (2005). Introduction to Social Research Quantitative and Qualitative Approaches. Sage.

Sandelowski, M. (1997). "To be of use": Enhancing the utility of qualitative research. Nursing Outlook, 45(3), 125–132 [caveat – does rebut many of the ideas but nevertheless outlines them as how the two are seen – e.g. of generalizability]

Seale, C. (1999). Quality in qualitative research. Qualitative Inquiry, 5, 465–478.

Silverman, D. (2016). Introducing qualitative research.  Qualitative research ,  3 (3), 14–25.

Tashakkori, A., Teddlie, C., & Teddlie, C. B. (1998).  Mixed methodology: Combining qualitative and quantitative approaches  (Vol. 46). sage. [with the caveat that they talk about the differences as existing even though say they are not that wide]

Teddlie, C., & Tashakkori, A. (2011). Mixed methods research. Contemporary Issues in an emerging Field. in The Sage handbook of qualitative research ,  4 , 285–300.

Torrance, H. (2008). Building confidence in qualitative research: Engaging the demands of policy. Qualitative Inquiry, 14(4), 507–527.

1.1 Sources in languages other than English, and brief notes regarding their focus and content

Whilst not part of the literature review study, we also consulted the outline details, abstracts and contents lists of a number of sources in languages other than English. We put brief notes about after each source. Each source, unless specifically noted, adhered to similar binary treatment of quantitative and qualitative methods and approaches as the English language sources outlined above.

1.1.1 German

Blandz, M. (2021) Forschungsmethoden und Statistik für die Soziale Arbeit : Grundlage und Anwendingen. 2 nd . edit. Stuttgart: Kohlhammer Verlag. – this is a multidisciplinary source that focuses mostly on quantitative and mixed methods. It follows the suggestion that a qualitative study can be a preliminary study for the main quantitative study.

Caspari, D; Klippel, F; Legutke, M. & Schram, K. (2022) Forschungsmethoden: in der Fremdsprachendidaktik; Ein Handbuch. Tübingen: Narr Franke Altempo Verlag. [Focused on foreign language teaching, details quantitative, then qualitative and then mixed; all separately]

Dōring, N. (2023) Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschaften. 6. th edit. Berlin: Springer. [Focused on the Social Sciences and humanities; as with the previous source it has separate chapters on quantitative and qualitative and a section on mixed, and contains some critical commentary]

Frankenberger, N. (Ed.) (2022) Grundlagen der Politikwissenschaft : Forschungsmethoden und Forschendes Lernen. Stuttgart: Kohlhammer Verlag. [Political science focused and based around distinctions between quantitative and qualitative approaches, each of which is elaborated with different methods; there is no obvious section on mixed methods]

Hussy, W; Schiener, M; Echterhoff, G. (2013) Forschungsmethoden in Psychologie und Sozialwissenschaften für Bachelor. Berlin: Springer. [This book is focused on psychology and social sciences for undergraduates. It has separate parts to focus on quantitative and on qualitative and then a chapter on mixed, identifying mixed methods as an emerging trend]

Niederberger, M. & Finne, E. (Eds.) (2021) Forschungsmethoden in der Gesundsheitsfōrderung und Prävention. Berlin: Springer. [Focused on Health and wellbeing; develops the roles of quantitative, qualitative and mixed (in combinations) in multidisciplinary, interdisciplinary and transdisciplinary research. Notes much research is exclusively quantitative and that social sciences are more qualitative or mixed. Makes the argument that the quantitative versus qualitative divide was surpassed by ‘post-positivist’ versus ‘combined’ thinking and that integrated approaches are now widely accepted]

1.1.2 Spanish

Campos-Arenas, A. (2014) Métodos mixtos de investigación. Bogota: Magisterio Editorial. [Social science focused; devoted to mixed or combined approaches in Latin American contexts]

Hernandez-Sampieri, R. & Mendoza Torres, C. P. (2018) Metodología de investigación: Las rutas cuantitativa , cualitativa y mixta. Mexico: McGrw-Hill. [Social science focused with an introduction and conclusion focused on ‘three routes to research’ that are exceptionally and thoroughly elaborated; quantitative given 8 chapters; qualitative 3 and mixed just one]

Léon-García, O. G. & Carda-Celay, I. M. (2020) Méthodos de investigación en psicología y educación: Las tradiciones cuantitativas y qualitativas. 5. th edit. Barcelona : McGraw-Hill, España. [Psychology and education focused; based on relatively clearly cut distinctinos between ‘the two traditions’ of quantitative and qualitative]

Molina Marin, G. (Ed.) (2020) Integración de métodos de investigación : Estrategias metodológicas u experiencias en salud pública. Bogotá: Universidad de Antioquia. [Public health focused; gives most attention to multi-method combinations and asks questions about the epistemological integrity of integrating different approaches]

Ortega-Sanchez, D, (Ed.) (2023) ¿Como investigar en didáctica de las ciencias sociales? Fundamentos metodológicos , técnicas e instrumentos de investigación. Barcelona: Octaedro. [Education, research, pedagogy of teaching social sciences; focused on quantitative, qualitative and mixed methods in Spanish contexts]

Páramo-Reales, D. (2020) Métodos de investigación caulitativa : Fundamentos y aplicaciones . Bogota: Editorial Unimagdalena. [Social sciences: basic applications of qualitative approaches in Latin America]

Ponce, O. A. (2014) Investigación de métodos mixtos en educación, 2. nd edit. San Jaun: Publicaciones Puertoriqueñas. [Education and Pedagogy; Puerto Rican context and entirely about mixed methods]

Vasilachis de Giradino, I. (Ed.) (2009) Estrategias de investigación cauitativa. Barcelona: Editorial Gedisa. [Social sciences; much detail on research design; focus exclusively on qualitative methods in Spanish contexts]

1.1.3 French

Bouchard, S. & Cyr, C. (Eds.) (2005) Reserche psycosocial pour harmoniser reserche st pratique. Quebec: Prese de la Université de Quebec. [Focused on psychology and sociology. Despite its title about ‘harmonizing’ research it is mainly focused on quantitative approaches, with a small section on qualitative and nothing on mixed approaches]

Corbière, M. & Lamviere, N. (2021) Méthodes quantitatives , qualitatives et mixtes , dans la reserche en sciences humaines et de la santé. 2. nd edit. Quebec : PU Quebec. [Focused on Humanities and health care; highlights the division between quantitative, qualitative and mixed methods]

Devin, G. (Ed.) (2016) Méthodes de recherche en relations internationals. Paris: Sciences Po. [Focused on politics and international relations; mostly wholly focused on quantitative; only a little on qualitative]

Gavard-Perret, M.L; Gotteland, D; Haon, C. & Jolibert, A. (2018) Methodologie de la recherche en sciences de gestion : Réussir son mémoire ou sa these. Paris: Pearson. [Business and management focused and geared towards thesis research; notes clear distinctions between quantitative and qualitative approaches with nothing on mixed]

Komu, S. C. S. (2020) Le receuil des méthodes en sciences sociales : Mèthodo;ogies en reserche. Manitoba: Sciences Script. [Social sciences focused; mostly quantitative methods with some attention to focus groups and participatory research]

Lepillier, O; Fournier, T; Bricas, N. & Figuié, M. (2011 ) Méthodes d’investigation de l’alimentation et des mangeurs. Versailles: Editions Quae. [Focused on nutrition, health studies and diet; details quantitative and qualitative methods and has very little on mixed]

Millette, M; Millerand, F; Myles, D. & Latako-Toth, T. (2021) Méthodes de reserches en contexte humanique , une orientation qualiificative. Montreal: PU Montreal. [Humanities focused; outlines quantitative and qualitative methods and, unusually, attends to ‘qualitative investigations in numerical contexts’ in Canada]

Moscarda, J. (2018) Faire parler les donées: Méthodologies quantitatives et qualitatives. Caen: Editions EMS. [Has a multidisciplinary focus on ‘let the data talk’; deals with quantitative methods and then qualitative methods and also mixed]

Vallerand, R. J. (2000) Méthodes de recherche en psychologie. Quebec: Gaetan Morin. [Focused on psychology; emphasis on quantitative research; brief section on qualitative; Canadian contexts]

Appendix 2: Interview study schedule

2.1 understandings of ‘qualitative’ and ‘quantitative’.

This research project is exploratory and intends to delve into understandings of the specific terms ‘quantitative’ and ‘qualitative’ as they are perceived, used, and interpreted by researchers in very different fields. Such research is intended to shed light on the fields of quantitative and qualitative research. The idea for the research arises from a previous project where the researcher interviewed quantitative focused researchers and saw the use of qualitative and quantitative being used and interpreted very differently to how the terms are presented and understood in the research methods literature. It is expected that exploring these understandings further will add to the field by shedding light on the subtleties of how they are used and also in turn help researchers make informed decisions about the optimum approaches and methods to use in their own research.

2.2 Interview questions

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Pilcher, N., Cortazzi, M. 'Qualitative' and 'quantitative' methods and approaches across subject fields: implications for research values, assumptions, and practices. Qual Quant 58 , 2357–2387 (2024). https://doi.org/10.1007/s11135-023-01734-4

Download citation

Accepted : 21 August 2023

Published : 30 September 2023

Issue Date : June 2024

DOI : https://doi.org/10.1007/s11135-023-01734-4

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Qualitative
• Quantitative
• Assumptions
• Disciplines
• Semi-structured interviews
• Find a journal
• Publish with us
• Track your research

Qualitative VS Quantitative Definition – Research Methods and Data

When undertaking any type of research study, the data collected will fall into one of two categories: qualitative or quantitative. But what exactly is the difference between these two data types and research methodologies?

Put simply, quantitative data deals with numbers, objective facts and measurable statistics. For example, quantitative data provides specifics on values like website traffic metrics, sales figures, survey response rates, operational costs, etc.

Qualitative data , on the other hand, reveals deeper insights into people‘s subjective perspectives, experiences, beliefs and behaviors. Instead of numbers, qualitative findings are expressed through detailed observations, interviews, focus groups and more.

Now let‘s explore both types of research to understand how and when to apply these methodologies.

Qualitative Research: An In-Depth Perspective

The purpose of qualitative research is to comprehend human behaviors, opinions, motivations and tendencies through an in-depth exploratory approach. Qualitative studies generally seek to answer "why" and "how" questions to uncover deeper meaning and patterns.

Key Features of Qualitative Research

• Exploratory and open-ended data collection
• Subjective, experiential and perception-based findings
• Textual, audio and visual data representation
• Smaller purposeful sample sizes with participants studied in-depth
• Findings provide understanding and context around human behaviors

Some examples of popular qualitative methods include:

• In-depth interviews – Open discussions exploring perspectives
• Focus groups – Facilitated group discussions
• Ethnographic research – Observing behaviors in natural environments
• Content analysis – Studying documents, images, videos, etc.
• Open-ended surveys or questionnaires – Subjective questions

The benefit of these techniques is collecting elaborate and descriptive qualitative data based on personal experiences rather than just objective facts and figures. This reveals not just what research participants are doing but more importantly, why they think, feel and act in certain ways.

For example, an open-ended survey may find that 52% of respondents felt "happy" about using a particular smartphone brand. But in-depth interviews would help uncover exactly why they feel this way by collecting descriptive details on their user experience.

In essence, qualitative techniques like interviews and ethnographic studies add crucial context . This allows us to delve deeper into research problems to gain meaningful insights.

Quantitative Research: A Data-Driven Approach

Unlike qualitative methods, quantitative research relies primarily on the collection and analysis of objective, measurable numerical data. This structured empirical evidence is then manipulated using statistical, graphical and mathematical techniques to derive patterns, trends and conclusions.

Key Aspects of Quantitative Research

• Numerical, measurable and quantifiable data
• Objective facts and empirical evidence
• Statistical, mathematical or computational analysis
• Larger randomized sample sizes to generalize findings
• Research aims to prove, disprove or lend support to existing theories

Some examples of quantitative methods include:

• Closed-ended surveys with numeric rating scales
• Multiple choice/dichotomous questionnaires
• Counting behaviors, events or attributes as frequencies
• Scientific experiments generating stats and figures
• Economic and marketing modeling based on historical data

For instance, an online survey may find that 74% of respondents rate a particular laptop 4 or higher on a 5-point scale for quality. Or an experiment might determine that a revised checkout process increases e-commerce conversion rates by 14.5%.

The benefit of quantitative data is that it generates hard numbers and statistics that allow objective measurement and comparison between groups or changes over time. But the limitation is it lacks detailed insights into the subjective reasons and context behind the data.

Qualitative vs. Quantitative: A Comparison

Is Qualitative or Quantitative Research Better?

Qualitative and quantitative methodologies have differing strengths and limitations. Expert researchers argue both approaches play an invaluable role when combined effectively .

Qualitative research allows rich exploration of perceptions, motivations and ideas through open-ended inquiry. This generates impactful insights but typically with smaller sample sizes focused on depth over breadth.

Quantitative statistically analyzes empirical evidence to uncover patterns and test hypotheses. This lends generalizable support to relationships between variables but risks losing contextual qualitative detail.

In short, qualitative informs the human perspectives while quantitative informs the overarching trends. Together this approaches a problem from both a granular and big-picture level for robust conclusions.

Integrating Mixed Research Methods

Mixing qualitative and quantitative techniques leverages the strengths while minimizing the weaknesses of both approaches. This integration can happen sequentially in phases or concurrently in parallel strands:

Sequential Mixed Methods

• Initial exploratory qualitative data collection via interviews, ethnography etc.
• Develop hypotheses and theories based on qualitative findings
• Follow up with quantitative research to test hypotheses
• Interpret how quantitative results explain qualitative discoveries

Concurrent Mixed Methods

• Simultaneously collect both qualitative and quantitative data
• Merge findings to provide a comprehensive analysis
• Compare results between sources to cross-validate conclusions

This intermixing provides corroboration between subjective qualitative themes and hard quantitative figures to produce actionable insights.

Let‘s look at two examples of effective mixed methods research approaches.

Applied Examples of Mixed Methods

Hospital patient experience analysis.

A hospital administrator seeks to improve patient satisfaction rates.

Quantitative Data

• Statistical survey ratings for aspects like room cleanliness, wait times, staff courtesy etc.
• Rankings benchmarked over time and against other hospitals

Qualitative Data

• Patient interviews detailing frustrations, likes/dislikes and emotional journey
• Expert focus groups discussing challenges and brainstorming solutions

Combined Analysis

Statistical survey analysis coupled with patient interview narratives provides a robust perspective into precisely which issues most critically impact patient experience and what solutions may have the greatest impact.

Product Development Research

A technology company designs a new smartphone app prototype.

• App metric tracking showing feature usage frequencies, conversions, churn rates
• In-app surveys measuring ease-of-use ratings on numeric scales
• Moderated focus groups discussing reactions to prototype
• Diary studies capturing user challenges and delights

Metrics prove what features customers interact with most while qualitative findings explain why they choose to use or abandon certain app functions. This drives effective product refinement.

As demonstrated, thoughtfully blending quantitative and qualitative techniques can provide powerful multifaceted insights.

Tying It All Together: A Nuanced Perspective

Qualitative and quantitative research encompass differing but complementary methodological paradigms for understanding our world through data.

Qualitative research allows inquiry into the depths of human complexities – perceptions, stories, symbols and meanings. Meanwhile, quantitative methods enable us to zoom out and systematically analyze empirical patterns.

Leveraging both modes of discovery provides a nuanced perspective for unlocking insights. As analyst John Tukey noted, "The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data."

Rather than blindly following statistics alone, factoring in qualitative details allows us to carefully interpret the context and meaning behind the numbers.

In closing, elegantly integrating quantitative precision with qualitative awareness offers a multilayered lens for conducting research and driving data-savvy decisions.

Dr. Alex Mitchell is a dedicated coding instructor with a deep passion for teaching and a wealth of experience in computer science education. As a university professor, Dr. Mitchell has played a pivotal role in shaping the coding skills of countless students, helping them navigate the intricate world of programming languages and software development.

Beyond the classroom, Dr. Mitchell is an active contributor to the freeCodeCamp community, where he regularly shares his expertise through tutorials, code examples, and practical insights. His teaching repertoire includes a wide range of languages and frameworks, such as Python, JavaScript, Next.js, and React, which he presents in an accessible and engaging manner.

Dr. Mitchell’s approach to teaching blends academic rigor with real-world applications, ensuring that his students not only understand the theory but also how to apply it effectively. His commitment to education and his ability to simplify complex topics have made him a respected figure in both the university and online learning communities.

Similar Posts

Achieving 100: How to Optimize Your Gatsby Site for a Perfect Lighthouse Score

As a full stack developer who frequently works with JAMstack apps, I was accustomed to sky-high…

How to Prepare for a Software Developer Interview

Interviewing for a software developer role can be an intimidating process. With technical screens, take-home assignments,…

JavaScript Modules: A Beginner’s Guide

If you‘re new to JavaScript development, terms like "module bundlers vs. loaders," "Webpack vs. Browserify," and…

Inline Elements and Block Elements in HTML – Explained

As a developer with over 15 years of experience building websites and web applications, few concepts…

Android Broadcast Receivers: A 2600+ Word In-Depth Guide for Beginners

Broadcast receivers enable Android apps to respond to system or application events through broadcast messaging. This…

How to correctly mock Moment.js/dates in Jest

Working with dates and times in any programming language can be deceivingly tricky. Even basic use…

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Grad Med Educ
• v.7(4); 2015 Dec

Choosing a Qualitative Research Approach

Associated data.

Editor's Note: The online version of this article contains a list of further reading resources and the authors' professional information .

The Challenge

Educators often pose questions about qualitative research. For example, a program director might say: “I collect data from my residents about their learning experiences in a new longitudinal clinical rotation. If I want to know about their learning experiences, should I use qualitative methods? I have been told that there are many approaches from which to choose. Someone suggested that I use grounded theory, but how do I know this is the best approach? Are there others?”

What Is Known

Qualitative research is the systematic inquiry into social phenomena in natural settings. These phenomena can include, but are not limited to, how people experience aspects of their lives, how individuals and/or groups behave, how organizations function, and how interactions shape relationships. In qualitative research, the researcher is the main data collection instrument. The researcher examines why events occur, what happens, and what those events mean to the participants studied. 1 , 2

Qualitative research starts from a fundamentally different set of beliefs—or paradigms—than those that underpin quantitative research. Quantitative research is based on positivist beliefs that there is a singular reality that can be discovered with the appropriate experimental methods. Post-positivist researchers agree with the positivist paradigm, but believe that environmental and individual differences, such as the learning culture or the learners' capacity to learn, influence this reality, and that these differences are important. Constructivist researchers believe that there is no single reality, but that the researcher elicits participants' views of reality. 3 Qualitative research generally draws on post-positivist or constructivist beliefs.

Qualitative scholars develop their work from these beliefs—usually post-positivist or constructivist—using different approaches to conduct their research. In this Rip Out, we describe 3 different qualitative research approaches commonly used in medical education: grounded theory, ethnography, and phenomenology. Each acts as a pivotal frame that shapes the research question(s), the method(s) of data collection, and how data are analyzed. 4 , 5

Choosing a Qualitative Approach

Before engaging in any qualitative study, consider how your views about what is possible to study will affect your approach. Then select an appropriate approach within which to work. Alignment between the belief system underpinning the research approach, the research question, and the research approach itself is a prerequisite for rigorous qualitative research. To enhance the understanding of how different approaches frame qualitative research, we use this introductory challenge as an illustrative example.

The clinic rotation in a program director's training program was recently redesigned as a longitudinal clinical experience. Resident satisfaction with this rotation improved significantly following implementation of the new longitudinal experience. The program director wants to understand how the changes made in the clinic rotation translated into changes in learning experiences for the residents.

Qualitative research can support this program director's efforts. Qualitative research focuses on the events that transpire and on outcomes of those events from the perspectives of those involved. In this case, the program director can use qualitative research to understand the impact of the new clinic rotation on the learning experiences of residents. The next step is to decide which approach to use as a frame for the study.

The table lists the purpose of 3 commonly used approaches to frame qualitative research. For each frame, we provide an example of a research question that could direct the study and delineate what outcomes might be gained by using that particular approach.

Methodology Overview

How You Can Start TODAY

• 1 Examine the foundations of the existing literature: As part of the literature review, make note of what is known about the topic and which approaches have been used in prior studies. A decision should be made to determine the extent to which the new study is exploratory and the extent to which findings will advance what is already known about the topic.
• 2 Find a qualitatively skilled collaborator: If you are interested in doing qualitative research, you should consult with a qualitative expert. Be prepared to talk to the qualitative scholar about what you would like to study and why . Furthermore, be ready to describe the literature to date on the topic (remember, you are asking for this person's expertise regarding qualitative approaches—he or she won't necessarily have content expertise). Qualitative research must be designed and conducted with rigor (rigor will be discussed in Rip Out No. 8 of this series). Input from a qualitative expert will ensure that rigor is employed from the study's inception.
• 3 Consider the approach: With a literature review completed and a qualitatively skilled collaborator secured, it is time to decide which approach would be best suited to answering the research question. Questions to consider when weighing approaches might include the following:
• • Will my findings contribute to the creation of a theoretical model to better understand the area of study? ( grounded theory )
• • Will I need to spend an extended amount of time trying to understand the culture and process of a particular group of learners in their natural context? ( ethnography )
• • Is there a particular phenomenon I want to better understand/describe? ( phenomenology )

What You Can Do LONG TERM

• 1 Develop your qualitative research knowledge and skills : A basic qualitative research textbook is a valuable investment to learn about qualitative research (further reading is provided as online supplemental material). A novice qualitative researcher will also benefit from participating in a massive online open course or a mini-course (often offered by professional organizations or conferences) that provides an introduction to qualitative research. Most of all, collaborating with a qualitative researcher can provide the support necessary to design, execute, and report on the study.
• 2 Undertake a pilot study: After learning about qualitative methodology, the next best way to gain expertise in qualitative research is to try it in a small scale pilot study with the support of a qualitative expert. Such application provides an appreciation for the thought processes that go into designing a study, analyzing the data, and reporting on the findings. Alternatively, if you have the opportunity to work on a study led by a qualitative expert, take it! The experience will provide invaluable opportunities for learning how to engage in qualitative research.

Supplementary Material

The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the Uniformed Services University of the Health Sciences, the Department of the Navy, the Department of Defense, or the US government.

References and Resources for Further Reading

When to Use the 4 Qualitative Data Collection Methods

Qualitative data collection methods are the different ways to gather descriptive, non-numerical data for your research. 

Popular examples of qualitative data collection methods include surveys, observations, interviews, and focus groups. 

But it’s not enough to know what these methods are. Even more important is knowing when to use them. 

In an article published in Neurological Research and Practice titled, “How to use and assess qualitative research methods,” authors Busetto, Wick, and Gambinger assert that qualitative research is all about “flexibility, openness and responsivity to context . ” 

Because of this, “the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research,” according to the authors. 

This makes sense to me, too. And it means you have to use intuition and a pinch of guidance to know when—and how often—to use a specific qualitative data collection method. 

In this post, you’ll learn when to use the most common methods: interviews, focus groups, observations, and open-ended surveys.

#1. Interviews

An interview is a qualitative data collection method where a researcher has a one-on-one conversation with a participant. 

The goal of an interview is to explore how the participant feels about a specific topic. You’re mining for their unique experiences, perceptions, and thoughts.

There’s usually an element of structure here, with the researcher asking specific questions. But there’s room for organic discussion, too. The interviewer might take notes or record the session—or both—to capture the qualitative data collected.  

Interviews are slower, in some ways, than other qualitative data collection methods. Since you can only talk to one person at a time, you might not get as much data as you would from a survey sent out to 100 people at once. 

But interviews are a great way to go deep into a subject and collect details you wouldn’t get from a static survey response. 

Interviews are ideal to use when: 

• You need to know the “why”: A one-on-one conversation can help participants open up about the reasons they feel the way they do about a certain topic.
• You’re dealing with a sensitive topic: With an interview, you can create a safe space for a person to share their feelings without fear of judgment from other people.
• You want to know someone’s personal, lived experience: In a group setting, no one likes the person who takes over and tells their life story rather than participate in a larger conversation. But if you want that life story—if it’s relevant to your research—an interview is ideal.

There are times when interviews aren’t such a great choice, though. 

Choose another qualitative data collection method when:  

• You need information from lots of people, and quickly. Interviews are slow. If you need less depth and more breadth, go with a survey or questionnaire. 
• You don’t have a lot of resources to spare. It takes a significant amount of time and money to plan and carry out interviews. Most of the time, people don’t jump at the opportunity to participate in your research unless there’s an incentive—usually cash or a gift card. It ends up adding up to quite a bit.

#2. Focus Groups

A focus group is a qualitative data collection method where a small group of people discuss a topic together. A moderator is there to help guide the conversation. The goal here is to get everyone talking about their unique perspectives—and their shared experiences on a topic.

There’s one giant difference between focus groups and interviews, according to the authors of a 2018 article, “The use of focus groups discussion methodology: Insights from two decades of application in conservation,” published in the journal Methods in Ecology and Evolution . The article argues that in a one-on-one interview, the interviewer takes on the role of “investigator” and plays a central role in how the dynamics of the discussion play out. 

But in a focus group, the researcher “takes a peripheral, rather than a centre-stage role in a focus group discussion.”

AKA, researchers don’t have as much control over focus groups as they do interviews. 

And that can be a good thing. 

Focus groups are ideal to use when:  

• You’re in the early stages of research. If you haven’t been able to articulate the deeper questions you want to explore about a topic, a focus group can help you identify compelling areas to dig into. 
• You want to study a wide range of perspectives. A focus group can bring together a very diverse group of people if you want it to—and the conversation that results from this gathering of viewpoints can be incredibly insightful. 

So when should you steer clear of focus groups? 

Another research method might be better if: 

• You need raw, real honesty—from as many people as possible. Some participants might share valuable, sensitive information (like their honest opinions!) in a focus group. But many won’t feel comfortable doing so. The social dynamics in a group of people can greatly influence who shares what. If you want to build rapport with people and create a trusting environment, an interview might be a better choice. 

#3. Observation

Do you remember those strange, slightly special-feeling days in school when a random person, maybe the principal, would sit in on your class? Watching everyone, but especially your teacher? Jotting down mysterious notes from time to time? 

If you were anything like me, you behaved extra-good for a few minutes…and then promptly forgot about the person’s presence as you went about your normal school day.

That’s observation in a nutshell, and it’s a useful way to gather objective qualitative data. You don’t interfere or intrude when you’re observing. 

You just watch. 

Observation is a useful tool when: 

• You need to study natural behavior. Observation is ideal when you want to understand how people behave in a natural (aka non-conference-room) environment without interference. It allows you to see genuine interactions, routines, and practices as they happen. Think of observing kids on a playground or shoppers in a grocery store. 
• Participants may not be likely to accurately self-report behaviors. Sometimes participants might not be fully aware of their behaviors, or they might alter their responses to seem more “normal” or desirable to others. Observation allows you to capture what people do, rather than what they say they do. 

But observation isn’t always the best choice. 

Consider using another qualitative research method when: 

• The topic and/or behaviors studied are private or sensitive. Publicly observable behavior is one thing. Stuff that happens behind closed doors is another. If your research topic requires more of the latter and less of the former, go with interviews or surveys instead.
• You need to know the reasons behind specific behaviors. Observation gets you the what , but not the why . For detailed, in-depth insights, run an interview or open-ended survey.

#4. Open-Ended Surveys/Questionnaires

A survey is a series of questions sent out to a group of people in your target audience. 

In a qualitative survey, the questions are open-ended. This is different from quantitative questions, which are closed, yes-or-no queries. 

There’s a lot more room for spontaneity, opinion, and subjectivity with an open-ended survey question, which is why it’s considered a pillar of qualitative data collection. 

Of course, you can send out a survey that asks closed and open-ended questions. But our focus here is on the value of open-ended surveys.

Consider using an open-ended survey when:  

• You need detailed information from a diverse audience. The beauty of an open-ended questionnaire is you can send it to a lot of people. If you’re lucky, you’ll get plenty of details from each respondent. Not as much detail as you would in an interview, but still a super valuable amount.
• You’re just exploring a topic. If you’re in the early stages of research, an open-ended survey can help you discover angles you hadn’t considered before. You can move from a survey to a different data collection method, like interviews, to follow the threads you find intriguing.
• You want to give respondents anonymity. Surveys can easily be made anonymous in a way other methods, like focus groups, simply can’t. (And you can still collect important quantitative data from anonymous surveys, too, like age range, income level, and years of education completed.)

Useful though they are, open-ended surveys aren’t foolproof. 

Choose another method when:  

• You want to ask more than a few questions about a topic. It takes time and energy to compose an answer to an open-ended question. If you include more than three or four questions, you can expect the answers to get skimpier with each one. Or even completely absent by Question #4. 
• You want consistently high-quality answers. Researchers at Pew Research Center know a thing or two about surveys. According to authors Amina Dunn and Vianney Gómez in a piece for Decoded , Pew Research Center’s behind-the-scenes blog about research methods, “open-ended survey questions can be prone to high rates of nonresponse and wide variation in the quality of responses that are given.” If you need consistent, high-quality answers, consider hosting interviews instead. 

How to Decide Which Qualitative Data Collection Method to Use

Choosing the right qualitative data collection method can feel overwhelming. That’s why I’m breaking it down into a logical, step-by-step guide to help you choose the best method for your needs.

(Psst: you’ll probably end up using more than one of these methods throughout your qualitative research journey. That’s totally normal.)

Okay. Here goes. 

1. Start with your research goal

• If your goal is to understand deep, personal experiences or the reasons behind specific behaviors, then interviews are probably your best choice. There’s just no substitute for the data you’ll get during a one-on-one conversation with a research participant. And then another, and another. 
• If you’re not sure what your research goals are, begin by sending out a survey with general, open-ended questions asking for your respondents’ opinions about a topic. You can dig deeper from there.

2. Consider how sensitive your topic is

• If you’re dealing with a sensitive or private topic, where participants might not feel comfortable sharing in a group setting, interviews are ideal. They create a safe, confidential environment for open discussion between you and the respondent.
• If the topic is less sensitive and you want to see how social dynamics influence opinions, consider using focus groups instead.

3. Evaluate whether you need broad vs. deep data

• If you need broad data from a large number of people quickly, go with open-ended surveys or questionnaires . You don’t have to ask your respondents to write you an essay for each question. A few insightful lines will do just fine.
• If you need deep data, run interviews or focus groups. These allow for more in-depth responses and discussions you won’t get with a survey or observation.

4. Think about the context of your research

• If you want to study behavior in a natural setting without interference, observation is the way to go. More than any other, this method helps you capture genuine behaviors as they happen in real life. 
• But if you need to understand the reasons behind those behaviors, remember that observation only provides the what, not the why. In these cases, follow up with interviews or open-ended surveys for deeper insights.

5. Assess your resources If time and budget are limited, consider how many resources each qualitative data collection method will require. Open-ended surveys are less expensive—and faster to send out and analyze —than interviews or focus groups. The latter options require more time and effort from participants—and probably incentives, too.

Make your website better. Instantly.

Keep reading about user experience.

The 5 Best UI/UX Design Agencies Compared

UI/UX design agencies help bring brands to life and deliver optimized user experiences with well-researched and thoughtfully designed websites, apps, and products. All of the…

Qualitative data collection methods are the different ways to gather descriptive, non-numerical data for your research.  Popular examples of qualitative data collection methods include surveys,…

dscout Review–The Good and Bad

dscout is a great tool for doing qualitative user research, like live interviews or diary studies. But it isn’t the best choice for everyone.  If…

Out Of All Tips to Improve User Experience, 7 Are Legit

Figuring out the most effective ways to improve the user experience can be hard. There is tons of information out there, and it gets overwhelming…

Is Nominal Data Useful? Yes, In These Situations

Nominal data is descriptive information wherein rank and order don’t matter. Still confused? It helps to contrast nominal data with the other three main types…

What Is User Experience? Answers From 7 Top UX Designers

If you Google user experience the definition you’ll find is “the overall experience of a person using a product like a website or computer application,…

How to Do Each Qualitative Data Coding Type (All Steps)

Qualitative data coding is the process of organizing all the descriptive data you collect during a research project.  It has nothing to do with computer…

7 Qualitative Data Examples and Why They Work

Qualitative data presents information using descriptive language, images, and videos instead of numbers. To help make sense of this type of data—as opposed to quantitative…

The 5 Best Usability Testing Tools Compared

Usability testing helps designers, product managers, and other teams figure out how easily users can use a website, app, or product.  With these tools, user…

5 Qualitative Data Analysis Methods + When To Use Each

Qualitative data analysis is the work of organizing and interpreting descriptive data. Interview recordings, open-ended survey responses, and focus group observations all yield descriptive—qualitative—information. This…

The 5 Best UX Research Tools Compared

UX research tools help designers, product managers, and other teams understand users and how they interact with a company’s products and services. The tools provide…

Qualitative vs. Quantitative Data: 7 Key Differences

Qualitative data is information you can describe with words rather than numbers.  Quantitative data is information represented in a measurable way using numbers.  One type…

6 Real Ways AI Has Improved the User Experience

It seems like every other company is bragging about their AI-enhanced user experiences. Consumers and the UX professionals responsible for designing great user experiences are…

12 Key UX Metrics: What They Mean + How To Calculate Each

UX metrics help identify where users struggle when using an app or website and where they are successful. The data collected helps designers, developers, and…

5 Key Principles Of Good Website Usability

Ease of use is a common expectation for a site to be considered well designed. Over the past few years, we have been used to…

Over 300,000 websites use Crazy Egg to improve what's working, fix what isn't and test new ideas.

Last Updated on September 30, 2021

An official website of the United States government

Here’s how you know

Official websites use .gov A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS A lock ( Lock A locked padlock ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

A robust quantitative method to distinguish runoff-generated debris flows from floods

• More information: Publisher Index Page (via DOI)
• Open Access Version: Publisher Index Page
• Download citation as: RIS | Dublin Core

Debris flows and floods generated by rainfall runoff occur in rocky mountainous landscapes and burned steeplands. Flow type is commonly identified post-event through interpretation of depositional structures, but these may be poorly preserved or misinterpreted. Prior research indicates that discharge magnitude is commonly amplified in debris flows relative to floods due to volumetric bulking and increased frictional resistance. Here, we use this flow amplification to develop a metric ( Q* ) to separate debris flows from floods based on the ratio of observed peak discharge to the theoretical maximum water discharge from rainfall runoff. We compile 642 observations of floods and debris flows and demonstrate that  Q*  distinguishes flow type to ∼92% accuracy.  Q*  allows for accurate identification of debris flows through simple channel cross-section surveys rather than through qualitative interpretation of deposits, and therefore should increase the performance of models and engineered structures that require accurate flow-type observations.

Pardon Our Interruption

As you were browsing something about your browser made us think you were a bot. There are a few reasons this might happen:

• You've disabled JavaScript in your web browser.
• You're a power user moving through this website with super-human speed.
• You've disabled cookies in your web browser.
• A third-party browser plugin, such as Ghostery or NoScript, is preventing JavaScript from running. Additional information is available in this support article .

To regain access, please make sure that cookies and JavaScript are enabled before reloading the page.