• Privacy Policy

Research Method

Home » Validity – Types, Examples and Guide

Validity – Types, Examples and Guide

Table of Contents

Validity

Validity is a fundamental concept in research, referring to the extent to which a test, measurement, or study accurately reflects or assesses the specific concept that the researcher is attempting to measure. Ensuring validity is crucial as it determines the trustworthiness and credibility of the research findings.

Research Validity

Research validity pertains to the accuracy and truthfulness of the research. It examines whether the research truly measures what it claims to measure. Without validity, research results can be misleading or erroneous, leading to incorrect conclusions and potentially flawed applications.

How to Ensure Validity in Research

Ensuring validity in research involves several strategies:

  • Clear Operational Definitions : Define variables clearly and precisely.
  • Use of Reliable Instruments : Employ measurement tools that have been tested for reliability.
  • Pilot Testing : Conduct preliminary studies to refine the research design and instruments.
  • Triangulation : Use multiple methods or sources to cross-verify results.
  • Control Variables : Control extraneous variables that might influence the outcomes.

Types of Validity

Validity is categorized into several types, each addressing different aspects of measurement accuracy.

Internal Validity

Internal validity refers to the degree to which the results of a study can be attributed to the treatments or interventions rather than other factors. It is about ensuring that the study is free from confounding variables that could affect the outcome.

External Validity

External validity concerns the extent to which the research findings can be generalized to other settings, populations, or times. High external validity means the results are applicable beyond the specific context of the study.

Construct Validity

Construct validity evaluates whether a test or instrument measures the theoretical construct it is intended to measure. It involves ensuring that the test is truly assessing the concept it claims to represent.

Content Validity

Content validity examines whether a test covers the entire range of the concept being measured. It ensures that the test items represent all facets of the concept.

Criterion Validity

Criterion validity assesses how well one measure predicts an outcome based on another measure. It is divided into two types:

  • Predictive Validity : How well a test predicts future performance.
  • Concurrent Validity : How well a test correlates with a currently existing measure.

Face Validity

Face validity refers to the extent to which a test appears to measure what it is supposed to measure, based on superficial inspection. While it is the least scientific measure of validity, it is important for ensuring that stakeholders believe in the test’s relevance.

Importance of Validity

Validity is crucial because it directly affects the credibility of research findings. Valid results ensure that conclusions drawn from research are accurate and can be trusted. This, in turn, influences the decisions and policies based on the research.

Examples of Validity

  • Internal Validity : A randomized controlled trial (RCT) where the random assignment of participants helps eliminate biases.
  • External Validity : A study on educational interventions that can be applied to different schools across various regions.
  • Construct Validity : A psychological test that accurately measures depression levels.
  • Content Validity : An exam that covers all topics taught in a course.
  • Criterion Validity : A job performance test that predicts future job success.

Where to Write About Validity in A Thesis

In a thesis, the methodology section should include discussions about validity. Here, you explain how you ensured the validity of your research instruments and design. Additionally, you may discuss validity in the results section, interpreting how the validity of your measurements affects your findings.

Applications of Validity

Validity has wide applications across various fields:

  • Education : Ensuring assessments accurately measure student learning.
  • Psychology : Developing tests that correctly diagnose mental health conditions.
  • Market Research : Creating surveys that accurately capture consumer preferences.

Limitations of Validity

While ensuring validity is essential, it has its limitations:

  • Complexity : Achieving high validity can be complex and resource-intensive.
  • Context-Specific : Some validity types may not be universally applicable across all contexts.
  • Subjectivity : Certain types of validity, like face validity, involve subjective judgments.

By understanding and addressing these aspects of validity, researchers can enhance the quality and impact of their studies, leading to more reliable and actionable results.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Test-Retest Reliability

Test-Retest Reliability – Methods, Formula and...

Parallel Forms Reliability

Parallel Forms Reliability – Methods, Example...

Internal_Consistency_Reliability

Internal Consistency Reliability – Methods...

Split-Half Reliability

Split-Half Reliability – Methods, Examples and...

Criterion Validity

Criterion Validity – Methods, Examples and...

Inter-Rater Reliability

Inter-Rater Reliability – Methods, Examples and...

Validity in Analysis, Interpretation, and Conclusions

  • First Online: 14 December 2023

Cite this chapter

conclusion validity research method

  • Apollo M. Nkwake 2  

70 Accesses

This phase of the evaluation process involves use of appropriate methods and tools for cleaning, processing, and analysis; interpreting the results to determine what they mean; applying appropriate approaches for comparing, verifying, and triangulating results; and lastly, documenting appropriate conclusions and recommendations. Therefore, critical validity questions include:

Are conclusions and inferences accurately derived from evaluation data and measures that generate this data?

To what extent can findings be applied to situations other than the one in which evaluation is conducted?

The main forms of validity affected at this stage include statistical conclusion, internal validity, and external validity. This chapter discusses the meaning, preconditions, and assumptions of these validity types.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save.

  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
  • Available as EPUB and PDF
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Descriptive validity concerns the adequacy of the presentation of key features of an evaluation in a research report. The quality of documentation affects the usefulness of an evaluation. Farrington ( 2003 ) argues that a well-written evaluation report needs document nothing less than the following:

Design of the study, for example, how were participants allocated to different comparison groups and conditions?

Characteristics of study participants and settings (e.g., age and gender of individuals, sociodemographic features of areas).

Sample sizes and attrition rates.

Hypotheses to be tested and theories from which they are derived.

The operational definition and detailed description of the intervention’s theory of change (including its intensity and duration).

Implementation details and program delivery personnel.

Description of what treatment the control or other comparison groups received.

The operational definition and measurement of the outcome before and after the intervention.

The reliability and validity of outcome measures.

The follow-up period after the intervention (where applicable).

Effect size, confidence intervals, statistical significance, and statistical methods used.

How independent and extraneous variables were controlled so that it was possible to disentangle the impact of the intervention or how threats to internal validity were ruled out.

Who knows what about the intervention?

Conflict of interest issues: who funded the intervention, and how independent were the researchers? (Farrington, 2003 ).

Calloway, M., & Belyea, M. J. (1988). Ensuring validity using coworker samples: A situationally driven approach. Evaluation Review, 12 (2), 186–195.

Article   Google Scholar  

Campbell, D. T. (1986). Relabeling internal and external validity for applied social scientists, In W. M. K. Trochim, Advances in quasi-experimental design and analysis. New Directions for Program Education , 31 (Fall):67–78.

Google Scholar  

Chen, H. T., & Garbe, P. (2011). Assessing program outcomes from the bottom-up approach: An innovative perspective to outcome evaluation. In H. T. Chen, S. I. Donaldson, & M. M. Mark (Eds.), Advancing validity in outcome evaluation: Theory and practice. New directions for evaluation , 130 (summer), 93–106.

Cook, T. D., Campbell, D. T., & Peracchio, L. (1990). Quasi experimentation. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (pp. 491–576).

Cronbach, L. H., Glesser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles . Wiley.

Dikmen, S., Reitan, R. M., & Temkin, N. R. (1983). Neuropsychological recovery in head injury. Archives of Neurology, 40 , 333–338.

Article   PubMed   Google Scholar  

Farrington, D. F. (2003). Methodological quality standards for evaluation research. Annals of the American Academy of Political and Social Science, 587 (2003), 49–68.

Field, A. (2014). Discovering statistics using IBM SPSS . London: Sage.

Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27 , 3–12.

Glasgow, R. E., Green, L. W., & Ammerman, A. (2007). A focus on external validity. Evaluation & the Health Professions, 30 (2), 115–117.

Green, L. W., & Glasgow, R. E. (2006). Evaluating the relevance, generalization, and applicability of research issues in external validation and translation methodology. Evaluation & the Health Professions, 29 (1), 126–153.

Hahn, G. J., & Meeker, W. Q. (1993). assumptions for statistical inference. The American Statistician, 47 (1), 1–11.

House, E. R. (1980). The logic of evaluative argument, monograph #7 . Center for the Study of Evaluation, UCLA.

House, E. R. (2008). Blowback: Consequences of evaluation for evaluation. American Journal of Evaluation, 29 , 416–426.

Julnes, G. (2011). Reframing validity in research and evaluation: A multidimensional, systematic model of valid inference. In H. T. Chen, S. I. Donaldson, & M. M. Mark (Eds.), Advancing validity in outcome evaluation: Theory and practice. New Directions for Evaluation , 130 , 55–67.

Klass, G. M. (1984). Drawing inferences from policy experiments: Issues of external validity and conflict of interest. Evaluation Review, 8 (1), 3–24.

Mark, M. M. (2011). New (and old) directions for validity concerning generalizability. In H. T. Chen, S. I. Donaldson, & M. M. Mark (Eds.), Advancing validity in outcome evaluation: Theory and practice. New directions for evaluation, 130, 31–42.

Peck, L. R., Kim, Y., & Lucio, J. (2012). An empirical examination of validity in evaluation. American Journal of Evaluation, 0 (0), 1–16.

Reichardt, C. S. (2011). Criticisms of and an alternative to the Shadish, Cook, and Campbell validity typology. In H. T. Chen, S. I. Donaldson, & M. M. Mark (Eds.), Advancing validity in outcome evaluation: Theory and practice. New directions for evaluation , 130, 43–53.

Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation: Theories of practice . Sage.

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002a). Experimental and quasi-experimental design for generalized causal inference . Houghton Mifflin.

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002b). Experimental and quasi-experimental designs for generalized causal inference . Houghton Mifflin.

Stone, R. (1993). The assumptions on which causal inferences rest. Journal of the Royal Statistical Society. Series B (Methodological), 55 (2), 455–466.

Tebes, J. K., Snow, D. L., & Arthur, M. W. (1992). Panel attrition and external validity in the short-term follow-up study of adolescent substance use. Evaluation Review, 16 (2), 151–170.

Tunis, S. R., Stryer, D. B., & Clancy, C. M. (2003). Practical clinical trials. Increasing the value of clinical research for decision making in clinical and health policy. Journal of the American Medical Association, 290 , 1624–1632.

Yeaton, W. H., & Sechrest, L. (1986). Use and misuse of no-difference findings in eliminating threats to validity. Evaluation Review, 10 (6), 836–852.

Download references

Author information

Authors and affiliations.

The Questions Team, Frederick, MD, USA

Apollo M. Nkwake

You can also search for this author in PubMed   Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Nkwake, A.M. (2023). Validity in Analysis, Interpretation, and Conclusions. In: Credibility, Validity, and Assumptions in Program Evaluation Methodology. Springer, Cham. https://doi.org/10.1007/978-3-031-45614-5_6

Download citation

DOI : https://doi.org/10.1007/978-3-031-45614-5_6

Published : 14 December 2023

Publisher Name : Springer, Cham

Print ISBN : 978-3-031-45613-8

Online ISBN : 978-3-031-45614-5

eBook Packages : Behavioral Science and Psychology Behavioral Science and Psychology (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Publish with us

Policies and ethics

  • Find a journal
  • Track your research

Validity In Psychology Research: Types & Examples

Saul McLeod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul McLeod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Learn about our Editorial Process

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

In psychology research, validity refers to the extent to which a test or measurement tool accurately measures what it’s intended to measure. It ensures that the research findings are genuine and not due to extraneous factors.

Validity can be categorized into different types based on internal and external validity .

The concept of validity was formulated by Kelly (1927, p. 14), who stated that a test is valid if it measures what it claims to measure. For example, a test of intelligence should measure intelligence and not something else (such as memory).

Internal and External Validity In Research

Internal validity refers to whether the effects observed in a study are due to the manipulation of the independent variable and not some other confounding factor.

In other words, there is a causal relationship between the independent and dependent variables .

Internal validity can be improved by controlling extraneous variables, using standardized instructions, counterbalancing, and eliminating demand characteristics and investigator effects.

External validity refers to the extent to which the results of a study can be generalized to other settings (ecological validity), other people (population validity), and over time (historical validity).

External validity can be improved by setting experiments more naturally and using random sampling to select participants.

Types of Validity In Psychology

Two main categories of validity are used to assess the validity of the test (i.e., questionnaire, interview, IQ test, etc.): Content and criterion.

  • Content validity refers to the extent to which a test or measurement represents all aspects of the intended content domain. It assesses whether the test items adequately cover the topic or concept.
  • Criterion validity assesses the performance of a test based on its correlation with a known external criterion or outcome. It can be further divided into concurrent (measured at the same time) and predictive (measuring future performance) validity.

table showing the different types of validity

Face Validity

Face validity is simply whether the test appears (at face value) to measure what it claims to. This is the least sophisticated measure of content-related validity, and is a superficial and subjective assessment based on appearance.

Tests wherein the purpose is clear, even to naïve respondents, are said to have high face validity. Accordingly, tests wherein the purpose is unclear have low face validity (Nevo, 1985).

A direct measurement of face validity is obtained by asking people to rate the validity of a test as it appears to them. This rater could use a Likert scale to assess face validity.

For example:

  • The test is extremely suitable for a given purpose
  • The test is very suitable for that purpose;
  • The test is adequate
  • The test is inadequate
  • The test is irrelevant and, therefore, unsuitable

It is important to select suitable people to rate a test (e.g., questionnaire, interview, IQ test, etc.). For example, individuals who actually take the test would be well placed to judge its face validity.

Also, people who work with the test could offer their opinion (e.g., employers, university administrators, employers). Finally, the researcher could use members of the general public with an interest in the test (e.g., parents of testees, politicians, teachers, etc.).

The face validity of a test can be considered a robust construct only if a reasonable level of agreement exists among raters.

It should be noted that the term face validity should be avoided when the rating is done by an “expert,” as content validity is more appropriate.

Having face validity does not mean that a test really measures what the researcher intends to measure, but only in the judgment of raters that it appears to do so. Consequently, it is a crude and basic measure of validity.

A test item such as “ I have recently thought of killing myself ” has obvious face validity as an item measuring suicidal cognitions and may be useful when measuring symptoms of depression.

However, the implication of items on tests with clear face validity is that they are more vulnerable to social desirability bias. Individuals may manipulate their responses to deny or hide problems or exaggerate behaviors to present a positive image of themselves.

It is possible for a test item to lack face validity but still have general validity and measure what it claims to measure. This is good because it reduces demand characteristics and makes it harder for respondents to manipulate their answers.

For example, the test item “ I believe in the second coming of Christ ” would lack face validity as a measure of depression (as the purpose of the item is unclear).

This item appeared on the first version of The Minnesota Multiphasic Personality Inventory (MMPI) and loaded on the depression scale.

Because most of the original normative sample of the MMPI were good Christians, only a depressed Christian would think Christ is not coming back. Thus, for this particular religious sample, the item does have general validity but not face validity.

Construct Validity

Construct validity assesses how well a test or measure represents and captures an abstract theoretical concept, known as a construct. It indicates the degree to which the test accurately reflects the construct it intends to measure, often evaluated through relationships with other variables and measures theoretically connected to the construct.

Construct validity was invented by Cronbach and Meehl (1955). This type of content-related validity refers to the extent to which a test captures a specific theoretical construct or trait, and it overlaps with some of the other aspects of validity

Construct validity does not concern the simple, factual question of whether a test measures an attribute.

Instead, it is about the complex question of whether test score interpretations are consistent with a nomological network involving theoretical and observational terms (Cronbach & Meehl, 1955).

To test for construct validity, it must be demonstrated that the phenomenon being measured actually exists. So, the construct validity of a test for intelligence, for example, depends on a model or theory of intelligence .

Construct validity entails demonstrating the power of such a construct to explain a network of research findings and to predict further relationships.

The more evidence a researcher can demonstrate for a test’s construct validity, the better. However, there is no single method of determining the construct validity of a test.

Instead, different methods and approaches are combined to present the overall construct validity of a test. For example, factor analysis and correlational methods can be used.

Convergent validity

Convergent validity is a subtype of construct validity. It assesses the degree to which two measures that theoretically should be related are related.

It demonstrates that measures of similar constructs are highly correlated. It helps confirm that a test accurately measures the intended construct by showing its alignment with other tests designed to measure the same or similar constructs.

For example, suppose there are two different scales used to measure self-esteem:

Scale A and Scale B. If both scales effectively measure self-esteem, then individuals who score high on Scale A should also score high on Scale B, and those who score low on Scale A should score similarly low on Scale B.

If the scores from these two scales show a strong positive correlation, then this provides evidence for convergent validity because it indicates that both scales seem to measure the same underlying construct of self-esteem.

Concurrent Validity (i.e., occurring at the same time)

Concurrent validity evaluates how well a test’s results correlate with the results of a previously established and accepted measure, when both are administered at the same time.

It helps in determining whether a new measure is a good reflection of an established one without waiting to observe outcomes in the future.

If the new test is validated by comparison with a currently existing criterion, we have concurrent validity.

Very often, a new IQ or personality test might be compared with an older but similar test known to have good validity already.

Predictive Validity

Predictive validity assesses how well a test predicts a criterion that will occur in the future. It measures the test’s ability to foresee the performance of an individual on a related criterion measured at a later point in time. It gauges the test’s effectiveness in predicting subsequent real-world outcomes or results.

For example, a prediction may be made on the basis of a new intelligence test that high scorers at age 12 will be more likely to obtain university degrees several years later. If the prediction is born out, then the test has predictive validity.

Cronbach, L. J., and Meehl, P. E. (1955) Construct validity in psychological tests. Psychological Bulletin , 52, 281-302.

Hathaway, S. R., & McKinley, J. C. (1943). Manual for the Minnesota Multiphasic Personality Inventory . New York: Psychological Corporation.

Kelley, T. L. (1927). Interpretation of educational measurements. New York : Macmillan.

Nevo, B. (1985). Face validity revisited . Journal of Educational Measurement , 22(4), 287-293.

Print Friendly, PDF & Email

The 4 Types of Validity in Research Design (+3 More to Consider)

Avatar

The conclusions you draw from your research (whether from analyzing surveys, focus groups, experimental design, or other research methods) are only useful if they’re valid.

How “true” are these results? How well do they represent the thing you’re actually trying to study? Validity is used to determine whether research measures what it intended to measure and to approximate the truthfulness of the results.

Unfortunately, researchers sometimes create their own definitions when it comes to what is considered valid.

  • In quantitative research testing for validity and reliability is a given.
  • However, some qualitative researchers have gone so far as to suggest that validity does not apply to their research even as they acknowledge the need for some qualifying checks or measures in their work.

This is wrong. Validity is always important – even if it’s harder to determine in qualitative research.

To disregard validity is to put the trustworthiness of your work in question and to call into question others’ confidence in its results. Even when qualitative measures are used in research, they need to be looked at using measures of reliability and validity in order to sustain the trustworthiness of the results.

What is validity in research?

Validity is how researchers talk about the extent to which results represent reality. Research methods, quantitative or qualitative, are methods of studying real phenomenon – validity refers to how much of that phenomenon they measure vs. how much “noise,” or unrelated information, is captured by the results.

Validity and reliability make the difference between “good” and “bad” research reports. Quality research depends on a commitment to testing and increasing the validity as well as the reliability of your research results.

Any research worth its weight is concerned with whether what is being measured is what is intended to be measured and considers how observations are influenced by the circumstances in which they are made.

The basis of how our conclusions are made plays an important role in addressing the broader substantive issues of any given study.

For this reason, we are going to look at various validity types that have been formulated as a part of legitimate research methodology.

Here are the 7 key types of validity in research:

  • Face validity
  • Content validity
  • Construct validity
  • Internal validity
  • External validity
  • Statistical conclusion validity
  • Criterion-related validity

1. Face validity

Face validity is how valid your results seem based on what they look like. This is the least scientific method of validity, as it is not quantified using statistical methods.

Face validity is not validity in a technical sense of the term.  It is concerned with whether it seems like we measure what we claim.

Here we look at how valid a measure appears on the surface and make subjective judgments based on that.

For example,

  • Imagine you give a survey that appears to be valid to the respondent and the questions are selected because they look valid to the administer.
  • The administer asks a group of random people, untrained observers if the questions appear valid to them

In research, it’s never enough to rely on face judgments alone – and more quantifiable methods of validity are necessary to draw acceptable conclusions.  There are many instruments of measurement to consider so face validity is useful in cases where you need to distinguish one approach over another.

Face validity should never be trusted on its own merits.

2. Content validity

Content validity is whether or not the measure used in the research covers all of the content in the underlying construct (the thing you are trying to measure).

This is also a subjective measure, but unlike face validity, we ask whether the content of a measure covers the full domain of the content. If a researcher wanted to measure introversion, they would have to first decide what constitutes a relevant domain of content for that trait.

Content validity is considered a subjective form of measurement because it still relies on people’s perceptions for measuring constructs that would otherwise be difficult to measure.

Where content validity distinguishes itself (and becomes useful) through its use of experts in the field or individuals belonging to a target population. This study can be made more objective through the use of rigorous statistical tests.

For example, you could have a content validity study that informs researchers how items used in a survey represent their content domain, how clear they are, and the extent to which they maintain the theoretical factor structure assessed by the factor analysis.

3. Construct validity

A construct represents a collection of behaviors that are associated in a meaningful way to create an image or an idea invented for a research purpose. Construct validity is the degree to which your research measures the construct (as compared to things outside the construct).

Depression is a construct that represents a personality trait that manifests itself in behaviors such as oversleeping, loss of appetite, difficulty concentrating, etc.

The existence of a construct is manifest by observing the collection of related indicators.  Any one sign may be associated with several constructs.  A person with difficulty concentrating may have ADHD but not depression.

Construct validity is the degree to which inferences can be made from operationalizations (connecting concepts to observations) in your study to the constructs on which those operationalizations are based.  To establish construct validity you must first provide evidence that your data supports the theoretical structure.

You must also show that you control the operationalization of the construct, in other words, show that your theory has some correspondence with reality.

  • Convergent Validity –  the degree to which an operation is similar to other operations it should theoretically be similar to.
  • Discriminative Validity -– if a scale adequately differentiates itself or does not differentiate between groups that should differ or not differ based on theoretical reasons or previous research.
  • Nomological Network –  representation of the constructs of interest in a study, their observable manifestations, and the interrelationships among and between these.  According to Cronbach and Meehl,  a nomological network has to be developed for a measure for it to have construct validity
  • Multitrait-Multimethod Matrix –  six major considerations when examining Construct Validity according to Campbell and Fiske.  This includes evaluations of convergent validity and discriminative validity.  The others are trait method unit, multi-method/trait, truly different methodology, and trait characteristics.

4. Internal validity

Internal validity refers to the extent to which the independent variable can accurately be stated to produce the observed effect.

If the effect of the dependent variable is only due to the independent variable(s) then internal validity is achieved. This is the degree to which a result can be manipulated.

Put another way, internal validity is how you can tell that your research “works” in a research setting. Within a given study, does the variable you change affect the variable you’re studying?

5. External validity

External validity refers to the extent to which the results of a study can be generalized beyond the sample. Which is to say that you can apply your findings to other people and settings.

Think of this as the degree to which a result can be generalized. How well do the research results apply to the rest of the world?

A laboratory setting (or other research setting) is a controlled environment with fewer variables. External validity refers to how well the results hold, even in the presence of all those other variables.

6. Statistical conclusion validity

Statistical conclusion validity is a determination of whether a relationship or co-variation exists between cause and effect variables.

This type of validity requires:

  • Ensuring adequate sampling procedures
  • Appropriate statistical tests
  • Reliable measurement procedures

This is the degree to which a conclusion is credible or believable.

7. Criterion-related validity

Criterion-related validity (also called instrumental validity) is a measure of the quality of your measurement methods.  The accuracy of a measure is demonstrated by comparing it with a measure that is already known to be valid.

In other words – if your measure has a high correlation with other measures that are known to be valid because of previous research.

For this to work you must know that the criterion has been measured well.  And be aware that appropriate criteria do not always exist.

What you are doing is checking the performance of your operationalization against criteria.

The criteria you use as a standard of judgment accounts for the different approaches you would use:

  • Predictive Validity –  operationalization’s ability to predict what it is theoretically able to predict.  The extent to which a measure predicts expected outcomes.
  • Concurrent Validity –  operationalization’s ability to distinguish between groups it theoretically should be able to.  This is where a test correlates well with a measure that has been previously validated.

When we look at validity in survey data we are asking whether the data represents what we think it should represent.

We depend on the respondent’s mindset and attitude to give us valid data.

In other words, we depend on them to answer all questions honestly and conscientiously. We also depend on whether they are able to answer the questions that we ask. When questions are asked that the respondent can not comprehend or understand, then the data does not tell us what we think it does.

No credit card required. Instant set-up.

Please enter a valid email address to continue.

Related Posts

The 5 Best ConvertKit Alternatives for 2024

ConvertKit is a powerful email marketing platform that offers several advantages for businesses looking to build and engage with their...

Marketers: Support your Sales Team’s Growth With This List of Integrations

Marketing plays a critical role in driving quality leads into your sales pipeline. If you are tasked with increasing the...

Imagine you’re Charlie in Willy Wonka and the Chocolate Factory. This whole business is all yours! Run around it, eat...

Try it now, for free

conclusion validity research method

What is the Significance of Validity in Research?

conclusion validity research method

Introduction

  • What is validity in simple terms?

Internal validity vs. external validity in research

Uncovering different types of research validity, factors that improve research validity.

In qualitative research , validity refers to an evaluation metric for the trustworthiness of study findings. Within the expansive landscape of research methodologies , the qualitative approach, with its rich, narrative-driven investigations, demands unique criteria for ensuring validity.

Unlike its quantitative counterpart, which often leans on numerical robustness and statistical veracity, the essence of validity in qualitative research delves deep into the realms of credibility, dependability, and the richness of the data .

The importance of validity in qualitative research cannot be overstated. Establishing validity refers to ensuring that the research findings genuinely reflect the phenomena they are intended to represent. It reinforces the researcher's responsibility to present an authentic representation of study participants' experiences and insights.

This article will examine validity in qualitative research, exploring its characteristics, techniques to bolster it, and the challenges that researchers might face in establishing validity.

conclusion validity research method

At its core, validity in research speaks to the degree to which a study accurately reflects or assesses the specific concept that the researcher is attempting to measure or understand. It's about ensuring that the study investigates what it purports to investigate. While this seems like a straightforward idea, the way validity is approached can vary greatly between qualitative and quantitative research .

Quantitative research often hinges on numerical, measurable data. In this paradigm, validity might refer to whether a specific tool or method measures the correct variable, without interference from other variables. It's about numbers, scales, and objective measurements. For instance, if one is studying personalities by administering surveys, a valid instrument could be a survey that has been rigorously developed and tested to verify that the survey questions are referring to personality characteristics and not other similar concepts, such as moods, opinions, or social norms.

Conversely, qualitative research is more concerned with understanding human behavior and the reasons that govern such behavior. It's less about measuring in the strictest sense and more about interpreting the phenomenon that is being studied. The questions become: "Are these interpretations true representations of the human experience being studied?" and "Do they authentically convey participants' perspectives and contexts?"

conclusion validity research method

Differentiating between qualitative and quantitative validity is crucial because the research methods to ensure validity differ between these research paradigms. In quantitative realms, validity might involve test-retest reliability or examining the internal consistency of a test.

In the qualitative sphere, however, the focus shifts to ensuring that the researcher's interpretations align with the actual experiences and perspectives of their subjects.

This distinction is fundamental because it impacts how researchers engage in research design , gather data , and draw conclusions . Ensuring validity in qualitative research is like weaving a tapestry: every strand of data must be carefully interwoven with the interpretive threads of the researcher, creating a cohesive and faithful representation of the studied experience.

While often terms associated more closely with quantitative research, internal and external validity can still be relevant concepts to understand within the context of qualitative inquiries. Grasping these notions can help qualitative researchers better navigate the challenges of ensuring their findings are both credible and applicable in wider contexts.

Internal validity

Internal validity refers to the authenticity and truthfulness of the findings within the study itself. In qualitative research , this might involve asking: Do the conclusions drawn genuinely reflect the perspectives and experiences of the study's participants?

Internal validity revolves around the depth of understanding, ensuring that the researcher's interpretations are grounded in participants' realities. Techniques like member checking , where participants review and verify the researcher's interpretations , can bolster internal validity.

External validity

External validity refers to the extent to which the findings of a study can be generalized or applied to other settings or groups. For qualitative researchers, the emphasis isn't on statistical generalizability, as often seen in quantitative studies. Instead, it's about transferability.

It becomes a matter of determining how and where the insights gathered might be relevant in other contexts. This doesn't mean that every qualitative study's findings will apply universally, but qualitative researchers should provide enough detail (through rich, thick descriptions) to allow readers or other researchers to determine the potential for transfer to other contexts.

conclusion validity research method

Try out a free trial of ATLAS.ti today

See how you can turn your data into critical research findings with our intuitive interface.

Looking deeper into the realm of validity, it's crucial to recognize and understand its various types. Each type offers distinct criteria and methods of evaluation, ensuring that research remains robust and genuine. Here's an exploration of some of these types.

Construct validity

Construct validity is a cornerstone in research methodology . It pertains to ensuring that the tools or methods used in a research study genuinely capture the intended theoretical constructs.

In qualitative research , the challenge lies in the abstract nature of many constructs. For example, if one were to investigate "emotional intelligence" or "social cohesion," the definitions might vary, making them hard to pin down.

conclusion validity research method

To bolster construct validity, it is important to clearly and transparently define the concepts being studied. In addition, researchers may triangulate data from multiple sources , ensuring that different viewpoints converge towards a shared understanding of the construct. Furthermore, they might delve into iterative rounds of data collection, refining their methods with each cycle to better align with the conceptual essence of their focus.

Content validity

Content validity's emphasis is on the breadth and depth of the content being assessed. In other words, content validity refers to capturing all relevant facets of the phenomenon being studied. Within qualitative paradigms, ensuring comprehensive representation is paramount. If, for instance, a researcher is using interview protocols to understand community perceptions of a local policy, it's crucial that the questions encompass all relevant aspects of that policy. This could range from its implementation and impact to public awareness and opinion variations across demographic groups.

Enhancing content validity can involve expert reviews where subject matter experts evaluate tools or methods for comprehensiveness. Another strategy might involve pilot studies , where preliminary data collection reveals gaps or overlooked aspects that can be addressed in the main study.

Ecological validity

Ecological validity refers to the genuine reflection of real-world situations in research findings. For qualitative researchers, this means their observations , interpretations , and conclusions should resonate with the participants and context being studied.

If a study explores classroom dynamics, for example, studying students and teachers in a controlled research setting would have lower ecological validity than studying real classroom settings. Ecological validity is important to consider because it helps ensure the research is relevant to the people being studied. Individuals might behave entirely different in a controlled environment as opposed to their everyday natural settings.

Ecological validity tends to be stronger in qualitative research compared to quantitative research , because qualitative researchers are typically immersed in their study context and explore participants' subjective perceptions and experiences. Quantitative research, in contrast, can sometimes be more artificial if behavior is being observed in a lab or participants have to choose from predetermined options to answer survey questions.

Qualitative researchers can further bolster ecological validity through immersive fieldwork, where researchers spend extended periods in the studied environment. This immersion helps them capture the nuances and intricacies that might be missed in brief or superficial engagements.

Face validity

Face validity, while seemingly straightforward, holds significant weight in the preliminary stages of research. It serves as a litmus test, gauging the apparent appropriateness and relevance of a tool or method. If a researcher is developing a new interview guide to gauge employee satisfaction, for instance, a quick assessment from colleagues or a focus group can reveal if the questions intuitively seem fit for the purpose.

While face validity is more subjective and lacks the depth of other validity types, it's a crucial initial step, ensuring that the research starts on the right foot.

Criterion validity

Criterion validity evaluates how well the results obtained from one method correlate with those from another, more established method. In many research scenarios, establishing high criterion validity involves using statistical methods to measure validity. For instance, a researcher might utilize the appropriate statistical tests to determine the strength and direction of the linear relationship between two sets of data.

If a new measurement tool or method is being introduced, its validity might be established by statistically correlating its outcomes with those of a gold standard or previously validated tool. Correlational statistics can estimate the strength of the relationship between the new instrument and the previously established instrument, and regression analyses can also be useful to predict outcomes based on established criteria.

While these methods are traditionally aligned with quantitative research, qualitative researchers, particularly those using mixed methods , may also find value in these statistical approaches, especially when wanting to quantify certain aspects of their data for comparative purposes. More broadly, qualitative researchers could compare their operationalizations and findings to other similar qualitative studies to assess that they are indeed examining what they intend to study.

In the realm of qualitative research , the role of the researcher is not just that of an observer but often as an active participant in the meaning-making process. This unique positioning means the researcher's perspectives and interactions can significantly influence the data collected and its interpretation . Here's a deep dive into the researcher's pivotal role in upholding validity.

Reflexivity

A key concept in qualitative research, reflexivity requires researchers to continually reflect on their worldviews, beliefs, and potential influence on the data. By maintaining a reflexive journal or engaging in regular introspection, researchers can identify and address their own biases , ensuring a more genuine interpretation of participant narratives.

Building rapport

The depth and authenticity of information shared by participants often hinge on the rapport and trust established with the researcher. By cultivating genuine, non-judgmental, and empathetic relationships with participants, researchers can enhance the validity of the data collected.

Positionality

Every researcher brings to the study their own background, including their culture, education, socioeconomic status, and more. Recognizing how this positionality might influence interpretations and interactions is crucial. By acknowledging and transparently sharing their positionality, researchers can offer context to their findings and interpretations.

Active listening

The ability to listen without imposing one's own judgments or interpretations is vital. Active listening ensures that researchers capture the participants' experiences and emotions without distortion, enhancing the validity of the findings.

Transparency in methods

To ensure validity, researchers should be transparent about every step of their process. From how participants were selected to how data was analyzed , a clear documentation offers others a chance to understand and evaluate the research's authenticity and rigor .

Member checking

Once data is collected and interpreted, revisiting participants to confirm the researcher's interpretations can be invaluable. This process, known as member checking , ensures that the researcher's understanding aligns with the participants' intended meanings, bolstering validity.

Embracing ambiguity

Qualitative data can be complex and sometimes contradictory. Instead of trying to fit data into preconceived notions or frameworks, researchers must embrace ambiguity, acknowledging areas of uncertainty or multiple interpretations.

conclusion validity research method

Make the most of your research study with ATLAS.ti

From study design to data analysis, let ATLAS.ti guide you through the research process. Download a free trial today.

conclusion validity research method

  • Search Menu

Sign in through your institution

  • Browse content in Arts and Humanities
  • Browse content in Archaeology
  • Anglo-Saxon and Medieval Archaeology
  • Archaeological Methodology and Techniques
  • Archaeology by Region
  • Archaeology of Religion
  • Archaeology of Trade and Exchange
  • Biblical Archaeology
  • Contemporary and Public Archaeology
  • Environmental Archaeology
  • Historical Archaeology
  • History and Theory of Archaeology
  • Industrial Archaeology
  • Landscape Archaeology
  • Mortuary Archaeology
  • Prehistoric Archaeology
  • Underwater Archaeology
  • Zooarchaeology
  • Browse content in Architecture
  • Architectural Structure and Design
  • History of Architecture
  • Residential and Domestic Buildings
  • Theory of Architecture
  • Browse content in Art
  • Art Subjects and Themes
  • History of Art
  • Industrial and Commercial Art
  • Theory of Art
  • Biographical Studies
  • Byzantine Studies
  • Browse content in Classical Studies
  • Classical History
  • Classical Philosophy
  • Classical Mythology
  • Classical Numismatics
  • Classical Literature
  • Classical Reception
  • Classical Art and Architecture
  • Classical Oratory and Rhetoric
  • Greek and Roman Papyrology
  • Greek and Roman Epigraphy
  • Greek and Roman Law
  • Greek and Roman Archaeology
  • Late Antiquity
  • Religion in the Ancient World
  • Social History
  • Digital Humanities
  • Browse content in History
  • Colonialism and Imperialism
  • Diplomatic History
  • Environmental History
  • Genealogy, Heraldry, Names, and Honours
  • Genocide and Ethnic Cleansing
  • Historical Geography
  • History by Period
  • History of Emotions
  • History of Agriculture
  • History of Education
  • History of Gender and Sexuality
  • Industrial History
  • Intellectual History
  • International History
  • Labour History
  • Legal and Constitutional History
  • Local and Family History
  • Maritime History
  • Military History
  • National Liberation and Post-Colonialism
  • Oral History
  • Political History
  • Public History
  • Regional and National History
  • Revolutions and Rebellions
  • Slavery and Abolition of Slavery
  • Social and Cultural History
  • Theory, Methods, and Historiography
  • Urban History
  • World History
  • Browse content in Language Teaching and Learning
  • Language Learning (Specific Skills)
  • Language Teaching Theory and Methods
  • Browse content in Linguistics
  • Applied Linguistics
  • Cognitive Linguistics
  • Computational Linguistics
  • Forensic Linguistics
  • Grammar, Syntax and Morphology
  • Historical and Diachronic Linguistics
  • History of English
  • Language Evolution
  • Language Reference
  • Language Acquisition
  • Language Variation
  • Language Families
  • Lexicography
  • Linguistic Anthropology
  • Linguistic Theories
  • Linguistic Typology
  • Phonetics and Phonology
  • Psycholinguistics
  • Sociolinguistics
  • Translation and Interpretation
  • Writing Systems
  • Browse content in Literature
  • Bibliography
  • Children's Literature Studies
  • Literary Studies (Romanticism)
  • Literary Studies (American)
  • Literary Studies (Asian)
  • Literary Studies (European)
  • Literary Studies (Eco-criticism)
  • Literary Studies (Modernism)
  • Literary Studies - World
  • Literary Studies (1500 to 1800)
  • Literary Studies (19th Century)
  • Literary Studies (20th Century onwards)
  • Literary Studies (African American Literature)
  • Literary Studies (British and Irish)
  • Literary Studies (Early and Medieval)
  • Literary Studies (Fiction, Novelists, and Prose Writers)
  • Literary Studies (Gender Studies)
  • Literary Studies (Graphic Novels)
  • Literary Studies (History of the Book)
  • Literary Studies (Plays and Playwrights)
  • Literary Studies (Poetry and Poets)
  • Literary Studies (Postcolonial Literature)
  • Literary Studies (Queer Studies)
  • Literary Studies (Science Fiction)
  • Literary Studies (Travel Literature)
  • Literary Studies (War Literature)
  • Literary Studies (Women's Writing)
  • Literary Theory and Cultural Studies
  • Mythology and Folklore
  • Shakespeare Studies and Criticism
  • Browse content in Media Studies
  • Browse content in Music
  • Applied Music
  • Dance and Music
  • Ethics in Music
  • Ethnomusicology
  • Gender and Sexuality in Music
  • Medicine and Music
  • Music Cultures
  • Music and Media
  • Music and Religion
  • Music and Culture
  • Music Education and Pedagogy
  • Music Theory and Analysis
  • Musical Scores, Lyrics, and Libretti
  • Musical Structures, Styles, and Techniques
  • Musicology and Music History
  • Performance Practice and Studies
  • Race and Ethnicity in Music
  • Sound Studies
  • Browse content in Performing Arts
  • Browse content in Philosophy
  • Aesthetics and Philosophy of Art
  • Epistemology
  • Feminist Philosophy
  • History of Western Philosophy
  • Metaphysics
  • Moral Philosophy
  • Non-Western Philosophy
  • Philosophy of Language
  • Philosophy of Mind
  • Philosophy of Perception
  • Philosophy of Science
  • Philosophy of Action
  • Philosophy of Law
  • Philosophy of Religion
  • Philosophy of Mathematics and Logic
  • Practical Ethics
  • Social and Political Philosophy
  • Browse content in Religion
  • Biblical Studies
  • Christianity
  • East Asian Religions
  • History of Religion
  • Judaism and Jewish Studies
  • Qumran Studies
  • Religion and Education
  • Religion and Health
  • Religion and Politics
  • Religion and Science
  • Religion and Law
  • Religion and Art, Literature, and Music
  • Religious Studies
  • Browse content in Society and Culture
  • Cookery, Food, and Drink
  • Cultural Studies
  • Customs and Traditions
  • Ethical Issues and Debates
  • Hobbies, Games, Arts and Crafts
  • Natural world, Country Life, and Pets
  • Popular Beliefs and Controversial Knowledge
  • Sports and Outdoor Recreation
  • Technology and Society
  • Travel and Holiday
  • Visual Culture
  • Browse content in Law
  • Arbitration
  • Browse content in Company and Commercial Law
  • Commercial Law
  • Company Law
  • Browse content in Comparative Law
  • Systems of Law
  • Competition Law
  • Browse content in Constitutional and Administrative Law
  • Government Powers
  • Judicial Review
  • Local Government Law
  • Military and Defence Law
  • Parliamentary and Legislative Practice
  • Construction Law
  • Contract Law
  • Browse content in Criminal Law
  • Criminal Procedure
  • Criminal Evidence Law
  • Sentencing and Punishment
  • Employment and Labour Law
  • Environment and Energy Law
  • Browse content in Financial Law
  • Banking Law
  • Insolvency Law
  • History of Law
  • Human Rights and Immigration
  • Intellectual Property Law
  • Browse content in International Law
  • Private International Law and Conflict of Laws
  • Public International Law
  • IT and Communications Law
  • Jurisprudence and Philosophy of Law
  • Law and Politics
  • Law and Society
  • Browse content in Legal System and Practice
  • Courts and Procedure
  • Legal Skills and Practice
  • Legal System - Costs and Funding
  • Primary Sources of Law
  • Regulation of Legal Profession
  • Medical and Healthcare Law
  • Browse content in Policing
  • Criminal Investigation and Detection
  • Police and Security Services
  • Police Procedure and Law
  • Police Regional Planning
  • Browse content in Property Law
  • Personal Property Law
  • Restitution
  • Study and Revision
  • Terrorism and National Security Law
  • Browse content in Trusts Law
  • Wills and Probate or Succession
  • Browse content in Medicine and Health
  • Browse content in Allied Health Professions
  • Arts Therapies
  • Clinical Science
  • Dietetics and Nutrition
  • Occupational Therapy
  • Operating Department Practice
  • Physiotherapy
  • Radiography
  • Speech and Language Therapy
  • Browse content in Anaesthetics
  • General Anaesthesia
  • Clinical Neuroscience
  • Browse content in Clinical Medicine
  • Acute Medicine
  • Cardiovascular Medicine
  • Clinical Genetics
  • Clinical Pharmacology and Therapeutics
  • Dermatology
  • Endocrinology and Diabetes
  • Gastroenterology
  • Genito-urinary Medicine
  • Geriatric Medicine
  • Infectious Diseases
  • Medical Toxicology
  • Medical Oncology
  • Pain Medicine
  • Palliative Medicine
  • Rehabilitation Medicine
  • Respiratory Medicine and Pulmonology
  • Rheumatology
  • Sleep Medicine
  • Sports and Exercise Medicine
  • Community Medical Services
  • Critical Care
  • Emergency Medicine
  • Forensic Medicine
  • Haematology
  • History of Medicine
  • Browse content in Medical Skills
  • Clinical Skills
  • Communication Skills
  • Nursing Skills
  • Surgical Skills
  • Browse content in Medical Dentistry
  • Oral and Maxillofacial Surgery
  • Paediatric Dentistry
  • Restorative Dentistry and Orthodontics
  • Surgical Dentistry
  • Medical Ethics
  • Medical Statistics and Methodology
  • Browse content in Neurology
  • Clinical Neurophysiology
  • Neuropathology
  • Nursing Studies
  • Browse content in Obstetrics and Gynaecology
  • Gynaecology
  • Occupational Medicine
  • Ophthalmology
  • Otolaryngology (ENT)
  • Browse content in Paediatrics
  • Neonatology
  • Browse content in Pathology
  • Chemical Pathology
  • Clinical Cytogenetics and Molecular Genetics
  • Histopathology
  • Medical Microbiology and Virology
  • Patient Education and Information
  • Browse content in Pharmacology
  • Psychopharmacology
  • Browse content in Popular Health
  • Caring for Others
  • Complementary and Alternative Medicine
  • Self-help and Personal Development
  • Browse content in Preclinical Medicine
  • Cell Biology
  • Molecular Biology and Genetics
  • Reproduction, Growth and Development
  • Primary Care
  • Professional Development in Medicine
  • Browse content in Psychiatry
  • Addiction Medicine
  • Child and Adolescent Psychiatry
  • Forensic Psychiatry
  • Learning Disabilities
  • Old Age Psychiatry
  • Psychotherapy
  • Browse content in Public Health and Epidemiology
  • Epidemiology
  • Public Health
  • Browse content in Radiology
  • Clinical Radiology
  • Interventional Radiology
  • Nuclear Medicine
  • Radiation Oncology
  • Reproductive Medicine
  • Browse content in Surgery
  • Cardiothoracic Surgery
  • Gastro-intestinal and Colorectal Surgery
  • General Surgery
  • Neurosurgery
  • Paediatric Surgery
  • Peri-operative Care
  • Plastic and Reconstructive Surgery
  • Surgical Oncology
  • Transplant Surgery
  • Trauma and Orthopaedic Surgery
  • Vascular Surgery
  • Browse content in Science and Mathematics
  • Browse content in Biological Sciences
  • Aquatic Biology
  • Biochemistry
  • Bioinformatics and Computational Biology
  • Developmental Biology
  • Ecology and Conservation
  • Evolutionary Biology
  • Genetics and Genomics
  • Microbiology
  • Molecular and Cell Biology
  • Natural History
  • Plant Sciences and Forestry
  • Research Methods in Life Sciences
  • Structural Biology
  • Systems Biology
  • Zoology and Animal Sciences
  • Browse content in Chemistry
  • Analytical Chemistry
  • Computational Chemistry
  • Crystallography
  • Environmental Chemistry
  • Industrial Chemistry
  • Inorganic Chemistry
  • Materials Chemistry
  • Medicinal Chemistry
  • Mineralogy and Gems
  • Organic Chemistry
  • Physical Chemistry
  • Polymer Chemistry
  • Study and Communication Skills in Chemistry
  • Theoretical Chemistry
  • Browse content in Computer Science
  • Artificial Intelligence
  • Computer Architecture and Logic Design
  • Game Studies
  • Human-Computer Interaction
  • Mathematical Theory of Computation
  • Programming Languages
  • Software Engineering
  • Systems Analysis and Design
  • Virtual Reality
  • Browse content in Computing
  • Business Applications
  • Computer Security
  • Computer Games
  • Computer Networking and Communications
  • Digital Lifestyle
  • Graphical and Digital Media Applications
  • Operating Systems
  • Browse content in Earth Sciences and Geography
  • Atmospheric Sciences
  • Environmental Geography
  • Geology and the Lithosphere
  • Maps and Map-making
  • Meteorology and Climatology
  • Oceanography and Hydrology
  • Palaeontology
  • Physical Geography and Topography
  • Regional Geography
  • Soil Science
  • Urban Geography
  • Browse content in Engineering and Technology
  • Agriculture and Farming
  • Biological Engineering
  • Civil Engineering, Surveying, and Building
  • Electronics and Communications Engineering
  • Energy Technology
  • Engineering (General)
  • Environmental Science, Engineering, and Technology
  • History of Engineering and Technology
  • Mechanical Engineering and Materials
  • Technology of Industrial Chemistry
  • Transport Technology and Trades
  • Browse content in Environmental Science
  • Applied Ecology (Environmental Science)
  • Conservation of the Environment (Environmental Science)
  • Environmental Sustainability
  • Environmentalist Thought and Ideology (Environmental Science)
  • Management of Land and Natural Resources (Environmental Science)
  • Natural Disasters (Environmental Science)
  • Nuclear Issues (Environmental Science)
  • Pollution and Threats to the Environment (Environmental Science)
  • Social Impact of Environmental Issues (Environmental Science)
  • History of Science and Technology
  • Browse content in Materials Science
  • Ceramics and Glasses
  • Composite Materials
  • Metals, Alloying, and Corrosion
  • Nanotechnology
  • Browse content in Mathematics
  • Applied Mathematics
  • Biomathematics and Statistics
  • History of Mathematics
  • Mathematical Education
  • Mathematical Finance
  • Mathematical Analysis
  • Numerical and Computational Mathematics
  • Probability and Statistics
  • Pure Mathematics
  • Browse content in Neuroscience
  • Cognition and Behavioural Neuroscience
  • Development of the Nervous System
  • Disorders of the Nervous System
  • History of Neuroscience
  • Invertebrate Neurobiology
  • Molecular and Cellular Systems
  • Neuroendocrinology and Autonomic Nervous System
  • Neuroscientific Techniques
  • Sensory and Motor Systems
  • Browse content in Physics
  • Astronomy and Astrophysics
  • Atomic, Molecular, and Optical Physics
  • Biological and Medical Physics
  • Classical Mechanics
  • Computational Physics
  • Condensed Matter Physics
  • Electromagnetism, Optics, and Acoustics
  • History of Physics
  • Mathematical and Statistical Physics
  • Measurement Science
  • Nuclear Physics
  • Particles and Fields
  • Plasma Physics
  • Quantum Physics
  • Relativity and Gravitation
  • Semiconductor and Mesoscopic Physics
  • Browse content in Psychology
  • Affective Sciences
  • Clinical Psychology
  • Cognitive Psychology
  • Cognitive Neuroscience
  • Criminal and Forensic Psychology
  • Developmental Psychology
  • Educational Psychology
  • Evolutionary Psychology
  • Health Psychology
  • History and Systems in Psychology
  • Music Psychology
  • Neuropsychology
  • Organizational Psychology
  • Psychological Assessment and Testing
  • Psychology of Human-Technology Interaction
  • Psychology Professional Development and Training
  • Research Methods in Psychology
  • Social Psychology
  • Browse content in Social Sciences
  • Browse content in Anthropology
  • Anthropology of Religion
  • Human Evolution
  • Medical Anthropology
  • Physical Anthropology
  • Regional Anthropology
  • Social and Cultural Anthropology
  • Theory and Practice of Anthropology
  • Browse content in Business and Management
  • Business Ethics
  • Business Strategy
  • Business History
  • Business and Technology
  • Business and Government
  • Business and the Environment
  • Comparative Management
  • Corporate Governance
  • Corporate Social Responsibility
  • Entrepreneurship
  • Health Management
  • Human Resource Management
  • Industrial and Employment Relations
  • Industry Studies
  • Information and Communication Technologies
  • International Business
  • Knowledge Management
  • Management and Management Techniques
  • Operations Management
  • Organizational Theory and Behaviour
  • Pensions and Pension Management
  • Public and Nonprofit Management
  • Social Issues in Business and Management
  • Strategic Management
  • Supply Chain Management
  • Browse content in Criminology and Criminal Justice
  • Criminal Justice
  • Criminology
  • Forms of Crime
  • International and Comparative Criminology
  • Youth Violence and Juvenile Justice
  • Development Studies
  • Browse content in Economics
  • Agricultural, Environmental, and Natural Resource Economics
  • Asian Economics
  • Behavioural Finance
  • Behavioural Economics and Neuroeconomics
  • Econometrics and Mathematical Economics
  • Economic History
  • Economic Systems
  • Economic Methodology
  • Economic Development and Growth
  • Financial Markets
  • Financial Institutions and Services
  • General Economics and Teaching
  • Health, Education, and Welfare
  • History of Economic Thought
  • International Economics
  • Labour and Demographic Economics
  • Law and Economics
  • Macroeconomics and Monetary Economics
  • Microeconomics
  • Public Economics
  • Urban, Rural, and Regional Economics
  • Welfare Economics
  • Browse content in Education
  • Adult Education and Continuous Learning
  • Care and Counselling of Students
  • Early Childhood and Elementary Education
  • Educational Equipment and Technology
  • Educational Strategies and Policy
  • Higher and Further Education
  • Organization and Management of Education
  • Philosophy and Theory of Education
  • Schools Studies
  • Secondary Education
  • Teaching of a Specific Subject
  • Teaching of Specific Groups and Special Educational Needs
  • Teaching Skills and Techniques
  • Browse content in Environment
  • Applied Ecology (Social Science)
  • Climate Change
  • Conservation of the Environment (Social Science)
  • Environmentalist Thought and Ideology (Social Science)
  • Management of Land and Natural Resources (Social Science)
  • Natural Disasters (Environment)
  • Pollution and Threats to the Environment (Social Science)
  • Social Impact of Environmental Issues (Social Science)
  • Sustainability
  • Browse content in Human Geography
  • Cultural Geography
  • Economic Geography
  • Political Geography
  • Browse content in Interdisciplinary Studies
  • Communication Studies
  • Museums, Libraries, and Information Sciences
  • Browse content in Politics
  • African Politics
  • Asian Politics
  • Chinese Politics
  • Comparative Politics
  • Conflict Politics
  • Elections and Electoral Studies
  • Environmental Politics
  • Ethnic Politics
  • European Union
  • Foreign Policy
  • Gender and Politics
  • Human Rights and Politics
  • Indian Politics
  • International Relations
  • International Organization (Politics)
  • Irish Politics
  • Latin American Politics
  • Middle Eastern Politics
  • Political Behaviour
  • Political Economy
  • Political Institutions
  • Political Methodology
  • Political Communication
  • Political Philosophy
  • Political Sociology
  • Political Theory
  • Politics and Law
  • Politics of Development
  • Public Policy
  • Public Administration
  • Qualitative Political Methodology
  • Quantitative Political Methodology
  • Regional Political Studies
  • Russian Politics
  • Security Studies
  • State and Local Government
  • UK Politics
  • US Politics
  • Browse content in Regional and Area Studies
  • African Studies
  • Asian Studies
  • East Asian Studies
  • Japanese Studies
  • Latin American Studies
  • Middle Eastern Studies
  • Native American Studies
  • Scottish Studies
  • Browse content in Research and Information
  • Research Methods
  • Browse content in Social Work
  • Addictions and Substance Misuse
  • Adoption and Fostering
  • Care of the Elderly
  • Child and Adolescent Social Work
  • Couple and Family Social Work
  • Direct Practice and Clinical Social Work
  • Emergency Services
  • Human Behaviour and the Social Environment
  • International and Global Issues in Social Work
  • Mental and Behavioural Health
  • Social Justice and Human Rights
  • Social Policy and Advocacy
  • Social Work and Crime and Justice
  • Social Work Macro Practice
  • Social Work Practice Settings
  • Social Work Research and Evidence-based Practice
  • Welfare and Benefit Systems
  • Browse content in Sociology
  • Childhood Studies
  • Community Development
  • Comparative and Historical Sociology
  • Disability Studies
  • Economic Sociology
  • Gender and Sexuality
  • Gerontology and Ageing
  • Health, Illness, and Medicine
  • Marriage and the Family
  • Migration Studies
  • Occupations, Professions, and Work
  • Organizations
  • Population and Demography
  • Race and Ethnicity
  • Social Theory
  • Social Movements and Social Change
  • Social Research and Statistics
  • Social Stratification, Inequality, and Mobility
  • Sociology of Religion
  • Sociology of Education
  • Sport and Leisure
  • Urban and Rural Studies
  • Browse content in Warfare and Defence
  • Defence Strategy, Planning, and Research
  • Land Forces and Warfare
  • Military Administration
  • Military Life and Institutions
  • Naval Forces and Warfare
  • Other Warfare and Defence Issues
  • Peace Studies and Conflict Resolution
  • Weapons and Equipment

Validity and Validation

  • < Previous
  • Next chapter >

1 Validity and Validation in Research and Assessment

  • Published: October 2013
  • Cite Icon Cite
  • Permissions Icon Permissions

This chapter first sets out the book's purpose, namely to further define validity and to explore the factors that should be considered when evaluating claims from research and assessment. It then discusses validity theory and its philosophical foundations, with connections between the philosophical foundations and specific ways validation is considered in research and measurement. An overview of the subsequent chapters is also presented.

Personal account

  • Sign in with email/username & password
  • Get email alerts
  • Save searches
  • Purchase content
  • Activate your purchase/trial code
  • Add your ORCID iD

Institutional access

Sign in with a library card.

  • Sign in with username/password
  • Recommend to your librarian
  • Institutional account management
  • Get help with access

Access to content on Oxford Academic is often provided through institutional subscriptions and purchases. If you are a member of an institution with an active account, you may be able to access content in one of the following ways:

IP based access

Typically, access is provided across an institutional network to a range of IP addresses. This authentication occurs automatically, and it is not possible to sign out of an IP authenticated account.

Choose this option to get remote access when outside your institution. Shibboleth/Open Athens technology is used to provide single sign-on between your institution’s website and Oxford Academic.

  • Click Sign in through your institution.
  • Select your institution from the list provided, which will take you to your institution's website to sign in.
  • When on the institution site, please use the credentials provided by your institution. Do not use an Oxford Academic personal account.
  • Following successful sign in, you will be returned to Oxford Academic.

If your institution is not listed or you cannot sign in to your institution’s website, please contact your librarian or administrator.

Enter your library card number to sign in. If you cannot sign in, please contact your librarian.

Society Members

Society member access to a journal is achieved in one of the following ways:

Sign in through society site

Many societies offer single sign-on between the society website and Oxford Academic. If you see ‘Sign in through society site’ in the sign in pane within a journal:

  • Click Sign in through society site.
  • When on the society site, please use the credentials provided by that society. Do not use an Oxford Academic personal account.

If you do not have a society account or have forgotten your username or password, please contact your society.

Sign in using a personal account

Some societies use Oxford Academic personal accounts to provide access to their members. See below.

A personal account can be used to get email alerts, save searches, purchase content, and activate subscriptions.

Some societies use Oxford Academic personal accounts to provide access to their members.

Viewing your signed in accounts

Click the account icon in the top right to:

  • View your signed in personal account and access account management features.
  • View the institutional accounts that are providing access.

Signed in but can't access content

Oxford Academic is home to a wide variety of products. The institutional subscription may not cover the content that you are trying to access. If you believe you should have access to that content, please contact your librarian.

For librarians and administrators, your personal account also provides access to institutional account management. Here you will find options to view and activate subscriptions, manage institutional settings and access options, access usage statistics, and more.

Our books are available by subscription or purchase to libraries and institutions.

Month: Total Views:
October 2022 16
November 2022 10
December 2022 9
January 2023 3
February 2023 10
March 2023 31
April 2023 14
May 2023 15
June 2023 3
July 2023 6
August 2023 10
September 2023 10
October 2023 9
November 2023 7
December 2023 7
January 2024 11
February 2024 10
March 2024 12
April 2024 24
May 2024 29
June 2024 6
July 2024 6
August 2024 3
  • About Oxford Academic
  • Publish journals with us
  • University press partners
  • What we publish
  • New features  
  • Open access
  • Rights and permissions
  • Accessibility
  • Advertising
  • Media enquiries
  • Oxford University Press
  • Oxford Languages
  • University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

  • Copyright © 2024 Oxford University Press
  • Cookie settings
  • Cookie policy
  • Privacy policy
  • Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Validity in research: a guide to measuring the right things

Last updated

27 February 2023

Reviewed by

Cathy Heath

Short on time? Get an AI generated summary of this article instead

Validity is necessary for all types of studies ranging from market validation of a business or product idea to the effectiveness of medical trials and procedures. So, how can you determine whether your research is valid? This guide can help you understand what validity is, the types of validity in research, and the factors that affect research validity.

Make research less tedious

Dovetail streamlines research to help you uncover and share actionable insights

  • What is validity?

In the most basic sense, validity is the quality of being based on truth or reason. Valid research strives to eliminate the effects of unrelated information and the circumstances under which evidence is collected. 

Validity in research is the ability to conduct an accurate study with the right tools and conditions to yield acceptable and reliable data that can be reproduced. Researchers rely on carefully calibrated tools for precise measurements. However, collecting accurate information can be more of a challenge.

Studies must be conducted in environments that don't sway the results to achieve and maintain validity. They can be compromised by asking the wrong questions or relying on limited data. 

Why is validity important in research?

Research is used to improve life for humans. Every product and discovery, from innovative medical breakthroughs to advanced new products, depends on accurate research to be dependable. Without it, the results couldn't be trusted, and products would likely fail. Businesses would lose money, and patients couldn't rely on medical treatments. 

While wasting money on a lousy product is a concern, lack of validity paints a much grimmer picture in the medical field or producing automobiles and airplanes, for example. Whether you're launching an exciting new product or conducting scientific research, validity can determine success and failure.

  • What is reliability?

Reliability is the ability of a method to yield consistency. If the same result can be consistently achieved by using the same method to measure something, the measurement method is said to be reliable. For example, a thermometer that shows the same temperatures each time in a controlled environment is reliable.

While high reliability is a part of measuring validity, it's only part of the puzzle. If the reliable thermometer hasn't been properly calibrated and reliably measures temperatures two degrees too high, it doesn't provide a valid (accurate) measure of temperature. 

Similarly, if a researcher uses a thermometer to measure weight, the results won't be accurate because it's the wrong tool for the job. 

  • How are reliability and validity assessed?

While measuring reliability is a part of measuring validity, there are distinct ways to assess both measurements for accuracy. 

How is reliability measured?

These measures of consistency and stability help assess reliability, including:

Consistency and stability of the same measure when repeated multiple times and conditions

Consistency and stability of the measure across different test subjects

Consistency and stability of results from different parts of a test designed to measure the same thing

How is validity measured?

Since validity refers to how accurately a method measures what it is intended to measure, it can be difficult to assess the accuracy. Validity can be estimated by comparing research results to other relevant data or theories.

The adherence of a measure to existing knowledge of how the concept is measured

The ability to cover all aspects of the concept being measured

The relation of the result in comparison with other valid measures of the same concept

  • What are the types of validity in a research design?

Research validity is broadly gathered into two groups: internal and external. Yet, this grouping doesn't clearly define the different types of validity. Research validity can be divided into seven distinct groups.

Face validity : A test that appears valid simply because of the appropriateness or relativity of the testing method, included information, or tools used.

Content validity : The determination that the measure used in research covers the full domain of the content.

Construct validity : The assessment of the suitability of the measurement tool to measure the activity being studied.

Internal validity : The assessment of how your research environment affects measurement results. This is where other factors can’t explain the extent of an observed cause-and-effect response.

External validity : The extent to which the study will be accurate beyond the sample and the level to which it can be generalized in other settings, populations, and measures.

Statistical conclusion validity: The determination of whether a relationship exists between procedures and outcomes (appropriate sampling and measuring procedures along with appropriate statistical tests).

Criterion-related validity : A measurement of the quality of your testing methods against a criterion measure (like a “gold standard” test) that is measured at the same time.

  • Examples of validity

Like different types of research and the various ways to measure validity, examples of validity can vary widely. These include:

A questionnaire may be considered valid because each question addresses specific and relevant aspects of the study subject.

In a brand assessment study, researchers can use comparison testing to verify the results of an initial study. For example, the results from a focus group response about brand perception are considered more valid when the results match that of a questionnaire answered by current and potential customers.

A test to measure a class of students' understanding of the English language contains reading, writing, listening, and speaking components to cover the full scope of how language is used.

  • Factors that affect research validity

Certain factors can affect research validity in both positive and negative ways. By understanding the factors that improve validity and those that threaten it, you can enhance the validity of your study. These include:

Random selection of participants vs. the selection of participants that are representative of your study criteria

Blinding with interventions the participants are unaware of (like the use of placebos)

Manipulating the experiment by inserting a variable that will change the results

Randomly assigning participants to treatment and control groups to avoid bias

Following specific procedures during the study to avoid unintended effects

Conducting a study in the field instead of a laboratory for more accurate results

Replicating the study with different factors or settings to compare results

Using statistical methods to adjust for inconclusive data

What are the common validity threats in research, and how can their effects be minimized or nullified?

Research validity can be difficult to achieve because of internal and external threats that produce inaccurate results. These factors can jeopardize validity.

History: Events that occur between an early and later measurement

Maturation: The passage of time in a study can include data on actions that would have naturally occurred outside of the settings of the study

Repeated testing: The outcome of repeated tests can change the outcome of followed tests

Selection of subjects: Unconscious bias which can result in the selection of uniform comparison groups

Statistical regression: Choosing subjects based on extremes doesn't yield an accurate outcome for the majority of individuals

Attrition: When the sample group is diminished significantly during the course of the study

Maturation: When subjects mature during the study, and natural maturation is awarded to the effects of the study

While some validity threats can be minimized or wholly nullified, removing all threats from a study is impossible. For example, random selection can remove unconscious bias and statistical regression. 

Researchers can even hope to avoid attrition by using smaller study groups. Yet, smaller study groups could potentially affect the research in other ways. The best practice for researchers to prevent validity threats is through careful environmental planning and t reliable data-gathering methods. 

  • How to ensure validity in your research

Researchers should be mindful of the importance of validity in the early planning stages of any study to avoid inaccurate results. Researchers must take the time to consider tools and methods as well as how the testing environment matches closely with the natural environment in which results will be used.

The following steps can be used to ensure validity in research:

Choose appropriate methods of measurement

Use appropriate sampling to choose test subjects

Create an accurate testing environment

How do you maintain validity in research?

Accurate research is usually conducted over a period of time with different test subjects. To maintain validity across an entire study, you must take specific steps to ensure that gathered data has the same levels of accuracy. 

Consistency is crucial for maintaining validity in research. When researchers apply methods consistently and standardize the circumstances under which data is collected, validity can be maintained across the entire study.

Is there a need for validation of the research instrument before its implementation?

An essential part of validity is choosing the right research instrument or method for accurate results. Consider the thermometer that is reliable but still produces inaccurate results. You're unlikely to achieve research validity without activities like calibration, content, and construct validity.

  • Understanding research validity for more accurate results

Without validity, research can't provide the accuracy necessary to deliver a useful study. By getting a clear understanding of validity in research, you can take steps to improve your research skills and achieve more accurate results.

Should you be using a customer insights hub?

Do you want to discover previous research faster?

Do you share your research findings with others?

Do you analyze research data?

Start for free today, add your research, and get to key insights faster

Editor’s picks

Last updated: 18 April 2023

Last updated: 27 February 2023

Last updated: 6 February 2023

Last updated: 5 February 2023

Last updated: 16 April 2023

Last updated: 9 March 2023

Last updated: 30 April 2024

Last updated: 12 December 2023

Last updated: 11 March 2024

Last updated: 4 July 2024

Last updated: 6 March 2024

Last updated: 5 March 2024

Last updated: 13 May 2024

Latest articles

Related topics, .css-je19u9{-webkit-align-items:flex-end;-webkit-box-align:flex-end;-ms-flex-align:flex-end;align-items:flex-end;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-flex-direction:row;-ms-flex-direction:row;flex-direction:row;-webkit-box-flex-wrap:wrap;-webkit-flex-wrap:wrap;-ms-flex-wrap:wrap;flex-wrap:wrap;-webkit-box-pack:center;-ms-flex-pack:center;-webkit-justify-content:center;justify-content:center;row-gap:0;text-align:center;max-width:671px;}@media (max-width: 1079px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}}@media (max-width: 799px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}} decide what to .css-1kiodld{max-height:56px;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}@media (max-width: 1079px){.css-1kiodld{display:none;}} build next, decide what to build next, log in or sign up.

Get started for free

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

  • Knowledge Base
  • Methodology
  • Reliability vs Validity in Research | Differences, Types & Examples

Reliability vs Validity in Research | Differences, Types & Examples

Published on 3 May 2022 by Fiona Middleton . Revised on 10 October 2022.

Reliability and validity are concepts used to evaluate the quality of research. They indicate how well a method , technique, or test measures something. Reliability is about the consistency of a measure, and validity is about the accuracy of a measure.

It’s important to consider reliability and validity when you are creating your research design , planning your methods, and writing up your results, especially in quantitative research .

Reliability vs validity
Reliability Validity
What does it tell you? The extent to which the results can be reproduced when the research is repeated under the same conditions. The extent to which the results really measure what they are supposed to measure.
How is it assessed? By checking the consistency of results across time, across different observers, and across parts of the test itself. By checking how well the results correspond to established theories and other measures of the same concept.
How do they relate? A reliable measurement is not always valid: the results might be reproducible, but they’re not necessarily correct. A valid measurement is generally reliable: if a test produces accurate results, they should be .

Table of contents

Understanding reliability vs validity, how are reliability and validity assessed, how to ensure validity and reliability in your research, where to write about reliability and validity in a thesis.

Reliability and validity are closely related, but they mean different things. A measurement can be reliable without being valid. However, if a measurement is valid, it is usually also reliable.

What is reliability?

Reliability refers to how consistently a method measures something. If the same result can be consistently achieved by using the same methods under the same circumstances, the measurement is considered reliable.

What is validity?

Validity refers to how accurately a method measures what it is intended to measure. If research has high validity, that means it produces results that correspond to real properties, characteristics, and variations in the physical or social world.

High reliability is one indicator that a measurement is valid. If a method is not reliable, it probably isn’t valid.

However, reliability on its own is not enough to ensure validity. Even if a test is reliable, it may not accurately reflect the real situation.

Validity is harder to assess than reliability, but it is even more important. To obtain useful results, the methods you use to collect your data must be valid: the research must be measuring what it claims to measure. This ensures that your discussion of the data and the conclusions you draw are also valid.

Prevent plagiarism, run a free check.

Reliability can be estimated by comparing different versions of the same measurement. Validity is harder to assess, but it can be estimated by comparing the results to other relevant data or theory. Methods of estimating reliability and validity are usually split up into different types.

Types of reliability

Different types of reliability can be estimated through various statistical methods.

Type of reliability What does it assess? Example
The consistency of a measure : do you get the same results when you repeat the measurement? A group of participants complete a designed to measure personality traits. If they repeat the questionnaire days, weeks, or months apart and give the same answers, this indicates high test-retest reliability.
The consistency of a measure : do you get the same results when different people conduct the same measurement? Based on an assessment criteria checklist, five examiners submit substantially different results for the same student project. This indicates that the assessment checklist has low inter-rater reliability (for example, because the criteria are too subjective).
The consistency of : do you get the same results from different parts of a test that are designed to measure the same thing? You design a questionnaire to measure self-esteem. If you randomly split the results into two halves, there should be a between the two sets of results. If the two results are very different, this indicates low internal consistency.

Types of validity

The validity of a measurement can be estimated based on three main types of evidence. Each type can be evaluated through expert judgement or statistical methods.

Type of validity What does it assess? Example
The adherence of a measure to  of the concept being measured. A self-esteem questionnaire could be assessed by measuring other traits known or assumed to be related to the concept of self-esteem (such as social skills and optimism). Strong correlation between the scores for self-esteem and associated traits would indicate high construct validity.
The extent to which the measurement  of the concept being measured. A test that aims to measure a class of students’ level of Spanish contains reading, writing, and speaking components, but no listening component.  Experts agree that listening comprehension is an essential aspect of language ability, so the test lacks content validity for measuring the overall level of ability in Spanish.
The extent to which the result of a measure corresponds to of the same concept. A is conducted to measure the political opinions of voters in a region. If the results accurately predict the later outcome of an election in that region, this indicates that the survey has high criterion validity.

To assess the validity of a cause-and-effect relationship, you also need to consider internal validity (the design of the experiment ) and external validity (the generalisability of the results).

The reliability and validity of your results depends on creating a strong research design , choosing appropriate methods and samples, and conducting the research carefully and consistently.

Ensuring validity

If you use scores or ratings to measure variations in something (such as psychological traits, levels of ability, or physical properties), it’s important that your results reflect the real variations as accurately as possible. Validity should be considered in the very earliest stages of your research, when you decide how you will collect your data .

  • Choose appropriate methods of measurement

Ensure that your method and measurement technique are of high quality and targeted to measure exactly what you want to know. They should be thoroughly researched and based on existing knowledge.

For example, to collect data on a personality trait, you could use a standardised questionnaire that is considered reliable and valid. If you develop your own questionnaire, it should be based on established theory or the findings of previous studies, and the questions should be carefully and precisely worded.

  • Use appropriate sampling methods to select your subjects

To produce valid generalisable results, clearly define the population you are researching (e.g., people from a specific age range, geographical location, or profession). Ensure that you have enough participants and that they are representative of the population.

Ensuring reliability

Reliability should be considered throughout the data collection process. When you use a tool or technique to collect data, it’s important that the results are precise, stable, and reproducible.

  • Apply your methods consistently

Plan your method carefully to make sure you carry out the same steps in the same way for each measurement. This is especially important if multiple researchers are involved.

For example, if you are conducting interviews or observations, clearly define how specific behaviours or responses will be counted, and make sure questions are phrased the same way each time.

  • Standardise the conditions of your research

When you collect your data, keep the circumstances as consistent as possible to reduce the influence of external factors that might create variation in the results.

For example, in an experimental setup, make sure all participants are given the same information and tested under the same conditions.

It’s appropriate to discuss reliability and validity in various sections of your thesis or dissertation or research paper. Showing that you have taken them into account in planning your research and interpreting the results makes your work more credible and trustworthy.

Reliability and validity in a thesis
Section Discuss
What have other researchers done to devise and improve methods that are reliable and valid?
How did you plan your research to ensure reliability and validity of the measures used? This includes the chosen sample set and size, sample preparation, external conditions, and measuring techniques.
If you calculate reliability and validity, state these values alongside your main results.
This is the moment to talk about how reliable and valid your results actually were. Were they consistent, and did they reflect true values? If not, why not?
If reliability and validity were a big problem for your findings, it might be helpful to mention this here.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

Middleton, F. (2022, October 10). Reliability vs Validity in Research | Differences, Types & Examples. Scribbr. Retrieved 5 August 2024, from https://www.scribbr.co.uk/research-methods/reliability-or-validity/

Is this article helpful?

Fiona Middleton

Fiona Middleton

Other students also liked, the 4 types of validity | types, definitions & examples, a quick guide to experimental design | 5 steps & examples, sampling methods | types, techniques, & examples.

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • J Family Med Prim Care
  • v.4(3); Jul-Sep 2015

Validity, reliability, and generalizability in qualitative research

Lawrence leung.

1 Department of Family Medicine, Queen's University, Kingston, Ontario, Canada

2 Centre of Studies in Primary Care, Queen's University, Kingston, Ontario, Canada

In general practice, qualitative research contributes as significantly as quantitative research, in particular regarding psycho-social aspects of patient-care, health services provision, policy setting, and health administrations. In contrast to quantitative research, qualitative research as a whole has been constantly critiqued, if not disparaged, by the lack of consensus for assessing its quality and robustness. This article illustrates with five published studies how qualitative research can impact and reshape the discipline of primary care, spiraling out from clinic-based health screening to community-based disease monitoring, evaluation of out-of-hours triage services to provincial psychiatric care pathways model and finally, national legislation of core measures for children's healthcare insurance. Fundamental concepts of validity, reliability, and generalizability as applicable to qualitative research are then addressed with an update on the current views and controversies.

Nature of Qualitative Research versus Quantitative Research

The essence of qualitative research is to make sense of and recognize patterns among words in order to build up a meaningful picture without compromising its richness and dimensionality. Like quantitative research, the qualitative research aims to seek answers for questions of “how, where, when who and why” with a perspective to build a theory or refute an existing theory. Unlike quantitative research which deals primarily with numerical data and their statistical interpretations under a reductionist, logical and strictly objective paradigm, qualitative research handles nonnumerical information and their phenomenological interpretation, which inextricably tie in with human senses and subjectivity. While human emotions and perspectives from both subjects and researchers are considered undesirable biases confounding results in quantitative research, the same elements are considered essential and inevitable, if not treasurable, in qualitative research as they invariable add extra dimensions and colors to enrich the corpus of findings. However, the issue of subjectivity and contextual ramifications has fueled incessant controversies regarding yardsticks for quality and trustworthiness of qualitative research results for healthcare.

Impact of Qualitative Research upon Primary Care

In many ways, qualitative research contributes significantly, if not more so than quantitative research, to the field of primary care at various levels. Five qualitative studies are chosen to illustrate how various methodologies of qualitative research helped in advancing primary healthcare, from novel monitoring of chronic obstructive pulmonary disease (COPD) via mobile-health technology,[ 1 ] informed decision for colorectal cancer screening,[ 2 ] triaging out-of-hours GP services,[ 3 ] evaluating care pathways for community psychiatry[ 4 ] and finally prioritization of healthcare initiatives for legislation purposes at national levels.[ 5 ] With the recent advances of information technology and mobile connecting device, self-monitoring and management of chronic diseases via tele-health technology may seem beneficial to both the patient and healthcare provider. Recruiting COPD patients who were given tele-health devices that monitored lung functions, Williams et al. [ 1 ] conducted phone interviews and analyzed their transcripts via a grounded theory approach, identified themes which enabled them to conclude that such mobile-health setup and application helped to engage patients with better adherence to treatment and overall improvement in mood. Such positive findings were in contrast to previous studies, which opined that elderly patients were often challenged by operating computer tablets,[ 6 ] or, conversing with the tele-health software.[ 7 ] To explore the content of recommendations for colorectal cancer screening given out by family physicians, Wackerbarth, et al. [ 2 ] conducted semi-structure interviews with subsequent content analysis and found that most physicians delivered information to enrich patient knowledge with little regard to patients’ true understanding, ideas, and preferences in the matter. These findings suggested room for improvement for family physicians to better engage their patients in recommending preventative care. Faced with various models of out-of-hours triage services for GP consultations, Egbunike et al. [ 3 ] conducted thematic analysis on semi-structured telephone interviews with patients and doctors in various urban, rural and mixed settings. They found that the efficiency of triage services remained a prime concern from both users and providers, among issues of access to doctors and unfulfilled/mismatched expectations from users, which could arouse dissatisfaction and legal implications. In UK, a care pathways model for community psychiatry had been introduced but its benefits were unclear. Khandaker et al. [ 4 ] hence conducted a qualitative study using semi-structure interviews with medical staff and other stakeholders; adopting a grounded-theory approach, major themes emerged which included improved equality of access, more focused logistics, increased work throughput and better accountability for community psychiatry provided under the care pathway model. Finally, at the US national level, Mangione-Smith et al. [ 5 ] employed a modified Delphi method to gather consensus from a panel of nominators which were recognized experts and stakeholders in their disciplines, and identified a core set of quality measures for children's healthcare under the Medicaid and Children's Health Insurance Program. These core measures were made transparent for public opinion and later passed on for full legislation, hence illustrating the impact of qualitative research upon social welfare and policy improvement.

Overall Criteria for Quality in Qualitative Research

Given the diverse genera and forms of qualitative research, there is no consensus for assessing any piece of qualitative research work. Various approaches have been suggested, the two leading schools of thoughts being the school of Dixon-Woods et al. [ 8 ] which emphasizes on methodology, and that of Lincoln et al. [ 9 ] which stresses the rigor of interpretation of results. By identifying commonalities of qualitative research, Dixon-Woods produced a checklist of questions for assessing clarity and appropriateness of the research question; the description and appropriateness for sampling, data collection and data analysis; levels of support and evidence for claims; coherence between data, interpretation and conclusions, and finally level of contribution of the paper. These criteria foster the 10 questions for the Critical Appraisal Skills Program checklist for qualitative studies.[ 10 ] However, these methodology-weighted criteria may not do justice to qualitative studies that differ in epistemological and philosophical paradigms,[ 11 , 12 ] one classic example will be positivistic versus interpretivistic.[ 13 ] Equally, without a robust methodological layout, rigorous interpretation of results advocated by Lincoln et al. [ 9 ] will not be good either. Meyrick[ 14 ] argued from a different angle and proposed fulfillment of the dual core criteria of “transparency” and “systematicity” for good quality qualitative research. In brief, every step of the research logistics (from theory formation, design of study, sampling, data acquisition and analysis to results and conclusions) has to be validated if it is transparent or systematic enough. In this manner, both the research process and results can be assured of high rigor and robustness.[ 14 ] Finally, Kitto et al. [ 15 ] epitomized six criteria for assessing overall quality of qualitative research: (i) Clarification and justification, (ii) procedural rigor, (iii) sample representativeness, (iv) interpretative rigor, (v) reflexive and evaluative rigor and (vi) transferability/generalizability, which also double as evaluative landmarks for manuscript review to the Medical Journal of Australia. Same for quantitative research, quality for qualitative research can be assessed in terms of validity, reliability, and generalizability.

Validity in qualitative research means “appropriateness” of the tools, processes, and data. Whether the research question is valid for the desired outcome, the choice of methodology is appropriate for answering the research question, the design is valid for the methodology, the sampling and data analysis is appropriate, and finally the results and conclusions are valid for the sample and context. In assessing validity of qualitative research, the challenge can start from the ontology and epistemology of the issue being studied, e.g. the concept of “individual” is seen differently between humanistic and positive psychologists due to differing philosophical perspectives:[ 16 ] Where humanistic psychologists believe “individual” is a product of existential awareness and social interaction, positive psychologists think the “individual” exists side-by-side with formation of any human being. Set off in different pathways, qualitative research regarding the individual's wellbeing will be concluded with varying validity. Choice of methodology must enable detection of findings/phenomena in the appropriate context for it to be valid, with due regard to culturally and contextually variable. For sampling, procedures and methods must be appropriate for the research paradigm and be distinctive between systematic,[ 17 ] purposeful[ 18 ] or theoretical (adaptive) sampling[ 19 , 20 ] where the systematic sampling has no a priori theory, purposeful sampling often has a certain aim or framework and theoretical sampling is molded by the ongoing process of data collection and theory in evolution. For data extraction and analysis, several methods were adopted to enhance validity, including 1 st tier triangulation (of researchers) and 2 nd tier triangulation (of resources and theories),[ 17 , 21 ] well-documented audit trail of materials and processes,[ 22 , 23 , 24 ] multidimensional analysis as concept- or case-orientated[ 25 , 26 ] and respondent verification.[ 21 , 27 ]

Reliability

In quantitative research, reliability refers to exact replicability of the processes and the results. In qualitative research with diverse paradigms, such definition of reliability is challenging and epistemologically counter-intuitive. Hence, the essence of reliability for qualitative research lies with consistency.[ 24 , 28 ] A margin of variability for results is tolerated in qualitative research provided the methodology and epistemological logistics consistently yield data that are ontologically similar but may differ in richness and ambience within similar dimensions. Silverman[ 29 ] proposed five approaches in enhancing the reliability of process and results: Refutational analysis, constant data comparison, comprehensive data use, inclusive of the deviant case and use of tables. As data were extracted from the original sources, researchers must verify their accuracy in terms of form and context with constant comparison,[ 27 ] either alone or with peers (a form of triangulation).[ 30 ] The scope and analysis of data included should be as comprehensive and inclusive with reference to quantitative aspects if possible.[ 30 ] Adopting the Popperian dictum of falsifiability as essence of truth and science, attempted to refute the qualitative data and analytes should be performed to assess reliability.[ 31 ]

Generalizability

Most qualitative research studies, if not all, are meant to study a specific issue or phenomenon in a certain population or ethnic group, of a focused locality in a particular context, hence generalizability of qualitative research findings is usually not an expected attribute. However, with rising trend of knowledge synthesis from qualitative research via meta-synthesis, meta-narrative or meta-ethnography, evaluation of generalizability becomes pertinent. A pragmatic approach to assessing generalizability for qualitative studies is to adopt same criteria for validity: That is, use of systematic sampling, triangulation and constant comparison, proper audit and documentation, and multi-dimensional theory.[ 17 ] However, some researchers espouse the approach of analytical generalization[ 32 ] where one judges the extent to which the findings in one study can be generalized to another under similar theoretical, and the proximal similarity model, where generalizability of one study to another is judged by similarities between the time, place, people and other social contexts.[ 33 ] Thus said, Zimmer[ 34 ] questioned the suitability of meta-synthesis in view of the basic tenets of grounded theory,[ 35 ] phenomenology[ 36 ] and ethnography.[ 37 ] He concluded that any valid meta-synthesis must retain the other two goals of theory development and higher-level abstraction while in search of generalizability, and must be executed as a third level interpretation using Gadamer's concepts of the hermeneutic circle,[ 38 , 39 ] dialogic process[ 38 ] and fusion of horizons.[ 39 ] Finally, Toye et al. [ 40 ] reported the practicality of using “conceptual clarity” and “interpretative rigor” as intuitive criteria for assessing quality in meta-ethnography, which somehow echoed Rolfe's controversial aesthetic theory of research reports.[ 41 ]

Food for Thought

Despite various measures to enhance or ensure quality of qualitative studies, some researchers opined from a purist ontological and epistemological angle that qualitative research is not a unified, but ipso facto diverse field,[ 8 ] hence any attempt to synthesize or appraise different studies under one system is impossible and conceptually wrong. Barbour argued from a philosophical angle that these special measures or “technical fixes” (like purposive sampling, multiple-coding, triangulation, and respondent validation) can never confer the rigor as conceived.[ 11 ] In extremis, Rolfe et al. opined from the field of nursing research, that any set of formal criteria used to judge the quality of qualitative research are futile and without validity, and suggested that any qualitative report should be judged by the form it is written (aesthetic) and not by the contents (epistemic).[ 41 ] Rolfe's novel view is rebutted by Porter,[ 42 ] who argued via logical premises that two of Rolfe's fundamental statements were flawed: (i) “The content of research report is determined by their forms” may not be a fact, and (ii) that research appraisal being “subject to individual judgment based on insight and experience” will mean those without sufficient experience of performing research will be unable to judge adequately – hence an elitist's principle. From a realism standpoint, Porter then proposes multiple and open approaches for validity in qualitative research that incorporate parallel perspectives[ 43 , 44 ] and diversification of meanings.[ 44 ] Any work of qualitative research, when read by the readers, is always a two-way interactive process, such that validity and quality has to be judged by the receiving end too and not by the researcher end alone.

In summary, the three gold criteria of validity, reliability and generalizability apply in principle to assess quality for both quantitative and qualitative research, what differs will be the nature and type of processes that ontologically and epistemologically distinguish between the two.

Source of Support: Nil.

Conflict of Interest: None declared.

  • How it works

researchprospect post subheader

Reliability and Validity – Definitions, Types & Examples

Published by Alvin Nicolas at August 16th, 2021 , Revised On October 26, 2023

A researcher must test the collected data before making any conclusion. Every  research design  needs to be concerned with reliability and validity to measure the quality of the research.

What is Reliability?

Reliability refers to the consistency of the measurement. Reliability shows how trustworthy is the score of the test. If the collected data shows the same results after being tested using various methods and sample groups, the information is reliable. If your method has reliability, the results will be valid.

Example: If you weigh yourself on a weighing scale throughout the day, you’ll get the same results. These are considered reliable results obtained through repeated measures.

Example: If a teacher conducts the same math test of students and repeats it next week with the same questions. If she gets the same score, then the reliability of the test is high.

What is the Validity?

Validity refers to the accuracy of the measurement. Validity shows how a specific test is suitable for a particular situation. If the results are accurate according to the researcher’s situation, explanation, and prediction, then the research is valid. 

If the method of measuring is accurate, then it’ll produce accurate results. If a method is reliable, then it’s valid. In contrast, if a method is not reliable, it’s not valid. 

Example:  Your weighing scale shows different results each time you weigh yourself within a day even after handling it carefully, and weighing before and after meals. Your weighing machine might be malfunctioning. It means your method had low reliability. Hence you are getting inaccurate or inconsistent results that are not valid.

Example:  Suppose a questionnaire is distributed among a group of people to check the quality of a skincare product and repeated the same questionnaire with many groups. If you get the same response from various participants, it means the validity of the questionnaire and product is high as it has high reliability.

Most of the time, validity is difficult to measure even though the process of measurement is reliable. It isn’t easy to interpret the real situation.

Example:  If the weighing scale shows the same result, let’s say 70 kg each time, even if your actual weight is 55 kg, then it means the weighing scale is malfunctioning. However, it was showing consistent results, but it cannot be considered as reliable. It means the method has low reliability.

Internal Vs. External Validity

One of the key features of randomised designs is that they have significantly high internal and external validity.

Internal validity  is the ability to draw a causal link between your treatment and the dependent variable of interest. It means the observed changes should be due to the experiment conducted, and any external factor should not influence the  variables .

Example: age, level, height, and grade.

External validity  is the ability to identify and generalise your study outcomes to the population at large. The relationship between the study’s situation and the situations outside the study is considered external validity.

Also, read about Inductive vs Deductive reasoning in this article.

Looking for reliable dissertation support?

We hear you.

  • Whether you want a full dissertation written or need help forming a dissertation proposal, we can help you with both.
  • Get different dissertation services at ResearchProspect and score amazing grades!

Threats to Interval Validity

Threat Definition Example
Confounding factors Unexpected events during the experiment that are not a part of treatment. If you feel the increased weight of your experiment participants is due to lack of physical activity, but it was actually due to the consumption of coffee with sugar.
Maturation The influence on the independent variable due to passage of time. During a long-term experiment, subjects may feel tired, bored, and hungry.
Testing The results of one test affect the results of another test. Participants of the first experiment may react differently during the second experiment.
Instrumentation Changes in the instrument’s collaboration Change in the   may give different results instead of the expected results.
Statistical regression Groups selected depending on the extreme scores are not as extreme on subsequent testing. Students who failed in the pre-final exam are likely to get passed in the final exams; they might be more confident and conscious than earlier.
Selection bias Choosing comparison groups without randomisation. A group of trained and efficient teachers is selected to teach children communication skills instead of randomly selecting them.
Experimental mortality Due to the extension of the time of the experiment, participants may leave the experiment. Due to multi-tasking and various competition levels, the participants may leave the competition because they are dissatisfied with the time-extension even if they were doing well.

Threats of External Validity

Threat Definition Example
Reactive/interactive effects of testing The participants of the pre-test may get awareness about the next experiment. The treatment may not be effective without the pre-test. Students who got failed in the pre-final exam are likely to get passed in the final exams; they might be more confident and conscious than earlier.
Selection of participants A group of participants selected with specific characteristics and the treatment of the experiment may work only on the participants possessing those characteristics If an experiment is conducted specifically on the health issues of pregnant women, the same treatment cannot be given to male participants.

How to Assess Reliability and Validity?

Reliability can be measured by comparing the consistency of the procedure and its results. There are various methods to measure validity and reliability. Reliability can be measured through  various statistical methods  depending on the types of validity, as explained below:

Types of Reliability

Type of reliability What does it measure? Example
Test-Retests It measures the consistency of the results at different points of time. It identifies whether the results are the same after repeated measures. Suppose a questionnaire is distributed among a group of people to check the quality of a skincare product and repeated the same questionnaire with many groups. If you get the same response from a various group of participants, it means the validity of the questionnaire and product is high as it has high test-retest reliability.
Inter-Rater It measures the consistency of the results at the same time by different raters (researchers) Suppose five researchers measure the academic performance of the same student by incorporating various questions from all the academic subjects and submit various results. It shows that the questionnaire has low inter-rater reliability.
Parallel Forms It measures Equivalence. It includes different forms of the same test performed on the same participants. Suppose the same researcher conducts the two different forms of tests on the same topic and the same students. The tests could be written and oral tests on the same topic. If results are the same, then the parallel-forms reliability of the test is high; otherwise, it’ll be low if the results are different.
Inter-Term It measures the consistency of the measurement. The results of the same tests are split into two halves and compared with each other. If there is a lot of difference in results, then the inter-term reliability of the test is low.

Types of Validity

As we discussed above, the reliability of the measurement alone cannot determine its validity. Validity is difficult to be measured even if the method is reliable. The following type of tests is conducted for measuring validity. 

Type of reliability What does it measure? Example
Content validity It shows whether all the aspects of the test/measurement are covered. A language test is designed to measure the writing and reading skills, listening, and speaking skills. It indicates that a test has high content validity.
Face validity It is about the validity of the appearance of a test or procedure of the test. The type of   included in the question paper, time, and marks allotted. The number of questions and their categories. Is it a good question paper to measure the academic performance of students?
Construct validity It shows whether the test is measuring the correct construct (ability/attribute, trait, skill) Is the test conducted to measure communication skills is actually measuring communication skills?
Criterion validity It shows whether the test scores obtained are similar to other measures of the same concept. The results obtained from a prefinal exam of graduate accurately predict the results of the later final exam. It shows that the test has high criterion validity.

Does your Research Methodology Have the Following?

  • Great Research/Sources
  • Perfect Language
  • Accurate Sources

If not, we can help. Our panel of experts makes sure to keep the 3 pillars of Research Methodology strong.

Does your Research Methodology Have the Following?

How to Increase Reliability?

  • Use an appropriate questionnaire to measure the competency level.
  • Ensure a consistent environment for participants
  • Make the participants familiar with the criteria of assessment.
  • Train the participants appropriately.
  • Analyse the research items regularly to avoid poor performance.

How to Increase Validity?

Ensuring Validity is also not an easy job. A proper functioning method to ensure validity is given below:

  • The reactivity should be minimised at the first concern.
  • The Hawthorne effect should be reduced.
  • The respondents should be motivated.
  • The intervals between the pre-test and post-test should not be lengthy.
  • Dropout rates should be avoided.
  • The inter-rater reliability should be ensured.
  • Control and experimental groups should be matched with each other.

How to Implement Reliability and Validity in your Thesis?

According to the experts, it is helpful if to implement the concept of reliability and Validity. Especially, in the thesis and the dissertation, these concepts are adopted much. The method for implementation given below:

Segments Explanation
All the planning about reliability and validity will be discussed here, including the chosen samples and size and the techniques used to measure reliability and validity.
Please talk about the level of reliability and validity of your results and their influence on values.
Discuss the contribution of other researchers to improve reliability and validity.

Frequently Asked Questions

What is reliability and validity in research.

Reliability in research refers to the consistency and stability of measurements or findings. Validity relates to the accuracy and truthfulness of results, measuring what the study intends to. Both are crucial for trustworthy and credible research outcomes.

What is validity?

Validity in research refers to the extent to which a study accurately measures what it intends to measure. It ensures that the results are truly representative of the phenomena under investigation. Without validity, research findings may be irrelevant, misleading, or incorrect, limiting their applicability and credibility.

What is reliability?

Reliability in research refers to the consistency and stability of measurements over time. If a study is reliable, repeating the experiment or test under the same conditions should produce similar results. Without reliability, findings become unpredictable and lack dependability, potentially undermining the study’s credibility and generalisability.

What is reliability in psychology?

In psychology, reliability refers to the consistency of a measurement tool or test. A reliable psychological assessment produces stable and consistent results across different times, situations, or raters. It ensures that an instrument’s scores are not due to random error, making the findings dependable and reproducible in similar conditions.

What is test retest reliability?

Test-retest reliability assesses the consistency of measurements taken by a test over time. It involves administering the same test to the same participants at two different points in time and comparing the results. A high correlation between the scores indicates that the test produces stable and consistent results over time.

How to improve reliability of an experiment?

  • Standardise procedures and instructions.
  • Use consistent and precise measurement tools.
  • Train observers or raters to reduce subjective judgments.
  • Increase sample size to reduce random errors.
  • Conduct pilot studies to refine methods.
  • Repeat measurements or use multiple methods.
  • Address potential sources of variability.

What is the difference between reliability and validity?

Reliability refers to the consistency and repeatability of measurements, ensuring results are stable over time. Validity indicates how well an instrument measures what it’s intended to measure, ensuring accuracy and relevance. While a test can be reliable without being valid, a valid test must inherently be reliable. Both are essential for credible research.

Are interviews reliable and valid?

Interviews can be both reliable and valid, but they are susceptible to biases. The reliability and validity depend on the design, structure, and execution of the interview. Structured interviews with standardised questions improve reliability. Validity is enhanced when questions accurately capture the intended construct and when interviewer biases are minimised.

Are IQ tests valid and reliable?

IQ tests are generally considered reliable, producing consistent scores over time. Their validity, however, is a subject of debate. While they effectively measure certain cognitive skills, whether they capture the entirety of “intelligence” or predict success in all life areas is contested. Cultural bias and over-reliance on tests are also concerns.

Are questionnaires reliable and valid?

Questionnaires can be both reliable and valid if well-designed. Reliability is achieved when they produce consistent results over time or across similar populations. Validity is ensured when questions accurately measure the intended construct. However, factors like poorly phrased questions, respondent bias, and lack of standardisation can compromise their reliability and validity.

You May Also Like

Action research for my dissertation?, A brief overview of action research as a responsive, action-oriented, participative and reflective research technique.

A hypothesis is a research question that has to be proved correct or incorrect through hypothesis testing – a scientific approach to test a hypothesis.

Struggling to figure out “whether I should choose primary research or secondary research in my dissertation?” Here are some tips to help you decide.

USEFUL LINKS

LEARNING RESOURCES

researchprospect-reviews-trust-site

COMPANY DETAILS

Research-Prospect-Writing-Service

  • How It Works

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

  • Knowledge Base

Methodology

  • Construct Validity | Definition, Types, & Examples

Construct Validity | Definition, Types, & Examples

Published on February 17, 2022 by Pritha Bhandari . Revised on June 22, 2023.

Construct validity is about how well a test measures the concept it was designed to evaluate. It’s crucial to establishing the overall validity of a method.

Assessing construct validity is especially important when you’re researching something that can’t be measured or observed directly, such as intelligence, self-confidence, or happiness. You need multiple observable or measurable indicators to measure those constructs or run the risk of introducing research bias into your work.

  • Content validity : Is the test fully representative of what it aims to measure?
  • Face validity : Does the content of the test appear to be suitable to its aims?
  • Criterion validity : Do the results accurately measure the concrete outcome they are designed to measure?

Table of contents

What is a construct, what is construct validity, types of construct validity, how do you measure construct validity, threats to construct validity, other interesting articles, frequently asked questions about construct validity.

A construct is a theoretical concept, theme, or idea based on empirical observations. It’s a variable that’s usually not directly measurable.

Some common constructs include:

  • Self-esteem
  • Logical reasoning
  • Academic motivation
  • Social anxiety

Constructs can range from simple to complex. For example, a concept like hand preference is easily assessed:

  • A simple survey question : Ask participants which hand is their dominant hand.
  • Observations : Ask participants to perform simple tasks, such as picking up an object or drawing a cat, and observe which hand they use to execute the tasks.

A more complex concept, like social anxiety, requires more nuanced measurements, such as psychometric questionnaires and clinical interviews.

Simple constructs tend to be narrowly defined, while complex constructs are broader and made up of dimensions. Dimensions are different parts of a construct that are coherently linked to make it up as a whole.

As a construct, social anxiety is made up of several dimensions.

  • Psychological dimension: Intense fear and anxiety
  • Physiological dimension: Physical stress indicators
  • Behavioral dimension: Avoidance of social settings

Here's why students love Scribbr's proofreading services

Discover proofreading & editing

Construct validity concerns the extent to which your test or measure accurately assesses what it’s supposed to.

In research, it’s important to operationalize constructs into concrete and measurable characteristics based on your idea of the construct and its dimensions.

Be clear on how you define your construct and how the dimensions relate to each other before you collect or analyze data . This helps you ensure that any measurement method you use accurately assesses the specific construct you’re investigating as a whole and helps avoid biases and mistakes like omitted variable bias or information bias .

  • How often do you avoid entering a room when everyone else is already seated?
  • Do other people tend to describe you as quiet?
  • When talking to new acquaintances, how often do you worry about saying something foolish?
  • To what extent do you fear giving a talk in front of an audience?
  • How often do you avoid making eye contact with other people?
  • Do you prefer to have a small number of close friends over a big group of friends?

When designing or evaluating a measure, it’s important to consider whether it really targets the construct of interest or whether it assesses separate but related constructs.

It’s crucial to differentiate your construct from related constructs and make sure that every part of your measurement technique is solely focused on your specific construct.

  • Does your questionnaire solely measure social anxiety?
  • Are all aspects of social anxiety covered by the questions?
  • Do your questions avoid measuring other relevant constructs like shyness or introversion?

There are two main types of construct validity.

  • Convergent validity: The extent to which your measure corresponds to measures of related constructs
  • Discriminant validity: The extent to which your measure is unrelated or negatively related to measures of distinct constructs

Convergent validity

Convergent validity is the extent to which measures of the same or similar constructs actually correspond to each other.

In research studies, you expect measures of related constructs to correlate with one another. If you have two related scales, people who score highly on one scale tend to score highly on the other as well.

Discriminant validity

Conversely, discriminant validity means that two measures of unrelated constructs that should be unrelated, very weakly related, or negatively related actually are in practice.

You check for discriminant validity the same way as convergent validity: by comparing results for different measures and assessing whether or how they correlate.

How do you select unrelated constructs? It’s good to pick constructs that are theoretically distinct or opposing concepts within the same category.

For example, if your construct of interest is a personality trait (e.g., introversion), it’s appropriate to pick a completely opposing personality trait (e.g., extroversion). You can expect results for your introversion test to be negatively correlated with results for a measure of extroversion.

Alternatively, you can pick non-opposing unrelated concepts and check there are no correlations (or weak correlations) between measures.

You often focus on assessing construct validity after developing a new measure. It’s best to test out a new measure with a pilot study, but there are other options.

  • A pilot study is a trial run of your study. You test out your measure with a small sample to check its feasibility, reliability , and validity . This helps you figure out whether you need to tweak or revise your measure to make sure you’re accurately testing your construct.
  • Statistical analyses are often applied to test validity with data from your measures. You test convergent and discriminant validity with correlations to see if results from your test are positively or negatively related to those of other established tests.
  • You can also use regression analyses to assess whether your measure is actually predictive of outcomes that you expect it to predict theoretically. A regression analysis that supports your expectations strengthens your claim of construct validity.

It’s important to recognize and counter threats to construct validity for a robust research design. The most common threats are:

Poor operationalization

Experimenter expectancies, subject bias.

A big threat to construct validity is poor operationalization of the construct.

A good operational definition of a construct helps you measure it accurately and precisely every time. Your measurement protocol is clear and specific, and it can be used under different conditions by other people.

Without a good operational definition, you may have random or systematic error , which compromises your results and can lead to information bias . Your measure may not be able to accurately assess your construct.

Experimenter expectancies about a study can bias your results. It’s best to be aware of this research bias and take steps to avoid it.

To combat this threat, use researcher triangulation and involve people who don’t know the hypothesis in taking measurements in your study. Since they don’t have strong expectations, they are unlikely to bias the results.

When participants hold expectations about the study, their behaviors and responses are sometimes influenced by their own biases. This can threaten your construct validity because you may not be able to accurately measure what you’re interested in.

You can mitigate subject bias by using masking (blinding) to hide the true purpose of the study from participants. By giving them a cover story for your study, you can lower the effect of subject bias on your results, as well as prevent them guessing the point of your research, which can lead to demand characteristics , social desirability bias , and a Hawthorne effect .

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

  • Normal distribution
  • Degrees of freedom
  • Null hypothesis
  • Discourse analysis
  • Control groups
  • Mixed methods research
  • Non-probability sampling
  • Quantitative research
  • Ecological validity

Research bias

  • Rosenthal effect
  • Implicit bias
  • Cognitive bias
  • Selection bias
  • Negativity bias
  • Status quo bias

Construct validity is about how well a test measures the concept it was designed to evaluate. It’s one of four types of measurement validity , which includes construct validity, face validity , and criterion validity.

There are two subtypes of construct validity.

  • Convergent validity : The extent to which your measure corresponds to measures of related constructs
  • Discriminant validity : The extent to which your measure is unrelated or negatively related to measures of distinct constructs

When designing or evaluating a measure, construct validity helps you ensure you’re actually measuring the construct you’re interested in. If you don’t have construct validity, you may inadvertently measure unrelated or distinct constructs and lose precision in your research.

Construct validity is often considered the overarching type of measurement validity ,  because it covers all of the other types. You need to have face validity , content validity , and criterion validity to achieve construct validity.

Statistical analyses are often applied to test validity with data from your measures. You test convergent validity and discriminant validity with correlations to see if results from your test are positively or negatively related to those of other established tests.

You can also use regression analyses to assess whether your measure is actually predictive of outcomes that you expect it to predict theoretically. A regression analysis that supports your expectations strengthens your claim of construct validity .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Bhandari, P. (2023, June 22). Construct Validity | Definition, Types, & Examples. Scribbr. Retrieved August 5, 2024, from https://www.scribbr.com/methodology/construct-validity/

Is this article helpful?

Pritha Bhandari

Pritha Bhandari

Other students also liked, the 4 types of validity in research | definitions & examples, reliability vs. validity in research | difference, types and examples, correlation coefficient | types, formulas & examples, what is your plagiarism score.

5.3 Experimentation and Validity

Learning objectives.

  • Explain what internal validity is and why experiments are considered to be high in internal validity.
  • Explain what external validity is and evaluate studies in terms of their external validity.
  • Explain the concepts of construct and statistical validity.

Four Big Validities

When we read about psychology experiments with a critical view, one question to ask is “is this study valid?” However, that question is not as straightforward as it seems because, in psychology, there are many different kinds of validities. Researchers have focused on four validities to help assess whether an experiment is sound (Judd & Kenny, 1981; Morling, 2014) [1] [2] : internal validity, external validity, construct validity, and statistical validity. We will explore each validity in depth.

Internal Validity

Two variables being statistically related does not necessarily mean that one causes the other. “Correlation does not imply causation.” For example, if it were the case that people who exercise regularly are happier than people who do not exercise regularly, this implication would not necessarily mean that exercising increases people’s happiness. It could mean instead that greater happiness causes people to exercise or that something like better physical health causes people to exercise   and  be happier.

The purpose of an experiment, however, is to show that two variables are statistically related and to do so in a way that supports the conclusion that the independent variable caused any observed differences in the dependent variable. The logic is based on this assumption: If the researcher creates two or more highly similar conditions and then manipulates the independent variable to produce just  one  difference between them, then any later difference between the conditions must have been caused by the independent variable. For example, because the only difference between Darley and Latané’s conditions was the number of students that participants believed to be involved in the discussion, this difference in belief must have been responsible for differences in helping between the conditions.

An empirical study is said to be high in  internal validity  if the way it was conducted supports the conclusion that the independent variable caused any observed differences in the dependent variable. Thus experiments are high in internal validity because the way they are conducted—with the manipulation of the independent variable and the control of extraneous variables—provides strong support for causal conclusions. In contrast, nonexperimental research designs (e.g., correlational designs), in which variables are measured but are not manipulated by an experimenter, are low in internal validity.

External Validity

At the same time, the way that experiments are conducted sometimes leads to a different kind of criticism. Specifically, the need to manipulate the independent variable and control extraneous variables means that experiments are often conducted under conditions that seem artificial (Bauman, McGraw, Bartels, & Warren, 2014) [3] . In many psychology experiments, the participants are all undergraduate students and come to a classroom or laboratory to fill out a series of paper-and-pencil questionnaires or to perform a carefully designed computerized task. Consider, for example, an experiment in which researcher Barbara Fredrickson and her colleagues had undergraduate students come to a laboratory on campus and complete a math test while wearing a swimsuit (Fredrickson, Roberts, Noll, Quinn, & Twenge, 1998) [4] . At first, this manipulation might seem silly. When will undergraduate students ever have to complete math tests in their swimsuits outside of this experiment?

The issue we are confronting is that of external validity . An empirical study is high in external validity if the way it was conducted supports generalizing the results to people and situations beyond those actually studied. As a general rule, studies are higher in external validity when the participants and the situation studied are similar to those that the researchers want to generalize to and participants encounter every day, often described as mundane realism . Imagine, for example, that a group of researchers is interested in how shoppers in large grocery stores are affected by whether breakfast cereal is packaged in yellow or purple boxes. Their study would be high in external validity and have high mundane realism if they studied the decisions of ordinary people doing their weekly shopping in a real grocery store. If the shoppers bought much more cereal in purple boxes, the researchers would be fairly confident that this increase would be true for other shoppers in other stores. Their study would be relatively low in external validity, however, if they studied a sample of undergraduate students in a laboratory at a selective university who merely judged the appeal of various colors presented on a computer screen; however, this study would have high psychological realism where the same mental process is used in both the laboratory and in the real world.  If the students judged purple to be more appealing than yellow, the researchers would not be very confident that this preference is relevant to grocery shoppers’ cereal-buying decisions because of low external validity but they could be confident that the visual processing of colors has high psychological realism.

We should be careful, however, not to draw the blanket conclusion that experiments are low in external validity. One reason is that experiments need not seem artificial. Consider that Darley and Latané’s experiment provided a reasonably good simulation of a real emergency situation. Or consider field experiments  that are conducted entirely outside the laboratory. In one such experiment, Robert Cialdini and his colleagues studied whether hotel guests choose to reuse their towels for a second day as opposed to having them washed as a way of conserving water and energy (Cialdini, 2005) [5] . These researchers manipulated the message on a card left in a large sample of hotel rooms. One version of the message emphasized showing respect for the environment, another emphasized that the hotel would donate a portion of their savings to an environmental cause, and a third emphasized that most hotel guests choose to reuse their towels. The result was that guests who received the message that most hotel guests choose to reuse their towels, reused their own towels substantially more often than guests receiving either of the other two messages. Given the way they conducted their study, it seems very likely that their result would hold true for other guests in other hotels.

A second reason not to draw the blanket conclusion that experiments are low in external validity is that they are often conducted to learn about psychological processes  that are likely to operate in a variety of people and situations. Let us return to the experiment by Fredrickson and colleagues. They found that the women in their study, but not the men, performed worse on the math test when they were wearing swimsuits. They argued that this gender difference was due to women’s greater tendency to objectify themselves—to think about themselves from the perspective of an outside observer—which diverts their attention away from other tasks. They argued, furthermore, that this process of self-objectification and its effect on attention is likely to operate in a variety of women and situations—even if none of them ever finds herself taking a math test in her swimsuit.

Construct Validity

In addition to the generalizability of the results of an experiment, another element to scrutinize in a study is the quality of the experiment’s manipulations or the construct validity . The research question that Darley and Latané started with is “does helping behavior become diffused?” They hypothesized that participants in a lab would be less likely to help when they believed there were more potential helpers besides themselves. This conversion from research question to experiment design is called operationalization (see Chapter 4 for more information about the operational definition). Darley and Latané operationalized the independent variable of diffusion of responsibility by increasing the number of potential helpers. In evaluating this design, we would say that the construct validity was very high because the experiment’s manipulations very clearly speak to the research question; there was a crisis, a way for the participant to help, and increasing the number of other students involved in the discussion, they provided a way to test diffusion.

What if the number of conditions in Darley and Latané’s study changed? Consider if there were only two conditions: one student involved in the discussion or two. Even though we may see a decrease in helping by adding another person, it may not be a clear demonstration of diffusion of responsibility, just merely the presence of others. We might think it was a form of Bandura’s social inhibition. The construct validity would be lower. However, had there been five conditions, perhaps we would see the decrease continue with more people in the discussion or perhaps it would plateau after a certain number of people. In that situation, we may not necessarily be learning more about diffusion of responsibility or it may become a different phenomenon. By adding more conditions, the construct validity may not get higher. When designing your own experiment, consider how well the research question is operationalized your study.

Statistical Validity

Statistical validity concerns the proper statistical treatment of data and the soundness of the researchers’ statistical conclusions. There are many different types of inferential statistics tests (e.g.,  t- tests, ANOVA, regression, correlation) and statistical validity concerns the use of the proper type of test to analyze the data. When considering the proper type of test, researchers must consider the scale of measure their dependent variable was measured on and the design of their study. Further, many of inferential statistics tests carry certain assumptions (e.g., the data are normally distributed) and statistical validity is threatened when these assumptions are not met but the statistics are used nonetheless.

One common critique of experiments is that a study did not have enough participants. The main reason for this criticism is that it is difficult to generalize about a population from a small sample. At the outset, it seems as though this critique is about external validity but there are studies where small sample sizes are not a problem (subsequent chapters will discuss how small samples, even of only 1 person, are still very illuminating for psychology research). Therefore, small sample sizes are actually a critique of statistical validity . The statistical validity speaks to whether the statistics conducted in the study are sound and support the conclusions that are made.

The proper statistical analysis should be conducted on the data to determine whether the difference or relationship that was predicted was found. The number of conditions and the total number of participants will determine the overall size of the effect. With this information, a power analysis can be conducted to ascertain whether you are likely to find a real difference. When designing a study, it is best to think about the power analysis so that the appropriate number of participants can be recruited and tested. To design a statistically valid experiment, thinking about the statistical tests at the beginning of the design will help ensure the results can be believed.

Prioritizing Validities

These four big validities–internal, external, construct, and statistical–are useful to keep in mind when both reading about other experiments and designing your own. However, researchers must prioritize and often it is not possible to have high validity in all four areas. In Cialdini’s study on towel usage in hotels, the external validity was high but the statistical validity was more modest. This discrepancy does not invalidate the study but it shows where there may be room for improvement for future follow-up studies (Goldstein, Cialdini, & Griskevicius, 2008) [6] . Morling (2014) points out that most psychology studies have high internal and construct validity but sometimes sacrifice external validity.

Key Takeaways

  • Studies are high in internal validity to the extent that the way they are conducted supports the conclusion that the independent variable caused any observed differences in the dependent variable. Experiments are generally high in internal validity because of the manipulation of the independent variable and control of extraneous variables.
  • Studies are high in external validity to the extent that the result can be generalized to people and situations beyond those actually studied. Although experiments can seem “artificial”—and low in external validity—it is important to consider whether the psychological processes under study are likely to operate in other people and situations.
  • Judd, C.M. & Kenny, D.A. (1981). Estimating the effects of social interventions . Cambridge, MA: Cambridge University Press. ↵
  • Morling, B. (2014, April). Teach your students to be better consumers. APS Observer . Retrieved from http://www.psychologicalscience.org/index.php/publications/observer/2014/april-14/teach-your-students-to-be-better-consumers.html ↵
  • Bauman, C.W., McGraw, A.P., Bartels, D.M., & Warren, C. (2014). Revisiting external validity: Concerns about trolley problems and other sacrificial dilemmas in moral psychology. Social and Personality Psychology Compass, 8/9 , 536-554. ↵
  • Fredrickson, B. L., Roberts, T.-A., Noll, S. M., Quinn, D. M., & Twenge, J. M. (1998). The swimsuit becomes you: Sex differences in self-objectification, restrained eating, and math performance. Journal of Personality and Social Psychology, 75 , 269–284. ↵
  • Cialdini, R. (2005, April). Don’t throw in the towel: Use social influence research. APS Observer . Retrieved from http://www.psychologicalscience.org/index.php/publications/observer/2005/april-05/dont-throw-in-the-towel-use-social-influence-research.html ↵
  • Goldstein, N. J., Cialdini, R. B., & Griskevicius, V. (2008). A room with a viewpoint: Using social norms to motivate environmental conservation in hotels. Journal of Consumer Research, 35 , 472–482. ↵

Creative Commons License

Share This Book

  • Increase Font Size

Sago

What We Offer

With a comprehensive suite of qualitative and quantitative capabilities and 55 years of experience in the industry, Sago powers insights through adaptive solutions.

  • Recruitment
  • Communities
  • Methodify® Automated research
  • QualBoard® Digital Discussions
  • QualMeeting® Digital Interviews
  • Global Qualitative
  • Global Quantitative
  • In-Person Facilities
  • Healthcare Solutions
  • Research Consulting
  • Europe Solutions
  • Neuromarketing Tools
  • Trial & Jury Consulting

Who We Serve

Form deeper customer connections and make the process of answering your business questions easier. Sago delivers unparalleled access to the audiences you need through adaptive solutions and a consultative approach.

  • Consumer Packaged Goods
  • Financial Services
  • Media Technology
  • Medical Device Manufacturing
  • Marketing Research

With a 55-year legacy of impact, Sago has proven we have what it takes to be a long-standing industry leader and partner. We continually advance our range of expertise to provide our clients with the highest level of confidence.​

  • Global Offices
  • Partnerships & Certifications
  • News & Media
  • Researcher Events

steve schlesinger, mrx council hall of fame

Steve Schlesinger Inducted Into 2024 Market Research Council Hall of Fame

professional woman looking down at tablet in office at night

Sago Announces Launch of Sago Health to Elevate Healthcare Research

man and woman sitting in front of laptop smiling broadly

Sago Launches AI Video Summaries on QualBoard to Streamline Data Synthesis

Drop into your new favorite insights rabbit hole and explore content created by the leading minds in market research.

  • Case Studies
  • Knowledge Kit

girl wearing medical mask in foreground, two people talking in medical masks in background

How Connecting with Gen C Can Help Your Brand Grow

the deciders july 2024 blog thumbnail

The Deciders, July 2024: Former Nikki Haley Voters

  • Get in touch

conclusion validity research method

  • Account Logins

conclusion validity research method

The Significance of Validity and Reliability in Quantitative Research

  • Resources , Blog

clock icon

Key Takeaways:

  • Types of validity to consider during quantitative research include internal, external, construct, and statistical
  • Types of reliability that apply to quantitative research include test re-test, inter-rater, internal consistency, and parallel forms
  • There are numerous challenges to achieving validity and reliability in quantitative research, but the right techniques can help overcome them

Quantitative research is used to investigate and analyze data to draw meaningful conclusions. Validity and reliability are two critical concepts in quantitative analysis that ensure the accuracy and consistency of the research results. Validity refers to the extent to which the research measures what it intends to measure, while reliability refers to the consistency and reproducibility of the research results over time. Ensuring validity and reliability is crucial in conducting high-quality research, as it increases confidence in the findings and conclusions drawn from the data.

This article aims to provide an in-depth analysis of the significance of validity and reliability in quantitative research. It will explore the different types of validity and reliability, their interrelationships, and the associated challenges and limitations.

In this Article:

The role of validity in quantitative research, the role of reliability in quantitative research, validity and reliability: how they differ and interrelate, challenges and limitations of ensuring validity and reliability, overcoming challenges and limitations to achieve validity and reliability, explore trusted quantitative solutions.

Take the guesswork out of your quant research with solutions that put validity and reliability first. Discover Sago’s quantitative solutions.

Request a consultation

Validity is crucial in maintaining the credibility and reliability of quantitative research outcomes. Therefore, it is critical to establish that the variables being measured in a study align with the research objectives and accurately reflect the phenomenon being investigated.

Several types of validity apply to various study designs; let’s take a deeper look at each one below:

Internal validity is concerned with the extent to which a study establishes a causal relationship between the independent and dependent variables. In other words, internal validity determines whether the changes observed in the conditional variable result from changes in the independent variable or some other factor.

External validity refers to the degree to which the findings of a study can be generalized to other populations and contexts. External validity helps ensure the results of a study are not limited to the specific people or context in which the study was conducted.

Construct validity refers to the degree to which a research study accurately measures the theoretical construct it intends to measure. Construct validity helps provide alignment between the study’s measures and the theoretical concept it aims to investigate.

Finally, statistical validity refers to the accuracy of the statistical tests used to analyze the data. Establishing statistical validity provides confidence that the conclusions drawn from the data are reliable and accurate.

To safeguard the validity of a study, researchers must carefully design their research methodology, select appropriate measures, and control for extraneous variables that may impact the results. Validity is especially crucial in fields such as medicine, where inaccurate research findings can have severe consequences for patients and healthcare practices.

Ensuring the consistency and reproducibility of research outcomes over time is crucial in quantitative research, and this is where the concept of reliability comes into play. Reliability is vital to building trust in the research findings and their ability to be replicated in diverse contexts.

Similar to validity, multiple types of reliability are pertinent to different research designs. Let’s take a closer look at each of these types of reliability below:

Test-retest reliability refers to the consistency of the results obtained when the same test is administered to the same group of participants at different times. This type of reliability is essential when researchers need to administer the same test multiple times to assess changes in behavior or attitudes over time.

Inter-rater reliability refers to the results’ consistency when different raters or observers monitor the same behavior or phenomenon. This type of reliability is vital when researchers are required to rely on different individuals to rate or observe the same behavior or phenomenon.

Internal consistency reliability refers to the degree to which the items or questions in a test or questionnaire measure the same construct. This type of reliability is important in studies where researchers use multiple items or questions to assess a particular construct, such as knowledge or quality of life.

Lastly, parallel forms reliability refers to the consistency of the results obtained when two different versions of the same test are administered to the same group of participants. This type of reliability is important when researchers administer different versions of the same test to assess the consistency of the results.

Reliability in research is like the accuracy and consistency of a medical test. Just as a reliable medical test produces consistent and accurate results that physicians can trust to make informed decisions about patient care, a highly reliable study produces consistent and precise findings that researchers can trust to make knowledgeable conclusions about a particular phenomenon. To ensure reliability in a study, researchers must carefully select appropriate measures and establish protocols for administering the measures consistently. They must also take steps to control for extraneous variables that may impact the results.

Validity and reliability are two critical concepts in quantitative research that significantly determine the quality of research studies. While both terms are often used interchangeably, they refer to different aspects of research. Validity is the extent to which a research study measures what it claims to measure without being affected by extraneous factors or bias. In contrast, reliability is the degree to which the research results are consistent and stable over time and across different samples , methods, and evaluators.

Designing a research study that is both valid and reliable is essential for producing high-quality and trustworthy research findings. Finding this balance requires significant expertise, skill, and attention to detail. Ultimately, the goal is to produce research findings that are valid and reliable but also impactful and influential for the organization requesting them. Achieving this level of excellence requires a deep understanding of the nuances and complexities of research methodology and a commitment to excellence and rigor in all aspects of the research process.

Ensuring validity and reliability in quantitative research is not without its challenges. Some of the factors to consider include:

1. Measuring Complex Constructs or Variables One of the main challenges is the difficulty in accurately measuring complex constructs or variables. For instance, measuring constructs such as intelligence or personality can be complicated due to their multi-dimensional nature, and it can be challenging to capture all aspects accurately.

2. Limitations of Data Collection Instruments In addition, the measures or instruments used to collect data can also be limited in their sensitivity or specificity. This can impact the study’s validity and reliability, as accurate and precise measures can lead to incorrect conclusions and unreliable results. For example, a scale that measures depression but does not include all relevant symptoms may not accurately capture the construct being studied.

3. Sources of Error and Bias in Data Collection The data collection process itself can introduce sources of error or bias, which can impact the validity and reliability of the study. For instance, measurement errors can occur due to the limitations of the measuring instrument or human error during data collection. In addition, response bias can arise when participants provide socially desirable answers, while sampling bias can occur when the sample is not representative of the studied population.

4. The Complexity of Achieving Meaningful and Accurate Research Findings There are also some limitations to validity and reliability in research studies. For example, achieving internal validity by controlling for extraneous variables may only sometimes ensure external validity or the ability to generalize findings to other populations or settings. This can be a limitation for researchers who wish to apply their findings to a larger population or different contexts.

Additionally, while reliability is essential for producing consistent and reproducible results, it does not guarantee the accuracy or truth of the findings. This means that even if a study has reliable results, it may still need to be revised in terms of accuracy. These limitations remind us that research is a complex process, and achieving validity and reliability is just one part of the giant puzzle of producing accurate and meaningful research.

Researchers can adopt various measures and techniques to overcome the challenges and limitations in ensuring validity and reliability in research studies.

One such approach is to use multiple measures or instruments to assess the same construct. In addition, various steps can help identify commonalities and differences across measures, thereby providing a more comprehensive understanding of the construct being studied.

Inter-rater reliability checks can also be conducted to ensure different raters or observers consistently interpret and rate the same data. This can reduce measurement errors and improve the reliability of the results. Additionally, data-cleaning techniques can be used to identify and remove any outliers or errors in the data.

Finally, researchers can use appropriate statistical methods to assess the validity and reliability of their measures. For example, factor analysis identifies the underlying factors contributing to the construct being studied, while test-retest reliability helps evaluate the consistency of results over time. By adopting these measures and techniques, researchers can crease t their findings’ overall quality and usefulness.

The backbone of any quantitative research lies in the validity and reliability of the data collected. These factors ensure the data accurately reflects the intended research objectives and is consistent and reproducible. By carefully balancing the interrelationship between validity and reliability and using appropriate techniques to overcome challenges, researchers protect the credibility and impact of their work. This is essential in producing high-quality research that can withstand scrutiny and drive progress.

Are you seeking a reliable and valid way to collect, analyze, and report your quantitative data? Sago’s comprehensive quantitative solutions provide you the peace of mind to conduct research and draw meaningful conclusions.

Don’t Settle for Subpar Results

Work with a trusted quantitative research partner to deliver quantitative research you can count on. Book a consultation with our team to get started.

de la riva case study blog thumbnail

Enhancing Efficiency with All-in-One Digital Qual

smiling woman sitting at a table looking at her phone with a coffee cup in front of her

Crack the Code: Evolving Panel Expectations

toddler girl surrounded by stuffed animals and using an ipad

Pioneering the Future of Pediatric Health

swing voters, july 2024 florida thumbnail

The Swing Voter Project, July 2024: Florida

summer 2024 travel trends

Exploring Travel Trends and Behaviors for Summer 2024

The Deciders, June 2024, Georgia

The Deciders, June 24, 2024: Third-Party Georgia Voters

Summer 2024 Insights: The Compass to This Year's Travel Choices

Summer 2024 Insights: The Compass to This Year’s Travel Choices

swing voters, north carolina, june 2024, thumbnail

The Swing Voter Project, June 2024: North Carolina

Making the Case for Virtual Audiences: Unleashing Insights in a Creative Agency

Making the Case for Virtual Audiences: Unleashing Insights in a Creative Agency

Take a deep dive into your favorite market research topics

conclusion validity research method

How can we help support you and your research needs?

conclusion validity research method

BEFORE YOU GO

Have you considered how to harness AI in your research process? Check out our on-demand webinar for everything you need to know

conclusion validity research method

Popular searches

  • How to Get Participants For Your Study
  • How to Do Segmentation?
  • Conjoint Preference Share Simulator
  • MaxDiff Analysis
  • Likert Scales
  • Reliability & Validity

Request consultation

Do you need support in running a pricing or product study? We can help you with agile consumer research and conjoint analysis.

Looking for an online survey platform?

Conjointly offers a great survey tool with multiple question types, randomisation blocks, and multilingual support. The Basic tier is always free.

Research Methods Knowledge Base

  • Navigating the Knowledge Base
  • Foundations
  • Measurement
  • Research Design

Threats to Conclusion Validity

  • Improving Conclusion Validity
  • Statistical Power
  • Data Preparation
  • Descriptive Statistics
  • Inferential Statistics
  • Table of Contents

Fully-functional online survey tool with various question types, logic, randomisation, and reporting for unlimited number of surveys.

Completely free for academics and students .

A threat to conclusion validity is a factor that can lead you to reach an incorrect conclusion about a relationship in your observations. You can essentially make two kinds of errors about relationships:

  • Conclude that there is no relationship when in fact there is (you missed the relationship or didn’t see it)
  • Conclude that there is a relationship when in fact there is not (you’re seeing things that aren’t there!)

Most threats to conclusion validity have to do with the first problem. Why? Maybe it’s because it’s so hard in most research to find relationships in our data at all that it’s not as big or frequent a problem — we tend to have more problems finding the needle in the haystack than seeing things that aren’t there! So, I’ll divide the threats by the type of error they are associated with.

Finding no relationship when there is one (or, “missing the needle in the haystack”)

When you’re looking for the needle in the haystack you essentially have two basic problems: the tiny needle and too much hay. You can view this as a signal-to-noise ratio problem.The “signal” is the needle — the relationship you are trying to see. The “noise” consists of all of the factors that make it hard to see the relationship. There are several important sources of noise, each of which is a threat to conclusion validity. One important threat is low reliability of measures (see reliability ). This can be due to many factors including poor question wording, bad instrument design or layout, illegibility of field notes, and so on. In studies where you are evaluating a program you can introduce noise through poor reliability of treatment implementation . If the program doesn’t follow the prescribed procedures or is inconsistently carried out, it will be harder to see relationships between the program and other factors like the outcomes. Noise that is caused by random irrelevancies in the setting can also obscure your ability to see a relationship. In a classroom context, the traffic outside the room, disturbances in the hallway, and countless other irrelevant events can distract the researcher or the participants. The types of people you have in your study can also make it harder to see relationships. The threat here is due to random heterogeneity of respondents . If you have a very diverse group of respondents, they are likely to vary more widely on your measures or observations. Some of their variety may be related to the phenomenon you are looking at, but at least part of it is likely to just constitute individual differences that are irrelevant to the relationship being observed.

All of these threats add variability into the research context and contribute to the “noise” relative to the signal of the relationship you are looking for. But noise is only one part of the problem. We also have to consider the issue of the signal — the true strength of the relationship. There is one broad threat to conclusion validity that tends to subsume or encompass all of the noise-producing factors above and also takes into account the strength of the signal, the amount of information you collect, and the amount of risk you’re willing to take in making a decision about a whether a relationship exists. This threat is called low statistical power . Because this idea is so important in understanding how we make decisions about relationships, we have a separate discussion of statistical power .

Finding a relationship when there is not one (or “seeing things that aren’t there”)

In anything but the most trivial research study, the researcher will spend a considerable amount of time analyzing the data for relationships. Of course, it’s important to conduct a thorough analysis, but most people are well aware of the fact that if you play with the data long enough, you can often “turn up” results that support or corroborate your hypotheses. In more everyday terms, you are “fishing” for a specific result by analyzing the data repeatedly under slightly differing conditions or assumptions.

In statistical analysis, we attempt to determine the probability that the finding we get is a “real” one or could have been a “chance” finding. In fact, we often use this probability to decide whether to accept the statistical result as evidence that there is a relationship. In the social sciences, researchers often use the rather arbitrary value known as the 0.05 level of significance to decide whether their result is credible or could be considered a “fluke.” Essentially, the value 0.05 means that the result you got could be expected to occur by chance at least 5 times out of every 100 times you run the statistical analysis. The probability assumption that underlies most statistical analyses assumes that each analysis is “independent” of the other. But that may not be true when you conduct multiple analyses of the same data. For instance, let’s say you conduct 20 statistical tests and for each one you use the 0.05 level criterion for deciding whether you are observing a relationship. For each test, the odds are 5 out of 100 that you will see a relationship even if there is not one there (that’s what it means to say that the result could be “due to chance”). Odds of 5 out of 100 are equal to the fraction 5/100 which is also equal to 1 out of 20. Now, in this example, you conduct 20 separate analyses. Let’s say that you find that of the twenty results, only one is statistically significant at the 0.05 level. Does that mean you have found a statistically significant relationship? If you had only done the one analysis, you might conclude that you’ve found a relationship in that result. But if you did 20 analyses, you would expect to find one of them significant by chance alone, even if there is no real relationship in the data. We call this threat to conclusion validity fishing and the error rate problem . The basic problem is that you were “fishing” by conducting multiple analyses and treating each one as though it was independent. Instead, when you conduct multiple analyses, you should adjust the error rate (i.e. significance level) to reflect the number of analyses you are doing. The bottom line here is that you are more likely to see a relationship when there isn’t one when you keep reanalyzing your data and don’t take that fishing into account when drawing your conclusions.

Problems that can lead to either conclusion error

Every analysis is based on a variety of assumptions about the nature of the data, the procedures you use to conduct the analysis, and the match between these two. If you are not sensitive to the assumptions behind your analysis you are likely to draw erroneous conclusions about relationships. In quantitative research we refer to this threat as the violated assumptions of statistical tests . For instance, many statistical analyses assume that the data are distributed normally — that the population from which they are drawn would be distributed according to a “normal” or “bell-shaped” curve. If that assumption is not true for your data and you use that statistical test, you are likely to get an incorrect estimate of the true relationship. And, it’s not always possible to predict what type of error you might make — seeing a relationship that isn’t there or missing one that is.

I believe that the same problem can occur in qualitative research as well. There are assumptions, some of which we may not even realize, behind our qualitative methods. For instance, in interview situations we may assume that the respondent is free to say anything s/he wishes. If that is not true — if the respondent is under covert pressure from supervisors to respond in a certain way — you may erroneously see relationships in the responses that aren’t real and/or miss ones that are.

The threats listed above illustrate some of the major difficulties and traps that are involved in one of the most basic of research tasks — deciding whether there is a relationship in your data or observations. So, how do we attempt to deal with these threats? The researcher has a number of strategies for improving conclusion validity through minimizing or eliminating the threats described above.

Cookie Consent

Conjointly uses essential cookies to make our site work. We also use additional cookies in order to understand the usage of the site, gather audience analytics, and for remarketing purposes.

For more information on Conjointly's use of cookies, please read our Cookie Policy .

Which one are you?

I am new to conjointly, i am already using conjointly.

  • Open access
  • Published: 09 August 2024

Exploring Agrobacterium -mediated genetic transformation methods and its applications in Lilium

  • Xinyue Fan 1 &
  • Hongmei Sun 1 , 2  

Plant Methods volume  20 , Article number:  120 ( 2024 ) Cite this article

Metrics details

As a typical bulb flower, lily is widely cultivated worldwide because of its high ornamental, medicinal and edible value. Although breeding efforts evolved over the last 10000 years, there are still many problems in the face of increasing consumer demand. The approach of biotechnological methods would help to solve this problem and incorporate traits impossible by conventional breeding. Target traits are dormancy, development, color, floral fragrance and resistances against various biotic and abiotic stresses, so as to improve the quality of bulbs and cut flowers in planting, cultivation, postharvest, plant protection and marketing. Genetic transformation technology is an important method for varietal improvement and has become the foundation and core of plant functional genomics research, greatly assisting various plant improvement programs. However, achieving stable and efficient genetic transformation of lily has been difficult worldwide. Many gene function verification studies depend on the use of model plants, which greatly limits the pace of directed breeding and germplasm improvement in lily. Although significant progress has been made in the development and optimization of genetic transformation systems, shortcomings remain. Agrobacterium -mediated genetic transformation has been widely used in lily. However, severe genotypic dependence is the main bottleneck limiting the genetic transformation of lily. This review will summarizes the research progress in the genetic transformation of lily over the past 30 years to generate the material including a section how genome engineering using stable genetic transformation system, and give an overview about recent and future applications of lily transformation. The information provided in this paper includes ideas for optimizing and improving the efficiency of existing genetic transformation methods and for innovation, provides technical support for mining and identifying regulatory genes for key traits, and lays a foundation for genetic improvement and innovative germplasm development in lily.

Flowers are not only a globally important agricultural industry with great economic benefits but also necessary agents for mental health in people's daily lives. Many countries have given intensive attention to the development of the flower industry. At present, the world's flower cultivation area is 22.3 hm 2 , and the international trade volume of flowers is expanding (AIPH, https://www.floraldaily.com ). Lily is a typical perennial herbaceous bulb plant with more than 100 wild species and more than 9,000 varieties worldwide; additionally, this plant has high ornamental value, and the share of lily as a cut flower in the global flower market is increasing annually [ 1 ]. Some lily varieties are edible and have high medicinal value, and their extracts are rich in antioxidant and anti-inflammatory components, resulting in widespread use in medicine, functional food and cosmetics [ 2 ]. It is therefore unsurprising that lilies are the focus of much bulbous flower research. Improving the quality of seed balls and cut flowers has always been a key goal in the global lily industry [ 3 , 4 ]. The target traits are dormancy, development, colour, floral fragrance and resistance to various biological and abiotic stresses to improve the quality of bulbs and cut flowers in planting, cultivation, postharvest, plant protection and marketing. Crossbreeding can quickly fuse good traits and easily produce heterosis. However, lily has a complex genetic background, high heterozygosity, and it is extremely difficult to carry out genome processing, because it is one of the plants with the largest genome, with nearly 30 Gb of genetic information. The long cycle of cross-breeding requires a lot of manpower and material resources. In many cases, sexual incompatibility is also an obstacle in the crossbreeding of lily. Likewise, physical and chemical mutagenesis methods are also highly uncertain. With the rapid development of molecular biology technology, genetic engineering has received increasing amounts of attention. Using molecular methods to improve germplasms can not only lead to the creation of new traits but also increase the efficiency and accuracy of breeding [ 5 , 6 , 7 ] (Fig.  1 ).

figure 1

Strategies for developing new varieties of lily using different plant breeding tools. A Physical mutagenesis (in which mutants are created by exposing seeds or bulblets to radiation). B Chemical mutagenesis (treatment of different explants with chemical agents to obtain mutants, such as EMS mutagenesis). C Traditional crossbreeding has led to the cultivation of new lily varieties. D Transgenic breeding

Genetic transformation is an important part of genetic engineering technology, and the main goals of flower genetic transformation are as follows: (1) genetic transformation for basic research on a single gene, gene family or gene regulatory network and (2) the application of basic research results as the theoretical basis for improving flower traits and creating new varieties. Plant genetic transformation includes target gene selection, delivery, integration into plant cells, and expression and, ultimately, the production of a complete plant after numerous processes [ 8 ]. Although genetically modified plants were obtained in 1983, the genetic transformation of bulb flowers such as lily has long been considered difficult or impossible [ 9 ]. With progress in the field of lily research, an increasing number of genes, including genes related to major factors involved in regulating various life activities, responding to various biological and abiotic stresses, and responding to various environmental signals, have been identified. However, many gene function studies still depend on the heterologous transformation of model plants such as Arabidopsis and Nicotiana benthamiana (Fig. S1) . In 1992, Cohen conducted the first genetic transformation experiment in lily through Agrobacterium -mediated transformation and detected foreign genes in the calli [ 10 ]. However, the low efficiency, difficulty of regeneration, and difficulty of integration into the lily genome remain obstacles to overcome. With increasing basic research on lily plants, instantaneous transformation based on virus induction has gradually become the first choice of many researchers because this method is simple and fast, and the research cycle is only a few hours or days. However, because these methods cannot enable integration into the genome and are sometimes limited to a single tissue, it is difficult to provide sufficient evidence for gene function, and the research results are uninformative and unfavourable for further application in breeding work. Agrobacterium -mediated transformation, particle bombardment, PEG and electric shock are common methods of plant genetic transformation at present (Fig.  2 ). Compared with other plant transgenic methods, Agrobacterium -mediated plant genetic transformation remains the most common and widespread lily transgenic strategy because of its advantages of high transformation efficiency, few transgenic copies, and stable transfer of integrated genes into offspring after continuous optimization and updating [ 11 ].

figure 2

Common methods for the genetic transformation of lily. A Agrobacterium -mediated stable genetic transformation B Virus-induced transient gene silencing (VIGS). C Particle bombardment. D Pollen magnetic effect method

In the past 30 years, many researchers have attempted to improve and create technology by adjusting or changing various parameters and operating methods and have accumulated considerable valuable experience (Fig.  3 ). Agrobacterium is a gram-negative bacterial genus that is widely distributed in soil. At the beginning of the twentieth century, the principle that natural pathogens can infect plants through wounds was gradually elucidated. The main mechanism is the delivery of tumorigenic DNA molecules (transfer DNA or T-DNA) into plant cells through wounds in infected plants; these molecules are eventually integrated into the host genome and stably transmitted to the next generation of the plant through meiosis [ 12 , 13 ]. The ability of Agrobacterium to integrate its own DNA into the host genome is primarily determined by the Ti plasmid [ 14 ], which can be modified by the insertion of target genes into the T-DNA region. With the help of the transferability of this region, genes can be introduced into plants by Agrobacterium infection and incorporated into plant genome, after which transgenic plants can be generated by cell and tissue culture technology [ 13 ]. Like most plant genetic transformation methods mediated by Agrobacterium, the genetic transformation procedures for lily mainly include vector construction, selection and culture of explants, preculture, Agrobacterium infection, coculture, resistance selection and transgenic plant regeneration (Fig.  2 ). At present, in addition to calli induced by roots, petals and leaves, scales and embryonic calli are common explants used for genetic transformation in lily [ 15 , 16 , 17 ]. With the continuous updating and optimization of genetic transformation technology for lily, functional verification of several genes by heterologous transformation of model plants has gradually increased, and many genes that regulate desirable traits in lily have been identified [ 3 , 17 , 18 , 19 , 20 ]. Nevertheless, stable and efficient transformation of target genes has been achieved in only a few lily varieties, and the success rate of genetic transformation of some lily varieties is still low.

figure 3

Timeline of several major discoveries, applications and breakthroughs in the history of lily genetic transformation

In this paper, the development of genetic transformation technology for lily plants over the past 30 years is reviewed, the factors and key technical points restricting the efficiency of genetic transformation in lily are described, the problems and limitations associated with the genetic transformation of lily are summarized, and the prospects for application and improvement are discussed. The purpose of this paper is to provide a technical reference for establishing a stable and efficient genetic transformation system for lily and to lay a foundation for directional breeding and genetic improvement of key characteristics.

Factors affecting the genetic transformation of lily

Many factors affect lily regeneration and transformation. Genotyping is one of the key problems affecting the success of transformation [ 16 ]. Although genetic transformation systems have been established for different lily varieties, major differences exist between different genotypes [ 21 ]. Under the same conditions during the genetic transformation process, the genotype determines the difficulty of using Agrobacterium to successfully infect lily. At present, stable and efficient genetic transformation has been successfully achieved for few lily varieties (Table  1 ). Since the use of Agrobacterium -mediated genetic transformation of lily has been reported, several studies have aimed to optimize the transformation system or establish methods suitable for different lily species, including Lilium formolongi [ 22 , 23 ], Lilium longiflorum [ 24 , 25 , 26 ], Lilium pumilum DC.Fisch. [ 26 ] and the Oriental hybrid Lily [ 15 , 16 , 27 , 28 ]. Due to the strong genotypic dependence and difficult regeneration of explant materials after transformation, most related research results are restricted to certain genotypes [ 16 , 25 , 27 , 28 ]. Yan et al. [ 26 ] established a stable and efficient transformation system through somatic embryogenesis and adventitious bud regeneration in Lilium pumilum DC. Fisch. and Lilium longiflorum . After method optimization, the transformation efficiency reached 29.17% and 4%, respectively. Although the transformation efficiency in 'White Heaven' is still low, it is relatively stable and can be regenerated within 1 month. Song et al. [ 17 ] improved the original transformation system by adjusting the pH and CaCl 2 concentration of the medium; the number of resistant plants increased by 2.7–6.4 times, the number of positive lines increased by 3–6 times transformation, and the genetic transformation efficiency increased by 5.7–13.0%. In the latest study, the genetic transformation system of Oriental hybrid lily was further optimized, and the efficiency was increased to 60% by screening for the lethal concentration of antibiotics, the concentration of the bacterial solution and the duration of infection.

Good explant material is the basis of plant genetic transformation. The success of transformation depends on the selection and totipotency of explants [ 32 ]. Researchers have tested different explants for genetic transformation of target genes based on the Agrobacterium system (Table  1 ). Calli generated from floral organs, scales, leaves, or seeds have been used for genetic transformation in most lily hybrids [ 27 , 33 , 34 ]. Related studies have shown that filamentous calli have a faster growth rate and may be more susceptible to Agrobacterium infection [ 35 ]. In the Oriental hybrid lily ( Lilium cv. Acapulco), an Agrobacterium -mediated lily transformation system was successfully established by using filament-induced filiform calli as explants. Although transient expression of the GUS reporter gene could be detected by root–, leaf–, stalk–, ovary– and anther-induced callus infection, no positive transgenic tissues or plants were obtained [ 27 ]. In recent years, several other explants have been developed and offer additional possibilities for improving transformation efficiency. Liu et al. [ 24 ] discussed the effect of the direct regeneration pathway and the callus regeneration pathway on the transformation efficiency in Agrobacterium -based genetic transformation experiments using stem segments induced by lily scales as explants. Notably, when stem segments were used as explants, adventitious buds obtained via the direct regeneration pathway after coculture significantly increased the regeneration rate of resistant plants and decreased the gene escape rate [ 24 ]. Another study showed that the direct use of scales as transformation explants did not significantly improve the transformation rate but did greatly shorten the genetic transformation cycle [ 26 ]. Different explant materials have their own advantages. Cohen and Meredith [ 10 ] used a particle bombardment approach to carry out lily genetic transformation and reported that the ability of embryonic calli to accept foreign genes was 50–70 times greater than that of ordinary calli. Embryogenic calli are composed of many embryogenic cells, and each cell has the potential to develop into adult somatic embryos. Therefore, using embryogenic calli as explant materials can result in a more stable transformation population with a lower chimaerism rate, which is very important for the research and development of plant genetic transformation [ 36 , 37 , 38 , 39 ]. Mercuri et al. [ 25 ] induced embryonic calli using the styles and peduncles of Lilium longiflorum ‘Snow Queen’, and they were found to be highly competent for transformation. Recently, two studies reported an efficient protocol with high transformation efficiency for Lilium pumilum DC.Fisch. using embryonic calli. Despite their long transformation cycle, embryogenic calli are the most common explant material for the genetic transformation of lily due to their high cell proliferation rate and genetic stability [ 17 , 26 ].

Strains of agrobacterium

To date, many successful cases of stable genetic transformation of plants mediated by Agrobacterium have been reported [ 40 , 41 , 42 , 43 , 44 ]. The strain of Agrobacterium can also considerably influence the transformation frequency. With the continuous updating and optimization of plant genetic transformation technology, several researchers have attempted to improve the efficiency of plant transformation by changing various parameters, including Agrobacterium strains [ 45 ] (Table  1 ). Different plants have different preferences for the routinely used Agrobacterium strains EHA105, EHA101, LBA4404, GV3101, AGL1 and C58 [ 8 , 27 , 29 , 46 ]. In alfalfa [ 47 ], tomato [ 48 ], grasspea [ 49 ], and pigeon pea [ 50 ], LB4404 and LBA4404 were found to be more virulent and highly effective, offering higher transformation efficiency. However, the LBA4404 strain has been less frequently reported in lilies. Mercuri et al. [ 25 ] reported that LBA4404 effectively promoted the infection of embryogenic calli from Lilium longiflorum 'Snow Queen'. According to another study of genetic transformation in lily, the use of the EHA105 strain to infuse embryonic calli seemed to be more beneficial for improving transformation efficiency [ 26 ]. In recent years, the strains EHA101 and EHA105 have been more widely used in lily transformation and are considered to result in greater transformation frequency [ 16 , 18 ].

Selection of markers and reporter genes

The selection of marker genes also determines the efficiency of plant genetic transformation. They are usually delivered along with the target gene, conferring resistance to toxic compounds in plants and facilitating the growth of transformed cells in the presence of such unfavourable conditions. Normally, the marker gene and the target gene are connected to the same plasmid and delivered to the plant somatic cells via the Agrobacterium -mediated method. Suitable marker genes can help to quickly and efficiently screen many transformed materials and remove untransformed cells [ 8 ]. Conventional marker genes include the hpt gene, which encodes hygromycin phosphotransferase and confers resistance to hygromycin; the npt-II gene, which encodes neomycin phosphotransferase II and confers resistance to kanamycin, neomycin and geneticin; and the bar gene, which encodes phosphinothricin acetyltransferase and confers resistance to the herbicide phosphinothricin [ 23 , 51 , 52 ]. The type of resistance marker gene is determined in the vector, and hpt and npt-II are commonly used as marker genes for lily transformation [ 3 , 17 , 18 , 24 ]. Linking the GUS gene to a transformation vector for double or even triple marker gene screening combined with GUS histochemical staining is also an effective strategy for reducing the false positive rate of resistant plants [ 16 , 22 , 26 ] (Table  1 ).

Key parameters in the genetic transformation program

Ph of the medium.

The expression of the Agrobacterium virulence gene vir is the basis for the transformation of plant cells and the key to ensuring infection efficiency, which is strongly dependent on the pH of the medium [ 17 , 22 , 53 ]. Previous studies have shown that an acidic pH is more conducive to the expression of vir , and as the pH of the preculture or coculture medium decreases, the expression of vir is significantly upregulated [ 54 , 55 ]. Maintaining the pH at 5.2 effectively increased the genetic transformation efficiency of tomato cotyledons [ 56 ]. The virA and virG genes are switches that activate the expression of the vir gene [ 57 ]. Agrobacterium has a chemotactic system different from that of E. coli and is attracted to chemical inducers such as carbohydrates, amino acids and phenolic compounds [ 58 ]. High concentrations of chemical inducers bind to virA to induce the expression of the vir gene and trigger T-DNA transfer [ 59 ]. Acetylsyringone (AS) is a common class of natural phenolic compounds that can promote the direct entry of microorganisms into plant cells through wounds and achieve T-DNA transfer by activating the expression of the vir gene [ 58 , 60 , 61 , 62 ]. AS has been widely used in the genetic transformation of lily [ 23 , 27 ]. Although pH 7.0 is the most suitable environment for the growth of Agrobacterium , vir is more easily expressed under acidic conditions after the addition of AS, while vir expression is hardly induced under neutral pH conditions [ 54 , 63 ]. In a Lilium pumilum DC.Fisch. genetic transformation experiment, a stable pH of 5.8 in suspension and coculture media resulted in a somatic embryo transformation efficiency of 29.17% [ 26 ]. When the pH was adjusted to 5.0, the number of resistant calli increased significantly, and the transformation efficiency increased by 5.7–13% [ 17 ]. Ogaki et al. [ 23 ] reported that exogenous MES could effectively control the pH of the medium. This study further investigated the effect of adding different concentrations of MES (0, 10, 20, 50 and 100 mM) on the transformation efficiency of lily. The results showed that transient expression of the GUS gene could be observed only in coculture medium containing MES, and larger numbers of transgenic calli could be obtained by the addition of 10 mM MES buffer [ 30 ]. The above conclusions indicate that maintaining pH in the range of 5–6 values according to different varieties in the preculture and coculture stages is important for improving the efficiency of genetic transformation (Table  2 ).

Culture medium supplements

The composition of the medium is another rate-limiting factor affecting the genetic transformation efficiency of lily, and the process involves the preculture, coculture and regeneration of resistant plants. Many studies have shown that the addition or removal of certain compounds can significantly improve the efficiency of lily transformation (Table  2 ). MS medium, which contains 20.6 mM NH 4 NO 3 , is widely used in the tissue culture and genetic transformation of lily. However, the presence of NH 4 NO 3 limits the efficiency of genetic transformation in lily [ 23 , 26 , 64 ]. Previous studies have shown that virG transcription can be activated by low concentrations of phosphate [ 53 , 58 ]. When a low concentration of KH 2 PO 4 was used as a salt source instead of NH 4 NO 3 , there was no significant change in the number of regenerated resistant calli. In contrast, the complete removal of KH 2 PO 4 had a positive effect on lily transformation [ 22 ]. In a transformation study of the lily ‘Sorbonne’, it was found that the removal of KH 2 PO 4 , NH 4 NO 3 , KNO 3 or macroelements in the medium could significantly improve the transformation efficiency [ 28 ]. Montoro et al. [ 65 ] reported that Ga 2+ -free media significantly increased GUS activity in Brazilian rubber trees. However, another study concluded that the effect of GaCl 2 on plant transformation efficiency appears to be strongly dependent on genotype. Ga 2+ is considered one of the key factors involved in improving the efficiency of genetic transformation in improved lily genetic transformation systems. Increasing the GaCl 2 concentration from 0.44 g/L to 1.32 g/L significantly increased the germination coefficient of Lilium -resistant somatic embryos [ 17 ]. AS is an indispensable compound in the genetic transformation of lily, and its concentration is also a key factor; an AS concentration that is too high adversely affects T-DNA transfer [ 17 ]. Notably, researchers have found other compounds that can replace AS, and they can provide higher transformation efficiency. Chloroxynil (CX) is a class of phenolic compounds with a mode of action similar to that of AS that also improves the efficiency of treatment by activating the expression of vir. In the genetic transformation of lotus seeds, the transformation efficiency of explants treated with CX was 6 times greater than that of explants treated with AS [ 66 ]. Wei et al. [ 28 ] further confirmed the effect of CX in lily. When 4 μM CX was used, the transformation efficiency reached 11.1%, while 100 μM AS achieved only 6.6%, indicating that CX can replace AS in lily genetic transformation. Early studies showed that the promoting effect of carbohydrate substances other than glucose and xylose on vir gene activity was consistent with that of AS [ 67 , 68 ]. Further studies by Azadi et al. [ 22 ] showed that MS media supplemented with monosaccharides significantly inhibited the expression of the GUS gene, and no hygromycin-resistant lily calli were obtained. In contrast, adding sucrose significantly improved the efficiency of genetic transformation. In summary, for most series lilies, removing NH 4 NO 3 and adding an appropriate amount of AS has a positive effect on improving the genetic transformation efficiency. CX may be an excellent compound to replace AS, and it is worth further attempts in the future.

Bacterial concentration and infection time

The Agrobacterium concentration and infection time play pivotal roles in the transformation of lily. A low bacterial concentration and short infection duration will result in the failure of Agrobacterium to fully adhere to explant tissues, resulting in the inability to achieve effective transformation [ 69 ]. However, a high concentration of bacteria or long infection duration may also lead to rapid bacterial growth, which can cause severe damage to the recipient material [ 17 ]. Cell resistance varies greatly among different plant explants, and plant tolerance to different agrobacterium concentrations also differs. When the OD 600 was 0.8, the highest GUS expression rate was detected in embryogenic calli, but the percentage of resistant calli significantly decreased compared with that when the OD 600 was 0.6. For scales, the GUS expression rate and adventitious bud regeneration rate peaked when the OD 600 was 0.6. Infection time is also the key to determining transformation efficiency, and research shows that for embryonic calli and scales of Lilium pumilum, DC. Fisch, 15 min is the optimal time for Agrobacterium infection [ 26 ]. However, for embryogenic calli of the Oriental hybrid lily ‘Siberia’, an OD 600 of 0.4 was more beneficial for improving the transformation efficiency [ 18 ]. In addition, it has been reported that in the coculture process, the proliferation of Agrobacterium on the surface and around the callus increases with the removal of some elements, indicating that these elements have an inhibitory effect on Agrobacterium . Negative effects of bacterial overgrowth were observed when 10 mM MES was added to coculture media of sensitive varieties such as ‘Red Ruby’ and ‘Casa Blanca’. Therefore, screening different varieties of MES can effectively reduce bacterial growth and improve the transformation efficiency of lily [ 22 ].

Antibiotic selection

In the process of plant genetic transformation, an appropriate concentration of antibiotics can effectively inhibit the growth of non-transformed Cefatothin, and this is also a crucial step in determining the success of genetic transformation. Kanamycin, hygromycin and glyphosate have been used extensively for lily transformation due to their high availability and low toxicity, despite the occurrence of false positives in the screening of resistant plants [ 70 , 71 ] (Table  2 ). Lily explants of different genotypes have different antibiotic concentration requirements. Even within the same variety, different explant types have great differences in antibiotic tolerance [ 18 ]. Studies have shown that embryonic calli of Lilium pumilum DC. Fisch. The plants almost stopped growing and died after treatment with hygromycin supplemented at 40 mg·L −1 , resulting in extremely low growth and induction rates. However, a few scales of ‘White Heaven’ still formed complete buds under these conditions. Adjusting the concentration of hygromycin to 30 mg·L −1 reduced the browning rate of embryogenic calli by approximately 20% and significantly increased the growth and transformation rate. Therefore, 30 mg·L −1 and 40 mg·L −1 were the best hygromycin concentrations suitable for embryogenic calli and scales of Lilium pumilum DC. Fisch., respectively [ 26 ]. Another necessary antibiotic is a bacteriostatic antibiotic, which is mainly used to prevent the transformation of material from dying or difficult regeneration due to excessive Agrobacterium contamination. Cef is a common bacteriostatic agent used in plant transformation that has extensive resistance and inhibits the growth of Agrobacterium [ 72 , 73 ]. However, high concentrations of Cef can inhibit the growth of explant cells. Based on the results of studies on different lily varieties and explants, we believe that 300–400 mg·L −1 Cef may have a broad-spectrum effect [ 18 , 26 ]. The concentration of Agrobacterium may be a prerequisite for screening Cef concentrations. Even 400 mg·L −1 Cef had no bacteriostatic effect when the concentration of the bacterial solution was too high. When the OD600 of the bacterial solution is maintained within 0.2–0.4, 300 mg·L −1 Cef can have good antibacterial efficacy [ 18 ]. Therefore, it is necessary to combine the concentration of the bacterial solution with the concentration of the bacteriostatic agent during screening.

Preculture, infection and coculture procedures

Preculture, infection and coculture are the key steps in determining the success of plant genetic transformation. Previous studies have generally been conducted under the belief that the preculture of explants before transformation can effectively promote cell division so that they can maintain the best life state during infection and integrate foreign genes more easily [ 74 , 75 ]. The timing of preculture depends on the type and quality of the explants. Yan et al. [ 26 ] discussed the influence of preculture time on the transformation efficiency of L. pumilum and ‘White Heaven’. The results showed that the expression rate of GUS was lower in uncultured calli or scale explants. Similarly, compared with those of the control group, the proliferation and survival rates of the explant-treated group were significantly lower. For embryogenic calli, GUS expression and the proliferation rate were the highest in resistant calli after 10 days of preculture (66.67% and 63.33%, respectively). After 4 days of preculture, GUS expression and bud resistance began to decrease for the traumatized scales. Although the percentage of resistant buds was the highest after 2 days of preculture, a higher GUS expression rate appeared after 3 days (Table  2 ).

In lily, wounded explant materials are often more conducive to the transfer and integration of T-DNA, which can greatly improve the efficiency of genetic transformation [ 27 , 76 ]. Wei et al. [ 28 ] further confirmed this view. According to the results of Agrobacterium -mediated ‘Sobone’ genetic transformation, ultrasound treatment for 20 s can produce thousands of microwounds in explants, promote the penetration of Agrobacterium into the internal tissues of plants, and effectively improve the efficiency of transformation. The combination of heat shock and ultrasound had no significant effect. Coculture is an essential stage during which T-DNA is transferred into plant cells [ 77 ]. Therefore, coculture time is also an external factor that has been widely examined [ 75 ]. The time required for Agrobacterium -mediated gene transfer and integration into the plant genome varies widely depending on the genotype and explant type, usually ranging from a few hours to a few days [ 78 , 79 , 80 , 81 ]. Wu et al. [ 82 ] compared the transformation efficiency of bulb sections of Gladiolus under coculture for 3 days and 12 days, and the results showed that the transformation rate of coculture for 12 days was more than twice that for 3 days, indicating that a longer coculture time may benefit Agrobacterium infection and transformation. However, in Lilium pumilum DC. After more than 5 days of coculture, Fisch, which is also a typical bulbous flower, will cause severe browning and death of embryogenic calli and scales [ 26 ]. However, for the calli of the other two kinds of lilies, coculture for 7 days still maintained a high transformation efficiency, indicating that the tolerance of lily to Agrobacterium may depend on the genotype [ 15 , 27 ]. Drying plant tissue or cells before coculture can also promote T-DNA transfer [ 83 ]. The growth state and speed of calli in dry coculture were better than those in traditional media [ 84 ]. During subsequent resistance screening, only a few tissues were contaminated by the bacterial solution under dry conditions, and the regeneration rate of resistant calli increased significantly [ 34 ]. An appropriate low temperature during coculture also had a positive effect on T-DNA transfer [ 85 , 86 ]. The transformation efficiency of Boehmeria nivea (L.) Gaud. was significantly improved by coculture at 20 °C compared with 15 °C, 25 °C and 28 °C [ 87 ]. In the genetic transformation system of Gossypium hirsutum , 19 °C can significantly increase the regeneration rate of resistant calli and completely inhibit the proliferation of Agrobacterium . However, the effect of temperature on the genetic transformation efficiency of lily has not been clearly reported. In future studies, we can try to optimize the genetic transformation system for lily by adjusting the ambient temperature at each link.

Application of genetic transformation technology

Generation of the crispr/cas9 system.

With the continuous development of gene function research technology, gene modification has been widely used in basic plant research and molecular breeding [ 88 ]. Since CRISPR/Cas9 gene editing technology was successfully applied in Lotus japonicus , because of its simple design and limited operation, this technique has been successfully used in the study of flower anatomy and morphology, flower colour, flowering time, fragrance and stress resistance in various ornamental plants [ 89 , 90 , 91 , 92 ]. Yan et al. [ 26 ] established a stable and efficient genetic transformation system for two lily genotypes using somatic embryos and scales as explants and generated completely albino, light yellow and albino green chimeric mutants via directional knockout of the PDS gene; these authors successfully applied CRISPR/Cas9 technology to lily for the first time. The CRISPR/Cas9 system also validated the feasibility and efficiency of the two genetic transformation systems.

Application for improvement of plant morphogenesis

Morphogenetic genes are key factors that control plant organogenesis and somatic embryogenesis and determine the location of target cells to produce different structures or whole plants [ 8 ]. The functions of many morphogenetic genes have been identified in model plants and important cash crops and have been applied in scientific practice to increase the efficiency of regeneration and genetic transformation [ 93 , 94 ]. In lily, the somatic embryo has always been a good explant for genetic transformation. Plant somatic cells dedifferentiate into embryogenic stem cells under the action of external/internal genetic factors and then divide into somatic embryos. This process is the most critical stage for plant cells to become totipotent [ 95 ]. The most widely used method for somatic embryogenesis (SE) in various plants is the use of exogenous plant growth regulators, especially auxin [ 96 ]. Song et al. [ 17 ] reported that overexpression of LpABCB21 in lily could shorten the time required for SE without changing the exogenous PIC (Picloram). In contrast, the LpABCB21 mutant lines delayed somatic embryo generation by 1–3 days, but the induction rate of adventitious buds was significantly greater than that in the LpABCB21 -overexpressing lines. The study also indicated that the PILS (PIN-LIKES) family member LpPILS7 may participate in auxin regulation through the same mechanism as LpABCB21 , and the somatic embryo induction efficiency of the pils7 mutant was significantly reduced by approximately 10–60%. The importance of miRNAs in SE processes has also been validated in many dicot species and crops [ 82 , 97 ]. In Agrobacterium- mediated Lilium embryo transformation experiments, silencing lpu-miR171a and lpu-miR171b promoted starch accumulation and the expression of key cell cycle genes in calli, significantly accelerated the SE process in Lilium , and resulted in the same phenotype as overexpressing LpSCL6-II and LpSCL6-I . WUSCHEL is a typical gene family involved in the regulation of plant morphogenesis, and its expression is upregulated in many plant SE processes [ 98 , 99 ]. LlWOX9 and LlWOX11 reportedly play a positive regulatory role in the formation of bulbils by influencing cytokinin signalling [ 100 ]. However, the function of WUSCHEL members in Lilium embryogenesis remains to be further verified. It seems that changing the expression level of morphogenetic genes can be an effective means to improve the genetic transformation efficiency of lily, and this topic is worthy of further exploration in the future.

Genetic modification for agronomically important traits

At present, few studies have investigated genetic modification in lily, and most studies have validated the function of target genes only through transient gene transformation (Table  3 ). With the continuous improvement of the genetic transformation system for lily, a few key genes regulating important traits have been identified. In addition to influencing SE processes, many morphogenetic genes are involved in regulating plant organ formation or quality maintenance [ 101 , 102 , 103 ]. LaKNOX1 , a member of the homeobox gene family involved in regulating plant organogenesis, was also further validated in 'Siberia' and 'Sorbonne' [ 18 ]. A recent study revealed that a key gene, LdXERICO , is involved in the regulation of dormancy in Lilium davidii var. unicolour , which indicated that the maintenance of dormancy depends on the ABA-related pathway and that the transcription of LdXERICO is inhibited by the temperature response factor LdICE1 during low-temperature storage, which eventually leads to lily sprouting [ 3 ]. Recently, the LoNFYA7-LoVIL1 module has also been shown to play a key role in orchestrating the phase transition from slow to fast growth in lily bulbs [ 104 ]. Biological and abiotic stresses have a great impact on plant growth and development, and these stresses usually disrupt cellular mechanisms by inducing changes at the physiological, biochemical, and molecular levels in plants [ 105 ]. The identification of key genes involved in the regulation of the stress response in lily was aimed at improving plant resistance to biotic and abiotic stresses. Low temperature, drought, salt stress and abscisic acid treatment can significantly upregulate the expression of LlNAC2 , a member of the NAC transcription factor family. Overexpression of the LlNAC2 gene in tobacco significantly enhances the tolerance of transgenic plants to various abiotic stresses [ 106 ]. Chen et al. [ 18 ] used the genetic transformation system of lily to transform LlNAC2 and successfully generated a transgenic line, which provided favourable support for further clarifying the function of LlNAC2 in coping with abiotic stress in lily species. Typical biological stresses, including bacteria, fungi, viruses, insects and other diseases and pests, seriously negatively affect the quality of ornamental plants [ 89 ]. Several researchers have attempted to increase the resistance of lily plants to pathogens or pests by increasing or decreasing the expression of certain genes. Pratylenchus penetrans (RLN) is one of the main pests and diseases encountered in lily production. The overexpression of the rice cystatin (Oc-IΔD86 ) gene in Lilium longiflorum cv. 'Nellie White' showed that the resistance of transgenic lily to RLN infection was significantly enhanced, and the total nematode population decreased by 75 ± 5%. Compared with wild-type plants, OcIΔD86 -overexpressing plants also exhibited improved growth and development [ 107 ]. Plant resistance to viruses is usually established by transferring the coat protein-encoding gene of the virus into the plant [ 89 ]. Azadi et al. [ 22 ] introduced a cucumber mosaic virus (CMV) replicase defective gene ( CMV2-GDD ) into lily using an Agrobacterium -mediated genetic transformation system and identified two transgenic strains that showed stronger resistance to CMV. In Lilium oriental cv. 'Star Gazer', overexpression of the rice chitinase 10 ( RCH10 ) gene enhanced the resistance of lily to Botrytis elliptica [ 19 ]. Du et al. [ 108 ] identified a gene named LhSorPR4-2 , which encodes a disease course-related protein involved in fighting Botrytis elliptica infection in lily, and the overexpression of LhSorPR4-2 significantly enhanced the resistance of lily to Botrytis . This study also revealed that the function of LhSorPR4-2 was closely related to its chitinase activity. Another study showed that the transcription level of the resistance gene LrPR10-5 was significantly increased in transgenic ‘Siberia’ plants that overexpressed LrWRKY1 , which subsequently promoted resistance to F. oxysporum [ 109 ].

Conclusions

Since the first successful transformation event in lily, remarkable progress has been made; a variety of lily genetic transformation systems have been gradually established, and many excellent new germplasms have been obtained. However, the genetic transformation of lily still faces great challenges due to its strong genotypic dependence. Most related studies have focused on optimizing existing systems, and applicable genetic transformation systems have not yet been established for most lily strains with high market value. For a long time, how to stably and efficiently deliver recombinant gene vectors into plant cells has been the focus of most scholars. At present, the most common delivery method is Agrobacterium -mediated transformation. In addition to the cumbersome tissue culture process, the transformation efficiency also depends greatly on the genotype. The choice of explants for DNA, strains and vectors; culture conditions; and effective selection markers are all major factors that play pivotal roles in successful transformation. At present, most transgenic work in lily is limited by laboratory-scale gene function verification, and even after successful transformation, it is not easy to obtain stable transgenic plants. In recent years, various types of Rhizobium , including Ensifer adhaerens , Ochrobactrum haywardense and Sinorhizobium meliloti , have shown great potential in the transformation of nonagricultural bacterial systems. Some studies have revealed an invisible mechanism for delivering DNA into plant cells, where Sinorhizobium meliloti can infect both monocotyledonous and dicotyledonous plants [ 164 ]. Another way to improve the traditional transformation model is to coexpress developmental regulatory factors or morphogenetic genes during transformation. The overexpression of the developmental regulatory factors GROWTH-REGULATING factor (GRF) and Boby room (Bbm) in maize and sorghum, for which it is difficult to achieve genetic transformation, can significantly improve transformation efficiency [ 101 , 165 ]. Pollen tube transformation is a transformation system that does not require tissue culture, but this method is suitable only for model plants such as Arabidopsis and a few closely related plants. The pollen magnetic transfection-mediated transformation method can be applied to lily, but it may be species- or varietal specific. Zhang et al. [ 166 ] optimized pollen culture conditions, established a new method for the transient transformation of pollen magnetic beads, and concluded that the transformation efficiency was positively correlated with the transverse diameter of pollen and negatively correlated with the ratio of longitudinal diameter to transverse diameter. This study also evaluated the transformation efficiency of Lilium regale L. ‘Sweet Surrender’ and Lilium leucanthum ; L. ‘Sweet Surrender’ and Lilium leucanthum reached 85.80% and 54.47%, respectively, but successful transformation was not achieved in Lilium davidii var. unicolour . Particle bombardment and the electrical shock method are also common methods used in plant genetic transformation. At present, the main explants of the electroshock method are plant protoplasts, but because of their high cost, abundance of chimaeras after transformation and limited stable expression in offspring, these methods cannot be applied to large-scale lily plants. Therefore, exploring genetic transformation systems based on non-tissue culture methods is expected to alleviate the pressure of genetic transformation of lily in the future. Cao et al. [ 167 ] reported a cut-dip-bud (CDB) delivery system. Briefly, the CDB delivery system consists of cutting the junction of plant roots under nonsterile conditions, infecting the upper end with Agrobacterium , taking positive new roots after culture, cutting them into segments and culturing them again to obtain regenerated and transformed plants. Researchers have studied the effects on rubber grass ( Taraxacum koko-saghyz Rodin , TKS), Ipomoea batatas [L.] Lam.), Ailanthus altissima (Mill) Swingle, and Aralia elata (Miq.) The CDB system has been tested in several difficult-to-transform plants, including three woody plants, one of which is Clerodendrum chinense Mabb. The results showed that the CDB delivery system has wide applicability in plant genetic transformation. Furthermore, there is a great need for the validation of promoters other than CaMV35S to achieve optimal expression of transforming genes [ 8 ].

Notably, various plant genetic transformation systems have been further applied to establish RNA interference (RNAi) and gene editing technology systems. To date, there have been few reports on the application of RNAi and CRISPR/Cas9-based gene editing techniques in lilies. In 2019, Yan established a stable and efficient genetic transformation system for somatic embryo regeneration for the first time and successfully conducted targeted gene editing based on CRISPR/Cas9 [ 20 , 26 ]. As one of the sharpest tools in genetic technology, CRISPR/Cas9 “gene scissors” have set off a research boom in basic plant research and directed breeding work. It has great application potential for improving yield, quality, herbicide resistance, abiotic stress resistance and disease resistance. However, there are few successful cases of gene editing using CRISPR/Cas9 technology in lily, which may be related to its high heterozygosity. The stable genetic transformation system has not been widely used, which leads to many difficulties in the study of gene function. With the continuous improvement of the technical system of lily genetic transformation and the emergence of new delivery methods, the combination of multiple transformations may be the only way to develop functional lily genomics in the future, and major breakthroughs in genetic engineering applications in lily breeding are expected not to occur.

Availability of data and materials

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request. No datasets were generated or analysed during the current study.

Abbreviations

Embryogenesis

Acetosyringone

REGULATING factor

Cut-dip-bud

RNA interference

Liu X, Gu J, Wang J, Lu Y. Lily breeding by using molecular tools and transformation systems. Mol Biol Rep. 2014;41:6899–908.

Article   PubMed   CAS   Google Scholar  

Park S, Han N, Lee J, Lee JN, An S, Bae S. Anti-melanogenic effects of Lilium lancifolium root extract via downregulation of PKA/CREB and MAPK/CREB signaling pathways in B16F10 cells. Plant (Basel). 2023;12:3666.

CAS   Google Scholar  

Fan X, Zou X, Fu L, Yang Y, Li M, Wang C, et al. The RING-H2 gene LdXERICO plays a negative role in dormancy release regulated by low temperature in Lilium davidii var. unicolor . Hortic Res. 2023. https://doi.org/10.1093/hr/uhad030 .

Article   PubMed   PubMed Central   Google Scholar  

Li JW, Zhang XC, Wang MR, Bi WL, Faisal M, Da Silva JAT, et al. Development, progress and future prospects in cryobiotechnology of Lilium spp. Plant Method. 2019;15:125.

Article   Google Scholar  

Chen DF. Genetic transformation of wheat. Method Mol Biol. 1998;81:373–82.

Dayal S, Lavanya M, Devi P, Sharma KK. An efficient protocol for shoot regeneration and genetic transformation of pigeonpea [ Cajanus cajan (L) Millsp] using leaf explants. Plant Cell Rep. 2003;21:1072–9.

Ramkumar TR, Lenka SK, Arya SS, Bansal KC. A short history and perspectives on plant genetic transformation. Methods Mol Biol. 2020;2124:39–68.

Choudhury A, Rajam MV. Genetic transformation of legumes: an update. Plant Cell Rep. 2021;40:1813–30.

Zambryski P, Joos H, Genetello C, Leemans J, Montagu MV, Schell J. Ti plasmid vector for the introduction of DNA into plant cells without alteration of their normal regeneration capacity. EMBO J. 1983;2:2143–50.

Article   PubMed   PubMed Central   CAS   Google Scholar  

Cohen A, Meredith CP. Agrobacterium -mediated transformation of Lilium . Acta Hortic. 1992;325:611–8.

Hensel G. Genetic transformation of Triticeae cereals —summary of almost three-decade’s development. Biotechnol Adv. 2020;40: 107484.

Article   PubMed   Google Scholar  

Chilton MD, Drummond MH, Merio DJ, Sciaky D, Montoya AL, Gordon MP, et al. Stable incorporation of plasmid DNA into higher plant cells: the molecular basis of crown gall tumorigenesis. Cell. 1977;11:263–71.

Krenek P, Samajova O, Luptovciak I, Doskocilova A, Komis G, Samaj J. Transient plant transformation mediated by Agrobacterium tumefaciens : principles, methods and applications. Biotechnol Adv. 2015;33:1024–42.

Gelvin SB. Agrobacterium -mediated plant transformation: the biology behind the “gene-jockeying” tool. Microbiol Mol Biol Rev. 2003;67:16–37.

Hoshi Y, Kondo M, Kobayashi H, Mori S, Nakano M. Agrobacterium -mediated transformation of Lilium longiflorum . Acta Hortic. 2005;673:543–7.

Article   CAS   Google Scholar  

Qi Y, Du L, Quan Y, Tian F, Liu Y, Wang Y. Agrobacterium -mediated transformation of embryogenic cell suspension cultures and plant regeneration in Lilium tenuifolium oriental × trumpet ‘Robina.’ Acta Physiol Plant. 2014;36:2047–57.

Song S, Yan R, Wang C, Wang J, Sun H. Improvement of a genetic transformation system and preliminary study on the function of LpABCB21 and LpPILS7 based on somatic embryogenesis in Lilium pumilum DC. Fisch Int J Mol Sci. 2020;21:6784.

Chen Y, Hou X, Zheng Y, Lyu Y. The establishment of a genetic transformation system and the acquisition of transgenic plants of oriental hybrid lily ( Lilium L.). Int J Mol Sci. 2023;24:782.

González FFNDC, Davey MR, Cancho Sanchez E, Wilson ZA. Conferred resistance to Botrytis cinerea in Lilium by overexpression of the RCH10 chitinase gene. Plant Cell Rep. 2015;34:1201–9.

Yan R, Song S, Li H, Sun H. Functional analysis of the eTM-miR171-SCL6 module regulating somatic embryogenesis in Lilium pumilum DC. Fisch. Hortic Res. 2022. https://doi.org/10.1093/hr/uhac045 .

Azadi P, Bagheri H, Nalousi AM, Nazari F, Chandler SF. Current status and biotechnological advances in genetic engineering of ornamental plants. Biotechnol Adv. 2016;34:1073–90.

Azadi P, Otang NV, Supaporn H, Khan RS, Chin DP, Nakamura I, et al. Increased resistance to cucumber mosaic virus (CMV) in Lilium transformed with a defective CMV replicase gene. Biotechnol Lett. 2011;33:1249–55.

Ogaki M, Furuichi Y, Kuroda K, Chin DP, Ogawa Y, Mii M. Importance of co-cultivation medium pH for successful Agrobacterium -mediated transformation of Lilium x formolongi . Plant Cell Rep. 2008;27:699–705.

Liu J, Zhang J, Xu B, Jia C, Zhang J, Tan G, et al. Regeneration and production of transgenic Lilium longiflorum via Agrobacterium tumefaciens . In Vitro Cell Dev Biol Plant. 2011;47:348–56.

Mercuri A, De Benedetti L, Bruna S, Bregliano R, Bianchini C, Foglia G, et al. Agrobacterium -mediated transformation with rol genes of Lilium longiflorum thunb. Acta Hortic. 2003;612:129–36.

Yan R, Wang Z, Ren Y, Li H, Liu N, Sun H. Establishment of efficient genetic transformation systems and application of CRISPR/Cas9 genome editing technology in Lilium pumilum DC. Fisch. and Lilium longiflorum white heaven. Int J Mol Sci. 2019;20:2920.

Hoshi Y, Kondo M, Mori S, Adachi Y, Nakano M, Kobayashi H. Production of transgenic lily plants by Agrobacterium -mediated transformation. Plant Cell Rep. 2004;22:359–64.

Wei C, Cui Q, Lin Y, Jia G. Efficient Agrobacterium -mediated transformation of Lilium oriental “Sorbonne” with genes encoding anthocyanin regulators. Can J Plant Sci. 2017;97:796–807.

Li QH, Hong B, Tong Z, Ma C, Guan AN, Yu JJ, et al. Establishment of regeneration system and transformation of Zm401 gene in Lilium longiflorum × L. formosanum . Chin J Agric Biotechnol. 2008;5:113–9.

Abbasi H, Naderi R, Kafi M, Azadi P, Shakh-Asadi M, Okazaki K. Effect of ‘Chloroxynil’ on Agrobacterium -mediated transformation efficiency of Lilium cv ‘Manissa.’ Sci Hortic. 2020;271: 109404.

Fu L, Zhang J, Li M, Wang C, Chen Y, Fan X, et al. ldi-miR396- LdPMaT1 enhances reactive oxygen species scavenging capacity and promotes drought tolerance in Lilium distichum Nakai autotetraploids. Plant Cell Environ. 2023. https://doi.org/10.1111/pce.14783 .

Chakraborty N, Chakraborty P, Sen M, Bandopadhyay R. Choice of explant for plant genetic transformation. In: Rustgi S, Luo H, editors. Biolistic DNA delivery in plants: methods and protocols. New York: Springer; 2020. p. 107–23.

Chapter   Google Scholar  

Mori S, Adachi Y, Horimoto S, Suzuki S, Nakano M. Callus formation and plant regeneration in various Lilium species and cultivars. In Vitro Cell Dev Biol Plant. 2005;41:783–8.

Wang Y, Van Kronenburg B, Menzel T, Maliepaard C, Shen X, Krens F. Regeneration and Agrobacterium -mediated transformation of multiple lily cultivars. Plant Cell Tissue Organ Cult. 2012;111:113–22.

Potrykus I. Gene transfer to plants: assessment of published approaches and results. Annu Rev Plant Biol. 1991;42:205–25.

Cohen A, Lipsky A, Arazi T, Ion A, Stav R, Sandler-Ziv D, et al. Efficient genetic transformation of Lilium longiflorum and Ornithogalum dubium by particle acceleration followed by prolonged selection in liquid medium. Acta Hortic. 2004;651:131–8.

Mookkan M, Nelson-Vasilchik K, Hague J, Zhang ZJ, Kausch AP. Selectable marker independent transformation of recalcitrant maize inbred B73 and sorghum P898012 mediated by morphogenic regulators baby boom and WUSCHEL2. Plant Cell Rep. 2017;36:1477–91.

Nyaboga EN, Njiru JM, Tripathi L. Factors influencing somatic embryogenesis, regeneration, and Agrobacterium -mediated transformation of cassava ( Manihot esculenta Crantz) cultivar TME14. Front Plant Sci. 2015;6:411.

Su H, Jiao YT, Wang FF, Liu YE, Niu WL, Liu GT, et al. Overexpression of VpPR10.1 by an efficient transformation method enhances downy mildew resistance in V. vinifera . Plant Cell Rep. 2018;37:819–32.

Do PT, Lee H, Nelson-Vasilchik K, Kausch A, Zhang ZJ. Rapid and efficient genetic transformation of sorghum via Agrobacterium -mediated method. Curr Protoc Plant Biol. 2018;3: e20077.

Palomo-Ríos E, Narváez I, Pliego-Alfaro F, Mercado JA. Olive ( Olea europaea L. ) genetic transformation: current status and future prospects. Genes (Basel). 2021;12:386.

Raghuwanshi A, Birch RG. Genetic transformation of sweet sorghum. Plant Cell Rep. 2010;29:997–1005.

Tzfira T, Citovsky V. Agrobacterium -mediated genetic transformation of plants: biology and biotechnology. Curr Opin Biotechnol. 2006;17:147–54.

Zhang B. Agrobacterium -mediated genetic transformation of cotton. Method Mol Biol. 2019;1902:19–33.

Xi Y, Ge Y, Wang ZY. Genetic transformation of switchgrass. Method Mol Biol. 2009;581:53–9.

Tichá M, Illésová P, Hrbáčková M, Basheer J, Novák D, Hlaváčková K, et al. Tissue culture, genetic transformation, interaction with beneficial microbes, and modern bio-imaging techniques in alfalfa research. Crit Rev Biotechnol. 2020;40:1265–80.

Rosellini D, Capomaccio S, Ferradini N, Sardaro MLS, Nicolia A, Veronesi F. Non-antibiotic, efficient selection for alfalfa genetic engineering. Plant Cell Rep. 2007;26:1035–44.

Gao N, Shen W, Cao Y, Su Y, Shi W. Influence of bacterial density during preculture on Agrobacterium -mediated transformation of tomato. Plant Cell Tissue Organ Cult. 2009;98:321–30.

Barik DP, Mohapatra U, Chand PK. Transgenic grasspea ( Lathyrus sativus L.): factors influencing Agrobacterium -mediated transformation and regeneration. Plant Cell Rep. 2005;24:523–31.

Krishna G, Reddy PS, Ramteke PW, Bhattacharya PS. Progress of tissue culture and genetic transformation research in pigeon pea [ Cajanus cajan (L.) Millsp]. Plant Cell Rep. 2010;29:1079–95.

Ganguly S, Ghosh G, Ghosh S, Purohit A, Chaudhuri RK, Das S, et al. Plumular meristem transformation system for chickpea: an efficient method to overcome recalcitrant tissue culture responses. Plant Cell Tissue Organ Cult. 2020;142:493–504.

Ghosh G, Purohit A, Ganguly S, Chaudhuri RK, Chakraborti D. In vitro shoot grafting on rootstock: an effective tool for Agrobacterium-mediated transformation of pigeonpea ( Cajanus cajan (L.) Millsp.). Plant Biotechnol. 2014;31:301–8.

Winans SC. Transcriptional induction of an Agrobacterium regulatory gene at tandem promoters by plant-released phenolic compounds, phosphate starvation, and acidic growth media. J Bacteriol. 1990;172:2433–8.

Godwin I, Todd G, Ford-Lloyd B, Newbury HJ. The effects of acetosyringone and pH on Agrobacterium -mediated transformation vary according to plant species. Plant Cell Rep. 1991;9:671–5.

Vernade D, Herrera-Estrella A, Wang K, Van Montagu M. Glycine betaine allows enhanced induction of the Agrobacterium tumefaciens vir genes by acetosyringone at low pH. J Bacteriol. 1988;170:5822–9.

Wu YF, Chen Y, Liang XM, Wang XZ. An experimental assessment of the factors influencing Agrobacterium -mediated transformation in tomato. Russ J Plant Physiol. 2006;53:252–6.

Palmer AG, Gao R, Maresh J, Erbil WK, Lynn DG. Chemical biology of multi-host/pathogen interactions: chemical perception and metabolic complementation. Annu Rev Phytopathol. 2004;42:439–64.

McCullen CA, Binns AN. Agrobacterium tumefaciens and plant cell interactions and activities required for interkingdom macromolecular transfer. Annu Rev Cell Dev Biol. 2006;22:101–27.

Guo M, Huang Z, Yang J. Is there any crosstalk between the chemotaxis and virulence induction signaling in Agrobacterium tumefaciens ? Biotechnol Adv. 2017;35:505–11.

Song YN, Shibuya M, Ebizuka Y, Sankawa U. Synergistic action of phenolic signal compounds and carbohydrates in the induction of virulence gene expression of Agrobacterium tumefaciens . Chem Pharm Bull (Tokyo). 1991;39:2613–6.

Stachel SE, Nester EW, Zambryski PC. A plant cell factor induces Agrobacterium tumefaciens vir gene expression. Proc Natl Acad Sci U S A. 1986;83:379–83.

Verma AK, Chand L. Agrobacterium-mediated transformation of pigeonpea ( Cajanus cajan L.) with uidA and cryIA(b) genes. Physiol Mol Biol Plants. 2005;11:99–109.

Li L, Jia Y, Hou Q, Charles TC, Nester EW, Pan SQ. A global pH sensor: Agrobacterium sensor protein ChvG regulates acid-inducible genes on its two chromosomes and Ti plasmid. Proc Natl Acad Sci U S A. 2002;99:12369–74.

Azadi P, Ntui V, Chin D, Mii M. Genetic transformation and metabolic engineering of Lilium . In: Ramawat KG, Merillon JM, editors. Bulbous plants. Boca Raton: CRC Press; 2016. p. 197–213.

Google Scholar  

Montoro P, Teinseree N, Rattana W, Kongsawadworakul P, Michaux-Ferriere N. Effect of exogenous calcium on Agrobacterium tumefaciens -mediated gene transfer in Hevea brasiliensis (rubber tree) friable calli. Plant Cell Rep. 2000;19:851–5.

Kimura M, Cutler S, Isobe S. A novel phenolic compound, chloroxynil, improves Agrobacterium -mediated transient transformation in Lotus japonicus . PLoS ONE. 2015;10: e0131626.

Ahn JH, Lee JS. Sugar acts as a regulatory signal on the wound-inducible expression of SbHRGP3 ::GUS in transgenic plants. Plant Cell Rep. 2003;22:286–93.

Wise AA, Voinov L, Binns AN. Intersubunit complementation of sugar signal transduction in VirA heterodimers and posttranslational regulation of VirA activity in Agrobacterium tumefaciens . J Bacteriol. 2005;187:213–23.

Pushyami B, Beena MR, Sinha MK, Kirti PB. In vitro regeneration and optimization of conditions for Agrobacterium mediated transformation in jute. Corchorus capsularis J Plant Biochem Biotechnol. 2011;20:39–46.

Nakano M, Otani M. Plant regeneration and Agrobacterium -mediated genetic transformation systems in liliaceous ornamental plants. Plant Biotechnol (Tokyo). 2020;37:129–40.

Suzuki S, Oota M, Nakano M. Embryogenic callus induction from leaf explants of the liliaceous ornamental plant, Agapanthus praecox ssp. orientalis (Leighton) Leighton: histological study and response to selective agents. Sci Hortic. 2002;95:123–32.

Ahmed RI, Ding A, Xie M, Kong Y. Progress in optimization of Agrobacterium -mediated transformation in Sorghum ( Sorghum bicolor ). Int J Mol Sci. 2018;19:2983.

Sunilkumar G, Rathore KS. Transgenic cotton: factors influencing Agrobacterium -mediated transformation and regeneration. Mol Breed. 2001;8:37–52.

Lin YJ, Zhang Q. Optimising the tissue culture conditions for high efficiency transformation of indica rice. Plant Cell Rep. 2005;23:540–7.

Toki S, Hara N, Ono K, Onodera H, Tagiri A, Oka S, et al. Early infection of scutellum tissue with Agrobacterium allows high-speed transformation of rice. Plant J. 2006;47:969–76.

Liu Z, Park BJ, Kanno A, Kameya T. The novel use of a combination of sonication and vacuum infiltration in Agrobacterium -mediated transformation of kidney bean ( Phaseolus vulgaris L.) with lea Gene. Mol Breed. 2005;16:189–97.

Liu SJ, Wei ZM, Huang JQ. The effect of co-cultivation and selection parameters on Agrobacterium -mediated transformation of Chinese soybean varieties. Plant Cell Rep. 2008;27:489–98.

Chen X, Equi R, Baxter H, Berk K, Han J, Agarwal S, et al. A high-throughput transient gene expression system for switchgrass ( Panicum virgatum L.) seedlings. Biotechnol Biofuel. 2010;3:9.

Sun HJ, Uchii S, Watanabe S, Ezura H. A highly efficient transformation protocol for Micro-Tom, a model cultivar for tomato functional genomics. Plant Cell Physiol. 2006;47:426–31.

Vergne P, Maene M, Gabant G, Chauvet A, Debener T, Bendahmane M. Somatic embryogenesis and transformation of the diploid Rosa chinensis cv Old Blush. Plant Cell Tissue Organ Cult. 2010;100:73–81.

Zhao J, Li ZT, Cui J, Henny RJ, Gray DJ, Xie J, et al. Efficient somatic embryogenesis and Agrobacterium -mediated transformation of pothos ( Epipremnum aureum ) ‘Jade.’ Plant Cell Tissue Organ Cult. 2013;114:237–47.

Wu XM, Kou SJ, Liu YL, Fang YN, Xu Q, Guo WW. Genomewide analysis of small RNAs in nonembryogenic and embryogenic tissues of citrus: microRNA- and siRNA-mediated transcript cleavage involved in somatic embryogenesis. Plant Biotechnol J. 2015;13:383–94.

Cheng M, Hu T, Layton J, Liu CN, Fry JE. Desiccation of plant tissues post- Agrobacterium infection enhances T-DNA delivery and increases stable transformation efficiency in wheat. In Vitro Cell Dev Biol Plant. 2003;39:595–604.

Vogel J, Hill T. High-efficiency Agrobacterium -mediated transformation of Brachypodium distachyon inbred line Bd21-3. Plant Cell Rep. 2008;27:471–8.

Dillen W, De Clercq J, Kapila J, Zambre M, Van Montagu M, Angenon G. The effect of temperature on Agrobacterium tumefaciens -mediated gene transfer to plants. Plant J. 1997;12:1459–63.

Fullner KJ, Nester EW. Temperature affects the T-DNA transfer machinery of Agrobacterium tumefaciens . J Bacteriol. 1996;178:1498–504.

An X, Wang B, Liu L, Jiang H, Chen J, Ye S, et al. Agrobacterium -mediated genetic transformation and regeneration of transgenic plants using leaf midribs as explants in ramie [ Boehmeria nivea (L.) Gaud]. Mol Biol Rep. 2014;41:3257–69.

Zhang Y, Ma X, Xie X, Liu YG. CRISPR/Cas9-based genome editing in plants. In: Weeks DP, Yang B, editors. Progress in molecular biology and translational science. Cambridge: Academic Press; 2017. p. 133–50.

Boutigny AL, Dohin N, Pornin D, Rolland M. Overview and detectability of the genetic modifications in ornamental plants. Hortic Res. 2020;7:11.

Kishi-Kaboshi M, Aida R, Sasaki K. Generation of gene-edited Chrysanthemum morifolium using multicopy transgenes as targets and markers. Plant Cell Physiol. 2017;58:216–26.

PubMed   CAS   Google Scholar  

Wang C, Li Y, Wang N, Yu Q, Li Y, Gao J, et al. An efficient CRISPR/Cas9 platform for targeted genome editing in rose ( Rosa hybrida ). J Integr Plant Biol. 2023;65:895–9.

Wang L, Wang L, Tan Q, Fan Q, Zhu H, Hong Z, et al. Efficient inactivation of symbiotic nitrogen fixation related genes in Lotus japonicus using CRISPR-Cas9. Front Plant Sci. 2016;7:1333.

PubMed   PubMed Central   Google Scholar  

Kausch AP, Nelson-Vasilchik K, Hague J, Mookkan M, Quemada H, Dellaporta S, et al. Edit at will: genotype independent plant transformation in the era of advanced genomics and genome editing. Plant Sci. 2019;281:186–205.

Lowe K, La Rota M, Hoerster G, Hastings C, Wang N, Chamberlin M, et al. Rapid genotype “independent” Zea mays L. (maize) transformation via direct somatic embryogenesis. In Vitro Cell Dev Biol Plant. 2018;54:240–52.

Nowak K, Wójcikowska B, Gaj MD. ERF022 impacts the induction of somatic embryogenesis in Arabidopsis through the ethylene-related pathway. Planta. 2015;241:967–85.

Jiménez VM. Involvement of plant hormones and plant growth regulators on in vitro somatic embryogenesis. Plant Growth Regul. 2005;47:91–110.

Long JM, Liu CY, Feng MQ, Liu Y, Wu XM, Guo WW. miR156-SPL modules regulate induction of somatic embryogenesis in citrus callus. J Exp Bot. 2018;69:2979–93.

Jha P, Ochatt SJ, Kumar V. WUSCHEL : a master regulator in plant growth signaling. Plant Cell Rep. 2020;39:431–44.

Zuo J, Niu QW, Frugis G, Chua NH. The WUSCHEL gene promotes vegetative-to-embryonic transition in Arabidopsis . Plant J. 2002;30:349–59.

He G, Cao Y, Wang J, Song M, Bi M, Tang Y, et al. WUSCHEL -related homeobox genes cooperate with cytokinin to promote bulbil formation in Lilium lancifolium . Plant Physiol. 2022;190:387–402.

Lowe K, Wu E, Wang N, Hoerster G, Hastings C, Cho MJ, et al. Morphogenic regulators baby boom and WUSCHEL improve monocot transformation. Plant Cell. 2016;28:1998–2015.

Sun L, Song SL, Yang Y, Sun HM. Melatonin regulates lily bulblet development through the LoBPM3-LoRAV module. Ornam Plant Res. 2022;2:1–11.

Sun Q, Zhang B, Yang C, Wang W, Xiang L, Wang Y, et al. Jasmonic acid biosynthetic genes TgLOX4 and TgLOX5 are involved in daughter bulb development in tulip ( Tulipa gesneriana ). Hortic Res. 2022. https://doi.org/10.1093/hr/uhac006 .

Pan W, Li J, Du Y, Zhao Y, Xin Y, Wang S, et al. Epigenetic silencing of callose synthase by VIL1 promotes bud-growth transition in lily bulbs. Nat Plant. 2023;9:1451–67.

Parmar N, Singh KH, Sharma D, Singh L, Kumar P, Nanjundan J, et al. Genetic engineering strategies for biotic and abiotic stress tolerance and quality enhancement in horticultural crops: a comprehensive review. 3 Biotech. 2017;7:239.

Yong Y, Zhang Y, Lyu Y. A stress-responsive NAC transcription factor from tiger lily (LlNAC2) interacts with LlDREB1 and LlZHFD4 and enhances various abiotic stress tolerance in Arabidopsis . Int J Mol Sci. 2019;20:3225.

Vieira P, Wantoch S, Lilley CJ, Chitwood DJ, Atkinson HJ, Kamo K. Expression of a cystatin transgene can confer resistance to root lesion nematodes in Lilium longiflorum cv ‘Nellie White.’ Transgenic Res. 2015;24:421–32.

Du W, Chai N, Sun Z, Wang H, Liu S, Sui S, et al. Full-length transcriptome characterization and functional analysis of pathogenesis-related proteins in Lilium oriental hybrid ‘Sorbonne’ infected with Botrytis elliptica . Int J Mol Sci. 2022;24:425.

Li S, Liu G, Pu L, Liu X, Wang Z, Zhao Q, et al. WRKY transcription factors actively respond to Fusarium oxysporum in Lilium regale . Phytopathology. 2021;111:1625–37.

Tong Z, Li Q, Yang Y, Dai F, Gao J, Hong B. Isolation and expression analysis of LoPIP2 , a lily ( Lilium oriental hybrids) aquaporin gene involved in desiccation-induced anther dehiscence. Sci Hortic. 2013;164:316–22.

Wu Z, Liang J, Wang C, Zhao X, Zhong X, Cao X, et al. Overexpression of lily HsfA3s in Arabidopsis confers increased thermotolerance and salt sensitivity via alterations in proline catabolism. J Exp Bot. 2018;69:2005–21.

Wu Z, Liang J, Zhang S, Zhang B, Zhao Q, Li G, et al. A canonical DREB2-type transcription factor in lily is post-translationally regulated and mediates heat stress response. Front Plant Sci. 2018;9:243.

Zhang T, Sun M, Guo Y, Shi X, Yang Y, Chen J, et al. Overexpression of LiDXS and LiDXR from lily ( Lilium ’Siberia’) enhances the terpenoid content in tobacco flowers. Front Plant Sci. 2018;9:909.

Wu Z, Liang J, Wang C, Ding L, Zhao X, Cao X, et al. Alternative splicing provides a mechanism to regulate LlHSFA3 function in response to heat stress in lily. Plant Physiol. 2019;181:1651–67.

Tasaki K, Yamagishi M, Masuta C. Virus-induced gene silencing in lilies using cucumber mosaic virus vectors. Methods Mol Biol. 2020;2172:1–13.

Fu Y, Zhu Y, Yang W, Xu W, Li Q, Chen M, et al. Isolation and functional identification of a Botrytis cinerea -responsive caffeoyl-CoA O-methyltransferase gene from Lilium regale wilson. Plant Physiol Biochem. 2020;157:379–89.

Zhang T, Guo Y, Shi X, Yang Y, Chen J, Zhang Q, et al. Overexpression of LiTPS2 from a cultivar of lily ( Lilium ’Siberia’) enhances the monoterpenoids content in tobacco flowers. Plant Physiol Biochem. 2020;151:391–9.

Jiang X, Chi X, Zhou R, Li Y, Li W, Liu Q, et al. Transcriptome profiling to identify tepal cell enlargement and pigmentation genes and the function of LtEXLB1 in Lilium tsingtauense . Funct Plant Biol. 2021;48:241–56.

Yin X, Zhang Y, Zhang L, Wang B, Zhao Y, Irfan M, et al. Regulation of MYB transcription factors of anthocyanin synthesis in lily flowers. Front Plant Sci. 2021;12: 761668.

Abbas F, Nian X, Zhou Y, Ke Y, Liu L, Yu R, et al. Putative regulatory role of hexokinase and fructokinase in terpenoid aroma biosynthesis in Lilium “Siberia.” Plant Physiol Biochem. 2021;167:619–29.

Ding L, Wu Z, Teng R, Xu S, Cao X, Yuan G, et al. LlWRKY39 is involved in thermotolerance by activating LlMBF1c and interacting with LlCaM3 in lily ( Lilium longiflorum ). Hortic Res. 2021;8:36.

Luo J, Li R, Xu X, Niu H, Zhang Y, Wang C. SMRT and illumina RNA sequencing and characterization of a key NAC gene LoNAC29 during the flower senescence in Lilium oriental “Siberia.” Genes (Basel). 2021;12:869.

He G, Yang P, Cao Y, Tang Y, Wang L, Song M, et al. Cytokinin type-B response regulators promote bulbil initiation in Lilium lancifolium . Int J Mol Sci. 2021;22:3320.

Liu X, Wu Z, Feng J, Yuan G, He L, Zhang D, et al. A novel R2R3-MYB gene LoMYB33 from lily is specifically expressed in anthers and plays a role in pollen development. Front Plant Sci. 2021;12: 730007.

Wu Z, Li T, Liu X, Yuan G, Hou H, Teng N. A novel R2R3-MYB transcription factor LlMYB305 from Lilium longiflorum plays a positive role in thermotolerance via activating heat-protective genes. Environ Exp Bot. 2021;184: 104399.

Yuan G, Wu Z, Liu X, Li T, Teng N. Characterization and functional analysis of LoUDT1, a bHLH transcription factor related to anther development in the lily oriental hybrid Siberia ( Lilium spp.). Plant Physiol Biochem. 2021;166:1087–95.

Wang Y, Zhou Y, Wang R, Xu F, Tong S, Song C, et al. Ethylene response factor LlERF110 mediates heat stress response via regulation of LlHsfA3A expression and interaction with LlHsfA2 in lilies ( Lilium longiflorum ). Int J Mol Sci. 2022;23:16135.

Fang S, Yang C, Ali MM, Lin M, Tian S, Zhang L, et al. Transcriptome analysis reveals the molecular regularity mechanism underlying stem bulblet formation in oriental lily “Siberia”; functional characterization of the LoLOB18 gene. Int J Mol Sci. 2022;23:15246.

Yang YY, Ma B, Li YY, Han MZ, Wu J, Zhou XF, et al. Transcriptome analysis identifies key gene LiMYB305 involved in monoterpene biosynthesis in Lilium “Siberia.” Front Plant Sci. 2022;13:1021576.

Wu Z, Li T, Cao X, Zhang D, Teng N. Lily WRKY factor LlWRKY22 promotes thermotolerance through autoactivation and activation of LlDREB2B . Hortic Res. 2022;9:uhac186.

Wu Z, Li T, Zhang D, Teng N. Lily HD-Zip I transcription factor LlHB16 promotes thermotolerance by activating LlHSFA2 and LlMBF1c. Plant Cell Physiol. 2022;63:1729–44.

Li T, Wu Z, Xiang J, Zhang D, Teng N. Overexpression of a novel heat-inducible ethylene-responsive factor gene LlERF110 from Lilium longiflorum decreases thermotolerance. Plant Sci. 2022;319: 111246.

Li T, Zhou T, Liang J, Zhang D, Teng N, Wu Z. Overexpression of lily LlWRKY22 enhances multiple abiotic stress tolerances in transgenic Arabidopsis . Ornam Plant Res. 2022;2:1–10.

Wang Z, Deng J, Liang T, Su L, Zheng L, Chen H, et al. Lilium regale Wilson WRKY3 modulates an antimicrobial peptide gene, LrDef1 , during response to Fusarium oxysporum . BMC Plant Biol. 2022;22:257.

Fu Y, Li J, Wu H, Jiang S, Zhu Y, Liu C, et al. Analyses of Botrytis cinerea -responsive LrWRKY genes from Lilium regale reveal distinct roles of two LrWRKY transcription factors in mediating responses to B. cinerea . Plant Cell Rep. 2022;41:995–1012.

Zhou Y, Wang Y, Xu F, Song C, Yang X, Zhang Z, et al. Small HSPs play an important role in crosstalk between HSF-HSP and ROS pathways in heat stress response through transcriptomic analysis in lilies ( Lilium longiflorum ). BMC Plant Biol. 2022;22:202.

Chen Y, Zhao M, Wang X, Cui J, Ge W, Zhang K. Key microRNAs and target genes involved in regulating maturation in Lilium . Ornam Plant Res. 2022;2:1–14.

Westerdahl B, Riddle L, Giraud D, Kamo K. Field test of Easter lilies transformed with a rice cystatin gene for root lesion nematode resistance. Front Plant Sci. 2023;14:1134224.

Yue Y, Wang L, Li M, Liu F, Yin J, Huang L, et al. A BAHD acyltransferase contributes to the biosynthesis of both ethyl benzoate and methyl benzoate in the flowers of Lilium oriental hybrid “Siberia.” Front Plant Sci. 2023;14:1275960.

Guo Y, Guo Z, Zhong J, Liang Y, Feng Y, Zhang P, et al. Positive regulatory role of R2R3 MYBs in terpene biosynthesis in Lilium ‘Siberia.’ Hortic Plant J. 2023;9:1024–38.

Feng Y, Guo Z, Zhong J, Liang Y, Zhang P, Sun M. The LibHLH22 and LibHLH63 from Lilium ‘Siberia’ can positively regulate volatile terpenoid biosynthesis. Horticulturae. 2023;9:459.

Fang S, Lin M, Ali MM, Zheng Y, Yi X, Wang S, et al. LhANS-rr1 , LhDFR , and LhMYB114 regulate anthocyanin biosynthesis in flower buds of Lilium ‘Siberia.’ Genes (Basel). 2023;14:559.

Liu L, Xie T, Zhao Z, Zhao J, Deng M, Wen J. Involvement of a novel NAP member LbNAP in flower senescence and dehydration stress in cut lily. Sci Hortic. 2023;308: 111482.

Liu X, He L, Wu Z, Teng N. GAMYB transcription factor LoMYB65 from lily plays a vital role in pollen development. Hortic Plant J. 2023;10:223–38.

Liu Y, Wang Q, Abbas F, Zhou Y, He J, Fan Y, et al. Light regulation of LoCOP1 and its role in floral scent biosynthesis in Lilium ‘Siberia.’ Plants (Basel). 2023;12:2004.

Deng J, Wang ZE, Li WY, Chen XH, Liu DQ. WRKY11 up-regulated dirigent expression to enhance lignin/lignans accumulation in Lilium regale Wilson during response to Fusarium wilt. J Integr Agric. 2023. https://doi.org/10.1016/j.jia.2023.07.032 .

Wang X, Li Q, Zhu H, Song M, Zhang K, Ge W. Molecular mechanisms of miR172a and its target gene LbrTOE3 regulating maturation in Lilium . Planta. 2023;258:53.

Sun Y, Zang Y, Ma Y, Wang C, Song S, Sun H. Identification and functional analysis of LpNAC37 associated with somatic embryogenesis in Lilium pumilum DC. Fisch. based on transcriptome analysis. Plant Physiol Biochem. 2023;205:107964.

Wu Z, Li T, Xiang J, Teng R, Zhang D, Teng N. A lily membrane-associated NAC transcription factor LlNAC014 is involved in thermotolerance via activation of the DREB2-HSFA3 module. J Exp Bot. 2023;74:945–63.

Wu Z, Liang J, Li T, Zhang D, Teng N. A LlMYB305-LlC3H18-LlWRKY33 module regulates thermotolerance in lily. Mol Hortic. 2023;3:15.

Zhang X, Xu S, Pan X, Wu Z, Ding L, Teng N. Low LdMYB12 expression contributes to petal spot deficiency in Lilium davidii var. unicolor . Mol Genet Genomics. 2023;298:1545–57.

Bi M, Liang R, Wang J, Qu Y, Liu X, Cao Y, et al. Multifaceted roles of LhWRKY44 in promoting anthocyanin accumulation in Asiatic hybrid lilies ( Lilium spp.). Hortic Res. 2023;10:uhad167.

Feng J, Wang Y, Ge W, Zhang K, Cui J. Regulatory mechanism of the miR172e-LbrAP2 module during the vegetative growth phase transition in Lilium . Planta. 2023;259:26.

Zhang L, Wang Z, Ji S, Zhu G, Dong Y, Li J, et al. Ferric reduction oxidase in Lilium pumilum affects plant saline-alkaline tolerance by regulating ROS homeostasis. Plant Physiol Biochem. 2023;207: 108305.

Jing Y, Song Y, Ji S, Zhang L, Wang Z, Dong Y, et al. PS II subunit P in Lilium pumilum ( LpPsbP ) confers saline-alkali resistance to the plant by scavenging ROS. Int J Mol Sci. 2023;24:3311.

Wu X, Ling W, Pan Y, Yang Z, Ma J, Yang Y, et al. Functional analysis of a lily short vegetative phase ortholog in flowering transition and floral development. Plant Physiol Biochem. 2024;206: 108287.

Wu Z, Li T, Ding L, Wang C, Teng R, Xu S, et al. Lily LlHSFC2 coordinates with HSFAs to balance heat stress response and improve thermotolerance. New Phytol. 2024;241:2124–42.

Wu Z, Li T, Zhang Y, Zhang D, Teng N. HD-Zip I protein LlHOX6 antagonizes homeobox protein LlHB16 to attenuate basal thermotolerance in lily. Plant Physiol. 2024;194:1870–88.

Tong Z, Dong T, Li Q, Wang R, He J, Hong B. R2R3-type LoMYB21 affects jasmonate-regulated development and dehiscence of anthers in lily ( Lilium oriental hybrids). Hortic Plant J. 2024;10:239–51.

Liu T, Wang Y, Li X, Che H, Zhang Y. LpNAC5 positively regulates drought, salt and alkalinity tolerance of Lilium pumilum . Gene. 2024;20: 148550.

Liu X, Yan W, Liu S, Wu J, Leng P, Hu Z. LiNAC100 contributes to linalool biosynthesis by directly regulating LiLiS in Lilium ‘Siberia.’ Planta. 2024;259:73.

Cao L, Jiang F, Liu D, Zhang J, Yang T, Zhang J, et al. Genome-wide characterization of differentially expressed scent genes in the MEP control network of the flower of Lilium ‘Sorbonne.’ Mol Biotechnol. 2024. https://doi.org/10.1007/s12033-024-01063-3 .

Cao YW, Song M, Bi MM, Yang PP, He GR, Wang J, et al. Lily (Lilium spp.) LhERF4 negatively affects anthocyanin biosynthesis by suppressing LhMYBSPLATTER transcription. Plant Sci. 2024;342:112026.

Rathore DS, Mullins E. Alternative non- Agrobacterium based methods for plant transformation. In: Roberts JA, editor. Annual plant reviews online. Chichester: John Wiley & Sons; 2018. p. 891–908.

Debernardi JM, Tricoli DM, Ercoli MF, Hayta S, Ronald P, Palatnik JF, et al. A GRF-GIF chimeric protein improves the regeneration efficiency of transgenic plants. Nat Biotechnol. 2020;38:1274–9.

Zhang M, Ma X, Jin G, Han D, Xue J, Du Y, et al. A modified method for transient transformation via pollen magnetofection in Lilium germplasm . Int J Mol Sci. 2023;24:15304.

Cao X, Xie H, Song M, Lu J, Ma P, Huang B, et al. Cut-dip-budding delivery system enables genetic modifications in plants without tissue culture. Innovation (Camb). 2023;4: 100345.

PubMed   Google Scholar  

Download references

Acknowledgements

Not applicable

This work was financed by the National Natural Science Foundation of China (grant number 32302589), the Postdoctoral Science Foundation of China (2023MD744227), Shenyang Innovation Program of Seed Industry (21-110-3-12), Liaoning Province Germplasm Innovation Grain Storage Technology Special Plan (2023JH1/10200010), and the earmarked fund for CARS (CARS-23).

Author information

Authors and affiliations.

Key Laboratory of Protected Horticulture of Education Ministry, College of Horticulture, Shenyang Agricultural University, Shenyang, 110866, China

Xinyue Fan & Hongmei Sun

National and Local Joint Engineering Research Center of Northern Horticultural Facilities Design and Application Technology, Shenyang, 110866, China

Hongmei Sun

You can also search for this author in PubMed   Google Scholar

Contributions

Xinyue Fan: Writing—original draft. Hongmei Sun: Conceptualization, Writing—review & editing, Supervision, and Funding acquisition. All the authors read and approved the final version of the paper.

Corresponding author

Correspondence to Hongmei Sun .

Ethics declarations

Ethics approval and consent to participate.

This study does not address all ethical issues and has been approved by all the authors. Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

13007_2024_1246_moesm1_esm.jpg.

Additional Files 1. Fig. S1: Literature keywords related to the field of lily research that appear together in the map. Keywords that appear more than 30 times are displayed, and different colours represent different cluster.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Fan, X., Sun, H. Exploring Agrobacterium -mediated genetic transformation methods and its applications in Lilium . Plant Methods 20 , 120 (2024). https://doi.org/10.1186/s13007-024-01246-8

Download citation

Received : 17 June 2024

Accepted : 27 July 2024

Published : 09 August 2024

DOI : https://doi.org/10.1186/s13007-024-01246-8

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Agrobacterium tumefaciens
  • Genetically modified
  • Genetic transformation
  • Transgenic plants
  • CRISPR‒Cas9

Plant Methods

ISSN: 1746-4811

conclusion validity research method

IMAGES

  1. PPT

    conclusion validity research method

  2. PPT

    conclusion validity research method

  3. PPT

    conclusion validity research method

  4. PPT

    conclusion validity research method

  5. PPT

    conclusion validity research method

  6. conclusion validity example in research

    conclusion validity research method

COMMENTS

  1. Conclusion Validity

    Conclusion validity is the degree to which the conclusion we reach is credible or believable. Although conclusion validity was originally thought to be a statistical inference issue, it has become more apparent that it is also relevant in qualitative research. For example, in an observational field study of homeless adolescents the researcher ...

  2. The 4 Types of Validity in Research

    As face validity is a subjective measure, it's often considered the weakest form of validity. However, it can be useful in the initial stages of developing a method. Criterion validity. Criterion validity evaluates how well a test can predict a concrete outcome, or how well the results of your test approximate the results of another test.

  3. Validity

    Validity is a fundamental concept in research, referring to the extent to which a test, measurement, or study accurately reflects or assesses ... Valid results ensure that conclusions drawn from research are accurate and can be trusted. This, in turn, influences the decisions and policies based on the research. ... the methodology section ...

  4. Statistical Conclusion Validity: Some Common Threats and Simple

    Statistical conclusion validity (SCV) holds when the conclusions of a research study are founded on an adequate analysis of the data, generally meaning that adequate statistical methods are used whose small-sample behavior is accurate, besides being logically capable of providing an answer to the research question.

  5. Validity in Analysis, Interpretation, and Conclusions

    Table 6.1 Validity questions in analysis, interpretation, and conclusion. Generally, the validity at this stage has to do with coherence or consistence in the story that an evaluation is trying to tell (Peck et al., 2012 ). The consistency of an evaluation's story definitely affects the persuasiveness of its argument.

  6. Validity In Psychology Research: Types & Examples

    In psychology research, validity refers to the extent to which a test or measurement tool accurately measures what it's intended to measure. It ensures that the research findings are genuine and not due to extraneous factors. Validity can be categorized into different types, including construct validity (measuring the intended abstract trait), internal validity (ensuring causal conclusions ...

  7. The 4 Types of Validity in Research Design (+3 More to Consider)

    For this reason, we are going to look at various validity types that have been formulated as a part of legitimate research methodology. Here are the 7 key types of validity in research: Face validity. Content validity. Construct validity. Internal validity. External validity. Statistical conclusion validity.

  8. Introduction to Validity

    When we talk about the validity of research, we are often referring to these to the many conclusions we reach about the quality of different parts of our research methodology. We subdivide validity into four types. Each type addresses a specific methodological question. In order to understand the types of validity, you have to know something ...

  9. What is Validity in Research?

    Construct validity is a cornerstone in research methodology. It pertains to ensuring that the tools or methods used in a research study genuinely capture the intended theoretical constructs. In qualitative research, the challenge lies in the abstract nature of many constructs. For example, if one were to investigate "emotional intelligence" or ...

  10. 1 Validity and Validation in Research and Assessment

    We can question the validity of inferences drawn from data; the validity of interpretations based on test scores; the validity of conclusions drawn from research results. In this book, I will use the word claim to refer to inferences, interpretations, or conclusions, unless use of a more specific term is appropriate.

  11. PDF VALIDITY OF QUANTITATIVE RESEARCH

    Statistical conclusion validity is an issue whenever statistical tests are used to test hypotheses. The research design can address threats to validity through. considerations of statistical power. alpha reduction procedures (e.g., Bonferoni technique) when multiple tests are used. use of reliable instruments.

  12. Validity in Research: A Guide to Better Results

    Validity in research is the ability to conduct an accurate study with the right tools and conditions to yield acceptable and reliable data that can be reproduced. Researchers rely on carefully calibrated tools for precise measurements. However, collecting accurate information can be more of a challenge. Studies must be conducted in environments ...

  13. Reliability vs Validity in Research

    Revised on 10 October 2022. Reliability and validity are concepts used to evaluate the quality of research. They indicate how well a method, technique, or test measures something. Reliability is about the consistency of a measure, and validity is about the accuracy of a measure. It's important to consider reliability and validity when you are ...

  14. Validity, reliability, and generalizability in qualitative research

    In assessing validity of qualitative research, the challenge can start from the ontology and epistemology of the issue being studied, e.g. the concept of "individual" is seen differently between humanistic and positive psychologists due to differing philosophical perspectives: Where humanistic psychologists believe "individual" is a ...

  15. Improving Conclusion Validity

    Good Implementation. When you are studying the effects of interventions, treatments or programs, you can improve conclusion validity by assuring good implementation. This can be accomplished by training program operators and standardizing the protocols for administering the program. Here are some general guidelines you can follow in designing ...

  16. Reliability vs. Validity in Research

    Reliability is about the consistency of a measure, and validity is about the accuracy of a measure.opt. It's important to consider reliability and validity when you are creating your research design, planning your methods, and writing up your results, especially in quantitative research. Failing to do so can lead to several types of research ...

  17. Reliability and Validity

    Reliability refers to the consistency of the measurement. Reliability shows how trustworthy is the score of the test. If the collected data shows the same results after being tested using various methods and sample groups, the information is reliable. If your method has reliability, the results will be valid. Example: If you weigh yourself on a ...

  18. Statistical conclusion validity: Some common threats and simple remedies

    The ultimate goal of research is to produce dependable knowledge or to provide the evidence that may guide practical decisions. Statistical conclusion validity (SCV) holds when the conclusions of a research study are founded on an adequate analysis of the data, generally meaning that adequate statistical methods are used whose small-sample behavior is accurate, besides being logically capable ...

  19. Construct Validity

    Construct Validity | Definition, Types, & Examples. Published on February 17, 2022 by Pritha Bhandari.Revised on June 22, 2023. Construct validity is about how well a test measures the concept it was designed to evaluate. It's crucial to establishing the overall validity of a method.. Assessing construct validity is especially important when you're researching something that can't be ...

  20. 5.3 Experimentation and Validity

    Researchers have focused on four validities to help assess whether an experiment is sound (Judd & Kenny, 1981; Morling, 2014)[1][2]: internal validity, external validity, construct validity, and statistical validity. We will explore each validity in depth. Internal Validity. Two variables being statistically related does not necessarily mean ...

  21. The Significance of Validity and Reliability in Quantitative Research

    Quantitative researchis used to investigate and analyze data to draw meaningful conclusions. Validity and reliability are two critical concepts in quantitative analysis that ensure the accuracy and consistency of the research results. Validity refers to the extent to which the research measures what it intends to measure, while reliability ...

  22. (PDF) Chapter 3

    Some important factors in research methodology include validity of research data, ethics and the ... findings and draw a conclusion to answer the research question thus solving the research problem.

  23. Full article: Ethical leadership and public sector performance

    Section 3 describes the methodology and measures used in this study. Section 4 presents the analysis and results. Section 5 presents the discussion. Section 6 presents the conclusions of the study. Section 7 outlines the theoretical and practical implications of the study. Finally, Section 8 identifies the limitations and future research ...

  24. Full article: The role of smart governance in ensuring the success of

    Discriminant validity. For the next stage, the HTMT method and the criterion are applied to determine the measurement's model discriminant validity ... Conclusion. This study contributes to the understanding of the effectiveness of smart cities by confirming that the elements of smart governance have an influence on the effectiveness of smart ...

  25. Threats to Conclusion Validity

    The "noise" consists of all of the factors that make it hard to see the relationship. There are several important sources of noise, each of which is a threat to conclusion validity. One important threat is low reliability of measures (see reliability ). This can be due to many factors including poor question wording, bad instrument design ...

  26. Development and Preliminary Validation of the Chinese Version of the

    Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were employed for the validity analysis; 22 venous therapy experts participated in the Delphi expert consultation. A total of 500 patients were recruited from two third-class A hospitals in Guangdong Province, China, between July 2020 and January 2021 to test reliability ...

  27. Malay Translation and Validation of the Oslo Sports Trauma Research

    In 2014, the Oslo Sports Trauma Research Center developed a method for capturing the occurrence and severity of overuse injuries in sport, known as the Oslo Sports Trauma Research Center Questionnaire on Health Problems (OSTRC-H). 5 The questionnaire consists of 4 core items that are administered from the period before a competition, at regular ...

  28. Exploring Agrobacterium-mediated genetic transformation methods and its

    As a typical bulb flower, lily is widely cultivated worldwide because of its high ornamental, medicinal and edible value. Although breeding efforts evolved over the last 10000 years, there are still many problems in the face of increasing consumer demand. The approach of biotechnological methods would help to solve this problem and incorporate traits impossible by conventional breeding. Target ...