critical thinking action research

The Action Research Planner

Doing Critical Participatory Action Research

• © 2014
• Stephen Kemmis 0 ,
• Robin McTaggart 1 ,
• Rhonda Nixon 2

Charles Sturt University, Wagga Wagga, Australia

You can also search for this author in PubMed   Google Scholar

Griffith University, Gold Coast, Australia

Victoria university, canada.

• A step-by-step guide to planning critical participatory action research projects
• Provides concise and readable illustrative examples
• Provides practical resources to assist new and experienced action researchers planning a study
• Provides a theoretical framework that explains ‘participation’, ‘practice’ and ‘research’
• Fully updated new edition of a classic of Action Research literature
• Includes supplementary material: sn.pub/extras

802k Accesses

677 Citations

74 Altmetric

This is a preview of subscription content, log in via an institution to check access.

Access this book

Subscribe and save.

• Get 10 units per month
• Download Article/Chapter or eBook
• 1 Unit = 1 Article or 1 Chapter
• Cancel anytime
• Available as EPUB and PDF
• Read on any device
• Instant download
• Own it forever
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info
• Durable hardcover edition

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

About this book

A fully-updated and reworked version of the classic book by Stephen Kemmis and Robin McTaggart, now joined by Rhonda Nixon, The Action Research Planner is a detailed guide to developing and conducting a critical participatory action research project. The authors outline new views on ‘participation’ (based on Jürgen Habermas’s notion of a ‘public sphere’), ‘practice’ (as shaped by practice architectures), and ‘research’ (as research within practice traditions). They provide five extended examples of critical participatory action research studies. The book includes a range of resources for people planning a critical participatory research initiative, providing guidance on how to establish an action research group and identify a shared concern, research ethics, principles of procedure for action researchers, protocols for collaborative work, keeping a journal, gathering evidence, reporting, and choosing academic partners.

Unlike earlier editions, The Action Research Planner focuses specifically on critical participatory action research, which occupies a particular (critical) niche in the action research 'family'.

The Action Research Planner is an essential guide to planning and undertaking this type of research.

Similar content being viewed by others

• Critical Participatory Action Research

Participatory action research

Principles of Participatory Research

• Action research in the classroom
• Critical aproaches to education
• Professional practice

Rhonda Nixon

Robin McTaggart

• Social and educational research

Stephen Kemmis

• action research in education
• action research project
• research methods
• learning and instruction

Table of contents (7 chapters)

Front matter, introducing critical participatory action research.

• Stephen Kemmis, Robin McTaggart, Rhonda Nixon

A New View of Participation: Participation in Public Spheres

A new view of practice: practices held in place by practice architectures, a new view of research: research within practice traditions, doing critical participatory action research: the ‘planner’ part, examples of critical participatory action research, resources for critical participatory action researchers, back matter, authors and affiliations, about the authors.

Stephen Kemmis is Professor of Education and a member of the Research Institute for Professional Practice, Learning and Education at Charles Sturt University (Faculty of Education, Wagga Wagga). He is also co-leader of the ‘Pedagogy, Education and Praxis’ (PEP) international collaboration involving researchers from universities in Europe and Canada. Stephen has held academic positions at the University of Sydney, University of Illinois, University of East Anglia, Deakin University and the University of Ballarat and also worked for several years as an independent consultant. He has published extensively on professional practice, indigenous education, participatory action research and qualitative methods in educational research. His most well-known publication is the highly acclaimed book (with Wilfred Carr) "Becoming Critical: Education, knowledge and action research". In 2001 Stephen was made an Honorary Life Member of the Australian Association for Educational Research (AARE), and in 2009 he was awarded two honorary doctorates for services to international educational research.

Robin McTaggart is Adjunct Professor at the Griffith Institute for Educational Research at Griffith University, Gold Coast, Queensland, Australia. He was formerly Professor and Head of School of  Administration and Curriculum Studies at Deakin University, Geelong, Australia, and Dean of Education and Pro-Vice-Chancellor Quality Assurance at James Cook University, Townsville, Australia. He was also Adjunct Professor in the International Graduate School of Management PhD program at the University of South Australia for several years. He has practised, taught and published extensively about critical participatory action research in many countries including Thailand, Malaysia, Indonesia, Singapore, Hong Kong, New Zealand, Canada and the USA.

Rhonda Nixon is an Adjunct Professor at the University of Alberta, Alberta, Canada and currently works at Edmonton CatholicSchools.  She has fifteen years of experience as a former elementary, junior and secondary teacher and English Language Arts Consultant for a large urban school district. She is currently supporting schools in critical participatory action research as an approach to professional learning in her role as Manager of Edmonton Catholic Schools’ TRANSFORM professional development programs. Her 2012 PhD thesis, from the University of Alberta, Investigating tension in collaborative action research about comics writing, reported on a critical participatory action research program undertaken with elementary school teachers investigating the power of comics writing as a way to teach narrative writing.

Bibliographic Information

Book Title : The Action Research Planner

Book Subtitle : Doing Critical Participatory Action Research

Authors : Stephen Kemmis, Robin McTaggart, Rhonda Nixon

DOI : https://doi.org/10.1007/978-981-4560-67-2

Publisher : Springer Singapore

eBook Packages : Humanities, Social Sciences and Law , Education (R0)

Copyright Information : Springer Science+Business Media Singapore 2014

Hardcover ISBN : 978-981-4560-66-5 Published: 27 November 2013

Softcover ISBN : 978-981-10-1350-8 Published: 18 September 2016

eBook ISBN : 978-981-4560-67-2 Published: 12 November 2013

Edition Number : 1

Number of Pages : XI, 200

Number of Illustrations : 6 b/w illustrations

Topics : Teaching and Teacher Education , Learning & Instruction , Assessment, Testing and Evaluation

• Publish with us

Policies and ethics

• Find a journal
• Track your research

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Review Article
• Open access
• Published: 11 January 2023

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

• Enwei Xu   ORCID: orcid.org/0000-0001-6424-8169 1 ,
• Wei Wang 1 &
• Qingxia Wang 1  

Humanities and Social Sciences Communications volume  10 , Article number:  16 ( 2023 ) Cite this article

19k Accesses

21 Citations

3 Altmetric

Metrics details

• Science, technology and society

Collaborative problem-solving has been widely embraced in the classroom instruction of critical thinking, which is regarded as the core of curriculum reform based on key competencies in the field of education as well as a key competence for learners in the 21st century. However, the effectiveness of collaborative problem-solving in promoting students’ critical thinking remains uncertain. This current research presents the major findings of a meta-analysis of 36 pieces of the literature revealed in worldwide educational periodicals during the 21st century to identify the effectiveness of collaborative problem-solving in promoting students’ critical thinking and to determine, based on evidence, whether and to what extent collaborative problem solving can result in a rise or decrease in critical thinking. The findings show that (1) collaborative problem solving is an effective teaching approach to foster students’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]); (2) in respect to the dimensions of critical thinking, collaborative problem solving can significantly and successfully enhance students’ attitudinal tendencies (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI[0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI[0.58, 0.82]); and (3) the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have an impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. On the basis of these results, recommendations are made for further study and instruction to better support students’ critical thinking in the context of collaborative problem-solving.

Similar content being viewed by others

A meta-analysis of the effects of design thinking on student learning

Fostering twenty-first century skills among primary school students through math project-based learning

A meta-analysis to gauge the impact of pedagogies employed in mixed-ability high school biology classrooms

Introduction.

Although critical thinking has a long history in research, the concept of critical thinking, which is regarded as an essential competence for learners in the 21st century, has recently attracted more attention from researchers and teaching practitioners (National Research Council, 2012 ). Critical thinking should be the core of curriculum reform based on key competencies in the field of education (Peng and Deng, 2017 ) because students with critical thinking can not only understand the meaning of knowledge but also effectively solve practical problems in real life even after knowledge is forgotten (Kek and Huijser, 2011 ). The definition of critical thinking is not universal (Ennis, 1989 ; Castle, 2009 ; Niu et al., 2013 ). In general, the definition of critical thinking is a self-aware and self-regulated thought process (Facione, 1990 ; Niu et al., 2013 ). It refers to the cognitive skills needed to interpret, analyze, synthesize, reason, and evaluate information as well as the attitudinal tendency to apply these abilities (Halpern, 2001 ). The view that critical thinking can be taught and learned through curriculum teaching has been widely supported by many researchers (e.g., Kuncel, 2011 ; Leng and Lu, 2020 ), leading to educators’ efforts to foster it among students. In the field of teaching practice, there are three types of courses for teaching critical thinking (Ennis, 1989 ). The first is an independent curriculum in which critical thinking is taught and cultivated without involving the knowledge of specific disciplines; the second is an integrated curriculum in which critical thinking is integrated into the teaching of other disciplines as a clear teaching goal; and the third is a mixed curriculum in which critical thinking is taught in parallel to the teaching of other disciplines for mixed teaching training. Furthermore, numerous measuring tools have been developed by researchers and educators to measure critical thinking in the context of teaching practice. These include standardized measurement tools, such as WGCTA, CCTST, CCTT, and CCTDI, which have been verified by repeated experiments and are considered effective and reliable by international scholars (Facione and Facione, 1992 ). In short, descriptions of critical thinking, including its two dimensions of attitudinal tendency and cognitive skills, different types of teaching courses, and standardized measurement tools provide a complex normative framework for understanding, teaching, and evaluating critical thinking.

Cultivating critical thinking in curriculum teaching can start with a problem, and one of the most popular critical thinking instructional approaches is problem-based learning (Liu et al., 2020 ). Duch et al. ( 2001 ) noted that problem-based learning in group collaboration is progressive active learning, which can improve students’ critical thinking and problem-solving skills. Collaborative problem-solving is the organic integration of collaborative learning and problem-based learning, which takes learners as the center of the learning process and uses problems with poor structure in real-world situations as the starting point for the learning process (Liang et al., 2017 ). Students learn the knowledge needed to solve problems in a collaborative group, reach a consensus on problems in the field, and form solutions through social cooperation methods, such as dialogue, interpretation, questioning, debate, negotiation, and reflection, thus promoting the development of learners’ domain knowledge and critical thinking (Cindy, 2004 ; Liang et al., 2017 ).

Collaborative problem-solving has been widely used in the teaching practice of critical thinking, and several studies have attempted to conduct a systematic review and meta-analysis of the empirical literature on critical thinking from various perspectives. However, little attention has been paid to the impact of collaborative problem-solving on critical thinking. Therefore, the best approach for developing and enhancing critical thinking throughout collaborative problem-solving is to examine how to implement critical thinking instruction; however, this issue is still unexplored, which means that many teachers are incapable of better instructing critical thinking (Leng and Lu, 2020 ; Niu et al., 2013 ). For example, Huber ( 2016 ) provided the meta-analysis findings of 71 publications on gaining critical thinking over various time frames in college with the aim of determining whether critical thinking was truly teachable. These authors found that learners significantly improve their critical thinking while in college and that critical thinking differs with factors such as teaching strategies, intervention duration, subject area, and teaching type. The usefulness of collaborative problem-solving in fostering students’ critical thinking, however, was not determined by this study, nor did it reveal whether there existed significant variations among the different elements. A meta-analysis of 31 pieces of educational literature was conducted by Liu et al. ( 2020 ) to assess the impact of problem-solving on college students’ critical thinking. These authors found that problem-solving could promote the development of critical thinking among college students and proposed establishing a reasonable group structure for problem-solving in a follow-up study to improve students’ critical thinking. Additionally, previous empirical studies have reached inconclusive and even contradictory conclusions about whether and to what extent collaborative problem-solving increases or decreases critical thinking levels. As an illustration, Yang et al. ( 2008 ) carried out an experiment on the integrated curriculum teaching of college students based on a web bulletin board with the goal of fostering participants’ critical thinking in the context of collaborative problem-solving. These authors’ research revealed that through sharing, debating, examining, and reflecting on various experiences and ideas, collaborative problem-solving can considerably enhance students’ critical thinking in real-life problem situations. In contrast, collaborative problem-solving had a positive impact on learners’ interaction and could improve learning interest and motivation but could not significantly improve students’ critical thinking when compared to traditional classroom teaching, according to research by Naber and Wyatt ( 2014 ) and Sendag and Odabasi ( 2009 ) on undergraduate and high school students, respectively.

The above studies show that there is inconsistency regarding the effectiveness of collaborative problem-solving in promoting students’ critical thinking. Therefore, it is essential to conduct a thorough and trustworthy review to detect and decide whether and to what degree collaborative problem-solving can result in a rise or decrease in critical thinking. Meta-analysis is a quantitative analysis approach that is utilized to examine quantitative data from various separate studies that are all focused on the same research topic. This approach characterizes the effectiveness of its impact by averaging the effect sizes of numerous qualitative studies in an effort to reduce the uncertainty brought on by independent research and produce more conclusive findings (Lipsey and Wilson, 2001 ).

This paper used a meta-analytic approach and carried out a meta-analysis to examine the effectiveness of collaborative problem-solving in promoting students’ critical thinking in order to make a contribution to both research and practice. The following research questions were addressed by this meta-analysis:

What is the overall effect size of collaborative problem-solving in promoting students’ critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills)?

How are the disparities between the study conclusions impacted by various moderating variables if the impacts of various experimental designs in the included studies are heterogeneous?

This research followed the strict procedures (e.g., database searching, identification, screening, eligibility, merging, duplicate removal, and analysis of included studies) of Cooper’s ( 2010 ) proposed meta-analysis approach for examining quantitative data from various separate studies that are all focused on the same research topic. The relevant empirical research that appeared in worldwide educational periodicals within the 21st century was subjected to this meta-analysis using Rev-Man 5.4. The consistency of the data extracted separately by two researchers was tested using Cohen’s kappa coefficient, and a publication bias test and a heterogeneity test were run on the sample data to ascertain the quality of this meta-analysis.

Data sources and search strategies

There were three stages to the data collection process for this meta-analysis, as shown in Fig. 1 , which shows the number of articles included and eliminated during the selection process based on the statement and study eligibility criteria.

This flowchart shows the number of records identified, included and excluded in the article.

First, the databases used to systematically search for relevant articles were the journal papers of the Web of Science Core Collection and the Chinese Core source journal, as well as the Chinese Social Science Citation Index (CSSCI) source journal papers included in CNKI. These databases were selected because they are credible platforms that are sources of scholarly and peer-reviewed information with advanced search tools and contain literature relevant to the subject of our topic from reliable researchers and experts. The search string with the Boolean operator used in the Web of Science was “TS = (((“critical thinking” or “ct” and “pretest” or “posttest”) or (“critical thinking” or “ct” and “control group” or “quasi experiment” or “experiment”)) and (“collaboration” or “collaborative learning” or “CSCL”) and (“problem solving” or “problem-based learning” or “PBL”))”. The research area was “Education Educational Research”, and the search period was “January 1, 2000, to December 30, 2021”. A total of 412 papers were obtained. The search string with the Boolean operator used in the CNKI was “SU = (‘critical thinking’*‘collaboration’ + ‘critical thinking’*‘collaborative learning’ + ‘critical thinking’*‘CSCL’ + ‘critical thinking’*‘problem solving’ + ‘critical thinking’*‘problem-based learning’ + ‘critical thinking’*‘PBL’ + ‘critical thinking’*‘problem oriented’) AND FT = (‘experiment’ + ‘quasi experiment’ + ‘pretest’ + ‘posttest’ + ‘empirical study’)” (translated into Chinese when searching). A total of 56 studies were found throughout the search period of “January 2000 to December 2021”. From the databases, all duplicates and retractions were eliminated before exporting the references into Endnote, a program for managing bibliographic references. In all, 466 studies were found.

Second, the studies that matched the inclusion and exclusion criteria for the meta-analysis were chosen by two researchers after they had reviewed the abstracts and titles of the gathered articles, yielding a total of 126 studies.

Third, two researchers thoroughly reviewed each included article’s whole text in accordance with the inclusion and exclusion criteria. Meanwhile, a snowball search was performed using the references and citations of the included articles to ensure complete coverage of the articles. Ultimately, 36 articles were kept.

Two researchers worked together to carry out this entire process, and a consensus rate of almost 94.7% was reached after discussion and negotiation to clarify any emerging differences.

Eligibility criteria

Since not all the retrieved studies matched the criteria for this meta-analysis, eligibility criteria for both inclusion and exclusion were developed as follows:

The publication language of the included studies was limited to English and Chinese, and the full text could be obtained. Articles that did not meet the publication language and articles not published between 2000 and 2021 were excluded.

The research design of the included studies must be empirical and quantitative studies that can assess the effect of collaborative problem-solving on the development of critical thinking. Articles that could not identify the causal mechanisms by which collaborative problem-solving affects critical thinking, such as review articles and theoretical articles, were excluded.

The research method of the included studies must feature a randomized control experiment or a quasi-experiment, or a natural experiment, which have a higher degree of internal validity with strong experimental designs and can all plausibly provide evidence that critical thinking and collaborative problem-solving are causally related. Articles with non-experimental research methods, such as purely correlational or observational studies, were excluded.

The participants of the included studies were only students in school, including K-12 students and college students. Articles in which the participants were non-school students, such as social workers or adult learners, were excluded.

The research results of the included studies must mention definite signs that may be utilized to gauge critical thinking’s impact (e.g., sample size, mean value, or standard deviation). Articles that lacked specific measurement indicators for critical thinking and could not calculate the effect size were excluded.

Data coding design

In order to perform a meta-analysis, it is necessary to collect the most important information from the articles, codify that information’s properties, and convert descriptive data into quantitative data. Therefore, this study designed a data coding template (see Table 1 ). Ultimately, 16 coding fields were retained.

The designed data-coding template consisted of three pieces of information. Basic information about the papers was included in the descriptive information: the publishing year, author, serial number, and title of the paper.

The variable information for the experimental design had three variables: the independent variable (instruction method), the dependent variable (critical thinking), and the moderating variable (learning stage, teaching type, intervention duration, learning scaffold, group size, measuring tool, and subject area). Depending on the topic of this study, the intervention strategy, as the independent variable, was coded into collaborative and non-collaborative problem-solving. The dependent variable, critical thinking, was coded as a cognitive skill and an attitudinal tendency. And seven moderating variables were created by grouping and combining the experimental design variables discovered within the 36 studies (see Table 1 ), where learning stages were encoded as higher education, high school, middle school, and primary school or lower; teaching types were encoded as mixed courses, integrated courses, and independent courses; intervention durations were encoded as 0–1 weeks, 1–4 weeks, 4–12 weeks, and more than 12 weeks; group sizes were encoded as 2–3 persons, 4–6 persons, 7–10 persons, and more than 10 persons; learning scaffolds were encoded as teacher-supported learning scaffold, technique-supported learning scaffold, and resource-supported learning scaffold; measuring tools were encoded as standardized measurement tools (e.g., WGCTA, CCTT, CCTST, and CCTDI) and self-adapting measurement tools (e.g., modified or made by researchers); and subject areas were encoded according to the specific subjects used in the 36 included studies.

The data information contained three metrics for measuring critical thinking: sample size, average value, and standard deviation. It is vital to remember that studies with various experimental designs frequently adopt various formulas to determine the effect size. And this paper used Morris’ proposed standardized mean difference (SMD) calculation formula ( 2008 , p. 369; see Supplementary Table S3 ).

Procedure for extracting and coding data

According to the data coding template (see Table 1 ), the 36 papers’ information was retrieved by two researchers, who then entered them into Excel (see Supplementary Table S1 ). The results of each study were extracted separately in the data extraction procedure if an article contained numerous studies on critical thinking, or if a study assessed different critical thinking dimensions. For instance, Tiwari et al. ( 2010 ) used four time points, which were viewed as numerous different studies, to examine the outcomes of critical thinking, and Chen ( 2013 ) included the two outcome variables of attitudinal tendency and cognitive skills, which were regarded as two studies. After discussion and negotiation during data extraction, the two researchers’ consistency test coefficients were roughly 93.27%. Supplementary Table S2 details the key characteristics of the 36 included articles with 79 effect quantities, including descriptive information (e.g., the publishing year, author, serial number, and title of the paper), variable information (e.g., independent variables, dependent variables, and moderating variables), and data information (e.g., mean values, standard deviations, and sample size). Following that, testing for publication bias and heterogeneity was done on the sample data using the Rev-Man 5.4 software, and then the test results were used to conduct a meta-analysis.

Publication bias test

When the sample of studies included in a meta-analysis does not accurately reflect the general status of research on the relevant subject, publication bias is said to be exhibited in this research. The reliability and accuracy of the meta-analysis may be impacted by publication bias. Due to this, the meta-analysis needs to check the sample data for publication bias (Stewart et al., 2006 ). A popular method to check for publication bias is the funnel plot; and it is unlikely that there will be publishing bias when the data are equally dispersed on either side of the average effect size and targeted within the higher region. The data are equally dispersed within the higher portion of the efficient zone, consistent with the funnel plot connected with this analysis (see Fig. 2 ), indicating that publication bias is unlikely in this situation.

This funnel plot shows the result of publication bias of 79 effect quantities across 36 studies.

Heterogeneity test

To select the appropriate effect models for the meta-analysis, one might use the results of a heterogeneity test on the data effect sizes. In a meta-analysis, it is common practice to gauge the degree of data heterogeneity using the I 2 value, and I 2  ≥ 50% is typically understood to denote medium-high heterogeneity, which calls for the adoption of a random effect model; if not, a fixed effect model ought to be applied (Lipsey and Wilson, 2001 ). The findings of the heterogeneity test in this paper (see Table 2 ) revealed that I 2 was 86% and displayed significant heterogeneity ( P  < 0.01). To ensure accuracy and reliability, the overall effect size ought to be calculated utilizing the random effect model.

The analysis of the overall effect size

This meta-analysis utilized a random effect model to examine 79 effect quantities from 36 studies after eliminating heterogeneity. In accordance with Cohen’s criterion (Cohen, 1992 ), it is abundantly clear from the analysis results, which are shown in the forest plot of the overall effect (see Fig. 3 ), that the cumulative impact size of cooperative problem-solving is 0.82, which is statistically significant ( z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]), and can encourage learners to practice critical thinking.

This forest plot shows the analysis result of the overall effect size across 36 studies.

In addition, this study examined two distinct dimensions of critical thinking to better understand the precise contributions that collaborative problem-solving makes to the growth of critical thinking. The findings (see Table 3 ) indicate that collaborative problem-solving improves cognitive skills (ES = 0.70) and attitudinal tendency (ES = 1.17), with significant intergroup differences (chi 2  = 7.95, P  < 0.01). Although collaborative problem-solving improves both dimensions of critical thinking, it is essential to point out that the improvements in students’ attitudinal tendency are much more pronounced and have a significant comprehensive effect (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]), whereas gains in learners’ cognitive skill are slightly improved and are just above average. (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

The analysis of moderator effect size

The whole forest plot’s 79 effect quantities underwent a two-tailed test, which revealed significant heterogeneity ( I 2  = 86%, z  = 12.78, P  < 0.01), indicating differences between various effect sizes that may have been influenced by moderating factors other than sampling error. Therefore, exploring possible moderating factors that might produce considerable heterogeneity was done using subgroup analysis, such as the learning stage, learning scaffold, teaching type, group size, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, in order to further explore the key factors that influence critical thinking. The findings (see Table 4 ) indicate that various moderating factors have advantageous effects on critical thinking. In this situation, the subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), learning scaffold (chi 2  = 9.03, P  < 0.01), and teaching type (chi 2  = 7.20, P  < 0.05) are all significant moderators that can be applied to support the cultivation of critical thinking. However, since the learning stage and the measuring tools did not significantly differ among intergroup (chi 2  = 3.15, P  = 0.21 > 0.05, and chi 2  = 0.08, P  = 0.78 > 0.05), we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving. These are the precise outcomes, as follows:

Various learning stages influenced critical thinking positively, without significant intergroup differences (chi 2  = 3.15, P  = 0.21 > 0.05). High school was first on the list of effect sizes (ES = 1.36, P  < 0.01), then higher education (ES = 0.78, P  < 0.01), and middle school (ES = 0.73, P  < 0.01). These results show that, despite the learning stage’s beneficial influence on cultivating learners’ critical thinking, we are unable to explain why it is essential for cultivating critical thinking in the context of collaborative problem-solving.

Different teaching types had varying degrees of positive impact on critical thinking, with significant intergroup differences (chi 2  = 7.20, P  < 0.05). The effect size was ranked as follows: mixed courses (ES = 1.34, P  < 0.01), integrated courses (ES = 0.81, P  < 0.01), and independent courses (ES = 0.27, P  < 0.01). These results indicate that the most effective approach to cultivate critical thinking utilizing collaborative problem solving is through the teaching type of mixed courses.

Various intervention durations significantly improved critical thinking, and there were significant intergroup differences (chi 2  = 12.18, P  < 0.01). The effect sizes related to this variable showed a tendency to increase with longer intervention durations. The improvement in critical thinking reached a significant level (ES = 0.85, P  < 0.01) after more than 12 weeks of training. These findings indicate that the intervention duration and critical thinking’s impact are positively correlated, with a longer intervention duration having a greater effect.

Different learning scaffolds influenced critical thinking positively, with significant intergroup differences (chi 2  = 9.03, P  < 0.01). The resource-supported learning scaffold (ES = 0.69, P  < 0.01) acquired a medium-to-higher level of impact, the technique-supported learning scaffold (ES = 0.63, P  < 0.01) also attained a medium-to-higher level of impact, and the teacher-supported learning scaffold (ES = 0.92, P  < 0.01) displayed a high level of significant impact. These results show that the learning scaffold with teacher support has the greatest impact on cultivating critical thinking.

Various group sizes influenced critical thinking positively, and the intergroup differences were statistically significant (chi 2  = 8.77, P  < 0.05). Critical thinking showed a general declining trend with increasing group size. The overall effect size of 2–3 people in this situation was the biggest (ES = 0.99, P  < 0.01), and when the group size was greater than 7 people, the improvement in critical thinking was at the lower-middle level (ES < 0.5, P  < 0.01). These results show that the impact on critical thinking is positively connected with group size, and as group size grows, so does the overall impact.

Various measuring tools influenced critical thinking positively, with significant intergroup differences (chi 2  = 0.08, P  = 0.78 > 0.05). In this situation, the self-adapting measurement tools obtained an upper-medium level of effect (ES = 0.78), whereas the complete effect size of the standardized measurement tools was the largest, achieving a significant level of effect (ES = 0.84, P  < 0.01). These results show that, despite the beneficial influence of the measuring tool on cultivating critical thinking, we are unable to explain why it is crucial in fostering the growth of critical thinking by utilizing the approach of collaborative problem-solving.

Different subject areas had a greater impact on critical thinking, and the intergroup differences were statistically significant (chi 2  = 13.36, P  < 0.05). Mathematics had the greatest overall impact, achieving a significant level of effect (ES = 1.68, P  < 0.01), followed by science (ES = 1.25, P  < 0.01) and medical science (ES = 0.87, P  < 0.01), both of which also achieved a significant level of effect. Programming technology was the least effective (ES = 0.39, P  < 0.01), only having a medium-low degree of effect compared to education (ES = 0.72, P  < 0.01) and other fields (such as language, art, and social sciences) (ES = 0.58, P  < 0.01). These results suggest that scientific fields (e.g., mathematics, science) may be the most effective subject areas for cultivating critical thinking utilizing the approach of collaborative problem-solving.

The effectiveness of collaborative problem solving with regard to teaching critical thinking

According to this meta-analysis, using collaborative problem-solving as an intervention strategy in critical thinking teaching has a considerable amount of impact on cultivating learners’ critical thinking as a whole and has a favorable promotional effect on the two dimensions of critical thinking. According to certain studies, collaborative problem solving, the most frequently used critical thinking teaching strategy in curriculum instruction can considerably enhance students’ critical thinking (e.g., Liang et al., 2017 ; Liu et al., 2020 ; Cindy, 2004 ). This meta-analysis provides convergent data support for the above research views. Thus, the findings of this meta-analysis not only effectively address the first research query regarding the overall effect of cultivating critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills) utilizing the approach of collaborative problem-solving, but also enhance our confidence in cultivating critical thinking by using collaborative problem-solving intervention approach in the context of classroom teaching.

Furthermore, the associated improvements in attitudinal tendency are much stronger, but the corresponding improvements in cognitive skill are only marginally better. According to certain studies, cognitive skill differs from the attitudinal tendency in classroom instruction; the cultivation and development of the former as a key ability is a process of gradual accumulation, while the latter as an attitude is affected by the context of the teaching situation (e.g., a novel and exciting teaching approach, challenging and rewarding tasks) (Halpern, 2001 ; Wei and Hong, 2022 ). Collaborative problem-solving as a teaching approach is exciting and interesting, as well as rewarding and challenging; because it takes the learners as the focus and examines problems with poor structure in real situations, and it can inspire students to fully realize their potential for problem-solving, which will significantly improve their attitudinal tendency toward solving problems (Liu et al., 2020 ). Similar to how collaborative problem-solving influences attitudinal tendency, attitudinal tendency impacts cognitive skill when attempting to solve a problem (Liu et al., 2020 ; Zhang et al., 2022 ), and stronger attitudinal tendencies are associated with improved learning achievement and cognitive ability in students (Sison, 2008 ; Zhang et al., 2022 ). It can be seen that the two specific dimensions of critical thinking as well as critical thinking as a whole are affected by collaborative problem-solving, and this study illuminates the nuanced links between cognitive skills and attitudinal tendencies with regard to these two dimensions of critical thinking. To fully develop students’ capacity for critical thinking, future empirical research should pay closer attention to cognitive skills.

The moderating effects of collaborative problem solving with regard to teaching critical thinking

In order to further explore the key factors that influence critical thinking, exploring possible moderating effects that might produce considerable heterogeneity was done using subgroup analysis. The findings show that the moderating factors, such as the teaching type, learning stage, group size, learning scaffold, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, could all support the cultivation of collaborative problem-solving in critical thinking. Among them, the effect size differences between the learning stage and measuring tool are not significant, which does not explain why these two factors are crucial in supporting the cultivation of critical thinking utilizing the approach of collaborative problem-solving.

In terms of the learning stage, various learning stages influenced critical thinking positively without significant intergroup differences, indicating that we are unable to explain why it is crucial in fostering the growth of critical thinking.

Although high education accounts for 70.89% of all empirical studies performed by researchers, high school may be the appropriate learning stage to foster students’ critical thinking by utilizing the approach of collaborative problem-solving since it has the largest overall effect size. This phenomenon may be related to student’s cognitive development, which needs to be further studied in follow-up research.

With regard to teaching type, mixed course teaching may be the best teaching method to cultivate students’ critical thinking. Relevant studies have shown that in the actual teaching process if students are trained in thinking methods alone, the methods they learn are isolated and divorced from subject knowledge, which is not conducive to their transfer of thinking methods; therefore, if students’ thinking is trained only in subject teaching without systematic method training, it is challenging to apply to real-world circumstances (Ruggiero, 2012 ; Hu and Liu, 2015 ). Teaching critical thinking as mixed course teaching in parallel to other subject teachings can achieve the best effect on learners’ critical thinking, and explicit critical thinking instruction is more effective than less explicit critical thinking instruction (Bensley and Spero, 2014 ).

In terms of the intervention duration, with longer intervention times, the overall effect size shows an upward tendency. Thus, the intervention duration and critical thinking’s impact are positively correlated. Critical thinking, as a key competency for students in the 21st century, is difficult to get a meaningful improvement in a brief intervention duration. Instead, it could be developed over a lengthy period of time through consistent teaching and the progressive accumulation of knowledge (Halpern, 2001 ; Hu and Liu, 2015 ). Therefore, future empirical studies ought to take these restrictions into account throughout a longer period of critical thinking instruction.

With regard to group size, a group size of 2–3 persons has the highest effect size, and the comprehensive effect size decreases with increasing group size in general. This outcome is in line with some research findings; as an example, a group composed of two to four members is most appropriate for collaborative learning (Schellens and Valcke, 2006 ). However, the meta-analysis results also indicate that once the group size exceeds 7 people, small groups cannot produce better interaction and performance than large groups. This may be because the learning scaffolds of technique support, resource support, and teacher support improve the frequency and effectiveness of interaction among group members, and a collaborative group with more members may increase the diversity of views, which is helpful to cultivate critical thinking utilizing the approach of collaborative problem-solving.

With regard to the learning scaffold, the three different kinds of learning scaffolds can all enhance critical thinking. Among them, the teacher-supported learning scaffold has the largest overall effect size, demonstrating the interdependence of effective learning scaffolds and collaborative problem-solving. This outcome is in line with some research findings; as an example, a successful strategy is to encourage learners to collaborate, come up with solutions, and develop critical thinking skills by using learning scaffolds (Reiser, 2004 ; Xu et al., 2022 ); learning scaffolds can lower task complexity and unpleasant feelings while also enticing students to engage in learning activities (Wood et al., 2006 ); learning scaffolds are designed to assist students in using learning approaches more successfully to adapt the collaborative problem-solving process, and the teacher-supported learning scaffolds have the greatest influence on critical thinking in this process because they are more targeted, informative, and timely (Xu et al., 2022 ).

With respect to the measuring tool, despite the fact that standardized measurement tools (such as the WGCTA, CCTT, and CCTST) have been acknowledged as trustworthy and effective by worldwide experts, only 54.43% of the research included in this meta-analysis adopted them for assessment, and the results indicated no intergroup differences. These results suggest that not all teaching circumstances are appropriate for measuring critical thinking using standardized measurement tools. “The measuring tools for measuring thinking ability have limits in assessing learners in educational situations and should be adapted appropriately to accurately assess the changes in learners’ critical thinking.”, according to Simpson and Courtney ( 2002 , p. 91). As a result, in order to more fully and precisely gauge how learners’ critical thinking has evolved, we must properly modify standardized measuring tools based on collaborative problem-solving learning contexts.

With regard to the subject area, the comprehensive effect size of science departments (e.g., mathematics, science, medical science) is larger than that of language arts and social sciences. Some recent international education reforms have noted that critical thinking is a basic part of scientific literacy. Students with scientific literacy can prove the rationality of their judgment according to accurate evidence and reasonable standards when they face challenges or poorly structured problems (Kyndt et al., 2013 ), which makes critical thinking crucial for developing scientific understanding and applying this understanding to practical problem solving for problems related to science, technology, and society (Yore et al., 2007 ).

Suggestions for critical thinking teaching

Other than those stated in the discussion above, the following suggestions are offered for critical thinking instruction utilizing the approach of collaborative problem-solving.

First, teachers should put a special emphasis on the two core elements, which are collaboration and problem-solving, to design real problems based on collaborative situations. This meta-analysis provides evidence to support the view that collaborative problem-solving has a strong synergistic effect on promoting students’ critical thinking. Asking questions about real situations and allowing learners to take part in critical discussions on real problems during class instruction are key ways to teach critical thinking rather than simply reading speculative articles without practice (Mulnix, 2012 ). Furthermore, the improvement of students’ critical thinking is realized through cognitive conflict with other learners in the problem situation (Yang et al., 2008 ). Consequently, it is essential for teachers to put a special emphasis on the two core elements, which are collaboration and problem-solving, and design real problems and encourage students to discuss, negotiate, and argue based on collaborative problem-solving situations.

Second, teachers should design and implement mixed courses to cultivate learners’ critical thinking, utilizing the approach of collaborative problem-solving. Critical thinking can be taught through curriculum instruction (Kuncel, 2011 ; Leng and Lu, 2020 ), with the goal of cultivating learners’ critical thinking for flexible transfer and application in real problem-solving situations. This meta-analysis shows that mixed course teaching has a highly substantial impact on the cultivation and promotion of learners’ critical thinking. Therefore, teachers should design and implement mixed course teaching with real collaborative problem-solving situations in combination with the knowledge content of specific disciplines in conventional teaching, teach methods and strategies of critical thinking based on poorly structured problems to help students master critical thinking, and provide practical activities in which students can interact with each other to develop knowledge construction and critical thinking utilizing the approach of collaborative problem-solving.

Third, teachers should be more trained in critical thinking, particularly preservice teachers, and they also should be conscious of the ways in which teachers’ support for learning scaffolds can promote critical thinking. The learning scaffold supported by teachers had the greatest impact on learners’ critical thinking, in addition to being more directive, targeted, and timely (Wood et al., 2006 ). Critical thinking can only be effectively taught when teachers recognize the significance of critical thinking for students’ growth and use the proper approaches while designing instructional activities (Forawi, 2016 ). Therefore, with the intention of enabling teachers to create learning scaffolds to cultivate learners’ critical thinking utilizing the approach of collaborative problem solving, it is essential to concentrate on the teacher-supported learning scaffolds and enhance the instruction for teaching critical thinking to teachers, especially preservice teachers.

Implications and limitations

There are certain limitations in this meta-analysis, but future research can correct them. First, the search languages were restricted to English and Chinese, so it is possible that pertinent studies that were written in other languages were overlooked, resulting in an inadequate number of articles for review. Second, these data provided by the included studies are partially missing, such as whether teachers were trained in the theory and practice of critical thinking, the average age and gender of learners, and the differences in critical thinking among learners of various ages and genders. Third, as is typical for review articles, more studies were released while this meta-analysis was being done; therefore, it had a time limit. With the development of relevant research, future studies focusing on these issues are highly relevant and needed.

Conclusions

The subject of the magnitude of collaborative problem-solving’s impact on fostering students’ critical thinking, which received scant attention from other studies, was successfully addressed by this study. The question of the effectiveness of collaborative problem-solving in promoting students’ critical thinking was addressed in this study, which addressed a topic that had gotten little attention in earlier research. The following conclusions can be made:

Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]). With respect to the dimensions of critical thinking, collaborative problem-solving can significantly and effectively improve students’ attitudinal tendency, and the comprehensive effect is significant (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

As demonstrated by both the results and the discussion, there are varying degrees of beneficial effects on students’ critical thinking from all seven moderating factors, which were found across 36 studies. In this context, the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have a positive impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. Since the learning stage (chi 2  = 3.15, P  = 0.21 > 0.05) and measuring tools (chi 2  = 0.08, P  = 0.78 > 0.05) did not demonstrate any significant intergroup differences, we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving.

Data availability

All data generated or analyzed during this study are included within the article and its supplementary information files, and the supplementary information files are available in the Dataverse repository: https://doi.org/10.7910/DVN/IPFJO6 .

Bensley DA, Spero RA (2014) Improving critical thinking skills and meta-cognitive monitoring through direct infusion. Think Skills Creat 12:55–68. https://doi.org/10.1016/j.tsc.2014.02.001

Article   Google Scholar  

Castle A (2009) Defining and assessing critical thinking skills for student radiographers. Radiography 15(1):70–76. https://doi.org/10.1016/j.radi.2007.10.007

Chen XD (2013) An empirical study on the influence of PBL teaching model on critical thinking ability of non-English majors. J PLA Foreign Lang College 36 (04):68–72

Google Scholar  

Cohen A (1992) Antecedents of organizational commitment across occupational groups: a meta-analysis. J Organ Behav. https://doi.org/10.1002/job.4030130602

Cooper H (2010) Research synthesis and meta-analysis: a step-by-step approach, 4th edn. Sage, London, England

Cindy HS (2004) Problem-based learning: what and how do students learn? Educ Psychol Rev 51(1):31–39

Duch BJ, Gron SD, Allen DE (2001) The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Stylus Educ Sci 2:190–198

Ennis RH (1989) Critical thinking and subject specificity: clarification and needed research. Educ Res 18(3):4–10. https://doi.org/10.3102/0013189x018003004

Facione PA (1990) Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. Eric document reproduction service. https://eric.ed.gov/?id=ed315423

Facione PA, Facione NC (1992) The California Critical Thinking Dispositions Inventory (CCTDI) and the CCTDI test manual. California Academic Press, Millbrae, CA

Forawi SA (2016) Standard-based science education and critical thinking. Think Skills Creat 20:52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Halpern DF (2001) Assessing the effectiveness of critical thinking instruction. J Gen Educ 50(4):270–286. https://doi.org/10.2307/27797889

Hu WP, Liu J (2015) Cultivation of pupils’ thinking ability: a five-year follow-up study. Psychol Behav Res 13(05):648–654. https://doi.org/10.3969/j.issn.1672-0628.2015.05.010

Huber K (2016) Does college teach critical thinking? A meta-analysis. Rev Educ Res 86(2):431–468. https://doi.org/10.3102/0034654315605917

Kek MYCA, Huijser H (2011) The power of problem-based learning in developing critical thinking skills: preparing students for tomorrow’s digital futures in today’s classrooms. High Educ Res Dev 30(3):329–341. https://doi.org/10.1080/07294360.2010.501074

Kuncel NR (2011) Measurement and meaning of critical thinking (Research report for the NRC 21st Century Skills Workshop). National Research Council, Washington, DC

Kyndt E, Raes E, Lismont B, Timmers F, Cascallar E, Dochy F (2013) A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educ Res Rev 10(2):133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Leng J, Lu XX (2020) Is critical thinking really teachable?—A meta-analysis based on 79 experimental or quasi experimental studies. Open Educ Res 26(06):110–118. https://doi.org/10.13966/j.cnki.kfjyyj.2020.06.011

Liang YZ, Zhu K, Zhao CL (2017) An empirical study on the depth of interaction promoted by collaborative problem solving learning activities. J E-educ Res 38(10):87–92. https://doi.org/10.13811/j.cnki.eer.2017.10.014

Lipsey M, Wilson D (2001) Practical meta-analysis. International Educational and Professional, London, pp. 92–160

Liu Z, Wu W, Jiang Q (2020) A study on the influence of problem based learning on college students’ critical thinking-based on a meta-analysis of 31 studies. Explor High Educ 03:43–49

Morris SB (2008) Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods 11(2):364–386. https://doi.org/10.1177/1094428106291059

Article   ADS   Google Scholar  

Mulnix JW (2012) Thinking critically about critical thinking. Educ Philos Theory 44(5):464–479. https://doi.org/10.1111/j.1469-5812.2010.00673.x

Naber J, Wyatt TH (2014) The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today 34(1):67–72. https://doi.org/10.1016/j.nedt.2013.04.002

National Research Council (2012) Education for life and work: developing transferable knowledge and skills in the 21st century. The National Academies Press, Washington, DC

Niu L, Behar HLS, Garvan CW (2013) Do instructional interventions influence college students’ critical thinking skills? A meta-analysis. Educ Res Rev 9(12):114–128. https://doi.org/10.1016/j.edurev.2012.12.002

Peng ZM, Deng L (2017) Towards the core of education reform: cultivating critical thinking skills as the core of skills in the 21st century. Res Educ Dev 24:57–63. https://doi.org/10.14121/j.cnki.1008-3855.2017.24.011

Reiser BJ (2004) Scaffolding complex learning: the mechanisms of structuring and problematizing student work. J Learn Sci 13(3):273–304. https://doi.org/10.1207/s15327809jls1303_2

Ruggiero VR (2012) The art of thinking: a guide to critical and creative thought, 4th edn. Harper Collins College Publishers, New York

Schellens T, Valcke M (2006) Fostering knowledge construction in university students through asynchronous discussion groups. Comput Educ 46(4):349–370. https://doi.org/10.1016/j.compedu.2004.07.010

Sendag S, Odabasi HF (2009) Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 53(1):132–141. https://doi.org/10.1016/j.compedu.2009.01.008

Sison R (2008) Investigating Pair Programming in a Software Engineering Course in an Asian Setting. 2008 15th Asia-Pacific Software Engineering Conference, pp. 325–331. https://doi.org/10.1109/APSEC.2008.61

Simpson E, Courtney M (2002) Critical thinking in nursing education: literature review. Mary Courtney 8(2):89–98

Stewart L, Tierney J, Burdett S (2006) Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? Publication bias in meta-analysis. John Wiley and Sons Inc, New York, pp. 261–286

Tiwari A, Lai P, So M, Yuen K (2010) A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ 40(6):547–554. https://doi.org/10.1111/j.1365-2929.2006.02481.x

Wood D, Bruner JS, Ross G (2006) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Wei T, Hong S (2022) The meaning and realization of teachable critical thinking. Educ Theory Practice 10:51–57

Xu EW, Wang W, Wang QX (2022) A meta-analysis of the effectiveness of programming teaching in promoting K-12 students’ computational thinking. Educ Inf Technol. https://doi.org/10.1007/s10639-022-11445-2

Yang YC, Newby T, Bill R (2008) Facilitating interactions through structured web-based bulletin boards: a quasi-experimental study on promoting learners’ critical thinking skills. Comput Educ 50(4):1572–1585. https://doi.org/10.1016/j.compedu.2007.04.006

Yore LD, Pimm D, Tuan HL (2007) The literacy component of mathematical and scientific literacy. Int J Sci Math Educ 5(4):559–589. https://doi.org/10.1007/s10763-007-9089-4

Zhang T, Zhang S, Gao QQ, Wang JH (2022) Research on the development of learners’ critical thinking in online peer review. Audio Visual Educ Res 6:53–60. https://doi.org/10.13811/j.cnki.eer.2022.06.08

Download references

Acknowledgements

This research was supported by the graduate scientific research and innovation project of Xinjiang Uygur Autonomous Region named “Research on in-depth learning of high school information technology courses for the cultivation of computing thinking” (No. XJ2022G190) and the independent innovation fund project for doctoral students of the College of Educational Science of Xinjiang Normal University named “Research on project-based teaching of high school information technology courses from the perspective of discipline core literacy” (No. XJNUJKYA2003).

Author information

Authors and affiliations.

College of Educational Science, Xinjiang Normal University, 830017, Urumqi, Xinjiang, China

Enwei Xu, Wei Wang & Qingxia Wang

You can also search for this author in PubMed   Google Scholar

Corresponding authors

Correspondence to Enwei Xu or Wei Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Additional information.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary tables, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Xu, E., Wang, W. & Wang, Q. The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature. Humanit Soc Sci Commun 10 , 16 (2023). https://doi.org/10.1057/s41599-023-01508-1

Download citation

Received : 07 August 2022

Accepted : 04 January 2023

Published : 11 January 2023

DOI : https://doi.org/10.1057/s41599-023-01508-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Impacts of online collaborative learning on students’ intercultural communication apprehension and intercultural communicative competence.

• Hoa Thi Hoang Chau
• Hung Phu Bui
• Quynh Thi Huong Dinh

Education and Information Technologies (2024)

Exploring the effects of digital technology on deep learning: a meta-analysis

The impacts of computer-supported collaborative learning on students’ critical thinking: a meta-analysis.

• Yoseph Gebrehiwot Tedla
• Hsiu-Ling Chen

Sustainable electricity generation and farm-grid utilization from photovoltaic aquaculture: a bibliometric analysis

• A. A. Amusa
• M. Alhassan

International Journal of Environmental Science and Technology (2024)

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Information

• Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

• Active Journals
• Find a Journal
• Proceedings Series
• For Authors
• For Reviewers
• For Editors
• For Librarians
• For Publishers
• For Societies
• For Conference Organizers
• Open Access Policy
• Institutional Open Access Program
• Special Issues Guidelines
• Editorial Process
• Research and Publication Ethics
• Article Processing Charges
• Testimonials
• Preprints.org
• SciProfiles
• Encyclopedia

Article Menu

• Subscribe SciFeed
• Recommended Articles
• Google Scholar
• on Google Scholar
• Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

An action research in critical thinking concept designed curriculum based on collaborative learning for engineering ethics course.

1. Introduction

1.1. ct and engineering students, 1.2. ct and collaborative learning, 1.3. pbl, collaborative and collaborative learning, 1.4. purpose of study.

• Will students improve collaboration quality by collaborative learning?
• Will students improve CT disposition by collaborative learning?
• How will students cope with collaborative learning in the course progress of CT concept based curriculum design?

2. Materials and Methods

2.1. participants, 2.2. course design.

• Change team members twice by regrouping to enhance their abilities to coordinate to new fellows.
• Peer evaluation offer every participant the power to watch others and behave themselves.
• Practice teamwork by abundant team activities including white board competition, team/class discussion, debating, team brain-storming/reporting and real-world case study.

2.3. Research Tools

3.1. improvements in critical thinking dispositions, 3.2. improvements in collaboration, 3.3. learning experience opinion investment- quantitative, 3.4. learning experience opinion investment- qualitative.

• 1. Your gender.
• 36. Please write down a thing that brings difficulties to your study.
• 37. Write down a thing that you particularly enjoy in class.
• 38. So far, the overall reflections and suggestions to the course.

3.4.1. Difficulties, Item 36

3.4.2. enjoyment, item 37, 3.4.3. reflections and suggests, item 38, 3.4.4. summation of the qualitative questions, 4. findings, 4.1. research questions i.

• All the 3 means in the posttest increased significant statistically.
• Both in the pretest and posttest, the intra-group coordination was weakest with more divergent opinions; while the trust was best with highly agreement.
• The intra-group communication had been improved most.

4.2. Research Questions II

• The participants made a greatest improvement in the item of “I try to determine whether my views are sufficiently convincing by self-questioning,” in the construction of Reflective thinking. However, the posttest mean was still lower than the average of the all posttest items though
• On the opposite, the item of “In the context of the discussion, I try to respect the opinions of others,” in the construction of Open-mindedness, regressed the most. The posttest mean was still higher than the average of the all posttest items though
• The responses were mostly lower and more discrete in the pretest and became more convergent to generally higher posttest values.
• The participants demonstrated the improvements among the most items of the critical thinking dispositions. 18 items increased while 2 decreased. Two items (#10 and 15) among the 18 items improved statistically significantly.
• “Systematicity and analyticity” improved most dramatically while the other three constructions and entirety increased too.
• The intra-group “systematicity and analyticity” and the entirety also increased with statistical significance.
• The four means in the pretest were all lower than the college norms.
• The posttest means of “inquisitiveness” and “Reflective thinking” are higher than the norms, while the other two constructions of “systematicity and analyticity” and “open-minded” are still lower than the norms, and though they are better than their own pretest.

4.3. Research Questions III

• There are no items below medium level among the 35 questions. It indicates that the participants coped well with the designed curriculum.
• The level of medium high (83%) is majority while level high (14%) is minority. Others are trivial. It indicates medium high to high level satisfaction to the course.
• In general, the participants enjoyed the course materials and thought these CT and values infused course activities are helpful to the learning.
• The participants ranked coordination highest, communication next, and trust last. It is the same ranking result to the responses in the collaboration questionnaire.
• The participants were most sensible to their communication problems in the course learning process during collaborative activities.
• CT is the most noticeable problem for the participants. About one out of every five participants lacked the habit to think, while 17% of participants were afraid of complex questions to think. In addition, 10% doubted their CT skills. It concludes that a total of 46% participants thought CT is their most crucial shortage.
• Ten percent of participants preferred coordinative activities, while the majority of 65% participants enjoyed the communication process. Again, communication skills are most sensible to the participant’s drawbacks or advantages in the collaboration.
• Compared with that the 46% participants thought CT is their most crucial shortage, only 10% addressed that they enjoyed the critical thinking. It again demonstrated that CT was quite desperate for a lot of the participants.
• The collaboration was most significant to draw totally 54% attention with the ratios of .2, .31, and .03 for coordination, communication, and trust, respectively.
• The coordination was quite balanced on the positive and negative sides, 9% and 10.5%, respectively.
• The most noticeable category of the communication was more leaning to positive side, 7% to 24%.
• The trust was only mentioned in the negative side with a tiny ratio, 3%.
• CT drew totally 27% attention and leaning to negative learning experience.
• Nineteen percent of participants considered CT difficult, while 8% enjoyed the moment of CT learning.

5. Discussion of the Findings

6. conclusions and suggestions, institutional review board statement, informed consent statement, data availability statement, acknowledgments, conflicts of interest.

• Conley, D.T. Toward a More Comprehensive Conception of College Readiness, Educational Policy Improvement Center. Available online: https://docs.gatesfoundation.org/Documents/CollegeReadinessPaper.pdf (accessed on 15 February 2021).
• Masters, J. The history of action research. First Publ. 1995 . Available online: http://www.behs.cchs.usyd.edu.au/arow/Reader/rmasters.htm (accessed on 1 February 2021).
• Stipe, M.; Yasen, L. Facilitating Active Learning through Action Research. ORTESOL J. 2012 , 29 , 21. [ Google Scholar ]
• Gummesson, E. Qualitative Methods in Management Research ; Sage: Thousand Oaks, CA, USA, 2000. [ Google Scholar ]
• Eggan, G.M.; Lsegold, A.M. Modeling Requirements for Intelligence Training System, Instructional Models in Computer-Based Learning Environment ; NATO Scientific Affairs Division: New York, NY, USA, 1992. [ Google Scholar ]
• Gambrill, E. Critical Thinking in Clinical Practice: Improving the Quality of Judgments and Decisions ; John Wiley & Sons: Hoboken, NJ, USA, 2006. [ Google Scholar ]
• Elder, L.; Paul, R. Critical thinking: Thinking to some purpose. J. Dev. Educ. 2001 , 25 , 40. [ Google Scholar ]
• Ennis, R.H. Critical thinking dispositions: Their nature and assessability. Informal Log. 1996 , 18 , 165–182. [ Google Scholar ] [ CrossRef ]
• Ennis, R.H. A logical basis for measuring critical thinking skills. Educ. Leadersh. 1985 , 43 , 45–48. [ Google Scholar ]
• Ennis, R.H. Problems in Testing Informal Logic, Critical Thinking, Reasoning Ability. Informal Log. 1984 , 6 , 3–9. [ Google Scholar ] [ CrossRef ] [ Green Version ]
• Ching-Yi, C.; Chien-Huei, K.; Gwo-Jen, H. Facilitating Students’ Critical Thinking and Decision Making Performances: A Flipped Classroom for Neonatal Health Care Training. J. Educ. Technol. Soc. 2020 , 23 , 32–46. [ Google Scholar ]
• Swaile, B.H.; Kreppel, M.C. Building critical thinking, teamwork, and communication skills through professional ethics in engineering and chemical technology. In Proceedings of the 2001 American Society for Engineering Education Annual Conference & Exposition, Albuquerque, NM, USA, 24–27 June 2001; p. 1. [ Google Scholar ]
• Cooney, E.; Alfrey, K.; Owens, S. Critical thinking in engineering and technology education: A review. In Proceedings of the 2008 American Society of Association of Engineering Education (ASEE) Annual Conference, Pittsburg, PA, USA, 22–25 June 2008. [ Google Scholar ]
• Bero, B.; Kuhlman, A. Teaching ethics to engineers: Ethical decision making parallels the engineering design process. Sci. Eng. Ethics 2011 , 17 , 597–605. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Adair, D.; Jaeger, M. Incorporating Critical Thinking into an Engineering Undergraduate Learning Environment. Int. J. High. Educ. 2016 , 5 . [ Google Scholar ] [ CrossRef ] [ Green Version ]
• Sulaiman, N.D.; Shahrill, M. Engaging collaborative learning to develop students’ skiIls of the 21st century. Mediterr. J. Soc. Sci. 2015 , 6 , 544. [ Google Scholar ] [ CrossRef ] [ Green Version ]
• Rana, S.S. Progression of Collaborative Learning and Its Importance for Critical Thinking ; Maharaja Surajmal Institute: New Delhi, India, 2020. [ Google Scholar ]
• Johnson, D. Cooperation in the classroom. Psyccritiques 1991 , 36 , 1106–1107. [ Google Scholar ] [ CrossRef ]
• Vygotsky, L.S. Mind in Society: The Development of Higher Psychological Processes ; Harvard University Press: Cambridge, MA, USA, 1980. [ Google Scholar ]
• Bruner, J. Vygotsky: A historical and conceptual perspective. Cult. Commun. Cogn. Vygotskian Perspect. 1985 , 21 , 34. [ Google Scholar ]
• Gokhale, A.A. Collaborative learning enhances critical thinking. J. Technol. Educ. 1995 , 7 , 22–30. [ Google Scholar ] [ CrossRef ]
• Rau, W.; Heyl, B.S. Humanizing the college classroom: Collaborative learning and social organization among students. Teach. Sociol. 1990 , 141–155. [ Google Scholar ] [ CrossRef ]
• Slavin, R.E. Research on cooperative learning: An international perspective. Scand. J. Educ. Res. 1989 , 33 , 231–243. [ Google Scholar ] [ CrossRef ]
• Lê, T. Collaborate to learn and learn to collaborate. In Proceedings of the Seventh World Conference on Computers in Education Conference on Computers in Education: Australian Topics, Copenhagen, Denmark, 29 July–3 August 2001; Volume 8, pp. 67–70. [ Google Scholar ]
• Totten, S.S.; Digby, T.A.; Russ, P. Cooperative Learning: A Guide to Research ; Garland: New York, NY, USA, 1991. [ Google Scholar ]
• Barrows, H.S. Problem-based learning in medicine and beyond: A brief overview. New Dir. Teach. Learn. 1996 , 68 , 3–13. [ Google Scholar ] [ CrossRef ]
• Hmelo-Silver, C.E. Problem-based learning: What and how do students learn? Educ. Psychol. Rev. 2004 , 16 , 235–266. [ Google Scholar ] [ CrossRef ]
• Smith, B.L.; MacGregor, J.T. What is collaborative learning. Towards the Virtual University: International Online Learning Perspectives ; Information Age Publishing: Charlotte, NC, USA, 1992; pp. 217–232. [ Google Scholar ]
• Hsu, Y.-C. A Pilot Study to Incorporate Collaboration and Energy Competency into an Engineering Ethics Course. Educ. Sci. 2020 , 10 , 72. [ Google Scholar ] [ CrossRef ] [ Green Version ]
• Matthews, R.S.; Cooper, J.L.; Davidson, N.; Hawkes, P. Building bridges between cooperative and collaborative learning. Chang. Mag. High. Learn. 1995 , 27 , 35–40. [ Google Scholar ] [ CrossRef ]
• Cohen, E.G. Restructuring the classroom: Conditions for productive small groups. Rev. Educ. Res. 1994 , 64 , 1–35. [ Google Scholar ] [ CrossRef ]
• McInnerney, J.M.; Roberts, T.S. Collaborative and cooperative Learning. In Encyclopedia of Distance Learning, Second Edition ; IGI Global: Hershey, PA, USA, 2009; pp. 203–214. [ Google Scholar ]
• Panitz, T. Collaborative versus Cooperative Learning: A Comparison of the Two Concepts Which Will Help Us Understand the Underlying Nature of Interactive Learning. 1999. Available online: https://files.eric.ed.gov/fulltext/ED448443.pdf (accessed on 28 February 2021).
• Graber, G.C.; Pionke, C.D. A team-taught interdisciplinary approach to engineering ethics. Sci. Eng. Ethics 2006 , 12 , 313–320. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Hoffmann, M.; Borenstein, J. Understanding ill-structured engineering ethics problems through a collaborative learning and argument visualization approach. Sci. Eng. Ethics 2014 , 20 , 261–276. [ Google Scholar ] [ CrossRef ]
• Le, H.; Janssen, J.; Wubbels, T. Collaborative learning practices: Teacher and student perceived obstacles to effective student collaboration. Camb. J. Educ. 2018 , 48 , 103–122. [ Google Scholar ] [ CrossRef ] [ Green Version ]
• Lai, E.R. Critical Thinking: A literature Review. Pearson’s Res. Rep. 2011 , 6 , 40–41. [ Google Scholar ]
• Chang, P.-F.; Wang, D.-C. Cultivating engineering ethics and critical thinking: A systematic and cross-cultural education approach using problem-based learning. Eur. J. Eng. Educ. 2011 , 36 , 377–390. [ Google Scholar ] [ CrossRef ]
• Yeh, Y.C. A study of substitute teachers’ professional knowledge, personal teaching efficacy, and teaching behavior in critical-thinking instruction. J. Chengchi Univ. 1999 , 78 , 55–84. [ Google Scholar ]
• Hsu, Y.-C.; Lo, Y.-H.; Kao, C.-Y. Applying Action Research to Develop Curriculum for Engineering Ethics Based on Moral Practice. In Proceedings of the 2nd Eurasian Conference on Educational Innovation 2019, Singapore, 27–29 January 2019; pp. 351–354. [ Google Scholar ]
• Chen, S.-L.; Hsu, H.-P.; Lee, Y.-C.; Lo, Y.-H.; Kao, C.-P.; Chu, C.-C.; Hsu, Y.-C. The Pilot Investigation of the Competency-Oriented Collaboration Practice in Mechanical Engineering Students. In Proceedings of the 3rd Eurasian Conference on Educational Innovation 2020, Hanoi, Vietnam, 5–7 February 2020; pp. 73–79. [ Google Scholar ]
• Hsu, Y.-C.; Tsai, Y.-L.; Yang, C.-F.; Tseng, P.-C. Action Research on Engineering Ethics Courses for Affective Emotional Education. J. Quemoy Univ. 2020 , 8 , 45–67. [ Google Scholar ]

Click here to enlarge figure

Share and Cite

Hsu, Y.-C. An Action Research in Critical Thinking Concept Designed Curriculum Based on Collaborative Learning for Engineering Ethics Course. Sustainability 2021 , 13 , 2621. https://doi.org/10.3390/su13052621

Hsu Y-C. An Action Research in Critical Thinking Concept Designed Curriculum Based on Collaborative Learning for Engineering Ethics Course. Sustainability . 2021; 13(5):2621. https://doi.org/10.3390/su13052621

Hsu, Yi-Chu. 2021. "An Action Research in Critical Thinking Concept Designed Curriculum Based on Collaborative Learning for Engineering Ethics Course" Sustainability 13, no. 5: 2621. https://doi.org/10.3390/su13052621

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

Subscribe to receive issue release notifications and newsletters from MDPI journals

Critical Thinking in Academic Research - Second Edition

(4 reviews)

Cindy Gruwell, University of West Florida

Robin Ewing, St. Cloud State University

Copyright Year: 2022

Last Update: 2023

Publisher: Minnesota State Colleges and Universities

Language: English

Formats Available

Conditions of use.

Learn more about reviews.

Reviewed by Julie Jaszkowiak, Community Faculty, Metropolitan State University on 12/22/23

Organized in 11 parts, this his textbook includes introductory information about critical thinking and details about the academic research process. The basics of critical thinking related to doing academic research in Parts I and II. Parts III –... read more

Comprehensiveness rating: 5 see less

Organized in 11 parts, this his textbook includes introductory information about critical thinking and details about the academic research process. The basics of critical thinking related to doing academic research in Parts I and II. Parts III – XI provide specifics on various steps in doing academic research including details on finding and citing source material. There is a linked table of contents so the reader is able to jump to a specific section as needed. There is also a works cited page with information and links to works used for this textbook.

Content Accuracy rating: 5

The content of this textbook is accurate and error free. It contains examples that demonstrate concepts from a variety of disciplines such as “hard science” or “popular culture” that assist in eliminating bias. The authors are librarians so it is clear that their experience as such leads to clear and unbiased content.

Relevance/Longevity rating: 5

General concepts about critical thinking and academic research methodology is well defined and should not become obsolete. Specific content regarding use of citation tools and attribution structure may change but the links to various research sites allow for simple updates.

Clarity rating: 5

This textbook is written in a conversational manner that allows for a more personal interaction with the textbook. It is like the reader is having a conversation with a librarian. Each part has an introduction section that fully defines concepts and terms used for that part.

Consistency rating: 5

In addition to the written content, this textbook contains links to short quizzes at the end of each section. This is consistent throughout each part. Embedded links to additional information are included as necessary.

Modularity rating: 4

This textbook is arranged in 11 modular parts with each part having multiple sections. All of these are linked so a reader can go to a distinct part or section to find specific information. There are some links that refer back to previous sections in the document. It can be challenging to return to where you were once you have jumped to a different section.

Organization/Structure/Flow rating: 5

There is clear definition as to what information is contained within each of the parts and subsequent sections. The textbook follows the logical flow of the process of researching and writing a research paper.

Interface rating: 4

The pictures have alternative text that appears when you hover over the text. There is one picture on page 102 that is a link to where the downloaded picture is from. The pictures are clear and supportive of the text for a visual learner. All the links work and go to either the correct area of the textbook or to a valid website. If you are going to use the embedded links to go to other sections of the textbook you need to keep track of where you are as it can sometimes get confusing as to where you went based on clicking links.

Grammatical Errors rating: 4

This is not really a grammatical error but I did notice on some of the quizzes if you misspelled a work for fill in the blank it was incorrect. It was also sometimes challenging to come up with the correct word for the fill in the blanks.

Cultural Relevance rating: 5

There are no examples or text that are culturally insensitive or offensive. The examples are general and would be applicable to a variety of students study many different academic subjects. There are references and information to many research tools from traditional such as checking out books and articles from the library to more current such as blogs and other electronic sources. This information appeals to a wide expanse of student populations.

I really enjoyed the quizzes at the end of each section. It is very beneficial to test your knowledge and comprehension of what you just read. Often I had to return and reread the content more critically based on my quiz results! They are just the right length to not disrupt the overall reading of the textbook and cover the important content and learning objectives.

Reviewed by Sara Stigberg, Adjunct Reference Librarian, Truman College, City Colleges of Chicago on 3/15/23

Critical Thinking in Academic Research thoroughly covers the basics of academic research for undergraduates, including well-guided deeper dives into relevant areas. The authors root their introduction to academic research principles and practices... read more

Critical Thinking in Academic Research thoroughly covers the basics of academic research for undergraduates, including well-guided deeper dives into relevant areas. The authors root their introduction to academic research principles and practices in the Western philosophical tradition, focused on developing students' critical thinking skills and habits around inquiry, rationales, and frameworks for research.

This text conforms to the principles and frames of the Framework for Information Literacy for Higher Education, published by the Association of College and Research Libraries. It includes excellent, clear, step-by-step guides to help students understand rationales and techniques for academic research.

Essential for our current information climate, the authors present relevant information for students who may be new to academic research, in ways and with content that is not too broad or too narrow, or likely to change drastically in the near future.

The authors use clear and well-considered language and explanations of ideas and terms, contextualizing the scholarly research process and tools in a relatable manner. As mentioned earlier, this text includes excellent step-by-step guides, as well as illustrations, visualizations, and videos to instruct students in conducting academic research.

(4.75) The terminology and framework of this text are consistent. Early discussions of critical thinking skills are tied in to content in later chapters, with regard to selecting different types of sources and search tools, as well as rationales for choosing various formats of source references. Consciously making the theme of critical thinking as applied to the stages of academic research more explicit and frequent within the text would further strengthen it, however.

Modularity rating: 5

Chapters are divided in a logical, progressive manner throughout the text. The use of embedded links to further readings and some other relevant sections of the text are an excellent way of providing references and further online information, without overwhelming or side-tracking the reader.

Topics in the text are organized in logical, progressive order, transitioning cleanly from one focus to the next. Each chapter begins with a helpful outline of topics that will be covered within it.

There are no technical issues with the interface for this text. Interactive learning tools such as the many self-checks and short quizzes that are included throughout the text are a great bonus for reinforcing student learning, and the easily-accessible table of contents was very helpful. There are some slight inconsistencies across chapters, however, relative to formatting images and text and spacing, and an image was missing in the section on Narrowing a Topic. Justifying copy rather than aligning-left would prevent hyphenation, making the text more streamlined.

Grammatical Errors rating: 5

(4.75) A few minor punctuation errors are present.

The authors of this text use culturally-relevant examples and inclusive language. The chapter on Barriers to Critical Thinking works directly to break down bias and preconceived notions.

Overall, Critical Thinking in Academic Research is an excellent general textbook for teaching the whys and hows of academic research to undergraduates. A discussion of annotated bibliographies would be a great addition for future editions of the text. ---- (As an aside for the authors, I am curious if the anonymous data from the self-checks and quizzes is being collected and analyzed for assessment purposes. I'm sure it would be interesting!)

Reviewed by Ann Bell-Pfeifer, Program Director/ Instructor, Minnesota State Community and Technical College on 2/15/23

The book has in depth coverage of academic research. A formal glossary and index were not included. read more

Comprehensiveness rating: 4 see less

The book has in depth coverage of academic research. A formal glossary and index were not included.

The book appears error free and factual.

The content is current and would support students who are pursuing writing academic research papers.

Excellent explanations for specific terms were included throughout the text.

The text is easy to follow with a standardized format and structure.

The text contains headings and topics in each section.

It is easy to follow the format and review each section.

Interface rating: 5

The associated links were useful and not distracting.

No evidence of grammatical errors were found in the book.

The book is inclusive.

The book was informative, easy to follow, and sequential allowing the reader to digest each section before moving into another.

Reviewed by Jenny Inker, Assistant Professor, Virginia Commonwealth University on 8/23/22

This book provides a comprehensive yet easily comprehensible introduction to critical thinking in academic research. The author lays a foundation with an introduction to the concepts of critical thinking and analyzing and making arguments, and... read more

This book provides a comprehensive yet easily comprehensible introduction to critical thinking in academic research. The author lays a foundation with an introduction to the concepts of critical thinking and analyzing and making arguments, and then moves into the details of developing research questions and identifying and appropriately using research sources. There are many wonderful links to other open access publications for those who wish to read more or go deeper.

The content of the book appears to be accurate and free of bias.

The examples used throughout the book are relevant and up-to-date, making it easy to see how to apply the concepts in real life.

The text is very accessibly written and the content is presented in a simple, yet powerful way that helps the reader grasp the concepts easily. There are many short, interactive exercises scattered throughout each chapter of the book so that the reader can test their own knowledge as they go along. It would be even better if the author had provided some simple feedback explaining why quiz answers are correct or incorrect in order to bolster learning, but this is a very minor point and the interactive exercises still work well without this.

The book appears consistent throughout with regard to use of terminology and tone of writing. The basic concepts introduced in the early chapters are used consistently throughout the later chapters.

This book has been wonderfully designed into bite sized chunks that do not overwhelm the reader. This is perhaps its best feature, as this encourages the reader to take in a bit of information, digest it, check their understanding of it, and then move on to the next concept. I loved this!

The book is organized in a manner that introduces the basic architecture of critical thinking first, and then moves on to apply it to the subject of academic research. While the entire book would be helpful for college students (undergraduates particularly), the earlier chapters on critical thinking and argumentation also stand well on their own and would be of great utility to students in general.

This book was extremely easy to navigate with a clear, drop down list of chapters and subheadings on the left side of the screen. When the reader clicks on links to additional material, these open up in a new tab which keeps things clear and organized. Images and charts were clear and the overall organization is very easy to follow.

I came across no grammatical errors in the text.

Cultural Relevance rating: 4

This is perhaps an area where the book could do a little more. I did not come across anything that seemed culturally insensitive or offensive but on the other hand, the book might have taken more opportunities to represent a greater diversity of races, ethnicities, and backgrounds.

This book seems tailor made for undergraduate college students and I would highly recommend it. I think it has some use for graduate students as well, although some of the examples are perhaps little basic for this purpose. As well as using this book to guide students on doing academic research, I think it could also be used as a very helpful introduction to the concept of critical thinking by focusing solely on chapters 1-4.

Table of Contents

• Introduction
• Part I. What is Critical Thinking?
• Part II. Barriers to Critical Thinking
• Part III. Analyzing Arguments
• Part IV. Making an Argument
• Part V. Research Questions
• Part VI. Sources and Information Needs
• Part VII. Types of Sources
• Part VIII. Precision Searching
• Part IX. Evaluating Sources
• Part X. Ethical Use and Citing Sources
• Part XI. Copyright Basics
• Works Cited
• About the Authors

Ancillary Material

About the book.

Critical Thinking in Academic Research - 2nd Edition provides examples and easy-to-understand explanations to equip students with the skills to develop research questions, evaluate and choose the right sources, search for information, and understand arguments. This 2nd Edition includes new content based on student feedback as well as additional interactive elements throughout the text.

About the Contributors

Cindy Gruwell is an Assistant Librarian/Coordinator of Scholarly Communication at the University of West Florida. She is the library liaison to the department of biology and the College of Health which has extensive nursing programs, public health, health administration, movement, and medical laboratory sciences. In addition to supporting health sciences faculty, she oversees the Argo IRCommons (Institutional Repository) and provides scholarly communication services to faculty across campus. Cindy graduated with her BA (history) and MLS from the University of California, Los Angeles and has a Masters in Education from Bemidji State University. Cindy’s research interests include academic research support, publishing, and teaching.

Robin Ewing is a Professor/Collections Librarian at St. Cloud State University. Robin is the liaison to the College of Education and Learning Design. She oversees content selection for the Library’s collections. Robin graduated with her BBA (Management) and MLIS from the University of Oklahoma. She also has a Masters of Arts in Teaching from Bemidji State University. Robin’s research interests include collection analysis, assessment, and online teaching.

Contribute to this Page

• Programs & Services
• Delphi Center

Ideas to Action (i2a)

• What is Critical Thinking?

The ability to think critically calls for a higher-order thinking than simply the ability to recall information.

Definitions of critical thinking, its elements, and its associated activities fill the educational literature of the past forty years. Critical thinking has been described as an ability to question; to acknowledge and test previously held assumptions; to recognize ambiguity; to examine, interpret, evaluate, reason, and reflect; to make informed judgments and decisions; and to clarify, articulate, and justify positions (Hullfish & Smith, 1961; Ennis, 1962; Ruggiero, 1975; Scriven, 1976; Hallet, 1984; Kitchener, 1986; Pascarella & Terenzini, 1991; Mines et al., 1990; Halpern, 1996; Paul & Elder, 2001; Petress, 2004; Holyoak & Morrison, 2005; among others).

After a careful review of the mountainous body of literature defining critical thinking and its elements, UofL has chosen to adopt the language of Michael Scriven and Richard Paul (2003) as a comprehensive, concise operating definition:

Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action.

Paul and Scriven go on to suggest that critical thinking is based on: "universal intellectual values that transcend subject matter divisions: clarity, accuracy, precision, consistency, relevance, sound evidence, good reasons, depth, breadth, and fairness. It entails the examination of those structures or elements of thought implicit in all reasoning: purpose, problem, or question-at-issue, assumptions, concepts, empirical grounding; reasoning leading to conclusions, implication and consequences, objections from alternative viewpoints, and frame of reference. Critical thinking - in being responsive to variable subject matter, issues, and purposes - is incorporated in a family of interwoven modes of thinking, among them: scientific thinking, mathematical thinking, historical thinking, anthropological thinking, economic thinking, moral thinking, and philosophical thinking."

This conceptualization of critical thinking has been refined and developed further by Richard Paul and Linder Elder into the Paul-Elder framework of critical thinking. Currently, this approach is one of the most widely published and cited frameworks in the critical thinking literature. According to the Paul-Elder framework, critical thinking is the:

• Analysis of thinking by focusing on the parts or structures of thinking ("the Elements of Thought")
• Evaluation of thinking by focusing on the quality ("the Universal Intellectual Standards")
• Improvement of thinking by using what you have learned ("the Intellectual Traits")

Selection of a Critical Thinking Framework

The University of Louisville chose the Paul-Elder model of Critical Thinking as the approach to guide our efforts in developing and enhancing our critical thinking curriculum. The Paul-Elder framework was selected based on criteria adapted from the characteristics of a good model of critical thinking developed at Surry Community College. The Paul-Elder critical thinking framework is comprehensive, uses discipline-neutral terminology, is applicable to all disciplines, defines specific cognitive skills including metacognition, and offers high quality resources.

Why the selection of a single critical thinking framework?

The use of a single critical thinking framework is an important aspect of institution-wide critical thinking initiatives (Paul and Nosich, 1993; Paul, 2004). According to this view, critical thinking instruction should not be relegated to one or two disciplines or departments with discipline specific language and conceptualizations. Rather, critical thinking instruction should be explicitly infused in all courses so that critical thinking skills can be developed and reinforced in student learning across the curriculum. The use of a common approach with a common language allows for a central organizer and for the development of critical thinking skill sets in all courses.

• SACS & QEP
• Planning and Implementation
• Why Focus on Critical Thinking?
• Paul-Elder Critical Thinking Framework
• Culminating Undergraduate Experience
• Community Engagement
• Frequently Asked Questions
• What is i2a?

Copyright © 2012 - University of Louisville , Delphi Center

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base
• Working with sources
• What Is Critical Thinking? | Definition & Examples

What Is Critical Thinking? | Definition & Examples

Published on May 30, 2022 by Eoghan Ryan . Revised on May 31, 2023.

Critical thinking is the ability to effectively analyze information and form a judgment .

To think critically, you must be aware of your own biases and assumptions when encountering information, and apply consistent standards when evaluating sources .

Critical thinking skills help you to:

• Identify credible sources
• Evaluate and respond to arguments
• Assess alternative viewpoints
• Test hypotheses against relevant criteria

Table of contents

Why is critical thinking important, critical thinking examples, how to think critically, other interesting articles, frequently asked questions about critical thinking.

Critical thinking is important for making judgments about sources of information and forming your own arguments. It emphasizes a rational, objective, and self-aware approach that can help you to identify credible sources and strengthen your conclusions.

Critical thinking is important in all disciplines and throughout all stages of the research process . The types of evidence used in the sciences and in the humanities may differ, but critical thinking skills are relevant to both.

In academic writing , critical thinking can help you to determine whether a source:

• Is free from research bias
• Provides evidence to support its research findings
• Considers alternative viewpoints

Outside of academia, critical thinking goes hand in hand with information literacy to help you form opinions rationally and engage independently and critically with popular media.

Prevent plagiarism. Run a free check.

Critical thinking can help you to identify reliable sources of information that you can cite in your research paper . It can also guide your own research methods and inform your own arguments.

Outside of academia, critical thinking can help you to be aware of both your own and others’ biases and assumptions.

Academic examples

However, when you compare the findings of the study with other current research, you determine that the results seem improbable. You analyze the paper again, consulting the sources it cites.

You notice that the research was funded by the pharmaceutical company that created the treatment. Because of this, you view its results skeptically and determine that more independent research is necessary to confirm or refute them. Example: Poor critical thinking in an academic context You’re researching a paper on the impact wireless technology has had on developing countries that previously did not have large-scale communications infrastructure. You read an article that seems to confirm your hypothesis: the impact is mainly positive. Rather than evaluating the research methodology, you accept the findings uncritically.

Nonacademic examples

However, you decide to compare this review article with consumer reviews on a different site. You find that these reviews are not as positive. Some customers have had problems installing the alarm, and some have noted that it activates for no apparent reason.

You revisit the original review article. You notice that the words “sponsored content” appear in small print under the article title. Based on this, you conclude that the review is advertising and is therefore not an unbiased source. Example: Poor critical thinking in a nonacademic context You support a candidate in an upcoming election. You visit an online news site affiliated with their political party and read an article that criticizes their opponent. The article claims that the opponent is inexperienced in politics. You accept this without evidence, because it fits your preconceptions about the opponent.

There is no single way to think critically. How you engage with information will depend on the type of source you’re using and the information you need.

However, you can engage with sources in a systematic and critical way by asking certain questions when you encounter information. Like the CRAAP test , these questions focus on the currency , relevance , authority , accuracy , and purpose of a source of information.

When encountering information, ask:

• Who is the author? Are they an expert in their field?
• What do they say? Is their argument clear? Can you summarize it?
• When did they say this? Is the source current?
• Where is the information published? Is it an academic article? Is it peer-reviewed ?
• Why did the author publish it? What is their motivation?
• How do they make their argument? Is it backed up by evidence? Does it rely on opinion, speculation, or appeals to emotion ? Do they address alternative arguments?

Critical thinking also involves being aware of your own biases, not only those of others. When you make an argument or draw your own conclusions, you can ask similar questions about your own writing:

• Am I only considering evidence that supports my preconceptions?
• Is my argument expressed clearly and backed up with credible sources?
• Would I be convinced by this argument coming from someone else?

If you want to know more about ChatGPT, AI tools , citation , and plagiarism , make sure to check out some of our other articles with explanations and examples.

• ChatGPT vs human editor
• ChatGPT citations
• Is ChatGPT trustworthy?
• Using ChatGPT for your studies
• What is ChatGPT?
• Chicago style
• Paraphrasing

 Plagiarism

• Types of plagiarism
• Self-plagiarism
• Avoiding plagiarism
• Academic integrity
• Consequences of plagiarism
• Common knowledge

Critical thinking refers to the ability to evaluate information and to be aware of biases or assumptions, including your own.

Like information literacy , it involves evaluating arguments, identifying and solving problems in an objective and systematic way, and clearly communicating your ideas.

Critical thinking skills include the ability to:

You can assess information and arguments critically by asking certain questions about the source. You can use the CRAAP test , focusing on the currency , relevance , authority , accuracy , and purpose of a source of information.

Ask questions such as:

• Who is the author? Are they an expert?
• How do they make their argument? Is it backed up by evidence?

A credible source should pass the CRAAP test  and follow these guidelines:

• The information should be up to date and current.
• The author and publication should be a trusted authority on the subject you are researching.
• The sources the author cited should be easy to find, clear, and unbiased.
• For a web source, the URL and layout should signify that it is trustworthy.

Information literacy refers to a broad range of skills, including the ability to find, evaluate, and use sources of information effectively.

Being information literate means that you:

• Know how to find credible sources
• Use relevant sources to inform your research
• Understand what constitutes plagiarism
• Know how to cite your sources correctly

Confirmation bias is the tendency to search, interpret, and recall information in a way that aligns with our pre-existing values, opinions, or beliefs. It refers to the ability to recollect information best when it amplifies what we already believe. Relatedly, we tend to forget information that contradicts our opinions.

Although selective recall is a component of confirmation bias, it should not be confused with recall bias.

On the other hand, recall bias refers to the differences in the ability between study participants to recall past events when self-reporting is used. This difference in accuracy or completeness of recollection is not related to beliefs or opinions. Rather, recall bias relates to other factors, such as the length of the recall period, age, and the characteristics of the disease under investigation.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Ryan, E. (2023, May 31). What Is Critical Thinking? | Definition & Examples. Scribbr. Retrieved August 21, 2024, from https://www.scribbr.com/working-with-sources/critical-thinking/

Is this article helpful?

Eoghan Ryan

Other students also liked, student guide: information literacy | meaning & examples, what are credible sources & how to spot them | examples, applying the craap test & evaluating sources, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts