(of possible 24)
The C.R.A.A.P. Test was created by Sarah Blakeslee (University of California at Chico, Meriam Library). With her permission, this content was based off her original text with some modification.
Regardless of whether your course is online or face to face, you will need to provide feedback to your students on their strengths and areas for growth. Rubrics are one way to simplify the process of providing feedback and consistent grades to your students.
Rubrics are “scoring sheets” for learning tasks. There are multiple flavors of rubrics, but they all articulate two key variables for scoring how successful the learner has been in completing a specific task: the criteria for evaluation and the levels of performance. While you may have used rubrics in your face-to-face class, rubrics become essential when teaching online. Rubrics will not only save you time (a lot of time) when grading assignments, but they also help clarify expectations about how you are assessing students and why they received a particular grade. It also makes grading feel more objective to students (“I see what I did wrong here”), rather than subjective (“The teacher doesn’t like me and that’s why I got this grade.”).
When designing a rubric, ideally, the criteria for evaluation need to be aligned with the learning objectives [link to learning objectives] of the task. For example, if an instructor asks their learners to create an annotated bibliography for a research assignment, we can imagine that the instructor wants to give the students practice with identifying valid sources on their research topic, citing sources correctly (using the appropriate format), and summarizing sources appropriately. The criteria for evaluation in a rubric for that task might be
The levels of performance don’t necessarily have a scale they must align with. Some rubric types might use a typical letter grading scale for their levels – these rubrics often include language like “An A-level response will….” Other rubric types have very few levels of performance; sometimes they are as simple as a binary scale – complete or incomplete (a checklist is an example of this kind of rubric). How an instructor thinks about the levels of performance in a rubric is going to depend on a number of factors, including their own personal preferences and approaches to evaluating student work, and on how the task is being used in the learning experience. If a task is not going to contribute to the final grade for the course, it might not be necessary (or make sense) to provide many fine-grained levels of performance. On the other hand, an assignment that is designed to provide detailed information to the instructor as to how proficient each student is at a set of skills might need many, highly specific levels of performance. At the end of this module, we provide examples of different types of rubrics and structures for levels of performance.
What teaching goals can rubrics help meet?
In an online course, clear communication from the instructor about their expectations is critical for student success and success of the course. Effective feedback, where it is clear to the learner what they have already mastered and where there are gaps in the learners knowledge or skills, is necessary for deep learning. Rubrics help an instructor clearly explain their expectations to the class as a whole while also making it easier to give individual students specific feedback on their learning.
Although one of the practical advantages to using rubrics is to make grading of submitted assignments more efficient, they can be used for many, not mutually exclusive, purposes:
Different styles of rubrics are better fits for different task-types and for fulfilling the different teaching aims of a rubric . Here we focus on four different styles with varying levels of complexity: single point rubric, Specific task rubrics, general rubrics, holistic rubrics and analytical rubrics (Arter, J. A., & Chappuis, J., 2007).
Sometimes, simple is easiest. A single point rubric can tell students whether they met the expectations of the criteria or not. We’d generally recommend not using too many criteria with single point rubrics, they aren’t meant for complicated evaluation. They are great for short assignments like discussion posts.
Example task : Write a 250 discussion post reflecting on the purpose of this week’s readings. (20 points)
Example rubric:
This style of rubric is useful for articulating the knowledge and skill objectives (and their respective levels) of a specific assignment.
Example task:
Design and build a trebuchet that is adjustable to launch a
This style of rubric enables a single, overall assessment/evaluation of a learner’s performance on a task
Write a historical research paper discussing ….
( Adapted from http://jfmueller.faculty.noctrl.edu/toolbox/rubrics.htm#versus )
This style of rubric can be used for multiple, similar assignments to show growth (achieved and opportunities) over time.
Write a blog post appropriate for a specific audience exploring the themes of the reading for this week.
(Adapted from http://www.chronicle.com/blogs/profhacker/a-rubric-for-evaluating-student-blogs/27196 )
This style of rubric is well suited to breaking apart a complex task into component skills and allows for evaluation of those components. It can also help determine the grade for the whole assignment based on performance on the component skills. This style of rubric can look similar to a general rubric but includes detailed grading information.
( Adapted from http://www.chronicle.com/blogs/profhacker/a-rubric-for-evaluating-student-blogs/27196 )
You can approach designing a rubric from multiple angles. Here we outline just one possible procedure to get started. This approach assumes the learning task is graded, but it can be generalized for other structures for levels of performance.
CRLT – Sample lab rubrics
Cult of Pedagogy – The single point rubric
The Chronicle of Higher Ed – A rubric for evaluating student blogs
Canvas – Creating a rubric in Canvas
Jon Mueller – Authentic assessment toolkit
Arter, J. A., & Chappuis, J. (2007). Creating & recognizing quality rubrics. Upper Saddle River, NJ: Pearson Education.
Gilbert, P. K., & Dabbagh, N. (2004). How to structure online discussions for meaningful discourse: a case study. British Journal of Educational Technology , 36 (1), 5–18. doi: 10.1111/j.1467-8535.2005.00434.x
Wyss, V. L., Freedman, D., & Siebert, C. J. (2014). The Development of a Discussion Rubric for Online Courses: Standardizing Expectations of Graduate Students in Online Scholarly Discussions. TechTrends , 58 (2), 99–107. doi: 10.1007/s11528-014-0741-x
An instructor uses a "rubric" to grade papers and projects where there are no 'right or wrong' answers (Roell, 2019, para. 3). The rubric lists the requirements or "criteria" for the assignment and describes how students will be graded on each criteria. Students check to see whether they have met the criteria before submitting their assignments (Utah Education Network, n.d.). Have you made an excellent S'more? Check out the rubric on the next tab!
Roell, K. (2019, February 25). What is a rubric? https://www.thoughtco.com/what-is-a-rubric-p2-3212064
Utah Education Network. (n.d.). Rubric tool . https://www.uen.org/rubric/know.shtml
Assignments or papers:, on the assignment page, look for a "scoring guide" or a link to a "rubric" following the assignment directions., in some courses, such as en1300 composition ii and en3050 technical communications, you will find the paper rubric or "research paper requirements" under the link in the left colum: course materials or course resources page..
This page contains the following rubrics:
Composing a Title Rubric
Creating a Research Question Rubric
Positing a Thesis Statement Rubric
Creating an Annotated Bibliography Rubric
Creating a Literature Review Rubric
Creating an Abstract Rubric
TASK: Compose a Title | |||
LEVELS OF PERFORMANCE: | |||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | |
References the literary work, theory, and/or method | The title references the student’s chosen literary work, theory, and/or method. | The title is vague about the student’s chosen literary work, theory, and/or method. | The title does not reference the student’s chosen literary work, theory, and/or method at all. |
Clarity | The reader knows exactly what to expect from the student’s work. | The reader isn’t exactly sure what to expect from the student’s work just yet. | The reader has no idea what to expect from the student’s work based on the title. |
Grammar/Mechanics | MLA or APA is used correctly in the title. Grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly in the title, but with mistakes. Some awkward word choices or phrases as well as some grammar, punctuation, and capitalization errors. | The title contains multiple incorrect sentence structures and lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization. |
References Thesis Statement* | The title references the chosen argument.* | The title only slightly references the chosen argument.* | The title does not reference the chosen argument at all.* |
* Note: Titles that reference thesis statements and arguments may be OPTIONAL. Please check with your instructor.
TASK: Create a Research Question | |||
LEVELS OF PERFORMANCE: | |||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | |
Clear, Complex, and Focused Question | The research question is clear, complex, and focused. It is not unnecessarily loaded or leaning. It sets up a researchable and realistic project. | The research question remains too broad or too narrow. It is somewhat unnecessarily loaded or leaning. It is not very researchable and the project it sets up is not very realistic. The research question requires refining. | The research question is extremely broad or narrow. It is very unnecessarily loaded or leaning. It is not researchable and sets up an unrealistic project. The research question requires major refining. |
Arguable Answers | The possible answers to the research question (the thesis) are arguable. These answers can be much more than just “yes” or “no.” | The possible answers to the research question (the thesis) are only partially arguable. These answers can be only slightly more than just “yes” or “no.” | The possible answers to the research question (the thesis) are unarguable. These answers can only be a mere “yes” or “no.” |
Relevance to the scholarly conversation | The research question is relevant to the scholarly conversation and includes key concepts in the discipline. Other researchers and scholars are likely to be highly interested in the question. | The research question is somewhat relevant to the scholarly conversation and may be missing a key concept. Other researchers and scholars may only be slightly interested in this discourse. | The research question does not add anything of value to the scholarly conversation and is lacking any key concepts. Other researchers and scholars would not be interested in this question. |
Question relates to available scholarly sources and evidence | Key research sources and evidence are available and relate directly to the research question. | Key research sources and evidence may only partially available and may only partially relate to the research question. | Key research sources and evidence are not available and/or do not relate to the research question. |
Grammar/Mechanics | MLA or APA is used correctly throughout the research question. Sentence structure as well as grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly throughout the research question, but with mistakes. Some awkward sentences appear as well as some grammar, punctuation, and capitalization errors. | The research question contains multiple incorrect sentence structures and lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization. |
TASK: Posit a Thesis Statement | ||||
LEVELS OF PERFORMANCE: | ||||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | ||
Clarity | The thesis statement clearly conveys the argument and answers the research question. The reader knows what to expect from the work. | The thesis statement only slightly conveys the argument and/or answers the research question. The reader isn’t sure what to expect from the work. | The thesis statement does not convey the argument and does not answer the research question. The reader has no idea what to expect from the work. | |
Arguable | The thesis statement is arguable. Other answers are possible, but they are not as strong as this thesis statement. | The thesis statement is only partially arguable, or other answers are possible, but they are just as strong as this thesis statement. | The thesis statement is unarguable, or other answers are possible, but they are stronger than this particular thesis statement.
| |
Meaningful Discourse | The thesis statement situates claims in existing scholarly discourse. It adds value to the scholarly conversation. | The thesis statement partially situates claims in existing scholarly discourse. It does not add much value to the scholarly conversation. | The thesis statement does not situate claims in existing scholarly discourse. It does not add any value to the scholarly conversation. | |
Position | Takes a supportable position on the chosen topic and acknowledges other positions. | Takes a supportable position on the chosen topic, but fails to acknowledge other positions. | Does not take a supportable position on their chosen topic. | |
Effectiveness | Thesis statement is specific, relevant, and compelling. It effectively organizes all the points made in the rest of the work. | Thesis statement is only slightly specific, relevant, and/or compelling. It partially organizes all the points made in the rest of the work. | Thesis statement is not specific, relevant, and/or compelling. It does not organize the points made in the rest of the work. | |
Grammar/Mechanics | MLA or APA is used correctly in the thesis statement. Sentence structure as well as grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly in the thesis statement, but with mistakes. Some awkward phrases or sentences appear as well as some grammar, punctuation, and capitalization errors. | The thesis statement contains multiple incorrect phrase or sentence structures and lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization. |
TASK: Create an Annotated Bibliography | |||
LEVELS OF PERFORMANCE: | |||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | |
Quality/Reliability of Sources | Gathers a sufficient number of appropriate sources, which are highly relevant and credible. | Gathers a few appropriate sources, which are somewhat relevant and credible. | Does not gather enough sources; sources are not appropriate or relevant, or lack credibility. |
Currency of Sources | Includes sufficiently current content. | Lacks some sufficiently current content. | Current content is entirely lacking. |
Summarization | Summarizes the relevant ideas of chosen sources, states the purpose of the resource, and discusses the resource’s contribution to the topic. | Vaguely summarizes the relevant ideas of chosen sources. Most entries state the purpose of the resource and the resource’s contribution to the topic. | Does not adequately summarize the main ideas of chosen sources. Does not state the purpose of the resource nor the resource’s contribution to the topic. |
Annotation | The annotation shows careful reading and a clear understanding of the source’s content, quality, and relevance. It clearly explains why the sources were chosen. Offers insight into sources and makes explicit connections to the argument as well as to other chosen sources. | The annotation shows some understanding of the source’s content, quality, and relevance. It briefly explains why the sources were chosen. Offers some insight into sources but makes few connections to the argument or to other chosen sources. | The annotation shows little to no understanding of the source’s content, quality, and relevance. It does not explain why the sources were chosen. It offers little to no insight into the sources and does not make connections to the argument or to other chosen sources. |
Grammar/Mechanics | MLA or APA is used correctly throughout the annotated bibliography. Sentence structure as well as grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly throughout the annotated bibliography, but with mistakes. Some awkward sentences appear as well as some grammar, punctuation, and capitalization errors. | The annotated bibliography contains multiple incorrect sentence structures and lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization. |
TASK: Create a Literature Review | |||
LEVELS OF PERFORMANCE: | |||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | |
Introduction of Topic & Research Question | Effectively introduces the topic and direction of the literature review. The research question is clearly identified and connected to the content of the review. | Introduces the topic of the literature review. The research question is identified and connected to some of the content in the review. | Does not introduce the topic of the literature review. The research question is either not identified or not connected to the content of the review. |
Coverage of Content/Organization | Covers appropriate content related to the topic and research question in depth. Sources are cited correctly. The organization of material is clear, effective, and appropriate. | Covers some of the content related to the topic and research question. Sources are cited with minor mistakes. The organization of material is not as clear, effective, and/or appropriate as it could be. | Does not cover appropriate content related to the topic and research question. Sources are cited incorrectly. The organization of material is not clear, effective, and/or appropriate. |
Meaningful Discourse | Demonstrates a clear understanding of the available research about their topic. It situates ideas in existing discourse. | Demonstrates a partial understanding of the available research. It partially situates ideas in existing discourse. | Does not demonstrate an understanding of the available research. Ideas are not situated in existing discourse. |
Essay Form | The literature review is in essay form. | The literature review is mainly or partly in essay form. | The literature review reads like a list of sources summarized. |
Consideration of Audience | Addresses the target audience. | Addresses the target audience. | Does not clearly address the target audience. |
Connections to Discipline/Synthesis of Ideas | Creates “wholes” out of multiple parts, synthesizes, and/or draws conclusions by combining examples, facts, and/or theories. | Struggles to make “wholes” out of multiple parts, synthesize, and/or draw conclusions by combining examples, facts, and/or theories. | Does not create “wholes” out of multiple parts. Does not synthesize or draw conclusions. Merely summarizes material from different sources. |
Grammar/Mechanics | MLA or APA is used correctly throughout. Sentence structure as well as grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly throughout, but with mistakes. Some awkward sentences appear as well as some grammar, punctuation, and capitalization errors. | Lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization. |
TASK: Create an Abstract | |||
LEVELS OF PERFORMANCE: | |||
Above Satisfactory (A/B) | Satisfactory (C) | Below Satisfactory (D/F) | |
Purpose | The abstract is clear, concise, and relevant. | The abstract could be clearer, more concise, and/or more relevant. | The purpose of the abstract is not clear, concise, and/or relevant. |
Methodologies / Methods | Identifies the methods / methodologies used to support the thesis or answer the research question in an organized, specific, and concise manner. | Identifies the methods / methodologies used, but does not show how they support the thesis or answer the research question. | Does not identify the methods / methodologies used or how they support the thesis or answer the research question. |
Evidence | Identifies key evidence found within the research clearly and concisely, and connects it to the purpose of the study. | Identifies evidence found within the research but does not clearly connect the evidence to the purpose of the study. | Does not identify key evidence. |
Results/Conclusion | Provides an explanation of what was expected, discovered, accomplished, collected, and produced throughout their research in an organized, specific, and concise manner. | Provides an incomplete or confusing explanation of what was expected, discovered, accomplished, collected. | Does not provide an explanation of what was expected, discovered, accomplished, collected, and/or produced throughout their research. |
Grammar/Mechanics | The abstract is the appropriate length and MLA or APA is used correctly throughout. Sentence structure as well as grammar, punctuation, and capitalization are used correctly with minimal to no errors. | Generally, MLA or APA format is used correctly throughout the abstract, but with mistakes. It’s not quite the appropriate length, and some awkward sentences appear as well as some grammar, punctuation, and capitalization errors. | The abstract contains multiple incorrect sentence structures and lacks the use of correct MLA or APA format. There are significant errors in grammar, punctuation, and capitalization, and it is not long enough. |
Strategies for Conducting Literary Research Copyright © 2021 by Barry Mauer & John Venecek is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.
IMAGES
VIDEO
COMMENTS
Writing; Scor.. Rubric: Research Report/Paper
Directions: Use the rubric below as a guide to writing and revising your research report. Criteria (Weight) Good (3) Fair (2) Poor (1) Points Awarded. Introduction. A topic sentence clearly tells the topic and the main idea that readers will learn. The writer adds an interesting fact that readers will want to read.
WRITTEN RESEARCH REPORT GRADING RUBRIC. 9. Findings: accuracy of univariate analysis. Univariate analysis is consistent and accurate. No errors made. Analysis is generally consistent and accurate. Some errors are made. Analysis is too often inconsistent or inaccurate. Enough errors are made to distract a knowledgeable listener.
Use the section headings (outlined above) to assist with your rough plan. Write a thesis statement that clarifies the overall purpose of your report. Jot down anything you already know about the topic in the relevant sections. 3 Do the Research. Steps 1 and 2 will guide your research for this report.
research writing requires extensive writing describing empirical-based research. Such complex and demanding tasks require a specific and detailed assessment rubric. With such analytical rubric, students would be able to improve their writing skills (Andrade, 2000, 2001) and their understanding of the task and materials (Timmerman et al., 2010).
Example 9 - Original Research Project Rubric
Thesis. Thesis is a type of research report. A thesis is a long-form research document that presents the findings and conclusions of an original research study conducted by a student as part of a graduate or postgraduate program. It is typically written by a student pursuing a higher degree, such as a Master's or Doctoral degree, although it ...
Research Report Rubric Maker. Enter the appropriate information in the correct box below. Please note that if the title is left blank, nothing will appear in the output. Once you have completed the form above, click the "GENERATE RUBRIC" button below to create your rubric.
There are four main stages involved in constructing a rubric: Stage 1. Reflect on what you want from students, what are your expectations, why you created the assignment, and what students learned from the assignment in the past. Stage 2. Focus on the assignment dimensions as well as the details of the assignment.
Writing a Reflective Paper - Organizing Your Social Sciences ...
9 Elements of a Writing Rubric: How to Score Well ...
The roles of a rubric in writing a research dissertation are two-fold: (1) it serves as a meaningful guide for students' writing of their. dissertation and (2) it provides a proper reference for ...
Evidence of using mostly reliable sources of information on 2 art forms (arch., art, design, drama, music). Excessive reliance on 1 or 2 sources. Reasonable picture of historical context in which arts were made. Reasonable choice of examples. Evidence of using unreliable sources, or excessive reliance on a single source.
This guide will help you to. Define a literature review. Recognize that different fields of study have their own way to perform and write literature reviews. Prepare to search the literature. Read critically -- analyze and synthesize. Prepare to write a literature review. Graphic from Literature Review (2009) by Machi and McEvoy.
How to Write a Literature Review | Guide, Examples, & ...
Organizing Your Social Sciences Research Paper
How to Use Rubrics | Teaching + Learning Lab - MIT
Content is related -- And at correct level -- But you are not comfortable using the source in your research. Content is related -- And at correct level - And you are comfortable using the source in your research. Authority: No author is listed -- and No contact info provided. No author is listed - but includes contact information.
When creating a rubric, start with just a few levels of performance. It is easier to expand a rubric to include more specificity in the levels of performance than it is to shrink the number of levels. Smaller rubrics are much easier for the instructor to navigate to provide feedback. Using a rubric will (likely) not eliminate the need for ...
Marshmallow: your S'more has one black spot, so you receive 3 out of 4 points for that criteria. Chocolate: Your chocolate was melted and stayed on the crackers. The marshmallow, chocolate, and crackers "fused" or stuck together, so you receive 4 points. Graham Crackers: T. : You will find a link to the Discussion Rubric directly below each ...
Purpose - Assessment rubric often lacks rigor and is underutilized. This article reports the effectiveness of the use of several assessment rubrics for a research writing course. Specifically, we examined students' perceived changes and observed changes in their Chapter 1 thesis writing as assessed by supervisors using an existing departmental rubric and a new task-specific rubric ...
Composing a Title Rubric. The title references the student's chosen literary work, theory, and/or method. The title is vague about the student's chosen literary work, theory, and/or method. The title does not reference the student's chosen literary work, theory, and/or method at all.
lective writing rubrics, the focus is on the thinking process. Rubrics used in this manner can help organize the students' thinking for clinical. judgment development and provide a guide for faculty feedback. Reflective writing rubrics in nursing education have the potential to provide guidance.