Teaching · For Teachers

A rubric two teachers would score the same way.

Enter the criteria and their points, run the eight checks and, if you can, a short two-scorer trial. The checker shows where the points go, where descriptors blur and how closely scorers agree.

Check a rubricWhat you get
$12one-time · every device you sign in on
Buy · $12

Included with Caveat Classroom and Whole-school licenses. Or get it in the For Teachers toolkit, $79 for 72 items.

The rubric review

One review per rubric version. The example is made up.

Loading the form. If nothing appears, turn on JavaScript.

What you get

Teaching · For Teachers$12 · included with Classroom and Whole-school licenses

What you finish with
Checks met, each criterion’s share of the points, scorer agreement against common targets and a list of revisions.
Who it is for
Teachers, department heads, assessment leads and curriculum leads who write or adopt rubrics.
Format
Browser form. One saved review per rubric and date; printed with the summary or as a blank review form; CSV; export and import a file.
Access
$12 one-time, yours on every device you sign in on; the tool opens once you are signed in with it. Included with Caveat Classroom and Whole-school licenses. Also in the For Teachers toolkit ($79) and the Teaching Suite pass ($199), and 1 more bundle. Everything you type stays in this browser; nothing is sent to Caveat.
Where it lives
The For Teachers space in Caveat Teaching.
Support
Questions about an order, access or a correction: team@caveatacademic.com.
two scorers, one reading of the work
Drawn for this page. A rubric is working when two careful scorers put the same paper at the same level.

How to use it

  1. Start a review with a code for the rubric.
  2. Enter each criterion with its points and mark whether its levels are observable and distinct.
  3. Run the eight whole-rubric checks.
  4. If you can, have two people score the same ten papers and enter the agreement counts.
  5. Revise, then copy the review to a new date and check again.

Check a rubric

How the checks are read

Agreement

Exact agreement is how often two scorers give the same level; within one level adds the near misses. Reviews of rubric research often treat about 70% exact as acceptable, and within-one-level agreement should be far higher. Disagreements show which descriptors to tighten.

Weights

Points say what matters. A criterion carrying more than about 40% of an analytic rubric should be the heart of the learning goal, not mechanics by default.

What this is not

A reliability study. Ten papers and two scorers are a quick check, not a validation.

Sources

  1. Brookhart, S. M. (2013). How to Create and Use Rubrics for Formative Assessment and Grading. ASCD.
  2. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144.
  3. Moskal, B. M., & Leydens, J. A. (2000). Scoring rubric development: Validity and reliability. Practical Assessment, Research, and Evaluation, 7(10).
  4. Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144.

The example rubric and scores are made up. Support: team@caveatacademic.com.