A Rubrics users may choose to enable multiple evaluations either when they first create a rubric template or may edit a previously created template. This is accomplished by clicking on the rubric settings button and toggling multiple evaluators on, as shown in the screenshot below.
Though users have the ability to turn on multiple evaluators later on by navigating back to the rubric template settings, it is important to remember that adjusting a rubric template after data has been collected can cause inconsistencies in the data. Therefore, users are encouraged to make a copy of the template, adjust the multiple evaluation options and then collect data using the adjusted rubric template.
When choosing to enable multiple evaluations, you will also need to decide how to “roll up” these multiple scores. If the rubric is point based a user may choose from several options to roll up data (average, highest, manual selection, most recent, or sum). If the rubric is not point based a user may choose from either manual selection or most recent entered score.
For each of the options below, if only a single score has been provided than that will be returned as the score for the given student regardless of the option chosen.
|Average||This option will average the multiple evaluations together for an aggregate score which is returned for the student. If only a single score was submitted then that is the score returned.|
|Highest||This option will return the highest score that was submitted by evaluators.|
|Manual selection||This option allows the owner of the assessment/assignment, as well as evaluators that do not have a limited view to choose which score should be the final score for the student. If no choice is made, the first score entered will be the default.|
|Most Recent||This automatically chooses the score that was last entered as the final score for the student.|
|Sum||This option sums all scores provided by evaluators for a given student.|
In the example above you can see that Jenna has two evaluations submitted, one of 100% and one of 58.50% by two separate evaluators. As an evaluator, I could create a third evaluation for Jenna by clicking the blue plus button . A single evaluator can have multiple evaluations for a given student if they choose. This particular rubric is set to choose the highest score, which is why Moira’s evaluation of Jenna appears at the top.
If you have questions about when to use Multiple Evaluations, please don’t hesitate your contact your consultant! For technical support, you can also reach out to us by submitting a ticket or calling us at 716.270.0000.