I. Norming Outcomes Table
II. Inter-Rater Reliability Calculation (Calculator Link)
Total Number of Agreements= 38
Total Number of Raters= 2
Total Number of Scores Given by Each Rater= 22
Percentage of Agreement= 86 36363636363636%
*Scores >75% do not meet the threshold to establish reliability.
III Group’s Recommendations
A Does the instrument meet the threshold for reliability?
B. If not, why do you think it failed the reliability test?
C Do you recommend changes to the directions, rubric, etc ?
D. What specific next steps/ changes do you recommend?
ED 545 Percentage of Agreement Worksheet