Skip to contents

Shrout and Fleiss (1979) Case 2: (MSR - MSE)/(MSR + (MSC - MSE)/n), for raters who are a RANDOM SAMPLE and results meant to generalise to other raters. The (MSC - MSE)/n term charges SYSTEMATIC RATER DIFFERENCES against reliability, because a future rater brings their own bias. ICC(3,k) drops it and is always at least as large – reporting Case 3 for sampled raters is the standard way to overstate reliability, so both are returned.

Usage

morie_psy_icc2k(y, subject, rater)

Arguments

y

ratings.

subject, rater

identifiers; a complete crossed design.

Value

list: value (ICC(2,k)), icc_single, icc3k, rater_penalty, k, n, MSR, MSC, MSE, case, method.

References

Shrout and Fleiss (1979), Case 2 and Table 4; McGraw and Wong (1996), Psychological Methods 1:30-46.

Examples

y <- c(9, 2, 5, 8, 6, 1, 3, 2, 8, 4, 6, 8)
morie_psy_icc2k(y, rep(1:3, each = 4), rep(1:4, 3))$value
#> [1] 0.6764706