
StereoSet stereotype-preference fraction (Kamath Ch 6)
Source:R/kamath_llm2_native.R
morie_kamath_stereoset_bias.RdFraction of pairs preferring the stereotype; 0.5 is unbiased.
Examples
V <- c(1, 2, 3, 4, 5, 6, 7, 8)
morie_kamath_stereoset_bias(V, V)
#> $estimate
#> [1] 0
#>
#> $ss_score
#> [1] 0
#>
#> $n_stereotype_preferred
#> [1] 0
#>
#> $n_anti_preferred
#> [1] 0
#>
#> $n_ties
#> [1] 8
#>
#> $bias_magnitude
#> [1] 0.5
#>
#> $unbiased_point
#> [1] 0.5
#>
#> $n
#> [1] 8
#>
#> $method
#> [1] "StereoSet stereotype-preference fraction"
#>