
CrowS-Pairs stereotype preference rate (Kamath Ch 6)
Source:R/kamath_llm2_native.R
morie_kamath_crowspairs_bias.RdShare of minimal pairs whose stereotyping sentence scores higher.
Examples
morie_kamath_crowspairs_bias(c(-1, -3, -2), c(-2, -1, -2))
#> $estimate
#> [1] 0.3333333
#>
#> $score
#> [1] 0.3333333
#>
#> $n_stereotype_preferred
#> [1] 1
#>
#> $n_ties
#> [1] 1
#>
#> $bias_gap
#> [1] -0.1666667
#>
#> $n
#> [1] 3
#>
#> $method
#> [1] "CrowS-Pairs stereotype preference rate (Kamath Ch 6)"
#>