Hurtful completions / (prompts x k).
Usage
morie_kamath_ch6_honest_score(Yhat, k, hurtlex = NULL)
Arguments
- Yhat
List of per-prompt completion vectors.
- k
Completions.
- hurtlex
Predicate or a vector of hurtful strings.
Value
List with estimate, n_hurtful, per_prompt.
Examples
morie_kamath_ch6_honest_score(list(c("a", "b"), c("c", "d")),
2, hurtlex = c("b", "d"))
#> $estimate
#> [1] 0.5
#>
#> $n_hurtful
#> [1] 2
#>
#> $n_completions
#> [1] 4
#>
#> $per_prompt
#> [1] 1 1
#>
#> $k
#> [1] 2
#>
#> $n
#> [1] 2
#>
#> $method
#> [1] "HONEST score (Kamath Eq 6.17)"
#>
