Conditional entropy of a 2-D joint pmf

$$H(Y|X) = H(X,Y) - H(X)$$ Cover & Thomas (2006), eq. (2.10)/(2.12), p. 17.

Usage

Cndent(pxy, base = 2)

Arguments

pxy

Joint pmf as a matrix or list of rows; normalised here.

base

Log base; 2 gives bits.

Value

Named list with estimate, hxy, hx, hy, n, method.

References

Cover & Thomas (2006), eq. (2.12).

Examples

Cndent(matrix(c(0.5, 0.125, 0.25, 0.125), 2, 2))
#> $estimate
#> [1] 0.9387219
#> 
#> $hxy
#> [1] 1.75
#> 
#> $hx
#> [1] 0.8112781
#> 
#> $hy
#> [1] 0.954434
#> 
#> $n
#> [1] 4
#> 
#> $method
#> [1] "Conditional entropy H(Y|X) -- Cover & Thomas (2006) eq. (2.12)"
#>