For W ~ N(0, Sigma) on R^k the reproducing-kernel Hilbert space is the range of Sigma, carrying the inner product <Sigma a, Sigma b>_H = a' Sigma b. This finite-dimensional case is the one where every object in the general definition can be written down, which is why the book uses it to fix intuition; the reproducing formula h(t) = <h, K(t, .)>_H is checked coordinatewise here.
Details
Formula: <Sigma a, Sigma b>_H = a' Sigma b; h = Sigma a; K(t, .) = Sigma e_t, so <h, K(t, .)>_H = a' Sigma e_t = h(t).
