Learning curve – train / val MSE vs training-set size (R parity)

Manual implementation of the sklearn morie_learning_curve flow: shuffle, split into k folds, for each train-fraction fit on a prefix of the training fold and score on the held-out fold.

Usage

morie_learning_curve(x, y, sizes = NULL, cv = 5L, seed = 0L)

Arguments

x

Numeric matrix predictors.

y

Numeric response.

sizes

Training-set fractions (default seq(0.1, 1.0, length=5)).

cv

Number of CV folds.

seed

RNG seed for shuffling.

Value

Named list: estimate (final val MSE), train_sizes, train_scores, val_scores, n, method.

Examples

morie_learning_curve(x = rnorm(50), y = rnorm(50))
#> $estimate
#> [1] 1.042612
#> 
#> $train_sizes
#> [1]  4 13 22 31 40
#> 
#> $train_scores
#> [1] 0.03715635 0.62212841 0.73967700 0.84437516 0.95691595
#> 
#> $val_scores
#> [1] 3.025417 1.369557 1.137256 1.075742 1.042612
#> 
#> $n
#> [1] 50
#> 
#> $method
#> [1] "Learning curve (cv MSE)"
#>