
LoftQ Frobenius objective (Kamath Eq 4.11)
Source:R/kamath_llm2_native.R
morie_kamath_ch4_loftq_objective.Rd||W - Q - A B^T||_F; smaller is better.
Examples
morie_kamath_ch4_loftq_objective(W = c(1, 2, 3, 4, 5, 6, 7, 8), Q = c(1, 2, 3, 4, 5, 6, 7, 8),
A = c(1, 2, 3, 4, 5, 6, 7, 8), B = 5L)
#> $estimate
#> [1] 71.41428
#>
#> $residual
#> [,1]
#> [1,] -5
#> [2,] -10
#> [3,] -15
#> [4,] -20
#> [5,] -25
#> [6,] -30
#> [7,] -35
#> [8,] -40
#>
#> $quantisation_error
#> [1] 0
#>
#> $r
#> [1] 1
#>
#> $n
#> [1] 8
#>
#> $method
#> [1] "LoftQ Frobenius objective (Kamath Eq 4.11)"
#>