Skip to contents

Parameter count of a transformer encoder stack

Source: R/geron_w4d_native.R
morie_geron_encoder_params.Rd

Parameter count of a transformer encoder stack

Usage

morie_geron_encoder_params(d_model, d_ff, n_layers)

Arguments

d_model, d_ff, n_layers

Integers.

Value

Integer parameter count.

Examples

morie_geron_encoder_params(d_model = c(1, 2, 3, 4, 5, 6, 7, 8),
  d_ff = c(1, 2, 3, 4, 5, 6, 7, 8), n_layers = c(1, 2, 3, 4, 5, 6, 7, 8))
#> [1]   12   72  216  480  900 1512 2352 3456