Two-stream attention masks for a factorisation order

content[t,j]=1 when j precedes-or-equals t in perm (0-based perm); query[t,j]=1 only for strictly earlier positions.

Usage

morie_geron_permutation_masks(perm)

Arguments

perm

0-based permutation vector (length T).

Value

list(content, query), each a T x T 0/1 matrix.

Examples

V <- c(1, 2, 3, 4, 5, 6, 7, 8)
morie_geron_permutation_masks(V)
#> $content
#>      [,1] [,2] [,3] [,4] [,5] [,6] [,7] [,8]
#> [1,]    1    1    0    0    0    0    0    0
#> [2,]    1    1    0    0    0    0    0    0
#> [3,]    1    1    1    0    0    0    0    0
#> [4,]    1    1    1    1    0    0    0    0
#> [5,]    1    1    1    1    1    0    0    0
#> [6,]    1    1    1    1    1    1    0    0
#> [7,]    1    1    1    1    1    1    1    0
#> [8,]    1    1    1    1    1    1    1    1
#> 
#> $query
#>      [,1] [,2] [,3] [,4] [,5] [,6] [,7] [,8]
#> [1,]    0    0    0    0    0    0    0    0
#> [2,]    0    0    0    0    0    0    0    0
#> [3,]    1    1    0    0    0    0    0    0
#> [4,]    1    1    1    0    0    0    0    0
#> [5,]    1    1    1    1    0    0    0    0
#> [6,]    1    1    1    1    1    0    0    0
#> [7,]    1    1    1    1    1    1    0    0
#> [8,]    1    1    1    1    1    1    1    0
#>