Record Correctness Evidence in a Manifest

Adds the outcome of a correctness check to a manifest, so the capsule carries not only the reported numbers but the checks they passed. Each planted effect from cpsplant() becomes a record (recovered against planted, within the tolerance); a cpsspec() check records the share of specifications agreeing in sign (which should be 1); a cpsfals() result records each control that ran (1 for passed).

Usage

recevid(man, x, grp = "evidence")

Arguments

man

A manifest from mkmnf().

x

A result of cpsplant(), cpsspec() or cpsfals().

grp

The records' group.

Value

The manifest, with the new records.

See also

recrd(), cpsbndl().

Examples

set.seed(1)
d <- data.frame(x = rbinom(100, 1, 0.5))
d$y <- d$x + rnorm(100)
dm <- function(df) mean(df$y[df$x == 1]) - mean(df$y[df$x == 0])
man <- mkmnf(list(project = "demo"), env = FALSE)
man <- recevid(man, cpsplant(d, dm, "y", "x", n = 50, seed = 1))
#>   planted effect 0 recovered                   observed = -0.0221      expected = 0.0000       [INFO]
#>   planted effect 0.5 recovered                 observed = 0.4756       expected = 0.5000       [INFO]
#>   planted effect 1 recovered                   observed = 0.9878       expected = 1.0000       [INFO]
man
#> ╭── Run manifest ─────────────────────────────────────────────────────────────╮
#> │   project       demo                                                        │
#> │   synthetic     TRUE                                                        │
#> │   Cross-checks  3 (INFO 3)                                                  │
#> │   Environment   not captured                                                │
#> │                                                                             │
#> │   Cross-checks                                                              │
#> │   check                         group     observed     expected  diff       │
#> │   ----------------------------  --------  -----------  --------  ---------- │
#> │   planted effect 0 recovered    evidence  -0.02211655  0         0.02211655 │
#> │   planted effect 0.5 recovered  evidence  0.4756232    0.5       0.02437684 │
#> │   planted effect 1 recovered    evidence  0.9878458    1         0.0121542  │
#> │                                                                             │
#> │   check                         tol        status                           │
#> │   ----------------------------  ---------  ------                           │
#> │   planted effect 0 recovered    0.1296016  INFO                             │
#> │   planted effect 0.5 recovered  0.1367524  INFO                             │
#> │   planted effect 1 recovered    0.1324775  INFO                             │
#> │                                                                             │
#> │   No cross-check differs; 0 of 3 pass and the rest are INFO.                │
#> │   Built on synthetic data: every cross-check is INFO, not evidence.         │
#> │                                                                             │
#> │   wrmnfjs() writes it as JSON; mnfdgst() is the digest a signature          │
#> │   covers. Neither depends on how it prints.                                 │
#> ╰─────────────────────────────────────────────────────────────────────────────╯