Normal Distribution
nothing is called 95% until it has been counted
Concept

Dₐ-optimality — where it appears

The design criterion for a treatment effect in the presence of covariates: maximise the assignment's spread less the part of it the covariates explain. It is the criterion a balancing rule optimises whether or not anybody says so, which is what makes balancing a covariate's mean the right move only when the covariate enters linearly.

Named by 2 essays across one field — each of them below, with the objects they name alongside it.

Two rates, not a factor. The standard deviation of the covariate imbalance under three rules, at five trial sizes, 260 trials each, on log axes. The upper line is a coin: its slope is -0.489, against a closed form of exactly −½. The middle line is minimisation on a median split; its slope is -0.519 — the same rate — because inside a category the assignment is still a coin, and what it buys is the constant, 0.654 of a coin's at n = 200. The lower line is the rule that reads x and maximises the information about the treatment effect: slope -0.987, nearly twice as steep. Its advantage is therefore not a number that can be quoted — it is 0.258 of a coin's at n = 50 and 0.065 at n = 800, and it keeps going.

The rule that reads the number

Stop categorising and let the rule read the covariate itself. What it should minimise is not an invented distance but the variance of the effect being estimated — and what comes back is not a better constant but a different rate.

continuous · Assignment What balancing several numbers at once costs each of them. The criterion generalises without a word changing — the covariate imbalance becomes a vector and the correction a quadratic form — so the question is what it is worth rather than whether it can be done. At n = 200 with 200 trials per point, a rule balancing one covariate leaves 12.7% of a coin's imbalance in it; balancing eight leaves 23.2% in each. The assignment has a fixed amount of freedom and every covariate added takes a share of it. The rule degrades rather than failing: at eight covariates it is still four times better balanced than a coin, and the eight are being held simultaneously rather than in turn.

Balancing more than one number

The criterion generalises to several covariates without a word changing, which makes the question what it is worth rather than whether it can be done. Each one added takes a share of the assignment's freedom, and the imbalance left in every one of them rises.

continuous · Blocking

Named alongside it

The objects these essays reach for when they reach for this one.

Continuous covariateCovariate-adaptive randomisationCovariate imbalanceExperimental designInformation matrixMonte CarloOptimal designRandomisationBiased coinBlockingConvergence rateDegrees of freedom

All concepts