Normal Distribution
nothing is called 95% until it has been counted
Concept

Latent variable — where it appears

A variable in a model that is never observed. It is what separates a structure from its observable covariance: two structures can differ only in latents and still imply different effects while implying the same distribution.

Named by 3 essays across one field — each of them below, with the objects they name alongside it.

A covariate that is prior to everything and still ruins it. A covariate measured before the treatment, caused by neither the treatment nor the outcome, and not a common cause of them. Two unmeasured variables sit behind it: one reaches the treatment, the other reaches the outcome, and both reach the covariate. Every rule of thumb for including a baseline variable is satisfied, and the regression that leaves the covariate out estimates the treatment's effect of 0.50 without bias, while the regression that includes it is off by −0.2000 — because the covariate is a common effect of the two unmeasured causes, and conditioning on a common effect makes its causes dependent. The path it opens runs from the treatment back through the first unmeasured cause, through the covariate, and out through the second to the outcome.

A collider before the treatment

A covariate measured before the treatment, on no causal path, and not a common cause of anything, still biases the estimate by exactly −0.2000 against an effect of 0.5 — while the regression that leaves it out is exact. The bias saturates at 0.3536, and the two paths that make it a collider do not appear in that bound.

collider · Conditioning The covariate the treatment caused, and what it hides. A covariate on the causal path: the treatment causes it and it causes the outcome, so the treatment's total effect of 1.130 runs partly through it. Adjusting for it returns the direct edge alone, 0.500, which is what somebody wanting the total effect should not have asked for. The dashed variable is the second problem: an unmeasured cause of both the covariate and the outcome. It does not touch the treatment, so the unadjusted regression still recovers 1.130 exactly. It does touch the covariate, so once the covariate is conditioned on the treatment and the outcome are linked through it, and the adjusted coefficient lands on 0.050 — neither the total effect nor the direct one.

The variable the treatment caused

Adjusting for a covariate the treatment caused stops estimating the total effect and starts estimating the direct one. When that covariate shares an unmeasured cause with the outcome it estimates neither: the total effect is 1.1300, the direct effect is 0.5000, and the regression returns 0.0500.

collider · Conditioning A proxy removes less than its reliability, always. The share of the confounding bias removed by adjusting for a proxy, against how well the proxy measures the confounder. The diagonal is the answer a reader would guess — a covariate that is 80% signal removes 80% of the problem. The curve is what the arithmetic gives: the reliability, times one minus the squared correlation between the treatment and the confounder, divided by one minus the product of those two. That squared correlation is 0.4475. A reliability of 0.8 removes 68.85% and one of 0.6 removes 45.32%. The two agree only at the ends, and the gap is widest where most applied covariates sit.

Adjusting for a shadow

A covariate that is 80% signal removes 68.85% of the confounding, not 80% — the share is λ(1 − ρ²)/(1 − λρ²) and it is below the reliability everywhere. The residual bias is 0.1084 against an effect of 0.5, and at 25,600 rows it is 17.6 standard errors wide.

collider · Conditioning

Named alongside it

The objects these essays reach for when they reach for this one.

Adjustment setBiasCausal diagramCovariate adjustmentUnmeasured confoundingClosed formCollider biasPath coefficientAsymptotic biasBack door pathColliderDirect effect

All concepts