Normal Distribution
nothing is called 95% until it has been counted
Concept

Mediator — where it appears

A variable that the treatment causes and that in turn causes the outcome, so part of the treatment's effect travels through it. Conditioning on it removes exactly that part, which turns an estimate of the total effect into an estimate of what is left.

Named by 5 essays across 2 fields — each of them below, with the objects they name alongside it.

The same covariate, three ways round. Three worlds over a treatment, an outcome and a covariate, joined by the same three edges at the same three strengths — 0.90, 0.50 and 0.70 — differing only in which way the two edges touching the covariate point. In the first the covariate causes both and adjusting for it recovers the effect of 0.50 exactly. In the second the treatment causes the covariate, the effect is 1.13, and adjusting returns 0.50 — the direct edge alone, with the part that travels through the covariate deleted. In the third the treatment and the outcome both cause the covariate, the effect is 0.50, and adjusting returns -0.087. The regression that produces those three numbers is one formula, and nothing in the data says which panel it is being run in.

One arithmetic, three decisions

A covariate beside a treatment and an outcome can be a common cause of both, a step on the path between them, or an effect of both. The regression that includes it is the same arithmetic in all three, and it is right in one — returning 0.5000, deleting 0.6300 of the effect, and turning 0.5000 into −0.0872.

collider · Conditioning Two structures in three are made worse. What adjusting for every covariate measured does to the bias in the treatment's estimated effect, against adjusting for none, over 4000 randomly drawn structures of 6 covariates each. Each covariate is independently a common cause with probability 0.25, a cause of the treatment only, a cause of the outcome only, a cause of neither, a step on the causal path, or a common effect. The rule leaves a larger bias on 65.5% of structures, a smaller one on 33.8%, and the same on 0.7%. The share is a property of that population of structures rather than of adjustment, which is why the weights are stated; what does not depend on them is that the rule has no direction — it is not a conservative default that occasionally overcorrects, it is a rule whose error is whatever the structure happens to be.

Adjusting for everything

"Control for every covariate that was measured" leaves a larger bias than controlling for nothing on 65.5% of four thousand randomly drawn structures and a smaller one on 33.8%. Its squared error is 4.110 times that of using no covariate at all, and half of it sits in its worst tenth of structures.

collider · Conditioning What stratifying on a mediator estimates, and what it does not. The direct effect stays at -0.109 throughout, because it is defined with the mediator held fixed. The total effect runs from -0.218 to 0.027 and crosses zero at 1.5. On 15% of the sweep the two have opposite signs, and both are correct answers.

Conditioning on what the treatment caused

When the grouping variable lies on the path from treatment to outcome, the stratified answer is the direct effect and the aggregate is the total effect. Both are correct. Over 15% of a sweep of the indirect path they have opposite signs, and no arithmetic on the table says which question was being asked.

reversal · Simpson The covariate the treatment caused, and what it hides. A covariate on the causal path: the treatment causes it and it causes the outcome, so the treatment's total effect of 1.130 runs partly through it. Adjusting for it returns the direct edge alone, 0.500, which is what somebody wanting the total effect should not have asked for. The dashed variable is the second problem: an unmeasured cause of both the covariate and the outcome. It does not touch the treatment, so the unadjusted regression still recovers 1.130 exactly. It does touch the covariate, so once the covariate is conditioned on the treatment and the outcome are linked through it, and the adjusted coefficient lands on 0.050 — neither the total effect nor the direct one.

The variable the treatment caused

Adjusting for a covariate the treatment caused stops estimating the total effect and starts estimating the direct one. When that covariate shares an unmeasured cause with the outcome it estimates neither: the total effect is 1.1300, the direct effect is 0.5000, and the regression returns 0.0500.

collider · Conditioning Three adjustment rules on four thousand structures, as every covariate gets noisier. Four thousand random structures of six covariates, the treatment's effect fixed at 0.5, every covariate observed with the same reliability. Mean absolute bias of adjusting for nothing stays 0.190; adjusting for everything measured falls from 0.377 with exact covariates to 0.279 at reliability 0.8 and 0.203 at 0.5; adjusting for the common causes rises from 0 to 0.056 and 0.118. Adjusting for everything beats adjusting for nothing on 33.8% at 1, 38.3% at 0.9, 42.0% at 0.8, 45.3% at 0.7, 48.3% at 0.6, 50.8% at 0.5. The common causes never do worse than nothing at any common reliability.

A set of shadows

Measure every covariate of four thousand random structures with reliability 0.8 and adjusting for the common causes still never does worse than adjusting for nothing — the bias left is each confounder's part times one minus its proxy's reliability, scaled alike. Adjusting for everything measured gets better, beating nothing on 42.0% of structures against 33.8% with exact covariates, because noise blunts the bad adjustments too. Spread the reliabilities to 0.75 ± 0.25 and the right set does harm on 7.15% of structures, every one of them with confounders pushing opposite ways.

collider · Conditioning

Named alongside it

The objects these essays reach for when they reach for this one.

Causal diagramAdjustment setConfoundingCovariate adjustmentBiasColliderDirect effectTotal effectCollider biasInstrumental-variableMean squared errorMonte Carlo

All concepts