Normal Distribution
nothing is called 95% until it has been counted
Concept

Median split — where it appears

Replacing a continuous covariate by whether it is above or below its own median. It is a statement about rank rather than about value, so it is unchanged by any increasing transformation of the covariate — which makes several of its properties invariant where a mean’s are not.

Named by 22 essays across 6 fields — each of them below, with the objects they name alongside it.

One margin rises; the other turns over. The two halves of the table's margin across the sweep: a lower-tail copula's own leak with a symmetric covariate, and a covariate skewed at 0.95 under a Gaussian copula. The marginal's leak rises at every step, from 3.727% to 36.056%. The copula's does not: it rises to 9.064% at a Spearman of 0.6 and falls to 8.219% by 0.7. It has to turn over, because at a rank correlation of one the two variables are a deterministic function of each other and there is no interaction left for a split to leak. So the margin of the table turns over before any cell in it does.

A margin that turns over

A skewed covariate's leak grows without limit as the dependence strengthens. A copula's own leak does not — it peaks at a rank correlation of 0.6 and falls. The margin of the table turns over before any cell in it does.

stronger · Adjustment One zero is arithmetic and one is a symmetry. What two balancing rules remove of the interaction they are aimed at, on five joint laws of the ranks matched at a Spearman correlation of 0.4, with a normal covariate throughout. A rule holding a median split of each covariate removes exactly nothing of the product of the splits under every one of them, including the two that are not symmetric under reflection — and the reason is not a symmetry at all: a centred median split takes the values ±½, so its square is a quarter identically, and the interaction is orthogonal to both main effects whatever the joint law is. A rule holding the mean of each removes exactly nothing under the three radially symmetric copulas and 7.71% under the two that are not. Bars at the floor are exact zeros; the axis cannot draw 9e-32.

A zero that is arithmetic

A median split's exact zero was explained by a symmetry of the latent normal. It holds under a Clayton copula, which has no such symmetry, because a centred median split squares to a quarter identically.

copula · Criterion One zero holds and one does not. Three rules, at a correlation of 0.5, against the skewness of the covariate. A rule balancing the mean of each covariate removes exactly nothing of their product when the marginal is symmetric — including the heavy-tailed symmetric one at skewness zero, which is what says the guarantee needs symmetry rather than normality — and removes up to 29.7% when it is not. A rule balancing a median split of each removes exactly nothing of the product of the splits under every marginal here, to 1e-30: both sides are functions of the sign of the latent normal, and a monotone transformation moves neither. A rule balancing a threshold at a value on the covariate's own scale removes between 4.9% and 22.5% — it never had a zero to lose, under any marginal at all.

A zero that rests on a symmetry

A balancing rule removes exactly none of an interaction between two odd functions, at every correlation. The argument needs the joint sign flip to preserve the law, and no real covariate is symmetric about anything.

skew · Criterion What a mean split leaves, with both halves varying. The share of a mean split's interaction that survives the rule balancing it, at every copula and every marginal, matched at a Spearman correlation of 0.40. The three radially symmetric copulas leave exactly nothing with a symmetric covariate and rise steeply with the skew. The two asymmetric ones start at 7.707% and go opposite ways: the lower-tail copula falls to 0.002% at a skewness of 0.95 — the two failures cancel almost exactly, and a guarantee both fields report as broken is restored — while the upper-tail one climbs to 40.288%. And the heavy-tailed symmetric covariate, which leaks exactly nothing on its own, doubles what the asymmetric copulas leak: 14.229% against 7.707%.

Two failures that cancel

A mildly skewed covariate under a lower-tail copula leaks 0.002% of an interaction where each failure alone leaks eight and seven per cent. Turn the copula over and the same pair compounds.

compound · Adjustment Where the two kinds of cut sit. Six covariates, each a monotone transformation of the same latent normal. The vertical line at zero is where every median split sits, on every one of them, because a monotone map preserves order: the median of the covariate is the image of the median of the latent normal. The marks on the curves are where a threshold at 1 on the covariate's scale falls — 1.000, 0.881, 0.875, 0.783, 0.713, 0.337 — and none of them is at zero. That is the whole of the difference. A function of the sign of the latent normal is odd, and a rule made of odd functions removes exactly nothing of an interaction between two of them; a threshold anywhere else is neither odd nor even and removes something.

A split survives what a mean does not

The two things every trial balances come apart on a skewed covariate. A median split is a function of the sign of the latent normal whatever the marginal is; a mean is not, and its exact zero is gone at a skewness of one.

skew · Criterion The same copula, turned over. A Clayton copula and its reflection, at the same Spearman correlation of 0.40 and the same Kendall tau of 0.275, against the covariate's marginal. With a symmetric covariate the two are the same number to nine decimals — 7.707% apiece — because the leak then depends on how much asymmetry the copula has and not on which way it points. Skew the covariate and they come apart: at a skewness of 2.26 the lower-tail copula leaves 3.431% and the upper-tail one 36.213%, a factor of 10.6. Both halves of the dependence are asymmetries and an asymmetry has a direction; a lower-tail copula concentrates the dependence where a right-skewed marginal is compressed and the two distortions partly undo each other, and an upper-tail one concentrates it where the marginal is stretched.

A symmetry that was not enough

A heavy-tailed symmetric covariate has a skewness of zero and leaks exactly nothing under three copulas. Under the two asymmetric ones it doubles the leak, from 7.707% to 14.229%.

compound · Adjustment A near-perfect cancellation, at one correlation. A covariate skewed at 0.75 under a lower-tail copula, at each of 7 rank correlations. The earlier field measures this cell at a Spearman of 0.4 and reads 0.002% where adding the two halves' own leaks gives 16.579% — a cancellation so near exact that it is that field's headline. Across the sweep the same cell reads 0.0084%, 0.0182%, 0.0097%, 0.0015%, 0.0864%, 0.4693%, 1.5327%. Its smallest value is at 0.4, in the interior, and by 0.7 it is 1007.40 times larger. The near-zero is where two curves cross, and they cross beside the one correlation that was measured.

The zero that was a crossing

A cell that leaks 0.002% where adding its two halves gives 16.6% is a field's headline. On a finer grid it passes through zero at a rank correlation of 0.38 — two hundredths from where it was measured.

stronger · Adjustment Three copulas that break nothing, and a factor of two between them. The three radially symmetric copulas, at a matched Spearman correlation of 0.40, against the covariate's marginal. All three leave exactly nothing with a symmetric covariate — that is the guarantee, and it holds to twenty decimal places. What they do to a skewed covariate is not the same at all: at a skewness of 2.26 a Frank copula leaves 12.118% where a Gaussian leaves 21.539% and a t on four degrees of freedom leaves 23.640%. A factor of 2.0 between two copulas that are both symmetric, both matched on rank correlation, and both harmless on their own. So the copula matters to the marginal's leak without breaking any symmetry of its own, which is a milder version of the same finding and applies to every trial rather than to the asymmetric ones.

A copula that halves a marginal

Three copulas break nothing on their own and put a factor of two between the same skewed covariate's leaks — 12.118% under a Frank against 23.640% under a t, at the same rank correlation.

compound · Adjustment Four cells change their answer. The four cells of the twenty whose excess changes sign as the dependence strengthens, over 7 recalibrations. Above the line the two failures compound — the cell leaks more than adding the copula's own leak and the marginal's — and below it they cancel. All four start above and end below, and all four are at the two most skewed covariates: skew 0.90 under heavy-tailed, skew 0.95 under heavy-tailed, skew 0.90 under upper tail, skew 0.95 under upper tail. Whether two failures of a dependence compound or cancel is therefore not a property of the pair. It is a property of the pair at a strength of dependence, and a fifth of the table changes its answer inside the range measured here.

An answer that changes

Eleven of twenty cells cancel and nine compound, at one rank correlation. Sweep the correlation and four of the twenty change sides — all four from compounding to cancelling, all four at the most skewed covariates.

stronger · Adjustment A cut at a quantile, and a cut at a value. Two rules that read identically in a protocol. One splits each covariate at its median; the other splits it at 1 on the covariate's own scale — a dose, a temperature, a clinical threshold. At a correlation of 0.5 the first removes exactly nothing of the interaction between its own two splits, under every marginal here, because a median split is a function of the sign of the latent normal whatever the marginal is. The second removes what the bars show, and it does so on a normal covariate too: the threshold sits at 1.000 on the latent scale rather than at zero, so it is 59.4% odd and 40.6% even. The exact zero was never about the cut; it was about the cut being at the median.

The cut that is not a quantile

A protocol that says split the covariate at a threshold and one that says split it at the median read the same and are different rules. One has an exact guarantee under every marginal and the other has none under any.

skew · Criterion Which tail the threshold is in. What a rule balancing a threshold at 1 on each covariate's own scale removes of the interaction between the two thresholds, on five copulas matched at a Spearman rank correlation of 0.4 with a normal covariate throughout. This rule never had a zero to lose — the earlier field establishes that under every marginal — so what is left is a size, and the size depends on where the dependence lives. A Clayton copula, whose density piles up in the lower tail, leaves 5.33%; the same copula turned over, so that it piles up in the upper tail where the threshold is, leaves 33.36%. Same rank correlation, same Kendall tau, same marginal, same threshold: 6.26 times the leak, decided by which end of the distribution the dependence and the cut are both in.

Which tail the cut sits in

The same copula and its reflection have the same rank correlation, the same Kendall tau and the same marginals. A balancing rule holding a threshold at a dose leaves 5.33% under one and 33.36% under the other.

copula · Criterion A guarantee that stops being a number. The worst case of each dictionary over six outcome shapes, at a correlation of 0.5, against the skewness of the covariate. Under a symmetric marginal every rule made of odd functions has a worst case of exactly zero, and the rule holding a mean and a median split of each covariate — the two things every trial balances — is one of them. Under skew that zero becomes 0.74%, 1.83%, 2.24%, 2.49%: small numbers, each of which depends on a marginal nobody stated. The guarantee has not improved by becoming positive. It has stopped being a guarantee, because it can no longer be written down without the covariate's distribution in it.

Balancing a skewed covariate

The worst case of the rule every trial runs goes from exactly zero to somewhere between a quarter of a per cent and two and a half. Which is small, and is a number that cannot be stated without the covariate's distribution in it.

skew · Criterion The one zero neither half of the dependence can touch. A median split's interaction leak at all 30 combinations of copula and marginal, on a log scale. Every one is under 10⁻¹⁶ and the largest is 1.74e-20, which is the quadrature's own noise rather than a leak. The reason is arithmetic and it is short: a centred median split takes the values ±½, so its square is a quarter identically — for every unit, on every draw, whatever the covariate's scale is and whatever joint law the ranks have. The interaction is then orthogonal to both main effects by construction, and there is nothing for either half of the dependence to break. Both of the fields this one joins report this zero holding under their own variation; running both variations at once is what establishes that it is not two coincidences.

The zero that survives both

A median split's interaction leak is under 10⁻¹⁶ at all thirty combinations of copula and marginal. It is the only guarantee in the collection that neither half of the dependence can touch.

compound · Adjustment What a companion with a known expectation can remove from the variance of a simulated 5% rate. For a rate of 0.05, a companion used linearly removes at most 22.4% of the variance however well it correlates. At a correlation of 0.9 it removes 18.1%, the companion's own rate at the same cut 38.2%, and the best function of the companion 48.1%; at 0.99, 21.9%, 77.0% and 82.8%. The companion's rate overtakes the linear companion at a correlation of 0.64.

A rate needs a rate beside it

A simulated rejection rate is an average of indicators, and a companion with an exactly known expectation can remove at most φ(c)²/p(1 − p) of its variance when it is used as a straight line — 22.4% for a 5% rate, 7.2% for a 1% rate — however closely it tracks the statistic. The ceiling is the share of a normal's information a cut keeps. Used as its own rate at the same cut, the same companion removes 38.2% at a correlation of 0.9 and 77.0% at 0.99. On the t test's size for lognormal data it was worth 1.43 times the draws used linearly and 2.32 times used as a rate at a matched level.

splits · Routes A cut walked from the median into each tail. What a rule balancing a threshold on each of two normal covariates removes of the interaction between the two thresholds, with the cut moved from the 1st percentile to the 99th, on five copulas at a Spearman rank correlation of 0.4. Every copula reads exactly zero at the median. The three radially symmetric copulas are mirror images about it: the Gaussian peaks at 19.49% near the 95th percentile and is down to 13.44% at the 99th; the Frank peaks at 13.22% near the 85th and falls to 2.06%; the t is still near its highest, 37.45%, at the 99th. The Clayton climbs to 56.37% at the 1st percentile, in the tail its dependence is in, and never passes 5.39% in the other; its reflection is the same curve turned round.

A cut walked into the tail

Move a balancing rule's threshold off the median and the interaction it leaks rises from exactly zero — and then either turns back to nothing or climbs to a ceiling, depending on one property of the dependence. With both covariates cut, the whole regression collapses to two probabilities, and far out it settles on 2λ/(1 + λ) of the tail-dependence coefficient: 57.25% under a Clayton, 35.57% under a t, and zero under a Gaussian or a Frank however strongly the covariates are related.

copula · Criterion The table swept along the covariate instead. What a rule holding a mean of each covariate fails to remove of their interaction, at each of 4 copulas, as the covariate is skewed further and the rank correlation is held at 0.4. The sweep runs from a symmetric covariate at g = 0 to a skewness of 11.16, and the three settings the earlier table names — g = 0.3, 0.6 and 0.9 — are on it, where this sweep reproduces that table to the last digit. Every row rises and then falls: the lower-tail copula from 7.707% through 0.0015% and back to 5.587%, the upper-tail one to a maximum of 36.213%. So the quantity a trial is exposed to is not monotone in how skewed its covariate is.

The other dial

The table is swept along the strength of the dependence and never along the shape of the covariate. Swept along the shape at a fixed correlation, the same two copulas cross, the same way — and the near-zero cell turns out to be a minimum in both directions at once.

stronger · Adjustment A median split of a measured scale. The share of the interaction a rule balancing a split above the median of each covariate removes, when the covariate is measured on k levels of a symmetric binomial, on five copulas at a Spearman rank correlation of 0.4. With an even number of levels nothing sits on the median and the split is exactly balanced: the rule removes nothing, as for a continuous covariate. With an odd number, 3 levels (50.00% on the median): Gaussian 10.44%, Clayton 4.91%, its reflection 18.44%; 5 levels (37.50% on the median): Gaussian 6.39%, Clayton 3.69%, its reflection 10.06%; 7 levels (31.25% on the median): Gaussian 4.58%, Clayton 2.91%, its reflection 6.77%; 9 levels (27.34% on the median): Gaussian 3.57%, Clayton 2.41%, its reflection 5.05%; 11 levels (24.61% on the median): Gaussian 2.92%, Clayton 2.05%, its reflection 4.01%; 15 levels (20.95% on the median): Gaussian 2.15%, Clayton 1.59%, its reflection 2.82%; 21 levels (17.62% on the median): Gaussian 1.53%, Clayton 1.19%, its reflection 1.93%; 31 levels (14.45% on the median): Gaussian 1.04%, Clayton 0.85%, its reflection 1.26%.

A median with ties

The median split's interaction zero survives every marginal and every copula, because a split that is on for exactly half the units squares to a constant. A covariate measured on a few levels cannot be split exactly in half: on a five-point scale three in eight units sit on the median, and a rule balancing 'above the median' removes 6.39% of the interaction under a Gaussian copula and 10.06% under one of the two Claytons. The size is set by the share of units on the median, which is the formula's own factor. And a fair coin for the tied units restores the zero exactly, on every copula.

compound · Adjustment A leak read off a cohort, at two cuts. The threshold rule's leak as a cohort of 1,000 units estimates it from its own two-by-two table: the bar is the middle eighty per cent of 600 cohorts' plug-in estimates, the open circle their median and the stroke the true leak, for five copulas at a Spearman rank correlation of 0.4. At the 90th percentile the estimate is centred on the truth and its middle eighty per cent spans about fourteen points: Gaussian 12.8% to 26.4% around 19.2%, t on four 21.5% to 35.7% around 28.9%, Frank 5.4% to 18.7% around 12.2%, Clayton 0.8% to 9.6% around 4.4%, Clayton turned over 35.9% to 49.5% around 43.1%. At the 99th it is not centred on anything: Gaussian 13.1% to 100.0% around 13.7%, t on four 17.5% to 72.9% around 37.4%, Frank 14.4% to 100.0% around 2.2%, Clayton 16.1% to 100.0% around 0.6%, Clayton turned over 37.0% to 75.7% around 56.3%, because on three of the five copulas between two cohorts in five and four in five have nobody past both cuts.

A leak read off a two-by-two table

The share of an interaction a threshold-balancing rule leaves alone needs one number from the data: how often a unit past the cut on one covariate is past it on the other. A cohort of a thousand estimates it to within a dozen points at the 90th percentile. At the 99th most cohorts have an empty cell in their table, and every one of those reads a leak of exactly one hundred per cent — a reading the bootstrap then confirms with an interval of zero width.

copula · Criterion Seven products of three splits. The correlation of every product of three centred median splits with every other, at a Spearman rank correlation of 0.4 between each pair of covariates. Under a Gaussian copula a main effect correlates with the other mains and with the triple (0.273), and with no pair at all, because the third moment is 0.000. Under a Frank copula, whose pairs are radially symmetric, the third moment is 0.078 and every other cell fills in: a main correlates 0.082 with the pair it is not in. In both panels a main is exactly uncorrelated with a pair it belongs to, which is the known zero.

The zero that needed two

A rule balancing two median splits removes nothing of their interaction, on every copula, because a centred split squares to a constant. Add a third covariate and the same arithmetic stops protecting the thing it looked as if it protected. The product of three splits is not orthogonal to the mains: at a rank correlation of 0.4 a rule on the mains removes 14.47% of it under a Gaussian copula. And the symmetry that decides the rest belongs to the triple rather than the pair, so Frank's copula, whose pairs are radially symmetric, leaks where Clayton's, whose pairs are not, barely does.

compound · Adjustment A cut on each covariate, every pair of them. The share of the product of two threshold indicators that a rule balancing the two indicators removes, in per cent, at a Spearman rank correlation of 0.4, for cuts at the fifth to the ninety-fifth percentile on each covariate. On the Gaussian the far corner, a cut at the 5th percentile on one and the 95th on the other, is 54.8% against 19.5% with both at the 95th. On the t copula it is 1.1% against 34.5%. Both surfaces have their only zero at the double median and leave the diagonal lower in places: moving one Gaussian cut from the 80th to the 70th lowers the share from 14.0% to 12.1%.

A cut on each side

Every table of the threshold's leak put one quantile on both covariates, which is the diagonal of a surface nobody had drawn. Off the diagonal the copulas swap places: a cut at the 5th percentile on one covariate and the 95th on the other removes 54.8% of the interaction under a Gaussian copula and 1.1% under a t copula, the reverse of their order at the near corner. Walked further out, the far corner has two opposite limits, and which one a Gaussian reaches is decided by whether its correlation is above or below exactly one third.

stronger · Adjustment The two shapes a scale decides between. The share of a coin's imbalance left at 400 units, by marginal and by what the rule reads. normal: linear 1.1% on values and 5.7% on ranks; split 37.4% on values and 25.4% on ranks. skew 2.26: linear 1.5% on values and 28.6% on ranks; split 61.9% on values and 25.0% on ranks. skew 4.75: linear 2.5% on values and 52.2% on ranks; split 95.5% on values and 25.1% on ranks. exponential: linear 1.4% on values and 28.1% on ranks; split 58.7% on values and 25.0% on ranks. A rank's hold on the split does not move with the marginal.

The covariate on its ranks

A skewed covariate spoils every parity argument a balancing rule relies on, and a rule that balances ranks instead of values looks like the way out, since a rank has the same uniform law on any marginal. The measurement says the skew really does belong to the scale for one kind of shape: a rank holds a median split at exactly a quarter of a coin's imbalance whatever the covariate. But it pays with a cap on any shape linear in the value, at nearly half a coin's imbalance on the strongest skew. And a rule holding values and median splits together holds both, beating the rank on the shape a rank gives up and matching it on the one it gains.

skew · Criterion How often a trial with nothing to find shows a Simpson reversal somewhere, by how many variables are searched and how. Trials of eighty whose treatment helps every patient by six points, twenty baseline variables tracking the risk with correlations from 0.95 to 0.10; 4,000 trials. Searching the strongest 1, 2, 5, 10, 20: every cut, 23.4%, 30.7%, 41.0%, 46.9%, 49.0%; the deciles, 13.2%, 19.4%, 27.9%, 33.3%, 36.4%; the median, 4.4%, 6.9%, 11.3%, 14.4%, 16.2%.

Every variable, every cut

Slide the cut along every one of twenty baseline variables in a randomised trial of eighty whose treatment helps every patient equally, and some variable shows a Simpson reversal at some cut in 49.0% of trials — a coin toss with nothing to find. The twenty scans do not add like independent chances: if they did they would reverse 92.4% of the time. They read one patient risk between them, and the weak variables seldom reverse at all, so the strongest five supply 41.0 of the 49.0 points. A trial that shows one reversal usually shows several: 4.8 variables on average.

reversal · Simpson

Named alongside it

The objects these essays reach for when they reach for this one.

Covariate balanceInteractionClosed formGaussian copulaMarginal distributionSkewnessCopulaMonotone transformationParitySymmetryThresholdCovariate adjustment

All concepts