Normal Distribution
nothing is called 95% until it has been counted
Concept

Edgeworth expansion — where it appears

A series that corrects the normal approximation to a standardised sum with terms carrying its skewness and kurtosis. Each term is a polynomial times the normal density, so it helps near the centre and can give negative probabilities in a short tail.

Named by 6 essays across 2 fields — each of them below, with the objects they name alongside it.

The upper tail of 10 exponential draws: normal, one Edgeworth term, two Edgeworth terms, each against the exact tail. Each curve is an approximation divided by the exact gamma tail, so 1 is exact. Six standard deviations out at n = 10: the normal gives ×0.0000670, one Edgeworth term ×0.00159, two ×0.0167 and the saddlepoint ×1.0007.

A correction that goes below zero

One Edgeworth term takes the normal approximation's error at two standard deviations from 38% to 8% on ten exponential draws, and stretches the range within 10% of the truth from 1.66 to 3.09 standard deviations at a hundred. It also turns negative in the short tail at every sample size — past 3.13 standard deviations at a hundred draws and 9.83 at a hundred thousand — because the region recedes only as the sixth root of n.

expansion · Rate The upper tail of 10 exponential draws: normal, two Edgeworth terms, saddlepoint, each against the exact tail. Each curve is an approximation divided by the exact gamma tail, so 1 is exact. Six standard deviations out at n = 10: the normal gives ×0.0000670, one Edgeworth term ×0.00159, two ×0.0167 and the saddlepoint ×1.0007.

An approximation built at the threshold

The saddlepoint approximation reads the tail of a sum of five exponential draws to within 0.19% six standard deviations out, where the normal is short by a factor of more than sixty thousand. It is within 2.2% out to ten standard deviations on a single draw, where there is nothing to average, and within 1.1% on a binomial whose expected count is one. It works because it is built where the tail is read rather than at the mean.

expansion · Rate What a corrected critical value delivers: actual size over nominal, upper tail, sum of 30 exponential draws. At a nominal 1% the upper-tail test's actual size is ×1.703 of nominal with the normal critical value, ×0.991 with one Cornish–Fisher term and ×0.998 with two. At 10⁻⁸ they are ×464, ×1.418 and ×0.932.

The same correction, inverted

One skewness term added to a tail probability keeps a sum of a hundred exponential draws within 10% of the truth out to 3.09 standard deviations. The same term used to move the critical value instead keeps the test's actual size within 10% of nominal out to 5.10 — a level of about one in six million. In the short tail it has a flaw of its own: below a level of about one in a million at ten draws the corrected critical value turns back, and a test asked for a level of 10⁻⁷ rejects 1,149 times too often.

expansion · Rate What a corrected critical value delivers to a t statistic: actual size over nominal, upper tail, 30 exponential draws. At a nominal 1% the upper-tail t test's actual size is ×0.153 with Student's quantile, ×2.94 with one Cornish–Fisher term and ×1.51 with Hall's cubic, both using the source's skewness, and ×0.878 with Hall's cubic using each sample's own. At 10⁻⁶ they are under a hundredth of nominal, ×1.04e+4, ×50.0 and ×1.59.

The correction a t test would use

On thirty exponential draws the one skewness term that held a sum's critical value within 10% out to five standard deviations nearly triples a t test's 1% size when the source's skewness is known, and its upper critical value turns back — at a level of 0.89% on ten draws, where a test asked for one in a thousand rejects 121 times too often. Hall's monotone cubic removes the turn and gains a floor. Built from the sample's own skewness it holds the short side within 20% from 10% down to one in a hundred thousand, and leaves the long side, the one a safety limit reads, at twice its level: the samples that fail are the ones that hide their skewness.

expansion · Rate A tilt for the ratio, read where it exists. The saddlepoint density of the draw's mean and mean square, integrated over the samples a tilt can reach that put the t statistic past its exact critical value, over the exact tail those same samples carry, at 30 exponential draws. On the short side the relative error runs from +0.88% at 10% to +2.47% at 10⁻⁵; on the long side from +0.83% to +2.05% at 10⁻⁶. Nothing in the construction was fitted to these tails; its error stays within 2.5% of the truth at every level shown.

A tilt for the ratio

A t statistic is a function of two means, so its saddlepoint tilts the joint law of each draw and its square. On an exponential source every such tilt is a truncated normal, and none has a coefficient of variation above one — the exponential is the edge of its own family. Integrated over the samples a tilt can reach, the saddlepoint reads a t statistic's tails on thirty draws within 2.5% from 10% to one in a million on the long side, with nothing fitted. The samples it cannot reach are a third of all samples, they sit at the centre of the statistic rather than in its tails, and a larger sample has more of them.

expansion · Rate Approximate weights against the size of the run. What sixteen bands of the logarithms' t statistic are worth to a simulation of the lognormal t test's lower-tail size, in multiples of the draws, against the size of the run, with the band weights from Student's t exactly and from three approximations to it. Exact weights are worth 2.709 at every size. Fisher's one-term expansion is worth 2.708 at four thousand draws and 2.523 at a million, and breaks even with counting at 23.7 million draws. The variance-matched normal is worth 1.849 at four thousand and breaks even at 14,698. The standard normal is worth 0.762 at a thousand and breaks even at 669: a bias that does not shrink is multiplied by every draw added.

Weights from an approximate law

A companion whose law is only approximately known can still be cut into bands, with each band's weight computed from the approximation. The weight's error is a bias that does not shrink, and the run multiplies it: the stratified rate is worth p(1 − p)/(v + Nb²) times the draws. Reading Student's t on nineteen degrees of freedom as normal breaks even at 669 draws; the normal with the t's variance at about fifteen thousand; Fisher's one-term expansion at twenty-four million. What decides the bias is how the weight errors line up with the band rates, not how large they are — Fisher's is wrong by sixty per cent in one band and biases the rate by six hundredths of one.

splits · Routes

Named alongside it

The objects these essays reach for when they reach for this one.

Tail probabilitySkewnessApproximation errorCornish–Fisher expansionNormal approximationSaddlepoint approximationStudent's tCritical valueCumulant generating functionExponential tiltingAsymptotic seriesBias-variance

All concepts