Normal Distribution
nothing is called 95% until it has been counted
Concept

Identification — where it appears

Whether a parameter has a value the data can distinguish. A parameter that indexes a family of identical distributions is unidentified, so it has no true value to concentrate on and no information about it — which is why the usual counts of degrees of freedom do not apply to it.

Named by 13 essays across 7 fields — each of them below, with the objects they name alongside it.

The profile a break point is chosen from. One sample of 120 rows under a break in the persistence, fitted as two first-order regimes at every admissible break point. The maximum is at row 78, where the true break is at 60. The shaded band is every break point within two log-likelihood units of the best one — 8 of the 73 positions searched, which is 11% of the range. The horizontal line is the one-regime fit the search is compared against; the whole profile is above it, at every position, which is the point: a maximum over 73 candidates is above the null by construction and not by evidence.

A break that was looked for

A two-regime whitening finds its change point by maximising a profile, and then reads a criterion that counts parameters. Under no break there is no parameter to count, because every position describes the same model.

charged · Break point Where the general fit becomes the parametric one. The band family's objective at the autoregression's own geometric sequence, cut off at each width, on one sample of 60 rows. The horizontal line is the profile likelihood the parametric fit maximises, written independently through a different whitening. At the full width the two are the same number to 3e-14, which is what says the general construction contains the parametric one rather than resembling it. Below 10 lags there is no line at all: the geometric sequence cut off short is not a covariance matrix, so the objective has nothing to evaluate. Between the two the truncation is briefly above the parametric likelihood — a wrong covariance can fit one sample better than the right one, which is the whole reason a width has to be charged for rather than chosen.

A family before a fit

A regression's coefficients and one correlation can be maximised together. Replace the correlation with an estimated covariance and there is nothing left for "jointly" to mean — until a set of covariances is named, and the set turns out not to contain the truth.

family · Dependence Two searches find some of the same luck. What each search reports on a sample with no break in it, and what the two report together, on four dependences. The dashed line is the sum of the two — what a rule charging each search separately would levy — and the two together always come in below it: 19.30, 15.44, 14.24, 26.64 short, on 100%, 99%, 99%, 100% of draws. The shortfall is not a rounding. Under AR(1) at 0.8 it is 19.30 of the 34.70 the break search manufactures on its own, which is more than half of it. Two searches over one sample are looking at the same noise, and the second one has less left to find.

Two searches, one sample

A searched break in a regression manufactures 34.7 of likelihood ratio where a count of coefficients says 11.1. A searched window manufactures 84.0. The two together manufacture 99.4, not 118.7.

twice · Break point What a search manufactures, law by law. The average likelihood ratio a search over 120 rows reports, on each of the four laws, over 400 draws. Three of them have no break at all and report 5.080, 4.839 and 4.748; the fourth has one and reports 8.757, so the real break is worth only 3.677 beyond what the search would have found anyway. The dashed line is 2, which is what an information criterion charges for one extra parameter. A search costs about two and a half of them, and the number is a measurement rather than a count.

What a search costs in parameters

An information criterion's penalty is an estimate of the optimism a fit carries. For a break point the optimism can be measured and cannot be counted, and it comes to about two and a half parameters.

charged · Break point One distribution, two effects. Three causal structures fitted to one covariance matrix over a treatment, a covariate and an outcome. Each reproduces it exactly — the largest entry-wise disagreement across all three is 4.4e-16 — so no sample of any size distinguishes them. The regression of the outcome on the treatment and the covariate returns 0.500 in all three, to within 4.4e-16, because that coefficient is a function of the covariance and of nothing else. The effect the three worlds hold is 0.500, 0.848 and 0.848: adjusting is exactly right in the first and off by −0.348 in the other two. The arithmetic cannot see the difference and the difference is the whole question.

The two worlds that look the same

Three causal structures were fitted to one covariance matrix and agree with it to 4.4·10⁻¹⁶. The regression returns 0.5000 under all three; the effect they hold is 0.5000, 0.8481 and 0.8481. What separates structures is a missing edge, and the signature of one is a correlation of exactly zero.

collider · Conditioning What a search costs is not a property of that search. The likelihood ratio a searched break in the regression reports, two ways, on every law. On its own — the whole rule being a split of the sample, at no whitening — it averages 34.70 under AR(1) at 0.8, against the 11.07 a chi-square on the five coefficients a split adds would use as a threshold. Inside a rule that also chooses a window from a list of eight, the same search adds only 15.40 — less than half. Most of what a break search finds under correlated errors is the correlation, and a whitening chosen from the same sample has taken it already. A charge measured for one search, carried into a rule that makes two, is not conservative in some harmless direction: it is measuring a different quantity.

A charge that depends on the rule

The break search's charge is 34.7 on its own and 15.4 once a window has been chosen from the same sample. Most of what a break search finds under correlated errors is the correlation, and a whitening has taken it already.

twice · Break point Three copulas that break nothing, and a factor of two between them. The three radially symmetric copulas, at a matched Spearman correlation of 0.40, against the covariate's marginal. All three leave exactly nothing with a symmetric covariate — that is the guarantee, and it holds to twenty decimal places. What they do to a skewed covariate is not the same at all: at a skewness of 2.26 a Frank copula leaves 12.118% where a Gaussian leaves 21.539% and a t on four degrees of freedom leaves 23.640%. A factor of 2.0 between two copulas that are both symmetric, both matched on rank correlation, and both harmless on their own. So the copula matters to the marginal's leak without breaking any symmetry of its own, which is a milder version of the same finding and applies to every trial rather than to the asymmetric ones.

A copula that halves a marginal

Three copulas break nothing on their own and put a factor of two between the same skewed covariate's leaks — 12.118% under a Frank against 23.640% under a t, at the same rank correlation.

compound · Adjustment The split depends on the order. How much two searches share, measured both ways round, over 300 draws. Pinning the first search at its own answer and searching the second gives one overlap; pinning the second and searching the first gives another. A break paired with an independent column reads -0.004395 one way and 0.002163 the other, at 8.70 paired standard errors and on opposite sides of zero. The excess the two components subtract to is the same in both orders by construction, so what changes is only how it is attributed. There is no order-free way to say which of two searches found ground both can reach, and the two orders bracket it.

A split that depends on the order

Run the second search first and pin that instead, and the same draw gives a different overlap and a different interaction — with the same difference. And one pair has no second order at all.

separate · Break point How often the split is taken, and by which rule. Over 400 draws on each of five laws. The first two rows have no break in them at all, the last two have one at row 60, and the middle one is a moving average. A criterion that counts a fitted two-regime model's parameters and nothing else takes the split on 99% of draws where there is no break. Counting the break point as one more parameter brings that to 67%. Charging what the search actually manufactures — 5.16 units, measured on a law with no break — brings it to 16%, and still takes the split on 61% of draws where there is one.

Choosing whether to break

Charging what the search manufactures takes a rule from splitting a stationary sample on 99% of draws to 16%. It also costs regret, because the two mistakes a rule can make are not the same size.

charged · Break point What a second break adds. Over 200 draws, the likelihood ratio a search over one break point reports, and how much more a search over an ordered pair adds on top of it. Under AR(1) at 0.8, which has no break at all, the first search manufactures 5.697 and the second adds 4.278. Under a law with exactly one break — where a second one is as absent as the first was in the row above — the first search reports 9.442 and the second still adds 5.800. Searching for something that is not there costs the same whether or not something else was there to find.

A second break on a flat profile

Searching a hundred and twenty rows for one change point manufactures five units of likelihood. Searching for a second manufactures four more, on a series that has at most one — and on a profile whose whole range is under seven.

charged · Break point Where two profile likelihoods put the break. Under a break in the persistence at row 60 of 120, and the same break turned over, over 300 draws: how often each search's estimate lands within twelve rows of the truth, with its average and spread beside it. persistent first · one scale for the whole series: 46.7%, at 74.8 with a spread of 11.8; persistent first · a scale per regime: 94.3%, at 61.8 with a spread of 5.8; persistent last · one scale for the whole series: 49.3%, at 45.3 with a spread of 11.7; persistent last · a scale per regime: 93.0%, at 56.7 with a spread of 5.9.

The break a shared scale hid

The break searches in this field all maximised a likelihood with one innovation variance for the whole series, and on a break from 0.95 to 0.65 they found it badly: an average of 74.8 where the truth is 60, within twelve rows on 47% of draws, from a profile everyone called flat. Give each regime its own innovation variance — one more parameter, and the one the law actually has — and the same search lands at 61.8 with a spread of 5.8, within twelve rows on 94% of draws, reporting four times the likelihood. The break was never barely there; the likelihood was blind to the half of its evidence that is in the scale. Under no break the extra parameter costs about one and a half units of manufactured likelihood.

charged · Break point The covariate the treatment caused, and what it hides. A covariate on the causal path: the treatment causes it and it causes the outcome, so the treatment's total effect of 1.130 runs partly through it. Adjusting for it returns the direct edge alone, 0.500, which is what somebody wanting the total effect should not have asked for. The dashed variable is the second problem: an unmeasured cause of both the covariate and the outcome. It does not touch the treatment, so the unadjusted regression still recovers 1.130 exactly. It does touch the covariate, so once the covariate is conditioned on the treatment and the outcome are linked through it, and the adjusted coefficient lands on 0.050 — neither the total effect nor the direct one.

The variable the treatment caused

Adjusting for a covariate the treatment caused stops estimating the total effect and starts estimating the direct one. When that covariate shares an unmeasured cause with the outcome it estimates neither: the total effect is 1.1300, the direct effect is 0.5000, and the regression returns 0.0500.

collider · Conditioning How often a test of a supplied cointegrating relation rejects it, by how wrong it is and how long the sample is. 800 systems a point. At 100, 200, 400, 800 observations the right relation is rejected 9.4%, 5.4%, 5.4%, 6.4% of the time; one with c = 0.9, 19.9%, 37.8%, 78.5%, 98.5%; c = 1.1, 16.8%, 37.9%, 76.8%, 97.5%.

A restriction the data can check

A rank-two system of three series is identified by exactly two restrictions on its relations, and any two that describe the estimated plane fit it equally well — their forecasts agree with the unrestricted fit's to the last digit, so the data can neither confirm nor refuse them. Supply one relation in full instead, one restriction more than identification needs, and the surplus becomes a test: a relation a tenth wrong is rejected 37.8% of the time at two hundred observations and 98.5% at eight hundred, the error found half the time halving as the sample doubles. A right relation buys the forecast almost nothing; a fifth wrong costs 13% of it at two hundred observations and 25% at eight hundred.

systems · Rank

Named alongside it

The objects these essays reach for when they reach for this one.

Likelihood ratioModel selectionStructural breakChange pointInformation criterionProfile likelihoodSelection effectSpecification searchSupremum statisticCritical valueWhiteningDegrees of freedom

All concepts