Every essay — page 17
What a dictionary buys and what it costs
A balancing rule is a list of functions, and the list decides two things that pull against each other. What it protects against is decided by parity: an interaction between two odd functions is even, an odd function is orthogonal to an even one at every correlation, and the two things every trial balances — a mean and a median split — are both odd, so their worst case is exactly zero however many of them are held. What it costs is the assignments it leaves, and past a certain thinness those stop being one set: the admissible assignments split into an arrangement and its mirror image, no sequence of admissible single swaps joins them, and the walk that samples them is uniform on half the reference distribution for ever.
The walk that cannot cross
A thin enough admissible set is not one set. It splits into an assignment and its mirror image, no sequence of admissible single swaps joins them, and the walk that samples it is uniform on half the reference distribution for ever.
Two functions a covariate
Every constraint costs admissible assignments at the same rate, so the decision a trial faces is a budget: which two functions of each covariate. Over twenty-eight pairs the worst case never picks the mean. At a correlation of a half it picks the square with a cut at one, beating the mean and the square by sixteen hundredths of a point on a floor held by a shape no pair removes a tenth of — and giving up 41% of a linear outcome to do it. Over the 127 lists of shapes a designer could write, twenty-three different pairs are best somewhere.
When a fixed width is reached
A fixed-width interval promises a precision rather than a sample size, so the trial stops when it has enough — and what the stopping rule is allowed to read decides whether the interval means anything. A rule that stops when its own interval is short enough is stopping on the spread it is about to quote, at a correlation of 0.938, and every weighting loses three to five points of coverage including the one told every true variance ratio. The width a set of weights will produce is predictable from the within-arm sums of squares alone, which are independent of every difference the interval is about; a rule that stops on the prediction is back at nominal, costs two and a half blocks, and gives up half of the width promise it was keeping.
A width the trial has to stop for
The weighting that covers at 94.9% on twelve blocks covers at 91.5% when the trial stops as soon as its interval is short enough — and so does the rule that is told every block's true variance ratio. The shortfall is the stopping, not the weights.
Stopping on the arms
The width a trial will report is predictable from quantities the interval is not about. A rule that stops on the prediction covers at 94.5% where one that stops on the interval covers at 91.5, and it costs two blocks and half of the width promise.
The trials that stopped early
A fixed-width trial that stops when its own interval is short enough covers 91.45% — an average of 78.2% among the 22.3% of runs that stop within eight blocks and 96% to 99% among those that run longer. Widening every interval by 17.1% brings the average to 95% and leaves the early stops at 85.6%, while 92.8% of runs now report an interval wider than the width they promised. Even doubling every interval leaves the early stops short.
A width rule on skewed outcomes
The blinded fixed-width rule rests on a within-arm spread being independent of the arm means, which only normal samples guarantee. On outcomes with a skewness of 4.75 the independence fails and the overall coverage barely notices — 93.60% to 94.70% across every shape counted, against 94.05% on normal outcomes. What skew moves is the runs that stop by twelve blocks, which cover about 90% with the skew in one arm, and the trial's length: a variance ratio corrected on normal theory lengthens it from 18.1 blocks to 26.0 with the skew in the first arm and shortens it to 14.2 with the skew in the second.
A weighting that does not read its own spreads
On skewed outcomes a block's spreads move with its means, so a weighting fitted to every block's spreads leans: +0.0255 at a skewness of 4.75. The obvious repair — fit each block's weight with that block left out — does not remove the lean. It reverses it and nearly doubles it, to −0.0455, because a weighted mean divides by the sum of the weights and every other block's weight still reads the one left out. Splitting the trial into two halves and weighting each by the other's fit does remove it: −0.0055, indistinguishable from the weighting told the true ratios, for a spread about a tenth wider.
Fitted together, or fitted after
Every whitening in this collection is a two-step rule: fit a candidate, read the dependence off what is left over, whiten, fit again. The step nobody examined is the first one. A fit removes memory as well as signal, and how much is arithmetic rather than noise — the residuals of a hundred and twenty rows report a lag-one coefficient of 0.73 where the errors report 0.78 and the law says 0.80. Estimating the coefficient with the line instead of after it recovers most of that, and iterating the two-step rule to its fixed point recovers nearly as much — because a fixed point of the sum of squares is not a maximum of the likelihood, and the difference between them is real, one-sided, and worth nothing at all in the decision the number feeds. The order the same criterion picks moves by nearly two, which is worth a great deal more.
A dependence fitted with the line
Every whitening in this collection reads the dependence off a set of residuals, and residuals are not errors. Fitting the two together recovers most of what that costs, and changes almost nothing about the decision it feeds.
The fit that takes the memory out
A candidate's residuals report less dependence than its errors do, and how much less is arithmetic rather than noise. The rule used for a good reason reads the series that has lost the most.
Iterating is not maximising
Re-reading a correlation from the generalised residuals and refitting converges in seven steps. What it converges to solves the first-order condition of a sum of squares, and the likelihood has one term more than that.
A window for every candidate
The window and the order a whitening needs are chosen once, from the fullest candidate, on an argument that was made about an estimated covariance. A tuning parameter is not a covariance, and the two cost different amounts.
A fixed point with no likelihood under it
A tapered band of autocovariances has no likelihood to maximise, so the one rule that can fit its dependence together with the regression is to iterate: read the band off the residuals, refit, read it again. It converges on every draw, in seven to eleven fits at the median, gives back about half the memory the first fit took out of the residuals under a short-memory law, and lowers prediction error by two to four thousandths — five to eight paired standard errors. Under the law a first-order likelihood describes, its maximum still wins; under the two it does not, the band's fixed point beats it.
Paying for a search
A two-regime whitening chooses its change point by searching a profile, and then reads a criterion that counts parameters. Nothing charges for the search. Nothing can, in the usual way: under no break the two regimes share a coefficient and the break point is not identified at all, so the likelihood ratio is a supremum over a parameter that exists only under the alternative and no count of restrictions describes its distribution. Searching a hundred and twenty rows for a change point that is not there manufactures about five units of ratio where one parameter costs two — and a rule that counts the break as free splits a stationary sample on 99% of draws. A second break costs as much again, on a sample that has only ever had one.
A break that was looked for
A two-regime whitening finds its change point by maximising a profile, and then reads a criterion that counts parameters. Under no break there is no parameter to count, because every position describes the same model.
What a search costs in parameters
An information criterion's penalty is an estimate of the optimism a fit carries. For a break point the optimism can be measured and cannot be counted, and it comes to about two and a half parameters.
Choosing whether to break
Charging what the search manufactures takes a rule from splitting a stationary sample on 99% of draws to 16%. It also costs regret, because the two mistakes a rule can make are not the same size.
A second break on a flat profile
Searching a hundred and twenty rows for one change point manufactures five units of likelihood. Searching for a second manufactures four more, on a series that has at most one — and on a profile whose whole range is under seven.
The break a shared scale hid
The break searches in this field all maximised a likelihood with one innovation variance for the whole series, and on a break from 0.95 to 0.65 they found it badly: an average of 74.8 where the truth is 60, within twelve rows on 47% of draws, from a profile everyone called flat. Give each regime its own innovation variance — one more parameter, and the one the law actually has — and the same search lands at 61.8 with a spread of 5.8, within twelve rows on 94% of draws, reporting four times the likelihood. The break was never barely there; the likelihood was blind to the half of its evidence that is in the scale. Under no break the extra parameter costs about one and a half units of manufactured likelihood.
What a chain cannot report
A thin admissible set falls into an arrangement and its mirror image, and the walk that samples it is uniform on half the reference distribution for ever while every diagnostic passes. That was found by enumerating fourteen units, and enumeration stops at about twenty-four. The test that does not enumerate is two chains — one from an assignment, one from its complement — compared on a statistic that changes sign under the complement, with a third chain from the same starting point to say whether a large reading is a fact about the set or about the length of the run. It agrees with the enumeration at every tolerance where the answer is known. At two hundred units it reports something else: the walk reaches the whole set at the tolerances a trial would use, and past a point the diagnostic stops agreeing with itself.
A test rather than a survey
A thin admissible set falls into an arrangement and its mirror image, and the walk that samples it is uniform on half the reference distribution for ever. That was found by enumerating fourteen units, and enumeration stops at twenty-four.
The statistic that changes sign
A test for an unreachable half needs a quantity that tells one half from the other. Every symmetric reading of a mirror pair is identical, and a magnitude is the natural thing to reach for.
A defect that is about size
The admitted share of a rerandomisation barely moves with the number of units. The number of admissible neighbours grows like the square of it, and that is what decides whether the walk can go everywhere.
The diagnostic at two hundred
Pointed at a trial size no enumeration reaches, the test gives three answers rather than one — and past a certain thinness it stops agreeing with itself, which is the honest reading and the one nothing could give before.
A unit that has not moved
At two hundred units the two-chain diagnostic could not settle its own verdict, because its standard error needed a relaxation time the run was too short to estimate. Reading which units moved needs no standard error. Run for 1.6 million steps on five designs, it finds a unit in place in both chains on three designs at the tightest tolerance and one at the next — and every one of them is a unit no swap can move from any admissible assignment, by arithmetic. The admissible set does split at two hundred units, and the split is one extreme unit.
A guarantee that needed a symmetry
What a balancing rule can remove of an interaction is decided by parity, and parity is a statement about a symmetry of the law rather than about the covariate. Keep the dependence and change the marginals — a Gaussian copula under a monotone transformation — and the two things every trial balances come apart. A median split is a function of the sign of the latent normal whatever the marginal is, so its exact zero survives every transformation to the last digit. A mean is odd only when the marginal is symmetric, and its zero is gone at a skewness of one. The separating case is a marginal that is heavy-tailed and symmetric, where every zero holds exactly: it is not normality the guarantees needed. And a threshold at a value on the covariate's own scale never had one at all.
A zero that rests on a symmetry
A balancing rule removes exactly none of an interaction between two odd functions, at every correlation. The argument needs the joint sign flip to preserve the law, and no real covariate is symmetric about anything.
A split survives what a mean does not
The two things every trial balances come apart on a skewed covariate. A median split is a function of the sign of the latent normal whatever the marginal is; a mean is not, and its exact zero is gone at a skewness of one.