Every essay — page 16
A cut point, at a correlation
The geometry of a balancing dictionary over two dependent covariates is closed for polynomials and was taken to be asymptotic for cut points, because a threshold's Hermite coefficients never terminate. Conditioning on the second variable closes it exactly: every mixed inner product is ρ^j times a one-variable answer and the only two-dimensional object left is an orthant probability, which at the median is (2/π) arcsin ρ. The truncation that was feared falls geometrically in the correlation rather than algebraically in the order — and the interaction guarantee a correlation destroys for powers survives it exactly for median splits, because a two-valued function squares to a constant.
The zero that survives a cut
A rule holding both main effects removes half of a pure interaction between correlated powers and exactly none between correlated median splits. The guarantee that a correlation destroyed was never about interactions.
A rate needs a rate beside it
A simulated rejection rate is an average of indicators, and a companion with an exactly known expectation can remove at most φ(c)²/p(1 − p) of its variance when it is used as a straight line — 22.4% for a 5% rate, 7.2% for a 1% rate — however closely it tracks the statistic. The ceiling is the share of a normal's information a cut keeps. Used as its own rate at the same cut, the same companion removes 38.2% at a correlation of 0.9 and 77.0% at 0.99. On the t test's size for lognormal data it was worth 1.43 times the draws used linearly and 2.32 times used as a rate at a matched level.
A companion cut into many
A simulated rate can be estimated within bands of a companion whose distribution is exact, and the bands weighted back by their exact probabilities. One band boundary at the target's threshold is the companion's own rate; infinitely many are the best any function of the companion can do, which for a 5% rate at a correlation of 0.9 removes 48.1% of the variance. Eight bands placed where the target's conditional probability is changing remove 46.8%; eight at equal probabilities remove 29.9%, and need thirty-two to catch up. On the lognormal t test's size, thirty-two bands of the logarithms' t statistic were worth 2.99 times the draws and two hundred and fifty-six, 2.14.
A companion with two coordinates
The logarithms' t statistic, cut into bands, is worth at most 2.77 times the draws to a simulation of the lognormal t test's size. It is one function of two exactly known statistics, the logarithms' mean and spread, and the pair is worth 4.64 when a score fitted to it on a pilot of a thousand samples is cut into sixteen bands whose probabilities are integrated exactly. A grid of cells in the pair needs a thousand cells to reach the same and, counted on runs of four thousand samples, is worth 1.97. Band weights estimated from a pilot instead of computed are worth less than the pilot's draws would have been had they simply been counted — exactly nothing at a pilot the size of the run.
Weights from an approximate law
A companion whose law is only approximately known can still be cut into bands, with each band's weight computed from the approximation. The weight's error is a bias that does not shrink, and the run multiplies it: the stratified rate is worth p(1 − p)/(v + Nb²) times the draws. Reading Student's t on nineteen degrees of freedom as normal breaks even at 669 draws; the normal with the t's variance at about fifteen thousand; Fisher's one-term expansion at twenty-four million. What decides the bias is how the weight errors line up with the band rates, not how large they are — Fisher's is wrong by sixty per cent in one band and biases the rate by six hundredths of one.
What a block may vary
Two questions from two corners of the collection with the same answer. A walk over the admissible assignments that exchanges more than one unit per arm mixes faster and is refused more often, and the trade is exactly computable: the gain is a factor of six where a hunt is fifty times cheaper anyway, and nothing at all where the comparison is actually decided. And a variance ratio that drifts between blocks cannot be estimated inside the block it weights — but it can be modelled across them, once the bias in a log variance estimate is subtracted, because that bias depends on the degrees of freedom and the degrees of freedom alternate with the allocation.
A proposal that moves more than two units
The walk's autocorrelation is a fact about its step size and not about its acceptance rate. Exchanging three units from each arm mixes nearly twice as fast as exchanging one, and is refused a third more often.
Stationary is not convergent
A walk that exchanges every unit in each arm preserves the uniform distribution exactly and never gets near it. Every doubly stochastic matrix has the same stationary distribution; only some of them have a limit.
Where the gain is, and where the decision is
A bigger proposal is worth a factor of six at a loose tolerance and nothing at a tight one. The tolerances where it helps are the ones where a hunt costs two evaluations a draw, and the crossing barely moves.
A ratio that changes between blocks
A wrong weight costs width and a random weight costs level. The rule aimed at the quantity that actually varies is the only one that misses its own coverage, and the rule that models it across blocks recovers the whole of what knowing it is worth.
The bias that lands in the slope
The bias in a log variance estimate depends on nothing but its degrees of freedom, so it goes into the intercept — unless the degrees of freedom alternate with the design, which is exactly what a block-randomised trial makes them do.
The shape a dependence has
Estimating a covariance rather than naming it was priced on errors that really were a first-order autoregression, where generality can only cost. Here are four laws with the same first lag and nothing else in common: a moving average that stops, a memory that does not, a break in the middle. The cost of generality where it is not needed and the benefit of it where it is turn out to be the same size — and against a covariance that changes with position rather than with gap, one number, a window and an order are worth exactly the same as each other. Both tuning parameters are then chosen from the sample, and every criterion available for choosing them is aimed at something else.
A dependence with a shape
Four ways for errors to repeat, all with the same first lag and nothing else in common. A rule told the errors are a first-order autoregression finds the same number in all four, and is right about one of them.
Where the generality runs out
A covariance that changes half way through a sample is not one a window can estimate. One number, a window and an order are worth the same as each other on it — and letting the model change once, at a point nobody can locate, is worth as much again as all three.
The window a whitening wants
Every law here is best whitened by a window several times longer than its own memory, including the one whose memory ends at the fourth lag. The three ways of choosing it from the sample all land in the same place, and it is the wrong one.
The order the tail is drawn at
A fitted autoregression reproduces the sample exactly at the lags it was fitted on, so everything it says past them is extrapolation — and the order is the dial that decides how much of it there is.
The residue was the weights
A regression whose errors change persistence at a known row was whitened as two autoregressions and still gave up 0.0246 against the law's own covariance. That residue was put down to estimating the two persistences from residuals, and the repair named was to fit them with the line. Fitting them with the line moves the persistent regime's estimate from 0.81 to 0.89 and recovers a fifth of the residue — exactly what being told the true persistences recovers. The rest was the transform: it never divided the two regimes by their own innovation scales, which differ sixfold. The law's own recursion, told the persistences, is the oracle to machine precision; fitted with the line, it estimates the persistent one at 0.945 and comes within 0.0006 of the oracle.
A block, weighted inside itself
Every resampling in this collection attenuates the dependence it is trying to keep, and until now every one of those attenuations was inherited rather than chosen. The construction the long-run-variance literature actually uses weights the residuals down towards each block's own ends — and what that buys turns out to be exactly the squared value of the window at the two ends and nothing else about its shape. It is an asymptotic gain that has not arrived at any block length a hundred and twenty rows can afford, and at the lengths that are available a tapered block is very nearly a shorter plain one.
A block weighted inside itself
The triangle every block resample attenuates by is not a fact about blocks. It is the self-convolution of a rectangle, and a block weighted down towards its own ends has a different one — whose leading term is the squared value at the two ends and nothing else about the shape.
A taper and a critical value
Two constructions whose tapers visibly differ give the same critical value, and two that share a taper exactly do not. Adding a construction whose taper is a decision rather than an accident says which half of that is true.
A block at every starting row
The t interval on the block count reads its scale from the disjoint blocks, three of them when 120 rows are cut into blocks of thirty-two, and throws away the other eighty-six blocks the series contains. Reading a block at every starting row leaves the scale's attenuation where it was — the two expectations agree to within a hundredth at every cell — and nearly doubles the degrees of freedom it realises, so the interval loses a third of its width at the same coverage. Where the interval falls short, at short blocks, it falls short by the same amount however the blocks are read.
A length chosen for the interval
The squared-error rule for a block length weighs the scale's bias against its variance. Rebuilt for a block at every starting row, whose variance is two thirds as large, it asks for blocks fourteen per cent longer and buys four tenths of a point of coverage. A t interval has already paid for the scale's variance in its multiplier, so its own coverage is predicted by the bias alone — within seven tenths of a point up to blocks of twenty-eight rows — and a rule that chooses the shortest length that prediction says will cover asks for blocks two and a half to three times longer and lands within about a point of 95% at 120, 240 and 480 rows. The price is width, and it is paid where the series is short.
A share read off the sample
A block length chosen for an interval's coverage needs the share of the mean's variance the scale will find, and the published rule reads it from a first-order autoregression at the sample's lag-one value. Reading it from the sample's own autocovariances instead was supposed to survive series nobody had modelled. At 120 rows it covers 92.5% to 93.5% on all four laws — worse than the wrong shape on every one — because a centred series' autocovariances sum to exactly zero and the share they imply is too generous; read to lag forty it covers 84%. The assumed shape costs width, not coverage: 17% too wide where dependence stops at lag four, and nothing visible under a break, where the interval covers for a reason the share knows nothing about.
A sequence that knows it was centred
A block length read off a sample's own autocovariances gets worse the further out it reads, because a centred series' autocovariances sum to exactly zero. To first order every lag loses the same amount, about the long-run variance over the sample size, and that can be added back. Corrected, a reading to lag forty goes from 84.5% to 89.2%, and to lag twelve from 93.3% to 94.5%. But the correction overshoots on the long lags, and on the rule that picks its own cut-off, which is short, it moves coverage by three tenths of a point. The identity was the reason the lag mattered. It was not the reason the rule falls short.
What a dictionary buys and what it costs
A balancing rule is a list of functions, and the list decides two things that pull against each other. What it protects against is decided by parity: an interaction between two odd functions is even, an odd function is orthogonal to an even one at every correlation, and the two things every trial balances — a mean and a median split — are both odd, so their worst case is exactly zero however many of them are held. What it costs is the assignments it leaves, and past a certain thinness those stop being one set: the admissible assignments split into an arrangement and its mirror image, no sequence of admissible single swaps joins them, and the walk that samples them is uniform on half the reference distribution for ever.
A dictionary that is neither
A rule handed two median splits removes none of their interaction; a rule handed two covariates removes none of their product. Those were two results with two explanations, and they are one result with one — and finding it corrected the number underneath both.
What the extra function buys
A rule balancing the mean of each covariate has a worst case of exactly zero. Adding the median split — the other thing every trial balances — leaves it at exactly zero, and one square moves it.
The set a dictionary leaves
A rule constrained on six functions at a loose tolerance leaves a set as thin as one constrained on three at a tight one. Both sampling methods cross over at the same thinness, and the tolerance where that happens moves by a factor of three.