Field

The weights the corner needs

A fixed-width interval about a difference is exact when the arms share a variance or the allocation ratio is constant, and exact under neither when both fail. It is exact there too, with h_b(λ) = (1/m_A + λ/m_B)⁻¹ — the inverse variances, written as a function of the variance ratio alone, which is a contrast and so is readable by a blinded rule. The estimated precision weights that had no theorem behind them turn out to be that rule at an estimated ratio. And an interval's own scale estimate is right in exactly two cases: inverse-variance weights, and equal ones.

Exact in the corner, where nothing was. Coverage of a nominal 95% interval on five designs, at a required half-width of 0.3. The first four are the two-arm field's own and the fifth is its corner — two variances, block sizes that swing by eight, and an allocation that alternates between five to one and one to five — where neither of that field's two conditions holds. The effective-size weights over-cover there at 98.40%; the weights h_b(λ) = (1/m_A + λ/m_B)⁻¹ cover at 94.84%, and at 94.84% when λ is estimated from the within-arm contrasts rather than known. Nothing here is supposed to move.

Weights that need only a ratio

A fixed-width interval about a difference is exact under either of two conditions and under neither in the corner. It is exact there too, and the only thing it needs is how much larger one arm's variance is than the other's.

How wrong the ratio is allowed to be. λ enters only through the weights, so misstating it leaves the estimate unbiased and moves two things — the interval's calibration and its efficiency — both of which are closed forms of the design. Coverage stays at its level over a factor of two in either direction (94.93% at half the truth, 94.27% at twice it) and starts to go at a factor of five. An estimate on hundreds of within-arm degrees of freedom is never wrong by anything like that, which is what makes the feasible rule usable rather than merely definable.

Blinded, and still exact

The one number the exact interval needs is a ratio of within-arm spreads, which is a contrast and contains no mean — so a rule forbidden to look at the effect may compute it, on more degrees of freedom than the interval itself has.

The weights may not read the block they weight. A weighted least squares decomposition needs weights that are constants, or at least independent of the differences they multiply. One λ̂ pooled across the trial is estimated on hundreds of degrees of freedom and is effectively a constant; a λ̂ estimated inside each block is estimated on that block's own two or three, and is correlated with the difference it weights. Coverage falls from 94.68% to 82.76% — and the interval gets wider while doing it, 0.5163 against 0.3024, which is the signature of weights that are noise.

The condition that cannot be dropped

The weights may not read the block they weight. Estimate the variance ratio inside each block rather than across the trial and the coverage falls to 83% — on an interval that is at the same time seventy per cent wider.

One pooled ratio, two periods. The calibration factor of weights built from one variance ratio pooled across the trial — the factor by which the interval's own scale estimate overstates the estimate's variance — when arm B's ratio is F times higher in one kind of period than the other, closed form on the corner's block compositions. With the small A-heavy blocks the noisier, the factor rises: 1.00 at F = 1, 1.50 at F = 1.5, 2.07 at F = 2, 3.12 at F = 3, 3.91 at F = 4, 4.86 at F = 6, 5.44 at F = 8. With the large B-heavy blocks the noisier, it falls: 1.00 at F = 1, 0.74 at F = 1.5, 0.65 at F = 2, 0.58 at F = 3, 0.55 at F = 4, 0.53 at F = 6, 0.53 at F = 8. A ratio estimated per period gives weights that are the inverse variances again, and its factor is exactly 1 at every F.

A ratio that changes with the period

The corner's exact interval needs one variance ratio, and the corner's own alternating allocation makes two kinds of period that need not share one. When they differ the pooled ratio is precise and wrong: at a fourfold difference the interval covers 100.0% one way round and 85.1% the other. A ratio estimated per period is exact again, blind to the effect, and costs under a tenth of the width — and a ratio that merely wanders at random costs width and no coverage at all.

What each stopping rule spends. The average number of observations the corner design takes before it stops, with the stopping rule reading pooled within-arm spreads (the upper bar) and each kind of period's own spreads (the lower), at a promised half-width of 0.3, 3,000 trials each. one ratio: 1,656 and 1,649; 2-fold, small blocks noisier: 1,020 and 1,015; 2-fold, large blocks noisier: 2,976 and 2,614; 4-fold, small blocks noisier: 751 and 669; 4-fold, large blocks noisier: 5,642 and 3,368; 8-fold, small blocks noisier: 711 and 490; 8-fold, large blocks noisier: 10,989 and 3,019. With one ratio the two rules are the same rule. With the large blocks noisier the pooled rule over-spends by a factor that grows with the difference, to 3.6 times at eightfold; with the small blocks noisier it over-spends less.

A stopping rule that reads the periods

A fixed-width trial in the corner stops when its estimated precision reaches the promise, and it estimated that precision from spreads pooled across a trial whose two kinds of period need not share a variance ratio. Read each kind of period's own spreads instead and the trial stops on 3,019 observations where it took 10,989, at an eightfold difference, with the interval it reports still covering 95.1%. The stopping time reads nothing but within-arm spreads, per period now as well as pooled, and that is all the exactness needed.

All essays