Normal Distribution
nothing is called 95% until it has been counted
Field

The block size as a schedule

The blinded rule's block size is a dial between an interval's degrees of freedom, a stopping rule's, and the overshoot. Letting it change during the run keeps the coverage exact — the argument never needed the sizes to be equal — and then runs into an identity: the two kinds of degree of freedom add to N − 1 on every run, so a schedule cannot make more of both. What it can do is spend each where it is worth most, which is worth a few per cent and is not the free lunch the dial looked like.
One experiment, with the blocks getting smaller as the target comes into range. A single run at a requirement of 0.25, with the block sizes 5, 5, 11, 25, 11, 8, 3, 2 and a total of 70 observations in 8 blocks. The rule stops when the observations in hand reach z²σ̂²/d², with σ̂² pooled from the within-block contrasts — an estimate that moves as the run goes on, so the target moves too. Early blocks are large because the target is far away and cannot be overshot; late ones are small because a block is the granularity of the answer. The interval afterwards is built from the 8 block means and from nothing the rule looked at, and it has 7 degrees of freedom against the rule's 62.

A block size that changes

The blinded rule's exactness never needed the blocks to be the same size. Letting the size be chosen from the contrasts as the run goes on leaves the coverage exactly where it was — and runs straight into an identity that says what a schedule can and cannot buy.

 No block size is best at both things the procedure claims. Two claims and one dial. The honest interval's half-width falls as the blocks get smaller, because the interval's degrees of freedom are the number of blocks: 0.2602 at blocks of two against 0.2933 at blocks of sixteen. The fixed-width claim — that the mean is within 0.25 of the truth — gets more reliable as they get larger, because the sample size is less variable: 92.40% against 95.00%. Both are computed from the same runs, and the second is reproduced to within a tenth of a point by E[2Φ(d√N/σ) − 1], which needs the sample-size distribution and nothing else. The schedules sit at the bottom left: as narrow as the smallest fixed block and as few observations, with the rule's spread estimate on half as many degrees of freedom again.

Two degrees of freedom, one total

The block size is a dial, and the two things a fixed-width procedure claims move in opposite directions along it. Divide the width by the square root of the sample size and one of them turns out to depend on the number of blocks and on nothing else.

 The overshoot is the last block size and nothing else. A run stops at a multiple of its own block sizes and cannot land between them, so it ends past its own target by about half a block. Fixed sizes overshoot by 1.5, 2.2, 3.1, 4.7, 8.5 observations as the size goes 2, 3, 5, 8, 16. Every schedule here ends in blocks of two and every one of them lands where blocks of two land — 1.62, 1.32, 1.37 against 1.48 — while having spent most of the run inside blocks four and eight times larger. That is the one thing on this page a schedule genuinely takes from both ends.

What a schedule actually buys

Big blocks early and small blocks late is the right instinct and it does not take both ends of the trade, because there are not two ends to take. What it does take is the overshoot — about four per cent of the observations — and a steadier stopping point.

 What a schedule is allowed to read, and what happens when it reads more. The construction allows the block sizes to be anything at all as long as they are functions of the within-block contrasts, which are independent of every block mean. A schedule that shrinks the block whenever the between-block spread is running above what the contrasts say is a direct attempt to hold down the quantity the interval will be built from, and it succeeds: the estimate lands at 0.8373σ² against the honest 0.9831, and the coverage goes with it. Growing the block on the same spread instead pushes the other way and over-covers — which is not a repair, it is the same violation with the sign reversed, and the level is no longer a property of the procedure at all.

A schedule that reads the mean

The block sizes may be anything at all provided they are functions of the contrasts. Two natural schedules break that, in opposite directions — and the most natural mistake of the three is not a schedule at all but a stopping rule, at 86.87% coverage and fewer observations.

 How much of the forbidden spread a stopping rule may read. The rule stops when the observations in hand reach z²ŝ²/d², with ŝ² a blend: a share 1 − κ of the pooled within-block estimate it may read, and a share κ of the between-block estimate the interval is built from, which it may not. At κ = 0 it is the honest rule; at κ = 1 it stops on the reported spread. Each curve is the coverage lost against κ = 0 on the same 6,000 runs, with two paired standard errors, at three requirements. At a half-width of 0.35 the loss is 0.87% at κ = 0.2 and peaks at 3.97%. At 0.25 it is 0.20% at 0.2, 0.98% at 0.5 and 5.50% at 1. At 0.15 nothing measurable is lost until κ = 0.9, and 3.73% at 1. The cost of reading is not proportional to how much is read; it is concentrated where the rule leans on the forbidden spread, and a longer experiment can lean further before paying.

How much of the forbidden spread a rule may read

A stopping rule that reads the spread its interval will report breaks the interval. Blend that spread into what the rule reads, a share at a time, and the cost is not proportional to the share — at a tight requirement a rule can read four fifths of it before anything is lost, and the last fifth costs nearly four points.

 Coverage lost against the honest rule. Coverage lost in points against the rule that reads only within-block spreads, on the same observations, blocks of 2, 6000 runs, at half-widths 0.5, 0.35, 0.25, 0.15. the reported spread in full: 0.32 ± 0.27, 2.53 ± 0.37, 5.33 ± 0.41, 3.75 ± 0.35. a fixed half: 0.72 ± 0.26, 2.43 ± 0.29, 0.98 ± 0.26, -0.25 ± 0.20. κ = (b − 1)/(N − 1): 0.37 ± 0.21, 1.18 ± 0.25, 0.58 ± 0.23, -0.18 ± 0.19. the same, phased in as b/(b + 20): 0.22 ± 0.10, 0.35 ± 0.16, 0.23 ± 0.18, -0.10 ± 0.19. the same, read in only after twenty blocks: 0.00 ± 0.00, -0.02 ± 0.04, 0.17 ± 0.19, -0.17 ± 0.19.

A rule that sets its own κ

A stopping rule may read the spread inside its blocks and may not read the spread between them, and the dial between the two costs nothing for a long stretch and then a lot. The share an efficiency argument recommends is each estimate's share of the degrees of freedom, and on blocks of two at a half-width of 0.15 that loses nothing and steadies the experiment by 30%. At 0.35 it loses 1.18 points. Deferring the forbidden reading until twenty blocks costs nothing measurable at any requirement, and it keeps most of the steadiness where steadiness can be had.

All essays