Two searches find some of the same luck

What each search reports on a sample with no break in it, and what the two report together, on four dependences. The dashed line is the sum of the two — what a rule charging each search separately would levy — and the two together always come in below it: 19.30, 15.44, 14.24, 26.64 short, on 100%, 99%, 99%, 100% of draws. The shortfall is not a rounding. Under AR(1) at 0.8 it is 19.30 of the 34.70 the break search manufactures on its own, which is more than half of it. Two searches over one sample are looking at the same noise, and the second one has less left to find.

What each of three thresholds does to the same decision, under AR(1) at 0.8, against the size of a genuine break in the mean at row 60. A chi-square on the 5 coefficients a split adds — 11.07 — declares a break on 73.6% of samples that have none: it is not a test at all. The break search's own 95% point, 69.6, carried into a rule that also chooses its window, fires on 0.0% of null samples and on 0.0% of samples with the largest break measured — the natural way of combining two published corrections does not lose a little power, it switches the test off. The calibrated charge, 27.2, holds 5.6% at no break and reaches 29.2% at the largest.

300 draws at each of 5 break sizes, a shift from row 60 of 120 on first-order autoregressive errors. The share of draws on which the profile's two-unit set contains the true row: at the fixed, unwhitened window 12.0% at 0.3, 19.0% at 0.6, 31.7% at 1, 51.7% at 1.5, 69.3% at 2; with the window searched 22.7% at 0.3, 30.0% at 0.6, 44.3% at 1, 63.3% at 1.5, 75.3% at 2. A 95% interval would sit at the top of the frame.

For a shift added to the response from row 60 of 120 on first-order errors at 0.8, 300 samples at each of five sizes and 120 simulations per sample, the coverage of sets for the break row built at a threshold each method supplies. simulated at the truth: 95.0%, 93.7%, 93.7%, 95.0%, 94.0%; estimated break, true persistence: 90.0%, 88.3%, 88.3%, 89.3%, 90.3%; estimated break, persistence matched: 81.0%, 83.3%, 81.3%, 81.3%, 82.3%; estimated break and persistence: 64.0%, 66.0%, 67.7%, 70.7%, 75.7%; a fixed threshold of 21 units: 96.0%, 94.0%, 96.0%, 97.3%, 98.3%; the two-unit set: 12.3%, 19.7%, 35.0%, 49.0%, 66.7%, at shifts of 0.3, 0.6, 1, 1.5, 2. Simulated at the truth the construction is exact; simulated at what one sample can estimate it misses the true row a quarter to a third of the time.