a-band-with-no-parameter-to-fit

Where the general fit becomes the parametric one

The band family's objective at the autoregression's own geometric sequence, cut off at each width, on one sample of 60 rows. The horizontal line is the profile likelihood the parametric fit maximises, written independently through a different whitening. At the full width the two are the same number to 3e-14, which is what says the general construction contains the parametric one rather than resembling it. Below 10 lags there is no line at all: the geometric sequence cut off short is not a covariance matrix, so the objective has nothing to evaluate. Between the two the truncation is briefly *above* the parametric likelihood — a wrong covariance can fit one sample better than the right one, which is the whole reason a width has to be charged for rather than chosen.

A covariance with no parameterwide5 views

What else it draws

The same object, drawn to answer the other questions the essays put to it.

The rise in log-likelihood from the tapered plug-in to the maximum over the same eight-lag band, beside what the same optimiser produces on a sample generated from the plug-in's own covariance — where the family is correctly specified by construction and there is nothing to find. Under AR(1) at 0.8 the raw rise is 5.72 and the manufactured baseline is 4.79, leaving 0.93 at 1.8 standard errors; under long memory the excess is 0.14, at 0.2. Under the moving average it is 11.87 at 19.4 standard errors, on every draw. The taper is a shrinkage, and it costs nothing where the sequence decays smoothly and a great deal where it stops dead.

The error of the fitted line against the width of the band, under AR(1) at 0.8, with the widths four rules choose marked on it. The criterion charging a unit a lag picks 6.2; a heavier charge picks 3.8; the rule of thumb every applied long-run variance uses picks 4; the width that actually minimises the error is 13.3, and it is available to nobody — chosen per draw it has a standard deviation of 10.2, which is most of the range on offer. What the three rules deliver differs by less than a hundredth of the error they are all paying: 1.1104, 1.1141 and 1.1133 against the best available 1.1031. The curve is nearly flat between eight and twenty lags, which is why three rules can disagree by a factor of three and cost almost nothing.

How often each rule's reported 95% interval covers the true coefficient under a five-period moving average, over 1000 draws of 120 rows, for the most persistent predictor (its own lag-one correlation 0.9) and the white one. The law's own covariance covers 94.9% and 94.1%. Least squares covers 65.0% on the persistent predictor and 94.4% on the white one; a fitted ρ̂ 93.0% and 96.3%; the two-step band 86.5% and 97.3%. The joint fit covers 73.2% and 71.4% — short on both, and short on the white predictor where every other rule is honest — and counting its eight band coefficients gives 76.1% and 73.5%.

Under a five-period moving average, over 200 regressions of 120 rows with an eight-lag band, how often each 95% interval for the white predictor's coefficient covers it: two-step band, as reported 95.5%; joint fit, as reported 72.0%; joint fit, White's sandwich 71.0%; joint fit, four-lag sandwich 71.0%; joint fit, band maximised again 85.5%; the law's own covariance 92.0%. The bootstrap redraws each regression 24 times from its fitted coefficients and fitted band, maximising the band afresh on every redraw.

Where it is used

7 essays draw this figure, each at the numbers its own argument is about, so the same picture answers 7 different questions.

All 80 figures

FieldsThreadsSeriesConceptsAll essaysSearch