Paper VReading edition

Stable recovery of separated jumps

Reading tools
Reading libraryFind statementsInspect Lean
Switch work

Saved reading

Read side by side

Start reading

Resources & source

Original TeX with line links · Download TeX

The wording and mathematics follow the retained manuscript. This reading format does not add a proof review or extend Lean coverage.

Skip contents and start reading

E9 Stable recovery of separated jumps

The detector needs a visible interval of thresholds

A smooth cell and bounded sample noise give one upper contrast bound. A jump cell gives a lower contrast bound after the same uncertainty is subtracted. Recovery is possible when the lower jump bound exceeds the upper smooth bound. The gap is a condition on the observation model, rather than an automatic consequence of packet coordinates.

Rational contrast bounds give an open threshold interval between one tenth and nine tenths.
A sufficient threshold interval from exact rational contrast bounds. With the displayed model parameters, smooth and noise contrasts are at most \(1/10\) and jump contrasts are at least \(9/10\). Every threshold strictly between those values separates the cells under the sampling assumptions stated below. The figure does not assert an optimal threshold for other observation models.

View full-size figure (new tab)

The previous sections describe the error after a packet has been estimated. We now give a direct recovery theorem for one dimensional separated jumps. The detector is intentionally simple because the aim is to expose the exact contrast gap.

Let

\[ t_k=kh, \qquad k=0,\ldots,n, \qquad h=\frac1n. \]

Assume

\[ f(t) = s(t)+\sum_{q=1}^{Q}a_qH_{\tau_q}(t), \qquad H_\tau(t)={\mathbf 1}_{[\tau,1]}(t), \]

where \(s\) is Lipschitz with constant \(M\), and \(Q\geq1\) is finite with nonzero jump amplitudes. The zero-jump case requires no minimum-amplitude condition. Suppose no jump lies at a sample point and no grid cell contains more than one jump. Observe

\[ y_k=f(t_k)+\eta_k. \]

Define the adjacent contrast

\[ D_k=y_{k+1}-y_k. \]

Lemma E9.1: Contrast gap

Assume \(|\eta_k|\leq\varepsilon\) and set

\[ b_h=Mh+2\varepsilon. \]

If the cell \((t_k,t_{k+1})\) contains no jump, then

\[ |D_k|\leq b_h. \]

If it contains one jump of amplitude \(a_q\), then

\[ |D_k-a_q|\leq b_h \]

and therefore

\[ |D_k|\geq |a_q|-b_h. \]

Proof of Lemma E9.1

In a cell without a jump,

\[ D_k=s(t_{k+1})-s(t_k)+\eta_{k+1}-\eta_k. \]

The Lipschitz and noise bounds give \(|D_k|\leq Mh+2\varepsilon\). In a cell with one jump, the same formula has the additional term \(a_q\), which proves the second estimate.

Theorem E9.2: Deterministic jump cell recovery

Let

\[ a_{\min}=\min_q|a_q| \]

and assume

\[ a_{\min}>2b_h. \]

Choose a threshold \(\theta\) satisfying

\[ b_h<\theta<a_{\min}-b_h. \]

Then

\[ \widehat{\mathcal K} = \{k:|D_k|>\theta\} \]

is exactly the set of grid cells containing jumps. If \(\widehat\tau_q\) is the midpoint of the detected cell and \(\widehat a_q=D_k\), then after matching by order,

\[ |\widehat\tau_q-\tau_q| \leq \frac h2 \]

and

\[ |\widehat a_q-a_q| \leq b_h. \]

Proof of Theorem E9.2

By Lemma E9.1, every cell without a jump has contrast at most \(b_h<\theta\). Every cell with a jump has contrast at least \(a_{\min}-b_h>\theta\). Hence the detected set is exact. The midpoint of a cell is within \(h/2\) of every point in that cell. The amplitude estimate is the second inequality in Lemma E9.1.

Corollary E9.3: Jump count and sign recovery

Under the hypotheses of Theorem E9.2, the number of detected cells equals \(Q\), and

\[ {\operatorname{sgn}}(\widehat a_q)={\operatorname{sgn}}(a_q) \]

for every real valued jump.

Proof of Corollary E9.3

Exact cell recovery gives the jump count. Since

\[ |\widehat a_q-a_q|\leq b_h<|a_q|, \]

the amplitude estimate cannot cross zero.

Corollary E9.4: Packet reconstruction after detection

Let

\[ j=\sum_{q=1}^{Q}a_qH_{\tau_q}, \qquad \widehat j=\sum_{q=1}^{Q}\widehat a_qH_{\widehat\tau_q}. \]

Under the hypotheses of Theorem E9.2, for \(1\leq p<\infty\),

\[ \|j-\widehat j\|_p \leq Qb_h + \left( \frac h2\sum_{q=1}^{Q}|a_q|^p \right)^{1/p}. \]

If \(Q_m\) is bounded and linear and

\[ \widehat f_m=Q_m(f-\widehat j)+\widehat j, \]

then

\[ \begin{aligned} \|f-\widehat f_m\|_p \leq{}& \|s-Q_ms\|_p\\ &+(1+\|Q_m\|) \left[ Qb_h+ \left( \frac h2\sum_q|a_q|^p \right)^{1/p} \right]. \end{aligned} \]

Proof of Corollary E9.4

Write

\[ j-\widehat j = \sum_q(a_q-\widehat a_q)H_{\widehat\tau_q} + \sum_q a_q(H_{\tau_q}-H_{\widehat\tau_q}). \]

The first sum has norm at most \(\sum_q|a_q-\widehat a_q|\leq Qb_h\). The location error interval for the \(q\)th jump is contained in its detected grid cell and has length at most \(h/2\). Distinct detected cells are disjoint, so the location errors have disjoint supports. Their \(p\)th powers therefore add exactly, which gives the displayed location term. The reconstruction estimate follows from Theorem E7.8.

Remark E9.5: Why finite \(L^p\) matters

A shifted step does not converge in the supremum norm until the location is exact. The finite \(L^p\) error does converge because the disagreement is confined to an interval whose length tends to zero.

Corollary E9.6: Deterministic consistency

Assume \(h\to0\) along grids satisfying the preceding sampling assumptions, \(\varepsilon_h\to0\), the number of jumps is fixed, and the nonzero jump amplitudes and positive minimum separation remain fixed. Then the detected packet converges to the true packet in every finite \(L^p\) norm. If \(Q_m\) has a vanishing smooth approximation error and uniformly bounded norm, the complete reconstruction also converges in \(L^p\).

Proof of Corollary E9.6

The gap condition holds for sufficiently small \(h\). Then \(b_h\to0\), and the bound in Corollary E9.4 tends to zero.

Separated jumps produce isolated adjacent-sample contrasts above the smooth and noise background.
Separated jumps create isolated adjacent sample contrasts above the smooth and noise background.

View full-size figure (new tab)

Example E9.7: A numerical threshold certificate

Take \(h=1/256\), \(M=0.5\), and \(\varepsilon=0.002\). Then

\[ b_h =\frac{0.5}{256}+0.004 <0.00596. \]

If every jump has magnitude at least \(0.08\), then \(0.08>2b_h\). Any threshold between \(0.00596\) and \(0.07404\) recovers the exact jump cells. The location error is at most

\[ \frac1{512} \]

and every amplitude error is less than \(0.00596\).

E9.1 Sub Gaussian noise

Assume the noise variables are independent, centered, and \(\sigma\) sub Gaussian:

\[ \mathbb E{\mathrm e}^{\lambda\eta_k} \leq {\mathrm e}^{\sigma^2\lambda^2/2}. \]

Theorem E9.8: Probability recovery bound

Fix \(0<\delta<1\) and define

\[ t_{n,\delta} = 2\sigma \sqrt{\log\left(\frac{2n}{\delta}\right)} \]

and

\[ b_{h,\delta}=Mh+t_{n,\delta}. \]

With probability at least \(1-\delta\), every contrast satisfies the conclusions of Lemma E9.1 with \(b_h\) replaced by \(b_{h,\delta}\).

If

\[ a_{\min}>2b_{h,\delta}, \]

then thresholding between \(b_{h,\delta}\) and \(a_{\min}-b_{h,\delta}\) recovers every jump cell with probability at least \(1-\delta\). The same location and amplitude bounds hold with \(b_{h,\delta}\).

Proof of Theorem E9.8

If \(\sigma=0\), every centered zero-sub-Gaussian noise variable vanishes almost surely, and the noise-free deterministic conclusion applies. For \(\sigma>0\), the difference \(\eta_{k+1}-\eta_k\) is sub Gaussian with variance proxy \(2\sigma^2\), so

\[ \mathbb P\bigl(|\eta_{k+1}-\eta_k|>t\bigr) \leq 2\exp\left(-\frac{t^2}{4\sigma^2}\right). \]

A union bound over the \(n\) cells gives

\[ \mathbb P\left( \max_k|\eta_{k+1}-\eta_k|>t_{n,\delta} \right) \leq \delta. \]

On the complementary event, repeat the deterministic proof.

Corollary E9.9: Repeated measurements

Suppose \(R\) observations are averaged at every sample location, with all noise variables independent across sites and repetitions and each centered and \(\sigma\) sub Gaussian. Then Theorem E9.8 holds with \(\sigma\) replaced by \(\sigma/\sqrt R\). In particular, a sufficient recovery condition is

\[ a_{\min} > 2Mh+ \frac{4\sigma}{\sqrt R} \sqrt{\log\left(\frac{2n}{\delta}\right)}. \]

Proof of Corollary E9.9

The average of \(R\) independent \(\sigma\) sub Gaussian variables is \(\sigma/\sqrt R\) sub Gaussian. Substitute this parameter in Theorem E9.8.

Remark E9.10

The displayed uniform noise certificate scales as \(\sigma\sqrt{\log n}\). At fixed positive \(\sigma\), it does not imply consistency of this detector. Decreasing the noise scale or averaging repeated measurements gives sufficient regimes; other averaging schemes require their own analysis.

Corollary E9.11: Probability consistency

Let \(\sigma_n\sqrt{\log n}\to0\) and \(h=1/n\). For every fixed \(0<\delta<1\), along grids satisfying the preceding sampling assumptions, all jump cells are recovered with probability at least \(1-\delta\) for sufficiently large \(n\). For the fixed finite jump model above, along grids satisfying the preceding sampling assumptions, the packet error converges to zero in probability in every finite \(L^p\) norm.

Proof of Corollary E9.11

For each fixed \(\delta>0\), \(b_{h,\delta}\to0\). Apply Theorem E9.8 and Corollary E9.4. For any error tolerance \(\epsilon>0\), the high-probability bound is eventually smaller than \(\epsilon\), so the limit superior of the probability that the packet error exceeds \(\epsilon\) is at most \(\delta\). Since \(\delta\) is arbitrary, convergence is in probability.

E9.2 Signals with values in a normed space

The recovery proof does not depend on an ordering of the signal values.

Proposition E9.12: Vector jump recovery

Let the values lie in a normed space \(V\). Assume

\[ \|s(t)-s(u)\|_V\leq M|t-u|, \qquad \|\eta_k\|_V\leq\varepsilon, \]

and let the jump vectors satisfy \(\|a_q\|_V\geq a_{\min}\). Thresholding \(\|D_k\|_V\) gives the same recovery theorem under the condition

\[ a_{\min}>2(Mh+2\varepsilon). \]

Proof of Proposition E9.12

Only the triangle inequality was used in Lemma E9.1 and Theorem E9.2.

Source and conversion record

Source SHA-256: 5d3c6b2e5709c37ea551eb8fd1d823e5249c5fbc411d36b806241af4df888f36

Unsupported prose commands stop the build. The mathematical expression sequence is checked against the source, with manuscript macros expanded for display.

Conversion records

Notation in Paper V

Look up a symbol without leaving this chapter. Select text before opening help to search for it.

Search this work’s notation.

    Symbols can have different meanings in different passages. Read each result in its own context.

    Open the full notation index