Paper VI visual guide · Visual 13 of 42 · HIDDEN MARKOV FILTERING / TIME ORDER

Prediction and observation do not commute

Traditional Part I: Proposition 9.3. Linear prediction followed by a positive-evidence update.

Start reading

Resources & source

Original plate in the visual guide PDF · Original atlas source

Skip contents and start reading

Use the two-state kernel \(K_2\) from Visual 2, the initial distribution \(e_0\), and likelihood \((1,1/2)\). Predicting first gives \((3/4,1/4)\). Its likelihood-weighted vector is \((3/4,1/8)\), with evidence \(7/8\), so the posterior is \((6/7,1/7)\).

Updating first leaves \(e_0\) unchanged. Predicting afterward gives \((3/4,1/4)\) instead. The order of operations expresses which time the observation concerns.

Two bar pairs compare prediction followed by update with the reverse order.
Original drawing. Read the description below; expand the labels and data for selectable text.

Reading the drawing

Both panels start from the same prior, transition, and likelihood, as stated above them. The displayed probability vectors differ. The left panel uses prediction first; the right panel applies the observation first.

Drawing labels and data 11 labels

Read the original labels as selectable text. Tables preserve grid relationships; other short labels are grouped compactly.

  • Predict, then update
  • 0

\(\frac{6}{7}\)

  • 1

\(\frac{1}{7}\)

  • Update, then predict
  • 0

\(\frac{3}{4}\)

  • 1

\(\frac{1}{4}\)

Same prior \(e_0\), transition \(K_2\), and likelihood \((1,1/2)\)

Open the full-size drawing

Evidence note from the source edition

Both routes produce valid probability vectors. Their difference is therefore not a normalization bug. It is a different conditioning problem.

Keep an unnormalized path alongside the filter

For a sequence of observations, let \(D_r={\operatorname{diag}}(\lambda^{(r)})\). The forward recursion is

\[ \widehat p_r=Kp_{r-1},\qquad p_r=D_r\widehat p_r/Z_r. \]

Its unnormalized companion is

\[ v_r=D_rK\cdots D_1Kp_0, \qquad p_r=\frac{v_r}{{\mathbf{1}}^{\mathsf T}v_r}, \qquad {\mathbf{1}}^{\mathsf T}v_r=\prod_{j=1}^r Z_j. \]

The product of evidences records the normalization lost at each individual step. The four-state computation on Visual 26 checks both paths independently, including their coarse versions.

Here \(D_rK\) means an observation after prediction. In the Feynman–Kac example on Visual 20, departure-state weighting has forward operator \(K D_w\). Both conventions are legitimate once their meanings are fixed, but they cannot be substituted for one another.

Read this as

Write the chronological sequence before multiplying matrices. A product can be normalized correctly and still answer the wrong time-ordered question.

Source and conversion record

The original atlas wording, equations, and drawing labels are retained. Drawings are views of the frozen visual-guide PDF. Text descriptions and table headings are added reading aids. This conversion does not rebuild TeX, rerun the examples, audit proofs or compile Lean.

Conversion checks and source hashes

Notation in Paper VI

Look up a symbol without leaving this chapter. Select text before opening help to search for it.

Search this work’s notation.

    Symbols can have different meanings in different passages. Read each result in its own context.

    Open the full notation index