Paper VI visual guide · Visual 36 of 42 · BAYESIAN FLOW / EVIDENCE CUMULANTS

The score rises because it has variance

Traditional Part II: Theorems E10.1 and E10.2. Exponential tilting of a fixed finite prior.

Start reading

Resources & source

Original plate in the visual guide PDF · Original atlas source

Skip contents and start reading

Start with equal prior masses on scores \(u=(0,1,2)\) and likelihood \(e^{tu}\). Put \(q=e^t\). The evidence and tilted distribution are

\[ Z(t)=\frac{1+q+q^2}{3},\qquad p(t)=\frac{(1,q,q^2)}{1+q+q^2}. \]

At \(t=\log2\), they are \(Z=7/3\) and \(p=(1,2,4)/7\).

A tilted three-score distribution is shown as a bar chart.
Original drawing. Read the description below; expand the labels and data for selectable text.

Reading the drawing

The horizontal addresses are the three score values, and each bar is labelled by its posterior probability. The annotation below gives the time, mean, and variance used by the worked example.

Drawing labels and data 8 labels

Read the original labels as selectable text. Tables preserve grid relationships; other short labels are grouped compactly.

  • score
  • \(0\)
  • \(1\)
  • \(2\)
  • \(1/7\)
  • \(2/7\)
  • \(4/7\)
  • At \(t=\log2\): mean \(10/7\), variance \(26/49\)

Open the full-size drawing

Evidence note from the source edition

The score values stay fixed. Their probabilities change. The rising mean score is a property of this tilted family, not an increase in the individual scores.

Two derivatives have different statistical meanings

The first derivative of log evidence is the current mean score, and the second is its variance:

\[ \frac{d}{dt}\log Z(t)={\mathbb E}_{p(t)}u, \qquad \frac{d^2}{dt^2}\log Z(t)={\operatorname{Var}}_{p(t)}(u)\ge0. \]

At \(q=2\) the exact values are

\[ {\mathbb E} u=\frac{10}{7},\qquad {\mathbb E} u^2=\frac{18}{7},\qquad {\operatorname{Var}}(u)=\frac{26}{49}. \]

Thus the derivative of the mean is \(26/49\) at this time. The flow equation \(p_i'=(u_i-{\mathbb E} u)p_i\) gives derivatives \((-10,-6,16)/49\), which sum to zero.

As \(t\to\infty\), mass concentrates on the largest score present in the initial support. A score with zero initial prior mass is never created by multiplication. If several occupied states tie for the maximum, their relative prior proportions remain unchanged within that maximal packet.

Read this as

Log evidence is a cumulant generator for the tilted law. Its curvature is variance, so the mean score is monotone even though the flow is nonlinear.

Source and conversion record

The original atlas wording, equations, and drawing labels are retained. Drawings are views of the frozen visual-guide PDF. Text descriptions and table headings are added reading aids. This conversion does not rebuild TeX, rerun the examples, audit proofs or compile Lean.

Conversion checks and source hashes

Notation in Paper VI

Look up a symbol without leaving this chapter. Select text before opening help to search for it.

Search this work’s notation.

    Symbols can have different meanings in different passages. Read each result in its own context.

    Open the full notation index