Manuscript text (TeX)
Grounded Abstraction
Grounded_Abstraction_v1.0.0.tex
This is the original TeX manuscript source. Use the paper’s PDF for typeset equations.
1 % Canonical first consolidated theoretical edition. Small exact illustrations are separate from proofs.
2 \documentclass[11pt,letterpaper]{article}
3 \usepackage[margin=1in,headheight=15pt]{geometry}
4 \usepackage[T1]{fontenc}\usepackage[utf8]{inputenc}
5 \usepackage{newtxtext,microtype}
6 \usepackage{amsmath,amsthm,mathtools,newtxmath}
7 \usepackage{booktabs,array,tabularx,longtable,graphicx,tocloft}
8 \usepackage{fancyhdr,titlesec,needspace,placeins,enumitem}
9 \usepackage{xcolor}
10 \definecolor{ink}{HTML}{172A44}\definecolor{muted}{HTML}{5B6778}
11 \usepackage[pdfencoding=auto,psdextra]{hyperref}\usepackage{bookmark}
12 \hypersetup{hidelinks,pdftitle={Grounded Abstraction: Identifiability, Representation Change, and the Limits of Learning},pdfauthor={Komorebi P.},pdfsubject={A theoretical account of evidence-relative abstraction, correction memory, and calibrated continuation}}
13 \pagestyle{fancy}\fancyhf{}
14 \fancyhead[L]{\small\textsc{Grounded Abstraction}}\fancyhead[R]{\small First edition, 2026}
15 \fancyfoot[C]{\thepage}\renewcommand{\headrulewidth}{.3pt}
16 \titleformat{\section}{\large\bfseries}{\thesection}{.65em}{}
17 \titleformat{\subsection}{\normalsize\bfseries}{\thesubsection}{.65em}{}
18 \titleformat{\part}[display]{\Large\bfseries}{\partname\ \thepart}{.4em}{}
19 \titlespacing*{\part}{0pt}{0pt}{1.6em}
20 \titlespacing*{\section}{0pt}{2.5ex plus .4ex}{1.2ex}
21 \titlespacing*{\subsection}{0pt}{1.8ex plus .3ex}{.8ex}
22 \setlength{\parindent}{1.2em}\setlength{\parskip}{.24em}\setlength{\emergencystretch}{2em}
23 \clubpenalty=10000\widowpenalty=10000\displaywidowpenalty=10000\raggedbottom
24 \setlength{\textfloatsep}{18pt plus 2pt minus 2pt}
25 \setlist{leftmargin=1.5em,topsep=.4em,itemsep=.25em,parsep=0pt}
26 \setcounter{tocdepth}{1}\setlength{\cftbeforesecskip}{2pt}
27 \theoremstyle{plain}
28 \newtheorem{theorem}{Theorem}[section]
29 \newtheorem{proposition}[theorem]{Proposition}
30 \newtheorem{corollary}[theorem]{Corollary}
31 \theoremstyle{definition}
32 \newtheorem{definition}[theorem]{Definition}
33 \newtheorem{counterexample}[theorem]{Counterexample}
34 \newcommand{\X}{\mathcal X}\newcommand{\Y}{\mathcal Y}\newcommand{\Z}{\mathcal Z}
35 \newcommand{\A}{\mathcal A}\newcommand{\C}{\mathcal C}\newcommand{\E}{\mathcal E}
36 \newcommand{\Hh}{\mathcal H}\newcommand{\Pp}{\mathcal P}\newcommand{\TV}{d_{\mathrm{TV}}}
37 \newcommand{\im}{\operatorname{im}}\newcommand{\supp}{\operatorname{supp}}
38 \newcommand{\Span}{\operatorname{span}}\newcommand{\Pow}{\mathcal P}
39 \newcolumntype{P}[1]{>{\raggedright\arraybackslash}p{#1}}
40 \newcolumntype{Y}{>{\raggedright\arraybackslash}X}
41 \begin{document}
42 \hypersetup{pageanchor=false}
43 \begin{titlepage}\thispagestyle{empty}
44 \vspace*{.25in}
45 \noindent{\color{muted}\small\textsc{Operation Komorebi}\hfill\textsc{Theoretical research manuscript}}\par
46 \vspace{.65in}
47 \noindent{\color{ink}\fontsize{36}{41}\selectfont\bfseries Grounded Abstraction\par}
48 \vspace{.20in}
49 \noindent{\fontsize{17}{22}\selectfont Identifiability, Representation Change,\\and the Limits of Learning\par}
50 \vspace{.28in}\noindent{\color{ink}\rule{\textwidth}{.85pt}}\par
51 \vspace{.16in}
52 \noindent\textbf{Komorebi P.}\hfill\textit{First consolidated edition}\\
53 \noindent 9 October 2026\hfill Version 1.0.0\par
54 \vspace{.46in}
55 \noindent{\large\bfseries Abstract}\par\smallskip
56 \noindent A useful abstraction need not identify the system that realizes it. It must be justified by the evidence available to initialize, update, and correct it. This first edition connects finite evidence contracts, minimal corrective memory, and partially known linear dynamics. An exact signature preserves future candidate elimination. Its probabilistic counterpart retains joint target and likelihood-profile masses, while an explicit migration criterion identifies when a revised evidence language needs information the old memory cannot recover. For linear continuation, paired-state tests decide output agreement across fixed candidate systems. An invariant discrepancy span characterizes a shared observable quotient, and an initialization theorem gives the smallest common linear predictor accessible from the retained record. The quantitative extension replaces exact probability coordinates by a finite integer record, with separate likelihood, rounding, and horizon terms. A block comparison controls hidden-to-visible return and distinguishes exact invisibility from a small but unstable leakage channel. These bounds compose into one posterior decision certificate for the same evidence history and future response. The result is a theory of what incomplete experience can justify, supported by self-contained conditional proofs, counterexamples, and small exact illustrations. It is not a trained general learner or a certificate that its supplied model describes an external process.
57 \vfill
58 \noindent\rule{\textwidth}{.4pt}\par\smallskip
59 \noindent{\color{muted}\small\textbf{Scope.} Finite models and finite-dimensional linear systems, with explicit assumptions and self-contained proofs. Established ingredients are acknowledged. First edition freezes this finite theoretical scope. Independent peer review, a learned physical-semantic interface, and proof-assistant verification are not claimed.}
60 \end{titlepage}
61 \hypersetup{pageanchor=true}\pagenumbering{roman}
62 \begingroup\small\setlength{\parskip}{0pt}\tableofcontents\endgroup
63 \clearpage
64 \section*{Reading the first edition}\addcontentsline{toc}{section}{Reading the first edition}
65 The central object is not an internal vector considered in isolation. It is a representation together with the evidence available to initialize it, the operations it supports, the questions it answers, and the future corrections it must permit. The paper asks which of those obligations can be met simultaneously.
66
67 Part I distinguishes identification of a hidden realization from justification of a reusable predictive state. Part II studies new questions, the cost of acquiring missing distinctions, and memory that preserves later correction. Part III separates certainty from noisy evidence, quantifies uncertainty, and constructs exact probability memory for future correction. Part IV compares full-state calibration, fixed-model output agreement, common observable quotients, and evidence-initialized linear prediction. Part V adds finite probability records, controlled visible leakage, and a common posterior decision certificate. Part VI consolidates revision requirements and the research boundary.
68
69 \paragraph{Relation to the existing collection.}
70 \emph{Machine Understanding} develops supplied representations, explanatory artifacts, correction transport, and their common resource contracts~\cite{understanding}. \emph{Self-Improving Intelligence} studies finite repair discovery and changes to discovery procedures~\cite{selfimproving}. \emph{Sufficient Resolution} treats behavioral quotients, hidden memory, reconstruction, and calibration~\cite{resolution}. The present contribution is organized around a different source of uncertainty: the evidence may leave several underlying realizations possible. A representation is justified only to the extent that its intended uses survive that ambiguity. Earlier manuscripts are source relationships, not claims that every result here is already formally verified.
71
72 \paragraph{What is and is not proposed.}
73 Behavioral quotients, testing bounds, compatible-model arguments, invariant subspaces, and set-intersection updates have established mathematical foundations. Their appearance here is not a claim of priority. The proposed synthesis makes evidence access, corrective memory, and the identifiable continuation domain parts of the same representation contract. The exact correction-memory, likelihood-profile, calibrated-domain, and observable-realization constructions are derived in full within their stated models. The linear reductions use established reachability and observability ideas, while exact probability memory uses finite likelihood interpolation. The first-edition estimates use elementary Bayesian perturbation, rounding, and nonnegative matrix comparison. These arguments are not priority claims for their ingredients. Their integration requires one actual record and one consistent prediction contract.
74
75 \begin{center}\small
76 \begin{tabularx}{\textwidth}{@{}lX@{}}\toprule
77 Symbol & Meaning\\\midrule
78 $\omega\in\Omega$ & A candidate world, including any fixed model or historical tag.\\
79 $K^\pi(h\mid\omega)$ & Probability of observable record $h$ under one permitted protocol.\\
80 $r:X\to Z$ & Retained evidence or an available initial code. Its access is explicit.\\
81 $F_a$, $q$ & A state transition and the task observation it must preserve.\\
82 $x\sim_{\C}y$ & Equality of every task observation after every permitted finite word.\\
83 $V\subseteq\Omega$ & A set of candidate worlds, including the possible empty set.\\
84 $E\in\E$ & An admitted evidence event used to filter $V$.\\
85 $\Sigma(V)$ & The complete signature of future task-valued corrections.\\
86 $U$, $S_a$ & A calibrated input subspace and a known operator restriction.\\
87 $U_\infty$ & The maximal domain on which calibrated continuation is determined.\\
88 $I_Q$ & Initial vectors with common output continuations across fixed models.\\
89 $E_\infty$ & Propagated span of all model-discrepancy directions.\\
90 $p_{i,y}$ & Joint probability of a likelihood profile and a target value.\\\bottomrule
91 \end{tabularx}\end{center}
92 \clearpage
93 \section*{First-edition claim and dependency guide}
94 \addcontentsline{toc}{section}{First-edition claim and dependency guide}
95 The first edition separates exact identification, quantitative approximation, and application to an external process. An argument may be complete within its stated model while the evidence that a physical or learned system satisfies that model remains unavailable.
96
97 \begin{center}\small
98 \begin{tabularx}{\textwidth}{@{}P{.18\textwidth}YY@{}}\toprule
99 Layer & Closed theoretical question & Premises that do not appear for free\\\midrule
100 Evidence & Does the record distinguish the future behavior required by the task? & Correct candidate worlds, admissible protocols, and actual record access.\\
101 Correction & Which joint distinctions must remain available for future filtering? & The evidence language, target, and a justified initial candidate set or prior.\\
102 Dynamics & Which outputs agree across compatible systems, and can one predictor realize them? & Shared observation semantics, a supplied model class, and enough initial evidence.\\
103 Approximation & How far can rounded memory and a reduced predictor deviate over the declared horizon? & A positive likelihood floor, model-error bounds, common block norms, and initial-state bounds.\\
104 Decision & Do the combined errors preserve a risk threshold or the chosen action? & One common history, response, posterior, and bounded Lipschitz loss.\\\bottomrule
105 \end{tabularx}
106 \end{center}
107
108 The main exact dependency runs from the finite evidence criterion to predictive initialization, and from correction signatures to likelihood-profile memory and migration. A separate linear route runs from calibration through model agreement and observable quotienting to a minimum linear predictor. The quantitative route joins probability-memory error to an independently justified output allowance only at the final decision theorem.
109
110 \paragraph{Reading routes.} For the central argument, read Sections~\ref{sec:sensor}, \ref{sec:memory}, \ref{sec:likelihoodmemory}, \ref{sec:commonquotient}, \ref{sec:jointquant}, and \ref{sec:integration}. For proofs, follow the sections in order and retain the distinction between a fixed unknown model and explicitly permitted switching. For a review of the limits, compare the destructive-test, rare-evidence, hidden-return, and feedback counterexamples.
111
112 \paragraph{Three evidence levels.} The mathematical claims have prose proofs. The reference programs check finite declared examples using exact arithmetic. External calibration, empirical model adequacy, and neural realization are not established by either a passing program or the edition number. The source package records assumptions, predecessor preservation, actual command results, and the depth of reference review.
113
114 \paragraph{What is frozen.} The completed scope includes finite evidence models, static noisy correction, finite-dimensional linear continuation, finite retained probability fields, and a bounded-loss composition. State-changing noisy filters, general model invention, unbounded adaptive learning, and independently verified implementations remain subsequent research topics.
115
116 \clearpage\pagenumbering{arabic}
117 \part{Evidence before representation}
118 \section{What does experience justify?}\label{sec:introduction}
119 A device displays a bit. A reasoner learns to predict that display perfectly, including what happens when a permitted switch is pressed. It still may not know which physical bit the display describes. The code linking the display to the physical state could be reversed. A second, equally accurate reasoner might use the opposite internal convention. Prediction is real, yet the interpretation remains underdetermined.
120
121 That observation does not force a choice between calling every representation meaningless and treating every successful prediction as a complete understanding. It suggests a more precise question. What claims are common to all systems compatible with the evidence? Which of those claims can be realized by one representation that the observer can actually initialize and update? What additional information becomes necessary when the questions change?
122
123 \subsection{Three separations}
124 Identification of an underlying system, identification of a task-relevant property, and acquisition of a usable representation are distinct. A nuisance parameter can remain unknown while every required prediction is fixed. Conversely, knowing that some accurate representation exists in each possible world does not supply one representation that can be selected from the observer's record.
125
126 There is a second separation between a probability law and a finite observation drawn from that law. Two candidate models can have different laws while sharing every finite record in their supports. In that setting the models are identifiable at the level of their laws, but an individual finite record cannot yield error-free discrimination.
127
128 The third separation concerns time. A summary may preserve everything required for a present decision while losing the relationship needed to interpret a later measurement. More data arriving tomorrow need not repair what the memory policy erased today. This paper treats that relationship as part of the retained mathematical state.
129
130 \subsection{Position among existing theories}
131 Classical statistical identification separates parameters that induce different observational laws~\cite{rothenberg}. Predictive state representations use action-conditional predictions as a state description~\cite{psr}. Query learning makes the teacher and the information it returns explicit~\cite{angluin}. These are neighboring answers to different parts of the present problem, not interchangeable definitions of grounding.
132
133 Data informativity is especially close to our organizing principle. It asks whether one property or one controller is justified for every system consistent with the data, without necessarily identifying a unique system~\cite{informativity}. Our later linear construction uses this compatible-extension viewpoint for the exact domain of repeated prediction. It is not offered as a replacement for data-driven control theory.
134
135 Causal abstraction concerns faithful relationships between mechanisms and their higher-level descriptions~\cite{causal}. Here we ask what evidence makes such a description selectable and which continuations remain determined when parts of the underlying mechanism are unknown. We do not derive a learned encoder from the existence of a commuting equation. State-identification theory also distinguishes individually separable states from a realizable adaptive test~\cite{stateid}. That distinction will matter when measurements alter the system.
136
137 \subsection{The intended contribution}
138 The main results form a connected argument. Exact grounding is an information factorization through a behavioral quotient. New task distinctions are classified relative to an actual diagnostic interface. Future correction requires a richer memory signature than present target uncertainty. Partial operator calibration can nevertheless justify every future composition on a computable invariant domain. Approximate claims require both a local discrepancy and a bound on the dynamics that may amplify it.
139
140 The positive message is not that the observer must recover everything. It is that the observer can often recover exactly the structure its intended operations need, provided the evidence contract is stated honestly. The negative message is that an attractive coordinate system cannot manufacture missing distinctions, missing experiments, or missing bounds.
141
142 \section{A calibrated bit with an irrelevant hidden register}\label{sec:sensor}
143 Consider eight possible worlds
144 \[
145 \omega=(s,\theta,k)\in\{0,1\}^3.
146 \]
147 The physical bit is $s$. The sensor convention is $\theta$, and $k$ is a nuisance bit that none of the admitted operations or questions uses. The display is
148 \[
149 y=s\oplus\theta.
150 \]
151 The ordinary action $F$ flips $s$ and leaves the other bits fixed. Its effect on the display is exactly $y\mapsto1-y$, whatever the unknown convention. Reading the current display therefore initializes a two-state representation that predicts every finite sequence of flips.
152
153 Neither $s$ nor $\theta$ is identified separately. The two worlds $(0,0,k)$ and $(1,1,k)$ both display zero, and every flip sequence produces the same display in both. That ambiguity is harmless for the original display-prediction contract.
154
155 \subsection{A new question}
156 Now ask for the physical bit $s$ as well as the display. The old representation is insufficient. The two previously equivalent worlds require different answers. A permitted nondestructive reference measurement returning $\theta$ makes the physical bit recoverable by $s=y\oplus\theta$. The enriched representation can retain $(y,\theta)$, or equivalently $(s,\theta)$. It has four states, not eight. The nuisance bit remains unidentified because no required continuation can detect it.
157
158 A new field named ``sensor convention'' does not provide the reference measurement. Nor does repeatedly flipping the physical bit resolve the ambiguity: the complete display history remains the same in the two worlds. Acquisition depends on an additional information channel, not merely a larger memory allocation.
159
160 \subsection{A state-changing measurement}
161 A different operation $Z$ sets $s$ to zero and then reports the new display. The report is $\theta$. If the old display $y_{\mathrm{old}}$ was retained, then
162 \[
163 s_{\mathrm{old}}=y_{\mathrm{old}}\oplus y_{\mathrm{after}\ Z}.
164 \]
165 The current physical state is zero, not $s_{\mathrm{old}}$. A correct account distinguishes the recovered historical value from the new state it will act on.
166
167 If the old display was discarded, worlds with opposite old physical bits but the same $\theta$ reach the same current state and give the same future reports. The old physical bit is then irrecoverable through this unchanged interface. A known present state has replaced, rather than identified, the unknown past.
168
169 \begin{figure}[tbp]\centering
170 \includegraphics[width=.95\linewidth]{figures/sensor_grounding.pdf}
171 \caption{One finite sensor model supports different exact abstractions. The current display and flip action need two behavioral states. Adding the physical-bit question requires four, but not the irrelevant nuisance register. Calibration is an information source. Resetting is a physical change.}\label{fig:sensor}
172 \end{figure}
173
174 \section{Laws, records, and reusable predictive state}\label{sec:grounding}
175 \begin{definition}[Finite evidence contract]\label{def:evidence}
176 A finite evidence contract has a nonempty candidate set $\Omega$, a family $\Pi$ of permitted protocols, a finite record space $H_\pi$ for each protocol, and kernels $K^\pi(h\mid\omega)$. A target $t:\Omega\to Y$ states what is to be identified. Any hidden model index that is fixed during a protocol is included in $\omega$. The protocol's action choices are functions of its permitted records and independent randomization, not of the unobserved world.
177 \end{definition}
178
179 Define $\omega\sim_\Pi\omega'$ when their record laws agree for every $\pi\in\Pi$. This relation concerns the complete records, including action choices when those are observable. Equality of individual observation marginals is insufficient.
180
181 \begin{proposition}[Law identification and finite-record identification]\label{prop:law}
182 The target is a function of the complete family of protocol laws if and only if it is constant on the $\sim_\Pi$ classes. For a fixed protocol $\pi$, an error-free rule $d:H_\pi\to Y$ exists if and only if $t$ is constant on every nonempty support set
183 \[
184 B_\pi(h)=\{\omega:K^\pi(h\mid\omega)>0\}.
185 \]
186 Allowing a randomized output rule does not weaken this condition for probability-one correctness in every world.
187 \end{proposition}
188 \begin{proof}
189 For the first claim, factor $t$ through the map sending a world to its tuple of protocol laws. A factor exists precisely when worlds with the same tuple have the same target. For the second claim, a record with positive probability in two worlds must be given the same output. Distinct targets on its support therefore prevent certainty. Conversely, assign each attainable record its support's common target. Every record generated in a world receives that world's target. A randomized error-free rule must place probability one on the required target at every positive-probability record. It cannot do so for two distinct targets at the same record.
190 \end{proof}
191
192 This elementary factorization does not supply the laws to the learner or bound the sample cost of estimating them. The two clauses answer different questions. A family of distinct laws can be identifiable in the first sense while every available short record remains ambiguous in the second.
193
194 \subsection{A canonical meaning for an operational state}
195 Let $X$ be a finite nonempty set, let $\A$ be a finite operation alphabet, and let each $F_a:X\to X$ be total and deterministic. Let $q:X\to Y$ be a finite vector of required observations. Different candidate models can be included by taking a disjoint union of their state sets and preserving each model tag under every action.
196
197 For a word $w=a_1\cdots a_m$, $F_w$ applies $a_1$ first and $a_m$ last. The empty word is the identity. Define
198 \[
199 x\sim_\C x'\quad\Longleftrightarrow\quad
200 q(F_wx)=q(F_wx')\quad\text{for every finite }w.
201 \]
202 This is a comparison in a common observation language. It does not require that different models share arbitrary latent coordinates. The behavioral class is a canonical response profile even when its implementation is not identifiable.
203
204 \begin{definition}[Exact initialization from available evidence]\label{def:initialization}
205 Given an available initial code $r:X\to H$, an exact reusable predictor consists of a finite state set $Z$, an initialization $d:H\to Z$, updates $G_a:Z\to Z$, and an output map $\bar q:Z\to Y$ such that
206 \[
207 \bar q\,G_w\,d\,r(x)=q(F_wx)
208 \]
209 for all $x$ and all finite words. After initialization the predictor receives the operation names, but no additional world observations or hidden state.
210 \end{definition}
211
212 \begin{theorem}[Evidence sufficient for one exact predictive realization]\label{thm:grounding}
213 An exact reusable predictor exists if and only if
214 \[
215 r(x)=r(x')\quad\Longrightarrow\quad x\sim_\C x'.\tag{1}
216 \]
217 When it exists, the behavioral quotient $X/{\sim_\C}$ supplies a predictor with the fewest initialized states. Every predictor initialized for all $x\in X$ requires at least $|X/{\sim_\C}|$ distinct values in $d(r(X))$.
218 \end{theorem}
219 \begin{proof}
220 Equal initial codes yield equal initialized states. The same operation sequence must then produce equal predicted outputs. Exactness forces equality of all true continuation outputs, proving necessity.
221
222 For sufficiency, note that $x\sim_\C x'$ implies $F_ax\sim_\C F_ax'$ because any subsequent word can be prefixed by $a$. The quotient consequently supports $G_a([x])=[F_ax]$ and $\bar q([x])=q(x)$. Condition (1) makes $d(r(x))=[x]$ well defined on the attained initial codes. Arbitrary unused codes can be assigned any quotient state. Induction on word length gives the required equality. Finally, two behaviorally different states cannot have the same initialized predictor state, or a distinguishing continuation would receive the same prediction. Thus the number of initialized values is at least the quotient cardinality.
223 \end{proof}
224
225 The underlying quotient argument is classical and is developed elsewhere in the collection~\cite{understanding,resolution}. Here its role is to attach a separate initialization condition to a common predictor across the surviving candidate worlds. A quotient can exist while the available record fails to initialize it.
226
227 \subsection{Finite checking does not require an infinite list of words}
228 Begin with the partition by $q$. Split any block whose members have successors in different current blocks under some action. A strict split increases the number of nonempty blocks, so at most $|X|-|q(X)|$ strict rounds occur. At a fixed point the quotient updates are well defined and preserve every later observation by induction. Any operation-stable refinement of the original output partition refines each round, so the terminal partition is the behavioral equivalence above. This supplies a finite computation when the complete candidate tables are given. It does not make their empirical acquisition free.
229
230 \subsection{State identity is relative to the chosen questions}
231 In the sensor example, $r=y$ satisfies (1) for display prediction. The quotient has two states even though eight worlds remain in the candidate universe. Adding physical-bit output refines the quotient to four classes and invalidates (1) for that same initial code. Adding the nuisance bit to the target would refine again to eight, but no admitted sensor action reveals it.
232
233 Only adding requirements yields a refinement relation automatically. Replacing one task with a different task can produce crossing partitions rather than a finer version of the old one. For example, the partition by display and the partition by physical bit are neither finer nor coarser than one another. A claim of cumulative learning must specify which old questions remain protected.
234
235 \subsection{An available predictor is stronger than a worldwise predictor}
236 Consider two immutable worlds, one with a permanently zero output and one with a permanently one output. The available initial record is the same symbol in both. Within each world separately, a one-state predictor exists: it simply prints that world's output. There is nevertheless no predictor that can be initialized from the common record and be correct in both. The obstruction is the order of quantifiers,
237 \[
238 \forall\omega\ \exists P_\omega
239 \qquad\text{versus}\qquad
240 \exists P\ \forall\omega.
241 \]
242 The first does not provide a selector for the second. The behavioral quotient of the combined family has two states, but the evidence cannot choose between them. Adding an output observation repairs the initialization problem without changing the mathematical existence of either predictor.
243
244 Likewise, a coordinate convention is not an observation. Relabeling a latent state and conjugating its updates can leave every operational prediction unchanged. Without a separately meaningful reference, evidence about those predictions need not favor one coordinate system. A canonical response profile avoids claiming that an arbitrary coordinate name was discovered as a physical entity. It does not prove that the reasoner's actual implementation uses the inferred profile causally.
245
246 Thus two distinct questions remain after fitting a predictor. Is it a common valid representation of the possible worlds, and does the observer possess the evidence needed to initialize it? The theorem answers their exact conjunction in a finite model. Efficient acquisition and causal attribution require further premises.
247
248
249 \FloatBarrier\clearpage
250 \part{New questions and the memory needed to correct them}
251 \section{Reinterpretation, acquisition, and irrecoverable distinctions}\label{sec:trichotomy}
252 A revised task often invites the vague instruction to learn a better representation. That instruction hides three different possibilities. The old code may already contain everything needed. A new observation may be required. Or the remaining interface may be unable to recover the needed distinction at all.
253
254 We first separate these cases in a setting where observations do not interfere with one another. Let $\Omega$ be finite, let $r:\Omega\to Z$ be retained evidence, and let $t:\Omega\to Y$ be the revised target. Let $\E=\{e_1,\ldots,e_m\}$ be a finite family of total, deterministic, nondestructive tests. Each test reads the same fixed world and leaves it unchanged. All tests remain available throughout the investigation. Equivalently, a reset may be allowed if it genuinely restores the same unknown world, including the relevant history. Resetting into a new known state does not satisfy this premise.
255
256 For $J\subseteq\{1,\ldots,m\}$, write
257 \[
258 R_J(\omega)=\bigl(r(\omega),(e_j(\omega))_{j\in J}\bigr).
259 \]
260 Let the unresolved target pairs be
261 \[
262 D=\{\{\omega,\omega'\}:r(\omega)=r(\omega'),\ t(\omega)\ne t(\omega')\}.
263 \]
264 A test covers such a pair when it gives different reports in the two worlds.
265
266 \begin{theorem}[Exact revision trichotomy for a reusable test interface]\label{thm:trichotomy}
267 Exactly one of the following applies.
268 \begin{enumerate}
269 \item $D$ is empty. A new decoder of the old code recovers $t$ without new observations.
270 \item $D$ is nonempty, but every pair in $D$ is separated by at least one admitted test. Executing all tests recovers $t$, and a selected nonadaptive set $J$ suffices exactly when it covers $D$.
271 \item Some pair in $D$ has identical reports under every admitted test. No finite adaptive protocol using this unchanged test interface and $r$ guarantees $t$ in every world.
272 \end{enumerate}
273 If test $j$ has nonnegative fixed cost $c_j$, the minimum cost of one fixed nonadaptive test set, used for all initial codes in case 2, is precisely
274 \[
275 \min_{J:\,J\text{ covers }D}\ \sum_{j\in J}c_j.\tag{2}
276 \]
277 This is not a claim that an optimal adaptive protocol has the same cost.
278 \end{theorem}
279 \begin{proof}
280 If $D$ is empty, the target is constant on each old-code fibre, giving a decoder. Otherwise a set $J$ permits a decoder exactly when no pair with the same old code and different target remains equal on all its test reports. That is exactly pair coverage. In particular, the full finite test family succeeds when every unresolved pair has a separating test.
281
282 If a pair survives every test, induction on an adaptive history shows that the two worlds give the same report after each chosen action. The protocol chooses the same next test because its available history is the same. Its stopping decision and output are therefore the same, so it cannot be correct on both targets. Independent randomization does not restore a probability-one guarantee, by conditioning on its random tape. The three cases are exclusive and exhaustive. Formula (2) follows from the equivalence between successful nonadaptive test sets and covers, with exactly the stated additive charges.
283 \end{proof}
284
285 The cover formulation exposes a concrete resource question without making a large learner part of the theorem. It also identifies what a negative certificate says. An uncovered pair is impossible to resolve through the declared interface. It is not impossible to resolve after a new sensor, retained record, or physical intervention changes that interface. Finding the cheapest cover can itself be difficult. Its formulation is not an efficient universal discovery algorithm.
286
287 \subsection{Why experimentwise evidence need not compose}
288 \begin{counterexample}[Pairwise separation without a successful investigation]\label{ce:destructive}
289 There are three possible initial cases $0,1,2$. Test $a$ reports whether the case is $0$, and test $b$ reports whether it is $1$. Either first test then destroys the accessible case state. Every later test returns a fixed zero report. The target remains the initial case, stored only as an inaccessible historical tag.
290
291 Every pair is distinguishable by some permitted first test. Yet beginning with $a$ leaves cases $1$ and $2$ indistinguishable whenever its answer is no. Beginning with $b$ leaves cases $0$ and $2$ indistinguishable. No finite adaptive protocol identifies every initial case. Randomizing the first test cannot guarantee success in every case either.
292 \end{counterexample}
293
294 The missing premise is not intelligence. It is the ability to combine evidence from mutually destructive inquiries. State-identification work studies related restrictions on adaptive tests~\cite{stateid}. The example makes clear why the target map, physical transition, and record cannot be separated in a general acquisition problem. The full state-changing repair constructions in \emph{Self-Improving Intelligence} address that different model~\cite{selfimproving}.
295
296 \subsection{The sensor revisited}
297 For physical-bit recovery, an old display and a nondestructive reference measurement satisfy case 2. Without the reference, flip sequences leave the convention ambiguity unresolved. For recovery of the pre-reset physical bit after losing the old display, the surviving states can have the same current physical state, convention, and every future sensor response while having opposite historical targets. That is case 3 relative to the post-reset interface.
298
299 A learner should record which kind of failure occurred. A failed search over decoders cannot establish that no new experiment would help. Conversely, repeatedly searching for a decoder cannot reconstruct a target that is not a function of its inputs. Formula length and information access are separate resources.
300
301 \section{A minimal memory for future correction}\label{sec:memory}
302 The old record can matter even when it does not change today's set of possible answers. The essential information may lie in a relation between a possible answer and an observation that will arrive later.
303
304 Let $\Omega$ be a finite model set and $t:\Omega\to Y$ a fixed target. For a candidate set $V\subseteq\Omega$, let
305 \[
306 Q(V)=t(V)=\{t(\omega):\omega\in V\}.
307 \]
308 The empty set is permitted. It represents a contradiction between the admitted model family and the evidence, not a successful identification. Let $\E\subseteq\Pow(\Omega)$ be a finite family of evidence events containing $\Omega$ and closed under intersections. Filtering by $E$ sends $V$ to $V\cap E$. The events are known, truthfully interpreted, and do not change the underlying model in this section.
309
310 \begin{definition}[Correction signature]\label{def:signature}
311 The correction signature of $V$ is
312 \[
313 \Sigma_{\E,t}(V)=\bigl(Q(V\cap E)\bigr)_{E\in\E}.\tag{3}
314 \]
315 Two candidate sets have the same signature when every admitted evidence filter leaves the same possible target values, including whether no candidate remains.
316 \end{definition}
317
318 \begin{theorem}[The coarsest exact memory for admitted corrections]\label{thm:correction}
319 Equality of correction signatures is a congruence for all updates $V\mapsto V\cap E_0$. The signature therefore supports well-defined updates and a readout of $Q(V)$. It preserves that readout after every finite sequence of admitted filters.
320
321 Conversely, any retained representation with deterministic filter updates and a readout reproducing $Q$ after every such sequence must distinguish every two candidate sets with different signatures. Thus the image of $\Sigma_{\E,t}$ is the smallest exact state space, in cardinality, for this correction contract on all candidate subsets.
322 \end{theorem}
323 \begin{proof}
324 If $\Sigma(V)=\Sigma(W)$, then for every $E\in\E$,
325 \[
326 Q((V\cap E_0)\cap E)=Q(V\cap(E_0\cap E))
327 =Q(W\cap(E_0\cap E)).
328 \]
329 Intersection closure puts $E_0\cap E$ in $\E$, so the equality is available from the original signatures. It proves $\Sigma(V\cap E_0)=\Sigma(W\cap E_0)$. The $E=\Omega$ coordinate gives $Q(V)$, and induction gives all finite filter sequences.
330
331 If two signatures differ, one event $E$ produces different target sets. A retained representation that merged the two candidate sets would update identically on that event and return the same readout, contradicting exactness. Every distinct signature therefore requires a distinct retained value. The signature itself attains that count with the updates just constructed.
332 \end{proof}
333
334 This is a behavioral quotient of a powerset system. It preserves later task-valued correction, not merely the present prediction. Candidate identities can be discarded when no admitted correction distinguishes them. Contradiction with the entire candidate set remains observable.
335
336 \subsection{An exact count when evidence identifies a partition cell}
337 Suppose $A_1,\ldots,A_m$ are a partition of $\Omega$ into nonempty cells, and $\E$ consists exactly of all unions of those cells. Define the attainable evidence--target pairs
338 \[
339 D_t=\{(i,y): y\in t(A_i)\},\qquad r=|D_t|=\sum_i|t(A_i)|.
340 \]
341 A candidate set induces an occupancy record
342 \[
343 O(V)=\{(i,t(\omega)):\omega\in V\cap A_i\}.
344 \]
345
346 \begin{corollary}[Exact correction-memory size for partition evidence]\label{cor:occupancy}
347 Two candidate sets have equal correction signatures if and only if their occupancy records agree. On the domain of all subsets $V\subseteq\Omega$, there are exactly $2^r$ distinct signatures. A fixed-length exact binary memory therefore requires at least $r$ bits, and an $r$-bit occupancy vector attains this bound.
348 \end{corollary}
349 \begin{proof}
350 Filtering by cell $A_i$ returns exactly the target values occurring in the $i$th part of $O(V)$. Thus equal signatures imply equal occupancy. Conversely, the target set after filtering by any union of cells is the union of their occupied target values, so occupancy determines every signature coordinate.
351
352 Every subset of $D_t$ is realized: for each included pair choose one world in its nonempty intersection $A_i\cap t^{-1}(y)$, and choose no worlds for excluded pairs. These intersections are disjoint for different pairs. Hence the occupancy map has $2^r$ values. Distinct values need distinct memory states by the preceding theorem. Binary counting gives the lower bound, and direct occupancy bits attain it.
353 \end{proof}
354
355 A particular inquiry may reach fewer candidate sets, reducing the number of attained occupancy records. The bound counts logical states, not interpreter bytes, update work, or evidence acquisition.
356
357 The exact evidence family matters. Two worlds $a,b$ in one cell with the same target have identical singleton occupancies. Adding the event $\{a\}$ distinguishes them: one filtered singleton retains the target and the other is empty. A new event that splits a cell can therefore require finer memory.
358
359 \subsection{Association can be the missing state}
360 \begin{counterexample}[Equal marginals with different corrected answers]\label{ce:marginals}
361 In the sensor model, let
362 \[
363 V_0=\{(s,\theta,k):s\oplus\theta=0\},\qquad
364 V_1=\{(s,\theta,k):s\oplus\theta=1\}.
365 \]
366 Take the target to be $s$ and the evidence cells to be the two values of $\theta$. Both candidate sets currently allow physical bits $\{0,1\}$, and both allow conventions $\{0,1\}$. Yet after the reference reports $\theta=0$, $V_0$ requires $s=0$ and $V_1$ requires $s=1$.
367
368 Retaining both marginal possibility sets loses the association needed to use the next measurement. Their equality is not a sufficient criterion for merging the records.
369 \end{counterexample}
370
371 Here the nuisance bit duplicates every attainable $(\theta,s)$ pair. There are $2^8=256$ raw candidate subsets, but only $2^4=16$ correction signatures. Four occupancy bits preserve every admitted future correction. The present physical-target set alone has only four possibilities, requiring two bits, but that smaller code is inadequate for the correction contract.
372
373 Four association bits suffice where eight raw membership bits are redundant and two marginal bits are inadequate.
374
375 \begin{figure}[tbp]\centering
376 \includegraphics[width=.88\linewidth]{figures/correction_association.pdf}
377 \caption{Two evidence histories preserve identical physical-bit and convention marginals. Their joint possibility patterns differ. A reference report selects a column, producing opposite physical-bit conclusions. The nuisance bit is omitted because it changes neither pattern.}\label{fig:association}
378 \end{figure}
379
380 \subsection{Correction memory has a scope}
381 The signature is minimal for its specified target and evidence family. New targets, events, candidate models, state-changing observations, or revised event meanings can split its classes. Old minimality remains a statement about the old contract.
382
383 If a future question asks for $k$, the occupancy is insufficient. When every available measurement ignores $k$, expanding the code cannot recover it. A finer signature can exist mathematically without being obtainable from the current interface.
384
385 \FloatBarrier\clearpage
386 \part{Noisy evidence and quantitative justification}
387 \section{Identifiable does not mean certainly identified}\label{sec:noise}
388 The earlier exact filters remove a world only when it cannot produce the observation. With noisy channels that criterion can retain every candidate indefinitely. A statistical procedure may nevertheless become increasingly reliable. These are different guarantees, not contradictory descriptions of learning.
389
390 For a fixed protocol, let two worlds with different targets generate finite transcript laws $P_0$ and $P_1$. An estimator sees only that transcript and independent randomness. Its average success under equal prior probabilities is bounded by the discrimination in the entire record.
391
392 \begin{proposition}[A finite-record discrimination bound]\label{prop:testing}
393 For two distinct target values and equal world probabilities, every transcript-based estimator has average success at most
394 \[
395 \frac{1+\TV(P_0,P_1)}{2},\qquad
396 \TV(P_0,P_1)=\frac12\sum_h|P_0(h)-P_1(h)|.\tag{4}
397 \]
398 A deterministic function or a common stochastic processing channel applied to the transcript cannot increase this upper bound.
399 \end{proposition}
400 \begin{proof}
401 Convert the estimator into a binary test by reporting world zero when it outputs the first target and world one otherwise. A correct target output always gives a correct binary decision. If $f(h)\in[0,1]$ is the test's chance of declaring world zero, its success is
402 \[
403 \frac12\left(1+\sum_h f(h)(P_0(h)-P_1(h))\right).
404 \]
405 The sum is at most the sum of positive differences, which equals total variation. This proves (4). If $B(h,z)$ is a common processing channel and $g(z)\in[0,1]$ a processed-record test, then $f(h)=\sum_zB(h,z)g(z)$ is a raw-record test with the same two expectations. Thus every processed decision was already available from the original record.
406 \end{proof}
407
408 This is an elementary testing and data-processing argument, related to the classical comparison of experiments~\cite{blackwell}. It does not identify the best protocol, establish the correctness of a sensor model, or make independent randomness into additional evidence. If an adaptive protocol is compared, its complete history must be the transcript in (4).
409
410 \begin{counterexample}[Distinct laws with no finite certain identification]\label{ce:bernoulli}
411 Let the unknown world be $\omega\in\{0,1\}$. A repeated observation is conditionally independent Bernoulli with success probability $1/4$ in world zero and $3/4$ in world one. The two one-observation laws differ, so the world is identified by its law. Every finite binary string nevertheless has positive probability under both worlds. No fixed finite sample supplies an error-free world classifier.
412
413 For odd $n$, majority voting is the likelihood-ratio rule. Its error in either world is
414 \[
415 e_n=\sum_{j=0}^{(n-1)/2}\binom{n}{j}(3/4)^j(1/4)^{n-j}.
416 \]
417 The first values are $e_1=1/4$, $e_3=5/32$, and $e_5=53/512$. These are exact analytical probabilities, not observed error rates from an agent experiment.
418 \end{counterexample}
419
420 The example illustrates why logical candidate elimination and statistical confidence should not share a Boolean field named ``known.'' Both candidate worlds remain in the support of every fixed finite record. Their relative likelihoods can become very different. Treating the most likely world as certain discards the distinction that the exact support test preserves.
421
422 \begin{figure}[tbp]\centering
423 \includegraphics[width=.88\linewidth]{figures/noisy_identification.pdf}
424 \caption{Exact majority-test error for two stipulated Bernoulli worlds. The laws differ, and repeated independent evidence reduces error, but every finite record remains compatible with both worlds. The curve is evaluated from the displayed binomial formula.}\label{fig:noise}
425 \end{figure}
426
427 \subsection{Identifiability is not a uniform rate}
428 Distinct models may induce arbitrarily similar laws. Unless a model class imposes a separation condition, a bounded number of observations need not distinguish every pair reliably. The total-variation term exposes that obstruction directly. A data-dependent summary cannot increase the discrimination contained in the actual record.
429
430 Conversely, a small class with known, well-separated distributions can admit a useful finite-sample procedure even when exact certainty is impossible. The statistical question is then how much error is acceptable and which assumptions justify its probability bound. We do not add a sample-complexity claim merely by labeling a model family finite. Separation, admissible protocols, and the sampling law have to enter the argument.
431
432 \section{An explicit radius for what remains unknown}\label{sec:radius}
433 A set of candidate worlds may disagree on some future outputs while agreeing closely on others. It is useful to quantify that disagreement without selecting one world as if it had been identified.
434
435 Let $v:\Omega\to\mathbb R^d$ record a fixed finite collection of target quantities, where $d\ge1$. These can be future predictions on specified operation words. For a nonempty $B\subseteq\Omega$, define
436 \[
437 \ell_j(B)=\min_{\omega\in B}v_j(\omega),\qquad
438 u_j(B)=\max_{\omega\in B}v_j(\omega),
439 \]
440 \[
441 m_j(B)=\frac{\ell_j(B)+u_j(B)}2,\qquad
442 \rho(B)=\frac12\max_j\bigl(u_j(B)-\ell_j(B)\bigr).\tag{5}
443 \]
444 The radius concerns coordinatewise prediction in a common frame. It is not an uncertainty measure invariant under arbitrary nonlinear reparameterization.
445
446 \begin{theorem}[Ambiguity radius and an explicit prediction certificate]\label{thm:radius}
447 For every nonempty finite $B$,
448 \[
449 \inf_{z\in\mathbb R^d}\ \max_{\omega\in B}\|z-v(\omega)\|_\infty=\rho(B),
450 \]
451 and $m(B)$ attains the infimum. If $B'\subseteq B$ is nonempty then $\rho(B')\le\rho(B)$.
452
453 Fix nonnegative tolerances $\eta,\varepsilon$ and $\delta_{\mathrm{id}},\delta_{\mathrm{model}}\in[0,1]$. Suppose a data record $H$ produces a candidate set $B(H)$ with
454 \[
455 \Pr\{\omega_*\in B(H)\}\ge1-\delta_{\mathrm{id}}.
456 \]
457 Suppose a second event, of probability at least $1-\delta_{\mathrm{model}}$, guarantees
458 \[
459 \sup_{\omega\in B(H)}\|v(\omega)-\widehat v_H(\omega)\|_\infty\le\eta.
460 \]
461 Read the last supremum as zero when $B(H)$ is empty. When $B(H)$ is nonempty, form the midpoint $\widehat m$ and radius $\widehat\rho$ from $\widehat v_H$. If the returned numerical vector $z$ satisfies $\|z-\widehat m\|_\infty\le\varepsilon$, then
462 \[
463 \|z-v(\omega_*)\|_\infty\le\widehat\rho+\eta+\varepsilon\tag{6}
464 \]
465 on an event of probability at least $1-\delta_{\mathrm{id}}-\delta_{\mathrm{model}}$. The rule abstains on an empty candidate set. No independence between the two stated events is required.
466 \end{theorem}
467 \begin{proof}
468 For each coordinate $j$, any point $z_j$ is at distance at least $(u_j-\ell_j)/2$ from one of the two extremes. Taking the largest coordinate width gives the lower bound. The midpoint is within half of every coordinate's width of every candidate, so it attains that bound. Inclusion can only narrow the coordinate ranges.
469
470 On the intersection of the coverage and model-accuracy events, the true world lies in the nonempty set and
471 \[
472 \|z-v(\omega_*)\|_\infty
473 \le\|z-\widehat m\|_\infty
474 +\|\widehat m-\widehat v_H(\omega_*)\|_\infty
475 +\|\widehat v_H(\omega_*)-v(\omega_*)\|_\infty.
476 \]
477 The three terms are bounded by $\varepsilon$, $\widehat\rho$, and $\eta$. The union bound gives the probability statement.
478 \end{proof}
479
480 The center is allowed to be any vector in $\mathbb R^d$. Requiring it to be the prediction of one admissible model can increase the optimum. Nor does a coordinatewise midpoint automatically define a coherent stochastic process or preserve logical invariants. Those are additional constraints on the permitted approximation, not consequences of (5).
481
482 \subsection{Three errors and two failure probabilities}
483 The radius measures unresolved disagreement among retained candidates. The model discrepancy controls how well their represented predictions match the intended quantities. Numerical error concerns the computation of the returned answer. The coverage probabilities express the chance that the premises fail. They are not added to the numerical tolerance as if they had the same units.
484
485 The probability assertion is unconditional over the stated evidence procedure. It is not automatically the same bound conditional on a rare event such as issuance of a certificate. Likewise, repeatedly changing the candidate family or stopping rule requires a validity argument for the actual procedure. A confidence set cannot be assumed valid merely because its contents look plausible.
486
487 \subsection{What compression does to the candidate set}
488 For a fixed raw-record channel, let $B(h)$ be its exact support set. If only $c(h)$ is retained, the correct support is
489 \[
490 B_c(z)=\bigcup_{h:c(h)=z}B(h).
491 \]
492 Indeed, a world can produce the coarse record exactly when it can produce at least one raw record in that fibre. Thus $B(h)\subseteq B_c(c(h))$, and the ambiguity radius cannot decrease for the same target vector. This is an information statement, not a command to retain every byte. The correction signature in Section~\ref{sec:memory} identifies one principled way to compress while retaining the specified future uses.
493
494 For general confidence sets rather than exact supports, taking the same union still preserves the original coverage guarantee. It may be conservative. Selecting a smaller coarse-record set requires a new coverage argument, not the assertion that compression should make the model simpler.
495
496 \begin{counterexample}[Agreement inside a misspecified family]\label{ce:misspec}
497 Suppose every candidate in a supplied family predicts zero for the target, but the actual unmodeled process produces one. The family has radius zero, and its internal arithmetic can be exact. The conclusion is nevertheless wrong because the true process is outside the represented family. Neither a narrow interval nor a successful proof about the family establishes that membership premise.
498 \end{counterexample}
499
500 This is why model adequacy is not treated as a reward for confidence. In the present paper it is a stated premise, or a separate statistical event, rather than an automatic consequence of a concentrated representation.
501
502 \section{A probability memory for repeated correction}\label{sec:likelihoodmemory}
503 The exact signature in Section~\ref{sec:memory} records which candidates remain possible. With noisy observations, all candidates can remain possible while their relative weights change substantially. Keeping only their support would then preserve logical possibility but discard the result of Bayesian correction. We now specify a different memory contract: retain both the probabilities of future reports and the posterior distribution of the selected target.
504
505 Let $\Omega$ be finite and nonempty, let $t:\Omega\to Y$ have finite image, and let $\mathcal B$ be a finite collection of experiments. Experiment $e$ has a finite outcome set and specified likelihoods
506 \[
507 \ell_{e,o}(\omega)\ge0,\qquad \sum_o\ell_{e,o}(\omega)=1.
508 \]
509 The world is fixed. Every experiment remains available, and each new report has this conditional law given the world, the chosen experiment, and all earlier reports. This is a fresh conditional-observation premise, not a claim that copied readings become new samples. No experiment changes the physical state in this section.
510
511 Partition $\Omega$ into the nonempty cells $A_1,\ldots,A_m$ on which the complete likelihood vector $(\ell_{e,o}(\omega))_{e,o}$ is constant. Write its common value as $\lambda_{e,o,i}$. The profile vectors of different cells are distinct by construction. For a prior $\mu$, retain
512 \[
513 p_{i,y}(\mu)=\sum_{\omega\in A_i,\ t(\omega)=y}\mu(\omega),
514 \qquad (i,y)\in D_t=\{(i,y):A_i\cap t^{-1}(y)\ne\varnothing\}.
515 \]
516 These are joint masses, not the two separate marginals. There are $r=|D_t|$ coordinates with nonnegative entries summing to one. Exact real probabilities are not a fixed $r$-bit code. A bit-complexity claim would also have to account for their representation and growing denominators.
517
518 \begin{theorem}[Exact target correction from likelihood-profile memory]\label{thm:likelihoodmemory}
519 Under the fixed-world likelihood model, the record $p=(p_{i,y})$ supports every finite sequence of report predictions and target-posterior corrections. Its next-report probability and update are
520 \[
521 z_{e,o}=\sum_{i,y}\lambda_{e,o,i}p_{i,y},\qquad
522 p'_{i,y}=\frac{\lambda_{e,o,i}p_{i,y}}{z_{e,o}}\quad(z_{e,o}>0),
523 \]
524 and its target readout is $\Pr(t=y)=\sum_i p_{i,y}$. A zero-probability report is marked impossible rather than assigned a normalized posterior.
525
526 Conversely, any deterministic memory, initialized for every prior on $\Omega$, that preserves all next-report probabilities and all target posteriors after every finite history must distinguish priors with different joint-mass records. In fact, the joint probabilities of the target and all experiment-report words of length at most $m-1$ already determine the joint-mass record. The memory is therefore minimal in the sense of its induced equivalence on priors, not in machine words or physical storage.
527 \end{theorem}
528 \begin{proof}
529 Likelihoods are constant on each profile cell, so summing the ordinary Bayesian update over $A_i\cap t^{-1}(y)$ gives the displayed update. Its normalization and target readout are exact. Repeating this argument proves sufficiency for any fixed experiment sequence, and also for choices made from the retained report history without extra world-dependent information.
530
531 For necessity, a valid predictor and updater determine, for every word $w=((e_1,o_1),\ldots,(e_k,o_k))$, the masses
532 \[
533 M_{\mu,y}(w)=\sum_{t(\omega)=y}\mu(\omega)
534 \prod_{j=1}^k\ell_{e_j,o_j}(\omega).
535 \]
536 Indeed, multiply the successive predicted report probabilities by the final target posterior. If an earlier factor is zero, the joint mass is zero and no impossible conditional posterior is needed. The empty word gives the current target distribution.
537
538 For each cell $i$ and each $j\ne i$, choose one likelihood coordinate $b(i,j)=(e,o)$ for which $\lambda_{b(i,j),i}\ne\lambda_{b(i,j),j}$. Such a coordinate exists because profile vectors are distinct. On $\Omega$ the polynomial
539 \[
540 P_i(\omega)=\prod_{j\ne i}
541 \frac{\ell_{b(i,j)}(\omega)-\lambda_{b(i,j),j}}
542 {\lambda_{b(i,j),i}-\lambda_{b(i,j),j}}
543 \]
544 is exactly $\mathbf1_{A_i}(\omega)$. It is a linear combination of likelihood monomials of degree at most $m-1$. Each monomial is the likelihood product of an admitted fixed experiment-report word. Consequently $p_{i,y}(\mu)=\sum_{t(\omega)=y}\mu(\omega)P_i(\omega)$ is a linear combination of the corresponding $M_{\mu,y}(w)$. For $m=1$ the empty product is one and the same argument uses only the current target masses. Two priors merged by an exact memory have equal predicted joint masses, hence equal joint-mass records. This proves the claimed separation and finite word-length bound.
545 \end{proof}
546
547 The proof uses a finite interpolation argument. Its polynomial coefficients are an identification device, not negative-probability experiments that a learner must execute. All likelihood values are supplied exactly. Very similar profile vectors can make the interpolation numerically ill-conditioned, so the theorem does not provide a stable estimator of $p$ from noisy frequency estimates. Nor does it infer the true likelihood model from a narrow posterior. The distinction between sufficient experiments and compressed statistical evidence is classical~\cite{blackwell}; the present contract additionally keeps the selected target and all future update operations explicit.
548
549 \subsection{Two identical marginals, two opposite corrections}
550 Return to the sensor worlds $\omega=(s,\theta,n)\in\{0,1\}^3$, where $s$ is the target bit, $\theta$ is a convention, and $n$ is irrelevant. Suppose the only future experiment is a nondestructive noisy reference with
551 \[
552 \Pr(o=1\mid\theta=0)=\tfrac14,\qquad
553 \Pr(o=1\mid\theta=1)=\tfrac34.
554 \]
555 There are two likelihood-profile cells, one for each convention, and four nonempty profile--target pairs. The eight-world prior can be reduced to four joint masses without losing any specified prediction or correction. The nuisance coordinate disappears.
556
557 Consider a prior $\mu_+$ assigning mass $1/2$ to $(s,\theta)=(0,0),(1,1)$ and a prior $\mu_-$ assigning mass $1/2$ to $(1,0),(0,1)$, with any fixed nuisance convention. Both have uniform $s$ and uniform $\theta$. Both predict the next report $1$ with probability $1/2$. After that report, however,
558 \[
559 \Pr_{\mu_+}(s=1\mid o=1)=\tfrac34,\qquad
560 \Pr_{\mu_-}(s=1\mid o=1)=\tfrac14.
561 \]
562 After $k$ fresh reports all equal to one, these become $3^k/(1+3^k)$ and $1/(1+3^k)$. The difference is not a numerical error. It is the association that the separate marginals failed to retain. At every finite $k$, both target values remain possible under either prior.
563
564 \begin{figure}[tbp]\centering
565 \includegraphics[width=.95\linewidth]{figures/noisy_association.pdf}
566 \caption{Exact posterior target probabilities for two priors with identical target and sensor marginals but opposite association. Each horizontal step is a fresh noisy-reference report equal to one. The curves are conditional analytical values, not measured learning performance. Four joint masses support the update; two separate marginals do not.}\label{fig:noisyassociation}
567 \end{figure}
568
569 \subsection{What a revised evidence language requires}
570 Let $\mathcal P_0$ be the partition of worlds into the nonempty old profile--target cells. Let $\mathcal P_1$ be the corresponding partition after likelihoods or the target have changed, still on the same finite $\Omega$. The old record stores the probability of each $\mathcal P_0$ cell. The new record would store the probability of each $\mathcal P_1$ cell.
571
572 \begin{corollary}[Exact migration of a probability memory]\label{cor:memorymigration}
573 A deterministic map reconstructing the new record from the old record for every prior exists if and only if every $\mathcal P_0$ cell is contained in a single $\mathcal P_1$ cell. When this condition holds, summing the relevant old masses gives the new record. If the new evidence or target strictly splits an old cell, no such universal reconstruction exists.
574 \end{corollary}
575 \begin{proof}
576 When every old cell lies inside a new one, each new mass is the sum of the old-cell masses it contains. Conversely, suppose two worlds lie in the same old cell but in different new cells. Point-mass priors on those worlds yield the same old record and distinct new records. No deterministic map can send that one old record to both required new records.
577 \end{proof}
578
579 \begin{counterexample}[An old exact memory does not upgrade itself]\label{ce:memorymigration}
580 Two worlds have the same target and the same old report law, so point masses on them give an identical old record. A newly admitted experiment reports one with probabilities $1/4$ and $3/4$ in the respective worlds. The old record cannot predict its probability, although it was exact for every old question and update. Adding a field for the new likelihood profile does not determine its contents.
581 \end{counterexample}
582
583 A restricted family of reachable priors can admit a reconstruction that fails for arbitrary priors. That restriction must be stated. Likewise, an archived raw record, a justified prior relation, or fresh evidence may help initialize the new memory, but its adequacy must be checked separately. Enlarging the candidate-world set is a different operation again: the old probabilities do not decide how much mass newly admitted worlds should receive.
584
585 \subsection{Exact sufficiency is not a finite-precision guarantee}
586 Even when two profiles differ only slightly, enough repeated evidence can make their posterior effects very different. Near-equal likelihoods are not interchangeable for an unbounded continuation contract. A finite-precision theory needs a horizon, a metric, a likelihood or evidence-mass condition, and a policy for outcomes of very small probability. Section~\ref{sec:quantized} supplies a finite-horizon approximation contract with an explicit likelihood floor and retained-record denominator. It does not make rounding an exact sufficient statistic or provide an unbounded-time guarantee.
587
588
589 \FloatBarrier\clearpage
590 \part{Grounded continuation without complete identification}
591 \section{What a partial operator calibration determines}\label{sec:linear}
592 The finite-world examples show that complete identification can be unnecessary. A linear setting makes the positive result more structural. We will determine the exact domain on which every future operation sequence is already fixed by partial calibration data.
593
594 Let $V$ be a finite-dimensional vector space over a field, and let $\A$ be a finite nonempty set of operation names. The unknown operations are linear maps $T_a:V\to V$. Calibration supplies input vectors $x_1,\ldots,x_m$ and exact outputs $y_{a,1},\ldots,y_{a,m}$ for every $a$. The operator family is fixed, rather than being reselected after each action. Let
595 \[
596 U=\Span\{x_1,\ldots,x_m\}.
597 \]
598 The calibration is consistent precisely when every linear relation among the inputs is respected by the outputs, for each action. Under that condition it defines maps $S_a:U\to V$ with $S_ax_i=y_{a,i}$. Every $S_a$ has linear extensions to $V$ by extending a basis. Unless stated otherwise, \emph{all} such extensions are admissible. There is no hidden norm bound, symmetry, invertibility condition, or preferred matrix completion.
599
600 The compatible-model viewpoint is shared with the data-informativity literature~\cite{informativity}. Our goal here is exact full-state prediction from a known initial vector, not stabilization, optimal control, or prediction from an unmeasured initial condition.
601
602 \begin{proposition}[One-step identification from exact calibration]\label{prop:onestep}
603 For a fixed action $a$, the value $T_av$ is the same for every linear extension of $S_a$ if and only if $v\in U$. The common value is then $S_av$.
604 \end{proposition}
605 \begin{proof}
606 If $v\in U$, all extensions agree by definition. If $v\notin U$, choose a linear functional $\ell$ that vanishes on $U$ and satisfies $\ell(v)=1$, and choose a nonzero vector $b\in V$. Given any extension $T_a$, the map $T_a'(x)=T_a(x)+\ell(x)b$ is another extension, but $T_a'v=T_av+b\ne T_av$. Such a functional exists by extending a basis of $U$ with $v$.
607 \end{proof}
608
609 The proposition uses the complete unrestricted extension class. A justified structural prior can determine more. For example, knowing an operator belongs to a smaller parametric family can constrain its action outside $U$. Those constraints must be included as prior information, not inferred from the calibration span alone.
610
611 \subsection{A known first step can leave the known domain}
612 Even if $v\in U$, the vector $S_av$ can lie outside $U$. A second action then acts at an input whose response was not calibrated. One-step accuracy is therefore insufficient for reusable operator meaning.
613
614 Define a descending sequence of subspaces
615 \[
616 U_0=U,\qquad
617 U_{j+1}=\{v\in U:S_av\in U_j\text{ for every }a\in\A\}.\tag{7}
618 \]
619 The sequence is descending by induction. Every strict inclusion decreases dimension, so a fixed point is reached after at most $\dim U$ strict drops. Denote it by $U_\infty$.
620
621 \begin{theorem}[The maximal calibrated continuation domain]\label{thm:core}
622 For every integer $n\ge1$ and every $v\in V$, the values $T_wv$ for all operation words of length at most $n$ are independent of the chosen compatible extension family if and only if
623 \[
624 v\in U_{n-1}.
625 \]
626 Consequently, every finite full-state continuation is identifiable exactly on $U_\infty$. This is the largest subspace $L\subseteq U$ such that $S_aL\subseteq L$ for every $a$. On this subspace the known restrictions themselves realize the complete operation family.
627 \end{theorem}
628 \begin{proof}
629 Membership in $U_{n-1}$ means that every path of at most $n-1$ calibrated operations stays inside $U$. This follows by induction from (7), beginning with $U_0=U$. All inputs on which the first $n$ operations must act are consequently calibrated. Their outputs are determined by the $S_a$, independently of every completion outside $U$.
630
631 For necessity, suppose $v\notin U_{n-1}$. If $v\notin U$, the one-step proposition supplies two extensions that disagree within one action. Otherwise the recursive definition gives a word of length $j\le n-1$ with a first exit from $U$. Its intermediate vectors before exit lie in $U$, so its exit vector $z\notin U$ is the same under every compatible extension family. Choose any next action $b$. Two extensions of $S_b$ can be made to disagree on $z$ by adding a linear map that vanishes on $U$. Keep the other action maps the same. Even if action $b$ occurred earlier, that modification has no effect before the exit because the earlier inputs lie in $U$. The two fixed extension families therefore produce different vectors after the exit word followed by $b$, whose total length is at most $n$. This contradicts uniform continuation identification.
632
633 At a fixed point, (7) gives $S_aU_\infty\subseteq U_\infty$. If $L\subseteq U$ is invariant under every restriction, induction gives $L\subseteq U_j$ for every $j$, so $L\subseteq U_\infty$. Applying the finite-horizon equivalence at all $n$ proves the all-word assertion.
634 \end{proof}
635
636 This theorem supplies an identifiable \emph{domain}, not necessarily an identified whole operator. It is exact for the stated completion class and full-state output. A smaller observation does not automatically enlarge the predictable domain: Proposition~\ref{prop:noenlargement} proves that it does not under the present unrestricted completion class when the observation is nonzero. Sections~\ref{sec:pairtest}--\ref{sec:linearpredictor} characterize the gains that become possible under explicitly structured uncertainty. Similarly, a learned nonlinear latent representation may compress the identifiable core further for its own tasks, but that is not part of this linear result.
637
638 \subsection{A two-dimensional calibration with a one-dimensional reusable core}
639 \begin{counterexample}[Calibration does not close under continuation]\label{ce:linear}
640 Let $V$ have basis $e_1,e_2,e_3$, let $U=\Span(e_1,e_2)$, and let the single calibrated operation satisfy
641 \[
642 Se_1=e_1,\qquad Se_2=e_3.
643 \]
644 The first continuation is known on all of $U$. The next calibrated domain is $U_1=\Span(e_1)$, which is already invariant. One completion has $T_0e_3=0$ and another has $T_1e_3=e_1$. Both agree on every supplied calibration. Starting from $e_2$, their first outputs agree at $e_3$, but their second outputs are respectively zero and $e_1$.
645 \end{counterexample}
646
647 Every continuation from $e_1$ is nevertheless determined. The system can ground a genuinely reusable operation on that line while remaining unable to predict repeated operations from $e_2$. A new exact calibration of $e_3$ expands the known input span to $V$ and identifies the whole operator. Obtaining that calibration is a new experiment, not an algebraic consequence of the old data.
648
649 \begin{figure}[tbp]\centering
650 \includegraphics[width=.95\linewidth]{figures/calibrated_core.pdf}
651 \caption{A partial calibration can support unlimited exact continuation on a proper invariant core. The known image of $e_2$ leaves the calibrated input subspace, so its next image is unrestricted. Agreement with every supplied one-step calibration is not agreement on two-step behavior.}\label{fig:core}
652 \end{figure}
653
654 \subsection{Several operators and the scope of the initial vector}
655 With several actions, (7) retains only vectors that remain calibrated under \emph{every} permitted word. An added action can therefore shrink the core even if the old operators and data are unchanged. Restricting the permitted grammar to a specific sequence can enlarge the domain of predictable use. The full free-word contract is deliberately stronger than one selected trajectory.
656
657 The initial vector $v$ is known to the predictor in this section. If the actual input is hidden behind an evidence code, its initialization must satisfy an additional factorization condition like (1). A calibrated operation and an unobserved initial state are different missing inputs. They cannot be exchanged merely because both appear as uncertainty about the next output.
658
659 \section{Why small local error needs an ambient growth bound}\label{sec:approx}
660 Exact calibration can justify a sharp domain. Approximate calibration needs a quantitative statement about errors that leave it. Let $V$ be a normed vector space and $L\subseteq V$ a linear subspace invariant under known bounded linear maps $S_a:L\to L$. Suppose the actual bounded linear maps $T_a:V\to V$ satisfy
661 \[
662 \|T_a\|\le A,\qquad \|S_a\|\le B,\qquad
663 \|(T_a-S_a)v\|\le\eta\|v\|\quad(v\in L),\tag{8}
664 \]
665 for common nonnegative bounds $A,B,\eta$. The norm on $T_a$ is an ambient bound. Its purpose is to control propagation of errors outside $L$, not only behavior on calibrated inputs.
666
667 \begin{proposition}[Approximate continuation with explicit leakage control]\label{prop:approx}
668 For every $v\in L$ and every word $w$ of length $n\ge1$,
669 \[
670 \|T_wv-S_wv\|
671 \le\eta\|v\|\sum_{j=0}^{n-1}A^{n-1-j}B^j.\tag{9}
672 \]
673 For the empty word the discrepancy is zero. Integer zero powers in the displayed finite sum have their usual value one. The conclusion does not require the actual trajectory to remain in $L$.
674 \end{proposition}
675 \begin{proof}
676 Write $z_j=S_{a_j}\cdots S_{a_1}v\in L$ and $x_j=T_{a_j}\cdots T_{a_1}v$. For the next operation,
677 \[
678 \|x_{j+1}-z_{j+1}\|
679 \le A\|x_j-z_j\|+\eta\|z_j\|
680 \le A\|x_j-z_j\|+\eta B^j\|v\|.
681 \]
682 The initial discrepancy is zero. Iterating this scalar recurrence gives (9). Ambient boundedness applies to $x_j-z_j$ even when that error has left $L$.
683 \end{proof}
684
685 This is a telescoping error estimate, not a new perturbation principle. Similar continuation bounds already appear in the collection~\cite{understanding,resolution}. Its role here is to identify a premise that calibration on a proper subspace cannot certify by itself.
686
687 \begin{counterexample}[An uncalibrated direction amplifies a small residual]\label{ce:growth}
688 Let $L=\Span(e_1)$, let $Se_1=e_1$, and in the $\ell^1$ norm define
689 \[
690 T=\begin{pmatrix}1&0\\ \eta&M\end{pmatrix},\qquad \eta>0,\ M\ge0.
691 \]
692 The one-step error on the unit calibrated vector is $\eta$, independent of $M$. After two steps the error is $\eta(1+M)$. It can be arbitrarily large while the local calibration error is fixed. For $n$ steps the second coordinate is $\eta\sum_{j=0}^{n-1}M^j$.
693 \end{counterexample}
694
695 A learned model can therefore match calibrated transitions closely and still fail rapidly under repetition. Increasing one-step accuracy helps only in relation to the length of use and the growth of the unseen directions. A measured small residual does not imply an ambient norm bound. The bound can come from a declared operator class, a separate global calibration argument, or a stronger structural certificate, but not from renaming the local fit ``stable meaning.''
696
697 \section{A smaller output is not automatically a weaker calibration requirement}\label{sec:noenlargement}
698 The preceding full-state theorem suggests asking whether a small observable can remain predictable outside the calibrated core. The answer depends on the uncertainty class. Under the unrestricted extension class of Section~\ref{sec:linear}, simply requesting fewer output coordinates does not enlarge the all-word identifiable domain unless the requested observation is identically zero.
699
700 Let $Q:V\to Y$ be a fixed linear observation. The initial vector $v$ remains known. All linear extensions of every calibrated restriction $S_a$ remain permitted, independently across action names but fixed throughout an execution.
701
702 \begin{proposition}[No enlargement under unrestricted linear completion]\label{prop:noenlargement}
703 If $Q\ne0$, then for every $h\ge1$, the vectors $QT_wv$ are independent of the compatible extension family for every word of length at most $h$ if and only if $v\in U_{h-1}$. In particular, the all-word output-identifiable domain is exactly $U_\infty$. If $Q=0$, every initial vector is trivially output-identifiable.
704 \end{proposition}
705 \begin{proof}
706 On $U_{h-1}$ the full vectors are determined by Theorem~\ref{thm:core}, so their $Q$ outputs are determined. Outside that subspace, follow the same first-exit construction as in that proof. At an uncalibrated input $z$, choose a linear functional $\ell$ vanishing on $U$ with $\ell(z)=1$. Because $Q\ne0$, choose $b$ with $Qb\ne0$. Replacing the next action by $T_a+\ell(\cdot)b$ preserves all calibration data and every earlier step of the first-exit path, but changes the next observed output by $Qb$. This produces disagreement within $h$ actions. Each modified action map is fixed, not chosen anew during execution. The zero-output case follows immediately.
707 \end{proof}
708
709 This corrects an overly broad suggestion in the first draft's surrounding prose. Output-relative prediction can be less demanding under \emph{structured} uncertainty. It is not automatically less demanding when every uncalibrated direction is allowed to return arbitrarily into the output. The previous full-state theorem and its proof are unchanged.
710
711 The next sections therefore change the model class explicitly. We first consider a finite family of complete candidate systems, retaining the fact that one unknown candidate is fixed. We then characterize the stronger situation in which an entire uncertainty family admits one common quotient. These are different questions and have different answers.
712
713 \section{A finite test for agreement under a fixed unknown model}\label{sec:pairtest}
714 Let $V$ be $n$-dimensional over a field, let $\Theta$ be a finite nonempty model set, and let $T_a^\theta:V\to V$ be specified linear maps for each model $\theta$ and action $a$ in a finite nonempty alphabet. All words are allowed. Choose a reference model $0\in\Theta$ and write $A_a=T_a^0$. The shared linear observation is $Q:V\to Y$. Define
715 \[
716 I_Q=\{v\in V:QT_w^\theta v=QA_wv\text{ for every }\theta\in\Theta\text{ and every word }w\}.
717 \]
718 This is an initial-condition subspace. It is not assumed invariant under the physical maps. The common coordinates are part of this linear comparison model. With unrelated latent carriers, a justified identification of the carriers would be an additional premise.
719
720 For each $\theta$, form the paired maps and difference observation
721 \[
722 B_a^\theta=\begin{pmatrix}T_a^\theta&0\\0&A_a\end{pmatrix},\qquad
723 C=\begin{pmatrix}Q&-Q\end{pmatrix},\qquad
724 \Delta v=(v,v).
725 \]
726 The pair is evolved by the \emph{same} action word in both components. Define
727 \[
728 K_0^\theta=\ker C,\qquad
729 K_{j+1}^\theta=K_j^\theta\cap\bigcap_a(B_a^\theta)^{-1}K_j^\theta.
730 \]
731
732 \begin{theorem}[Finite output-agreement test with persistent model tags]\label{thm:pairtest}
733 The descending paired-kernel sequence stabilizes in at most $2n$ strict dimension drops. Its terminal subspace is
734 \[
735 K_\infty^\theta=\bigcap_w\ker(CB_w^\theta),\qquad
736 I_Q=\bigcap_{\theta\in\Theta}\Delta^{-1}K_\infty^\theta.
737 \]
738 Thus exact all-word output agreement for the finite candidate family is decidable by finite linear algebra. If an initial vector is excluded, a disagreeing candidate and a distinguishing word can be extracted. Words of length at most $2n$ suffice for this test. The conclusion compares fixed candidate models; it does not admit arbitrary switching between candidates during a word.
739 \end{theorem}
740 \begin{proof}
741 By induction, $K_j^\theta$ consists precisely of paired states with zero difference output for all words of length at most $j$. The initial case is the empty word. Membership in the next intersection says that the present difference is zero and that applying any first action leaves a pair whose next $j$ actions have zero difference. This is exactly the length-$j+1$ condition.
742
743 Every strict inclusion lowers dimension in $V\oplus V$, which has dimension $2n$. Once two successive subspaces agree, the subspace is invariant under every $B_a^\theta$ and lies in $\ker C$, so all later intersections agree. This proves the all-word formula. At the diagonal initial pair, $CB_w^\theta\Delta v=QT_w^\theta v-QA_wv$, giving the paired-kernel formula. Row-space construction retains the operation word producing each tested row. If a vector fails the terminal kernel test, one such row is nonzero on it and supplies a witness. The dimension argument gives the stated conservative length bound.
744 \end{proof}
745
746 Finite linear-algebra equivalence testing has established precedents, including algorithms for probabilistic automata~\cite{tzeng}. Reachability, observability, and minimal realization for multiple linear operations are also established subjects~\cite{petreczky}. The contribution here is the fixed-compatible-model interpretation and its connection to evidence initialization and correction. We do not claim a new general automata-equivalence algorithm.
747
748 \subsection{Why the unknown model must not change between steps}
749 \begin{counterexample}[A switching adversary creates a nonexistent failure]\label{ce:switching}
750 Over $\mathbb Q$, let there be one action and two possible fixed matrices
751 \[
752 A=\begin{pmatrix}0&1\\0&0\end{pmatrix},\qquad
753 B=\begin{pmatrix}0&0\\1&0\end{pmatrix},\qquad
754 Q=\begin{pmatrix}1&1\end{pmatrix},\qquad v=\binom11.
755 \]
756 Both fixed systems have output sequence $2,1,0,0,\ldots$ from $v$, since $A^2=B^2=0$. But applying $A$ first and $B$ second gives $QBAv=1$, not zero. That hybrid trajectory belongs to neither candidate model. Treating fixed uncertainty as a freely changing matrix would incorrectly reject the valid output prediction.
757 \end{counterexample}
758
759 Here $I_Q=\Span\{(1,1)\}$, obtained already from the one-step equality. It is not invariant under $A$ or $B$: $Av=(1,0)$ and $Bv=(0,1)$ leave that line. Those new physical vectors cannot be treated as fresh initial conditions with a forgotten model history. For example, starting both models at $(1,0)$ gives different next outputs. The original fixed-model executions nevertheless remain in output agreement.
760
761 This is why the identifiable initial set is not automatically a common physical invariant core. A reference predictor may still work: it follows $A$ from the initial vector and reports its outputs. It represents the common response sequence, not a claim that the unknown physical state always equals the reference state.
762
763 \begin{figure}[tbp]\centering
764 \includegraphics[width=.95\linewidth]{figures/fixed_model_outputs.pdf}
765 \caption{Two fixed candidate systems produce the same complete output history from $(1,1)$ even though their hidden states differ. Switching from one candidate to the other after the first step creates an inadmissible history with a different second output. The fixed-model tag is information about the allowed trajectories.}\label{fig:fixedmodels}
766 \end{figure}
767
768 \subsection{More data restricts the model family, not the logical quantifier}
769 If new exact evidence removes candidates while preserving the reference model, the intersection defining $I_Q$ can only enlarge. Its practical value depends on whether the learner can justify that removal and initialize the resulting predictor. Adding a new candidate has the opposite effect. Neither operation warrants replacing the model label at each step. A candidate family that omits the true system can still yield an impressive but inapplicable agreement subspace.
770
771 \section{When uncertain dynamics admit one common observable quotient}\label{sec:commonquotient}
772 Agreement on selected initial conditions is weaker than agreement on the whole space. The stronger problem has a useful exact solution. Retain the finite family and reference matrices of Section~\ref{sec:pairtest}, and define the difference maps
773 \[
774 D_a^\theta=T_a^\theta-A_a.
775 \]
776 Their ranges contain all possible one-step discrepancies. Let
777 \[
778 E_0=\sum_{a,\theta}\im D_a^\theta,\qquad
779 E_{j+1}=E_j+\sum_a A_aE_j,\qquad E_\infty=\bigcup_jE_j.
780 \]
781 This increasing sequence stabilizes after at most $n$ strict dimension increases. Its limit is the smallest subspace invariant under all reference actions and containing every discrepancy range. It includes discrepancies that are invisible now but return to the output later.
782
783 \begin{theorem}[Exact common quotient for structured model uncertainty]\label{thm:commonquotient}
784 The following conditions are equivalent.
785 \begin{enumerate}
786 \item $QT_w^\theta=QA_w$ on all of $V$, for every fixed model $\theta$ and every word $w$.
787 \item $E_\infty\subseteq\ker Q$.
788 \item There exists a subspace $N\subseteq\ker Q$, invariant under every $A_a$, containing every $\im D_a^\theta$.
789 \item There is a surjective linear representation $r:V\to Z$, shared linear updates $G_a$, and a readout $\bar Q$ such that
790 \[
791 rT_a^\theta=G_ar\quad\text{for all }a,\theta,\qquad Q=\bar Qr.
792 \]
793 \end{enumerate}
794 When the conditions hold, $V/E_\infty$ gives one such quotient. The smallest-dimensional common linear quotient is $V/N_0$, where $N_0=\bigcap_w\ker(QA_w)$ is the reference system's unobservable subspace. Its dimension is $n-\dim N_0$. The shared quotient also preserves outputs if the candidate model is changed between actions, a stronger conclusion than fixed-model agreement on a restricted initial set.
795 \end{theorem}
796 \begin{proof}
797 Assume condition 1. For any $a,\theta,w$, agreement as linear maps on all of $V$ gives
798 \[
799 QA_wD_a^\theta
800 =QT_w^\theta T_a^\theta-QA_wA_a=0.
801 \]
802 The last equality is condition 1 for the word that executes $a$ and then $w$. Thus $Q$ annihilates the range of every $A_wD_a^\theta$, whose span is $E_\infty$, proving condition 2. Condition 2 supplies condition 3 with $N=E_\infty$.
803
804 Under condition 3, $T_a^\theta N\subseteq N$ because $T_a^\theta=A_a+D_a^\theta$, $A_aN\subseteq N$, and the entire range of $D_a^\theta$ lies in $N$. Every candidate therefore induces the same map $G_a([v])=[A_av]$ on $V/N$. Since $QN=0$, the output factors through that quotient. This proves condition 4. Composing its commuting equations proves condition 1. The same composition works with a different model index at each action because $r$ and $G_a$ are shared.
805
806 The subspace $N_0$ is invariant under every $A_a$ and lies in $\ker Q$. Every invariant subspace in $\ker Q$, including $E_\infty$ when condition 2 holds, lies in $N_0$. Hence $N_0$ gives a valid common quotient. Conversely, the kernel of any representation in condition 4 is invariant under the reference actions and contained in $\ker Q$, so it lies in $N_0$. Rank-nullity gives the lower bound $\dim Z\ge n-\dim N_0$, attained by $V/N_0$.
807 \end{proof}
808
809 \subsection{Large hidden variation with exact visible behavior}
810 For a structured example over $\mathbb Q$, take either of the fixed maps
811 \[
812 T_0=\begin{pmatrix}1&1&0\\0&1&0\\0&0&0\end{pmatrix},\qquad
813 T_1=\begin{pmatrix}1&1&0\\0&1&0\\2&-1&3\end{pmatrix},\qquad
814 Q=\begin{pmatrix}1&0&0\end{pmatrix}.
815 \]
816 The hidden third-coordinate dynamics are different, and $T_1$ can make that coordinate grow. Nevertheless the discrepancy range is $\Span\{e_3\}$, which the reference leaves inside itself and $Q$ annihilates. The common quotient retains $(x_1,x_2)$, with update
817 \[
818 G(x_1,x_2)=(x_1+x_2,x_2).
819 \]
820 The output at step $k$ is $x_1+kx_2$ under both models, and even under switching between them. The output alone is not an initialized reusable state: equal $x_1$ with different $x_2$ gives different next outputs. Ignoring $x_3$ is justified by the no-return structure, not by its small size or its being temporarily unobserved.
821
822 \begin{counterexample}[An invisible difference returns one step later]\label{ce:hiddenreturn}
823 Let
824 \[
825 A=\begin{pmatrix}0&1\\0&0\end{pmatrix},\qquad
826 D=\begin{pmatrix}0&0\\1&0\end{pmatrix},\qquad Q=\begin{pmatrix}1&0\end{pmatrix}.
827 \]
828 The candidates are $A$ and $A+D$. Since $QD=0$, every one-step output agrees for every input. But $QAD=(1,0)\ne0$. Starting at $e_1$, the second outputs are zero and one. The initial discrepancy range is invisible, while its propagated span $E_\infty=V$ is not. Checking only $QD=0$ misses the failure.
829 \end{counterexample}
830
831 \begin{figure}[tbp]\centering
832 \includegraphics[width=.95\linewidth]{figures/hidden_uncertainty.pdf}
833 \caption{Structured uncertainty may be harmless when every difference remains in an invariant, output-invisible subspace. The opposite example has zero first-step output discrepancy but a visible second-step return. The figure represents exact algebraic alternatives, not a claim that small learned residuals certify the invariant subspace.}\label{fig:hiddenuncertainty}
834 \end{figure}
835
836 \subsection{What the criterion does not learn}
837 The family $\{T_a^\theta\}$, its shared carrier, and $Q$ are given. The closure in the discrepancy-span recursion uses exact linear algebra and decides whether those models share the stated quotient. It neither discovers the model class from finite observations nor proves that the true mechanism belongs to it. A structural prior such as an invariant hidden block can justify a smaller uncertainty family, but that prior must be carried as evidence or an explicit assumption.
838
839 \section{Initializing the smallest common linear predictor}\label{sec:linearpredictor}
840 The paired-state criterion supplies a domain of identifiable output behavior. A learner may still lack the information needed to select the correct behavior within that domain. We now combine the two obligations without requiring the identifiable initial subspace to be physically invariant.
841
842 Let $L\subseteq I_Q$ be a specified linear initial-condition subspace and let the available initial record be a linear map $R:L\to H$. Define the reference reachable span and its unobservable part by
843 \[
844 W=\Span\{A_wv:v\in L,\ w\text{ any word}\},\qquad
845 N=\{z\in W:QA_wz=0\text{ for every word }w\}.
846 \]
847 Both $W$ and $N$ are invariant under the reference actions, and $N\subseteq\ker Q$. These spaces can be computed by finite reachable-span and row-kernel iterations. They concern a reference predictor, not a claim that every physical candidate remains inside $W$.
848
849 \begin{theorem}[Evidence-initialized minimal common linear prediction]\label{thm:linearpredictor}
850 There is a finite-dimensional linear predictor with initialization $d:R(L)\to Z$, updates $G_a:Z\to Z$, and readout $\bar Q:Z\to Y$ satisfying
851 \[
852 \bar QG_wdR(v)=QT_w^\theta v
853 \quad\text{for every }v\in L,\theta\in\Theta,w
854 \]
855 if and only if $\ker R\subseteq N$. When it exists, the smallest possible state-space dimension among such \emph{linear} predictors is
856 \[
857 \dim W-\dim N.
858 \]
859 The quotient $W/N$, initialized by $d(Rv)=[v]$, attains that minimum.
860 \end{theorem}
861 \begin{proof}
862 If $v\in\ker R$, linear initialization gives the same state as input zero. Exactness therefore requires $QA_wv=0$ for every word, so $v\in N$. Conversely, if $\ker R\subseteq N$, the rule $d(Rv)=[v]$ is well defined and linear. Invariance supplies $G_a([z])=[A_az]$, and $QN=0$ supplies $\bar Q([z])=Qz$. Their iteration gives $QA_wv$, which agrees with every candidate by $L\subseteq I_Q$.
863
864 For minimality, let any competing linear predictor be given. Its reachable span is generated by vectors $G_wdR(v)$. Associate such a vector with $[A_wv]\in W/N$ and extend by linearity. To see this association is well defined, suppose a finite linear combination of the predictor vectors is zero. Applying any later word and the predictor readout shows that the matching combination of reference vectors has zero $QA_u$ output for every $u$. That combination therefore belongs to $N$. The induced map from the competitor's reachable span onto $W/N$ is a well-defined linear surjection, since the classes of $A_wv$ span $W/N$. Its dimension cannot be smaller than the displayed quotient dimension. The constructed quotient attains equality.
865 \end{proof}
866
867 The dimension statement is a linear-realization theorem in a declared algebraic model, not a lower bound for arbitrary nonlinear encodings, unbounded-precision tricks, or shortest source programs. Reachability and observability are classical tools~\cite{petreczky}. The distinctive conjunction here is compatibility across the retained models, initialization from the actual record, and the smallest common linear predictor.
868
869 \subsection{Initial dimension, dynamic memory, and hidden state}
870 In Counterexample~\ref{ce:switching}, set $L=\Span\{(1,1)\}$ and $R(x)=x_1$. The reference reaches $(1,1)$ and $(1,0)$, so $W=\mathbb Q^2$. The rows $Q=(1,1)$ and $QA=(0,1)$ have trivial common kernel, giving $N=0$. A two-dimensional linear predictor is therefore necessary even for this one-dimensional initial family: it must reproduce $2t,t,0,0,\ldots$ for every multiplier $t$.
871
872 For the three-coordinate structured example, $L=V$, $W=V$, and $N=\Span\{e_3\}$. Two predictor coordinates suffice. The record $(x_1,x_2)$ initializes them; $x_1$ alone does not, since its kernel contains $e_2$, which becomes visible after one action. Physical dimension, initial-family dimension, and minimum predictive dimension are different quantities.
873
874 \FloatBarrier\clearpage
875 \part{Quantitative grounding with finite retained memory}
876 \section{From exact probability coordinates to a finite record}\label{sec:quantized}
877 The likelihood-profile theorem identifies what an exact statistical memory must retain. It does not make its probability coordinates finitely representable. A rational posterior can acquire larger denominators after each update. Rounding those coordinates changes the object, so a finite-record theory needs a stated error, horizon, and observation model.
878
879 We now give one such theory. The result deliberately uses a conservative positive-likelihood condition rather than claiming uniform stability for every observation process. Stability and numerical approximation of nonlinear filters have an established literature~\cite{legland}. Our construction concerns a static hidden world, a finite cell record, and an explicit finite-horizon error account. It is not a particle-filter theorem and does not inherit a contraction hypothesis from that literature.
880
881 \subsection{A concrete probability record}
882 For an integer $k\ge1$, write $\Delta_k$ for the probability simplex on $k$ cells. Fix a denominator $N\ge1$. A retained record has the form
883 \[
884 \widehat p=(n_1/N,\ldots,n_k/N),\qquad n_i\in\{0,\ldots,N\},\quad \sum_i n_i=N.
885 \]
886 The cell identities, denominator, and decoding rule are fixed background. The $k$ integer fields can be stored literally in $k\lceil\log_2(N+1)\rceil$ bits. This is an upper bound for this specified encoding, not a minimum description length. It excludes the likelihood table, program, temporary arithmetic, and any retained raw observation history.
887
888 Define $\mathcal Q_N(p)$ by first setting $n_i=\lfloor Np_i\rfloor$. Distribute the remaining $N-\sum_i n_i$ units to the largest fractional remainders, with ties broken by a fixed cell order. This makes the normalization exact after every rounding. It is not independent coordinate rounding followed by an unspecified repair.
889
890 For a likelihood vector $\ell=(\ell_i)$ define the Bayes map
891 \[
892 \mathcal B_\ell(p)_i=\frac{p_i\ell_i}{\sum_jp_j\ell_j}
893 \]
894 whenever its denominator is positive.
895
896 \begin{proposition}[Rounding and positive-likelihood update bounds]\label{prop:roundbayes}
897 For every $p\in\Delta_k$,
898 \[
899 \TV(p,\mathcal Q_N(p))\le\frac{k}{2N}.
900 \]
901 Let $p,q\in\Delta_k$, let $0<\beta\le1$, and let every entry of $\ell$ and $\widetilde\ell$ lie in $[\beta,1]$. If $\max_i|\ell_i-\widetilde\ell_i|\le\varepsilon$, then
902 \[
903 \TV\bigl(\mathcal B_\ell(p),\mathcal B_{\widetilde\ell}(q)\bigr)
904 \le \frac{\TV(p,q)+\varepsilon}{\beta}.
905 \]
906 Each right-hand side may also be replaced by its minimum with one. The probability-field storage bound above applies to the retained rounded record, not to all working memory.
907 \end{proposition}
908 \begin{proof}
909 The remainder rule produces nonnegative integers summing to $N$. Each rounded coordinate differs from the original by at most $1/N$, so half the sum of absolute differences is at most $k/(2N)$.
910
911 For the update, first hold $\ell$ fixed. Given $0\le f_i\le1$, put $a=\sum_i\mathcal B_\ell(q)_if_i$ and $Z_p=\sum_ip_i\ell_i$. Then
912 \[
913 \sum_i\bigl(\mathcal B_\ell(p)_i-\mathcal B_\ell(q)_i\bigr)f_i
914 =\frac{\sum_i(p_i-q_i)\ell_i(f_i-a)}{Z_p}.
915 \]
916 Every value $\ell_i(f_i-a)$ lies in $[-a,1-a]$, an interval of length one. Since $p-q$ has total mass zero, its pairing with a function of oscillation at most one is bounded in absolute value by $\TV(p,q)$. Also $Z_p\ge\beta$. Taking the supremum over $f$ bounds the fixed-likelihood difference by $\TV(p,q)/\beta$.
917
918 Next hold $q$ fixed and set $a=\sum_i\mathcal B_{\widetilde\ell}(q)_if_i$. The corresponding numerator is $\sum_iq_i(\ell_i-\widetilde\ell_i)(f_i-a)$, whose absolute value is at most $\varepsilon$. Its denominator is at least $\beta$. A triangle inequality proves the displayed update bound. The cap by one is the universal range of total variation. The storage assertion counts the stated integer fields only.
919 \end{proof}
920
921 The estimate is sufficient and can be loose. In particular, it need not credit favorable observations that reduce an existing error. Its purpose is a guarantee whose entire cost and probability assumptions are visible, not an assertion that rounding usually produces its worst possible error.
922
923 \subsection{Approximate likelihood profiles}
924 Let $\Omega$ be a finite static world set with prior $\mu_0$. A fixed partition $C_1,\ldots,C_k$ refines the target: $t(\omega)=t_i$ throughout $C_i$. Each admitted experiment $e$ is nondestructive and has a finite report alphabet. Its actual conditional probabilities are $\ell_{e,o}(\omega)$. Reports are freshly generated from those likelihoods conditional on the fixed world and the chosen experiments.
925
926 Choose one valid representative report law $\bar\ell_{e,o,i}$ per cell. Assume, for every admitted experiment, report, cell, and world in that cell,
927 \[
928 \beta\le \ell_{e,o}(\omega),\bar\ell_{e,o,i}\le1,
929 \qquad |\ell_{e,o}(\omega)-\bar\ell_{e,o,i}|\le\varepsilon. \tag{10}
930 \]
931 Both the actual and representative report laws sum to one over reports. Exact profile cells satisfy this condition with $\varepsilon=0$ when their likelihoods have the positive floor. A coarser partition can be used with a nonzero $\varepsilon$, but target-constant cells are still required for the target readout.
932
933 After a history, let $p_t$ be the cell masses of the exact world posterior. Initialize the retained record by $\widehat p_0=\mathcal Q_N(p_0)$. For the next selected experiment and observed report use
934 \[
935 \widehat p_{t+1}=\mathcal Q_N\!\left(\mathcal B_{\bar\ell_{e,o}}(\widehat p_t)\right).
936 \]
937 The reference posterior and rounded record are compared along the same actual action/report history. Experiment selection may depend on earlier retained records and independent randomness. It may not introduce a hidden world-dependent selector whose information is omitted from that history. The likelihood condition applies to every experiment the policy can select.
938
939 \begin{theorem}[Finite retained memory for a declared correction horizon]\label{thm:finiteprecision}
940 Under (10), set $\eta_N=k/(2N)$, $\gamma=\beta^{-1}$, and let $e_0$ be any valid bound on $\TV(p_0,\widehat p_0)$. For every possible action/report history of length $t$,
941 \[
942 \TV(p_t,\widehat p_t)\le e_t
943 :=\min\!\left\{1,\ \gamma^t e_0+(\gamma\varepsilon+\eta_N)
944 \sum_{j=0}^{t-1}\gamma^j\right\}. \tag{11}
945 \]
946 The same bound holds after mapping cells to target values. With the generic initialization bound $e_0\le\eta_N$, define
947 \[
948 A_H=\sum_{j=0}^{H}\gamma^j,\qquad
949 B_H=\gamma\sum_{j=0}^{H-1}\gamma^j.
950 \]
951 For any horizon $H\ge0$ and tolerance $\tau>\varepsilon B_H$, every integer
952 \[
953 N\ge \max\!\left\{1,\left\lceil
954 \frac{kA_H}{2(\tau-\varepsilon B_H)}\right\rceil\right\} \tag{12}
955 \]
956 is sufficient for target and cell error at most $\tau$ at every time through $H$. Empty sums are zero. This is a finite-horizon retained-record guarantee, not an unbounded-time or total-computation guarantee.
957 \end{theorem}
958 \begin{proof}
959 Condition on a particular attainable history and its next experiment. In each positive-mass cell, the exact next likelihood is the conditional average of $\ell_{e,o}(\omega)$ within that cell. It remains in $[\beta,1]$ and within $\varepsilon$ of $\bar\ell_{e,o,i}$. For a zero-mass cell any value obeying these bounds gives the same zero contribution. Thus the exact next cell mass is a Bayes update with such an effective likelihood vector, even when the worlds within a cell do not have identical laws.
960
961 Proposition~\ref{prop:roundbayes} and the rounding bound give
962 \[
963 \TV(p_{t+1},\widehat p_{t+1})
964 \le\gamma\TV(p_t,\widehat p_t)+\gamma\varepsilon+\eta_N.
965 \]
966 Iterating the uncapped scalar bound proves (11); total variation is also at most one. Aggregating cell coordinates into target coordinates cannot increase total variation, by the triangle inequality. Substituting $e_0\le\eta_N$ gives $\eta_N A_t+\varepsilon B_t$. These quantities are nondecreasing in $t$ because $\gamma\ge1$ and all terms are nonnegative. Inequality (12) makes the horizon-$H$ value at most $\tau$. It therefore suffices at every earlier step as well. Every report has positive probability under both updates by the floor assumption, so no zero denominator is silently normalized.
967 \end{proof}
968
969 Equation (12) is a sufficient precision requirement, not an exact minimum. An infeasible or large bound does not prove that the particular rounded filter is inaccurate. It means that this uniform certificate is insufficient. Conversely, increasing precision cannot eliminate the model term $\varepsilon B_H$. A false likelihood model does not become correct because its probabilities are stored with more bits.
970
971 \begin{counterexample}[A tiny rounded-away mass can control a later posterior]\label{ce:rareprecision}
972 Take two worlds with prior $(1-d,d)$, where $0<d<1/(2N)$. The remainder rule gives the retained record $(1,0)$. A binary report has likelihoods $(d^2,1)$ for outcome one. After that outcome, the actual posterior mass of the second world is
973 \[
974 \frac{d}{d+(1-d)d^2}=\frac{1}{1+d-d^2},
975 \]
976 which tends to one as $d$ tends to zero. The rounded posterior remains zero on that world. The initial total-variation error is only $d$. There is no common positive likelihood floor across this family: the first likelihood tends to zero, and the other report is impossible in the second world. No nontrivial uniform continuation conclusion follows from the small initial rounding error alone.
977 \end{counterexample}
978
979 The counterexample concerns evidence amplification, not a failure of the remainder arithmetic. Replacing the likelihood one by $1-d^2$ makes both outcomes possible in both worlds while preserving the limiting phenomenon. The minimum likelihood still tends to zero. Exact support, approximate probability, and justified abstention should therefore remain distinct data.
980
981 \begin{figure}[tbp]\centering
982 \includegraphics[width=.93\linewidth]{figures/finite_memory_horizon.pdf}
983 \caption{The noisy sensor with four retained cell masses, three future reports, and several denominator choices. The actual maximum error is enumerated over all eight three-report histories and their prefixes. The upper curve is the uniform positive-likelihood bound using generic rounded initialization. The gap is conservatism, not evidence of an uncounted learning gain. The installed likelihoods are exact; retained-record size does not count the program or temporary arithmetic.}\label{fig:finiteprecision}
984 \end{figure}
985
986 \section{Approximate invisibility must survive feedback}\label{sec:blockleakage}
987 The exact common-quotient theorem allows arbitrarily large hidden dynamics when those directions never return to the selected output. Approximation changes that fact. A small hidden-to-visible coupling can make hidden growth consequential. This section states the relevant dependence explicitly rather than replacing exact invariance by a small residual with no continuation bound.
988
989 Approximate simulation and bisimulation offer established ways to compare observable behavior with a declared precision~\cite{girard}. The following is a narrower block comparison argument for discrete linear operations. It does not claim that its matrix bound is a minimal simulation metric or that stability of every candidate separately supplies a common switching bound.
990
991 Write the physical state as $(v_t,h_t)$ in a direct sum of two finite-dimensional normed spaces. The required output is the visible component $v_t$. Along an admitted execution suppose
992 \[
993 \begin{pmatrix}v_{t+1}\\h_{t+1}\end{pmatrix}
994 =\begin{pmatrix}G_t&B_t\\C_t&H_t\end{pmatrix}
995 \begin{pmatrix}v_t\\h_t\end{pmatrix},
996 \qquad \bar v_{t+1}=G_t\bar v_t. \tag{13}
997 \]
998 The reduced predictor knows the chosen $G_t$ and receives the same action sequence. It does not observe $h_t$. The blocks may come from a fixed unknown candidate or from an explicitly admitted varying family. Assume common operator-norm bounds
999 \[
1000 \|G_t\|\le g,\quad \|B_t\|\le b,\quad
1001 \|C_t\|\le c,\quad \|H_t\|\le d,
1002 \qquad g,b,c,d\ge0.
1003 \]
1004 Let $\|v_0\|\le V_0$, $\|h_0\|\le H_0$, and $\|v_0-\bar v_0\|\le e_0$. These initial bounds are supplied evidence or declared model assumptions. Put
1005 \[
1006 M=\begin{pmatrix}g&b\\c&d\end{pmatrix},\qquad
1007 u_0=\begin{pmatrix}V_0\\H_0\end{pmatrix},\qquad u_j=M^ju_0.
1008 \]
1009 Powers of this nonnegative comparison matrix are bounds on norms. They are not a replacement physical dynamics inferred from measurements.
1010
1011 \begin{theorem}[Visible-error bounds from a common block comparison]\label{thm:blockleakage}
1012 Every admitted execution satisfying (13) obeys
1013 \[
1014 \|v_t-\bar v_t\|\le d_t
1015 :=g^te_0+b\sum_{j=0}^{t-1}g^{t-1-j}(u_j)_2. \tag{14}
1016 \]
1017 In particular, when $b=0$ and $e_0=0$, the visible prediction is exact for every finite time, without a stability requirement on $d$ or $c$.
1018
1019 If $g<1$, $d<1$, and
1020 \[
1021 D=(1-g)(1-d)-bc>0,
1022 \]
1023 then the total visible discrepancy is bounded by
1024 \[
1025 \sum_{t=0}^{\infty}\|v_t-\bar v_t\|
1026 \le \frac{e_0}{1-g}
1027 +\frac{b\bigl(cV_0+(1-g)H_0\bigr)}{(1-g)D}. \tag{15}
1028 \]
1029 These are sufficient common bounds. Failure of the inequality for $D$ is not a proof that a particular signed system is unstable. Conversely, the two diagonal conditions alone are insufficient for a uniform conclusion over the stated block class.
1030 \end{theorem}
1031 \begin{proof}
1032 The norm triangle inequality and the common block bounds give
1033 \[
1034 \begin{pmatrix}\|v_{t+1}\|\\\|h_{t+1}\|\end{pmatrix}
1035 \le M\begin{pmatrix}\|v_t\|\\\|h_t\|\end{pmatrix}
1036 \le M^{t+1}u_0
1037 \]
1038 componentwise. The error satisfies
1039 \[
1040 v_{t+1}-\bar v_{t+1}=G_t(v_t-\bar v_t)+B_th_t.
1041 \]
1042 Induction gives (14), including its empty sum at $t=0$. If $b=0$ and the initial error is zero, the recurrence has no forcing term and remains zero, regardless of hidden growth.
1043
1044 Under the three strict inequalities, $(I-M)^{-1}=D^{-1}\begin{pmatrix}1-d&b\\c&1-g\end{pmatrix}$ has nonnegative entries. Let $a=(I-M)^{-1}(1,1)^T$. Both coordinates are positive and $Ma=a-(1,1)^T<a$. Hence $M$ is a strict contraction in the weighted maximum norm with weights $a$, and its geometric series converges to $(I-M)^{-1}$. Summing the nonnegative right-hand side of (14) gives
1045 \[
1046 \frac{e_0}{1-g}+\frac{b}{1-g}\sum_{j\ge0}(M^ju_0)_2.
1047 \]
1048 The second coordinate of $(I-M)^{-1}u_0$ is $(cV_0+(1-g)H_0)/D$, proving (15). The common comparison applies at each step and therefore also covers switching when that switching is explicitly allowed by the contract. It need not cover a family supplied only with unrelated per-model stability certificates.
1049 \end{proof}
1050
1051 The result connects exact and approximate abstraction without collapsing them. Exact no-return can protect an output even when the hidden coordinate grows rapidly. With nonzero return, hidden growth and two-way feedback enter the error account. A small $b$ is useful only in relation to the horizon, the initial hidden bound, and the other blocks.
1052
1053 \begin{counterexample}[An arbitrarily small return channel exposes an unstable hidden mode]\label{ce:observableleak}
1054 Let $v_0=\bar v_0=0$, $h_0=1$, and use scalar blocks $G=1/2$, $B=\delta>0$, $C=0$, $H=2$. The reduced output remains zero, while
1055 \[
1056 v_t=\delta\sum_{j=0}^{t-1}(1/2)^{t-1-j}2^j
1057 =\frac{\delta(2^t-2^{-t})}{3/2}.
1058 \]
1059 The first error is $\delta$, yet the later error is unbounded for every fixed positive $\delta$. At $\delta=0$, every output is exactly zero. Thus a tiny positive coupling is not uniformly equivalent to exact no-return on an unbounded horizon.
1060 \end{counterexample}
1061
1062 \begin{counterexample}[Stable diagonal blocks can have unstable feedback]\label{ce:feedbackgain}
1063 Take scalar blocks $G=H=1/2$ and $B=C=3/4$. Both diagonal subsystems are contractions. The full matrix sends $(1,1)$ to $(5/4)(1,1)$ and consequently grows on that direction. Here $D=1/4-9/16<0$. A certificate that checks only the two diagonal bounds misses the feedback loop.
1064 \end{counterexample}
1065
1066 \begin{figure}[tbp]\centering
1067 \includegraphics[width=.93\linewidth]{figures/observable_leakage.pdf}
1068 \caption{Exact scalar output discrepancies with the same small return coupling $1/64$ and visible multiplier $1/2$. The stable hidden multiplier $1/2$ gives $t2^{-(t-1)}/64$; the hidden multiplier $2$ gives increasing error. The vertical axis is logarithmic. At exactly zero return coupling, the discrepancy is zero at every time in both cases and is not plotted on the log scale. These are explicit linear models, not neural activation traces.}\label{fig:visibleleakage}
1069 \end{figure}
1070
1071 \section{One justified decision from memory and dynamics}\label{sec:jointquant}
1072 A probability-memory error and an output error concern different objects. The former is a distance between distributions on retained cells. The latter is a distance between a candidate response and its surrogate. They cannot be added without a loss function connecting both to the same decision.
1073
1074 Fix an actual evidence history. Let $\mu$ be the exact posterior on the stipulated finite world set and let $p_i=\mu(C_i)$. Suppose the retained distribution is $\widehat p$ with $\TV(p,\widehat p)\le e$. For a declared later action word or response horizon, let $y(\omega)$ be the actual model response and let $\bar y_i$ be the response used for cell $i$. Assume
1075 \[
1076 \sup_{\omega\in C_i}\|y(\omega)-\bar y_i\|\le d
1077 \quad\text{for every cell }i. \tag{16}
1078 \]
1079 The cell need not identify the physical state or candidate operator. It must support this common response allowance. A block bound such as (14) can supply it when the initial records, common visible updates, and hidden-state bounds match that cell.
1080
1081 Let the permitted decision set $\mathcal D$ be finite and nonempty. Its loss $L(y,a)$ takes values in $[0,1]$ and is $K$-Lipschitz in $y$, uniformly over $a$. Define
1082 \[
1083 R(a)=\sum_{\omega}\mu(\omega)L(y(\omega),a),\qquad
1084 \widehat R(a)=\sum_i\widehat p_iL(\bar y_i,a).
1085 \]
1086 These are risks under the stated model posterior. They are not frequentist coverage probabilities or guarantees on the loss of a single realized world.
1087
1088 \begin{theorem}[A common quantitative grounding certificate]\label{thm:jointrisk}
1089 Under (16), put $\xi=\min\{1,e+Kd\}$. Then
1090 \[
1091 |R(a)-\widehat R(a)|\le\xi\quad\text{for every }a\in\mathcal D.
1092 \]
1093 If $\widehat a$ minimizes $\widehat R$, its true posterior regret is at most $2\xi$. If it is the unique approximate minimizer and
1094 \[
1095 \widehat R(a)-\widehat R(\widehat a)>2\xi\quad\text{for every }a\ne\widehat a,
1096 \]
1097 then it is the unique true minimizer. A decision issued only when $\widehat R(a)+\xi\le\tau$ has true posterior risk at most the declared threshold $\tau$.
1098
1099 The conclusion can combine (11) and (14) only when they refer to the same history, cell meanings, future action word, initialization, and admitted candidate family. No guarantee that the true external process belongs to that family is supplied by this composition.
1100 \end{theorem}
1101 \begin{proof}
1102 Insert the intermediate risk $\sum_ip_iL(\bar y_i,a)$. Its difference from $R(a)$ is at most $Kd$ by (16), the Lipschitz condition, and summing posterior masses. Its difference from $\widehat R(a)$ is at most $e$ because the function $i\mapsto L(\bar y_i,a)$ lies in $[0,1]$. A triangle inequality gives $e+Kd$; both risks also lie in $[0,1]$.
1103
1104 Let $a_*$ minimize $R$. Then
1105 \[
1106 R(\widehat a)\le\widehat R(\widehat a)+\xi
1107 \le\widehat R(a_*)+\xi\le R(a_*)+2\xi.
1108 \]
1109 For any other decision, the approximate gap loses at most $2\xi$ when the two risks are replaced by their true values, proving the strict-gap assertion. The threshold assertion is the upper risk bound itself. Each step uses the same posterior and surrogate responses, which is why separately valid certificates about different histories or targets cannot be substituted.
1110 \end{proof}
1111
1112 This is a bounded-loss composition of two error accounts, not a newly derived general decision principle. Related recipient-relative bounds appear in \emph{Machine Understanding}~\cite{understanding}. The additional content here is the instantiated chain from a finite retained probability record and a separately controlled hidden-return error to one declared decision.
1113
1114 \subsection{A complete sensor-to-predictor example}
1115 Use the eight worlds $(s,\theta,n)\in\{0,1\}^3$. The four joint $(s,\theta)$ masses in the order $(0,0),(0,1),(1,0),(1,1)$ are initially
1116 \[
1117 p_0=(3,1,1,3)/8,
1118 \]
1119 and $n$ is conditionally uniform. A noisy nondestructive reference has probability $1/4$ of report one under $\theta=0$ and $3/4$ under $\theta=1$. It does not depend on $n$. After three fresh reports all equal to one, the exact target probability is $\Pr(s=1\mid111)=41/56$.
1120
1121 The learner retains the four masses using $N=65\,536$ and the stated remainder rule after each update. There are 68 literal probability-field bits because each of the four counts includes values through $65\,536$. The initial masses are exactly representable, so $e_0=0$. With $\beta=1/4$, $\varepsilon=0$, and three observations, (11) gives the sharper bound
1122 \[
1123 e_3\le\frac{1+4+16}{32\,768}=\frac{21}{32\,768}.
1124 \]
1125 This uses the actual initialization, not the larger generic bound in (12).
1126
1127 The later response is produced by three applications of one fixed candidate matrix,
1128 \[
1129 T_n=\begin{pmatrix}1/2&(-1)^n/64\\1/8&1/2\end{pmatrix},
1130 \qquad (v_0,h_0)=(s,1).
1131 \tag{17}
1132 \]
1133 The predictor for cell $(s,\theta)$ uses $\bar v_t=2^{-t}s$ and therefore reports $\bar y_i=s/8$. The nuisance bit $n$ affects the physical response but remains unidentified by the reference observations. With $g=d=1/2$, $b=1/64$, $c=1/8$, and $V_0=H_0=1$, the comparison determinant is $127/512>0$. Directly evaluating (14) at three prediction steps yields
1134 \[
1135 d_3=\frac{481}{32\,768}.
1136 \]
1137 Choose between numerical predictions $a=0$ and $a=1/8$, with loss $L(y,a)=\min\{1,|y-a|\}$. It is bounded and 1-Lipschitz. The common radius is consequently
1138 \[
1139 \xi=\frac{21+481}{32\,768}=\frac{251}{16\,384}.
1140 \]
1141 The exact companion computes the actual retained masses, approximate risks, both true risks, and their comparison. It verifies that the retained predictor selects $a=1/8$, that its approximate advantage exceeds $2\xi$, and that $\widehat R(1/8)+\xi<3/50$. Thus the same finite construction supports a unique posterior-optimal decision and a posterior-risk threshold of $0.06$ under the supplied model. The complete prior, sensor laws, candidate matrices, bit record, and loss function all belong to this one example.
1142
1143 \begin{center}\small
1144 \begin{tabularx}{\textwidth}{@{}lXX@{}}\toprule
1145 Decision & Retained-record risk & Exact model-posterior risk\\\midrule
1146 $a=0$ & $23991/262144\ \approx0.09152$ & $173737/1835008\ \approx0.09468$\\
1147 $a=1/8$ & $8777/262144\ \approx0.03348$ & $81105/1835008\ \approx0.04420$\\\bottomrule
1148 \end{tabularx}
1149 \end{center}
1150 The certified upper risk for the selected decision is $12793/262144\approx0.04880$, below $3/50$. The actual cell-mass error is $1/114688$, smaller than its uniform allowance. The risk certificate uses the proved allowance, not a substituted post hoc exact error. Exact enumeration is available here only because the example is fully supplied and finite.
1151
1152 The probability coordinates do not encode $n$, and the dynamical allowance does not pretend they do. The result remains approximate precisely where the evidence leaves the physical response unresolved. Reducing the denominator, admitting an observation that depends on $n$, or increasing the hidden return coupling changes a different premise. These revisions require separate responses rather than an undifferentiated instruction to trust the old certificate.
1153
1154
1155 \FloatBarrier\clearpage
1156 \part{A consolidated grounding contract}
1157 \section{A common theoretical contract for grounded revision}\label{sec:integration}
1158 The results do not combine into one universal scalar score. They address different parts of a continuing claim.
1159
1160 An evidence contract says what the observer receives and which worlds remain possible. A predictive contract says what outputs must remain correct after which operations. A correction contract says which relationships between future evidence and target values must remain available. A calibration contract says where an operation is determined, and a quantitative contract controls any approximation and its growth.
1161
1162 A combined statement needs one representation and consistent premises. An unavailable input prevents initialization. An uncalibrated continuation prevents exact prediction. A lost association prevents correction. A narrow confidence set does not establish its own coverage.
1163
1164 \subsection{The complete sensor argument}
1165 The eight-world sensor illustrates the chain without a large implementation. Initially the display and flip operation admit a two-state exact predictor. That predictor is grounded by the current display, even though the physical bit and sensor convention are not separately identified. Adding the physical-bit question refines the needed behavioral state, and the old code fails the initialization condition. A reference measurement repairs the information deficit while leaving the nuisance bit irrelevant.
1166
1167 Before calibration, the records corresponding to the two possible display values have the same marginal physical uncertainty. They must not be merged if later reference evidence is expected to identify the physical bit. The correction-memory theorem identifies the missing association. Resetting supplies convention information only after changing the physical state. Recovering the original state then depends on the retained old record. If that record is gone, the unchanged future interface cannot reconstruct it.
1168
1169 Noise changes the strength of the conclusion. A highly probable physical bit is not an exact state certificate. A quantitative response set can carry the remaining ambiguity into a tolerance, but only under coverage and model-accuracy premises. Every clause refers to the same task and same record history.
1170
1171 \subsection{What this adds to the machine theory}
1172 The framework does not demand that an agent identify every detail of a world before it can reason. It gives restricted positive conditions for doing less. An unidentifiable physical realization can support an identified predictive quotient. An underdetermined operator can support a fully determined invariant domain. A large candidate set can be compressed exactly for future correction without preserving every candidate identity.
1173
1174 The additional discipline is that each reduction is indexed by what it preserves. One cannot transfer the word ``grounded'' from a successful prediction to an unrelated physical interpretation, from an exact model to a learned approximation, or from a present decision to every later correction. Such transfers require new evidence or a proved bridge.
1175
1176 \subsection{Three different reductions should not share one name}
1177 The exact set-valued memory merges worlds only when the selected target and every admitted filter agree. The likelihood-profile memory preserves joint target probabilities and the future statistical correction law. The observable linear quotient suppresses directions that cannot return to the chosen output under its declared model class. They are related examples of operation-compatible reduction, but their carriers, updates, and information requirements are different.
1178
1179 The fixed-model agreement subspace is a fourth object. It describes allowed initial vectors, not necessarily a physical invariant state space. A reference predictor can realize its common outputs even when the hidden candidate trajectories diverge. Forgetting that model history and restarting from a current physical vector can create a different inference problem.
1180
1181 \subsection{What changes when the evidence contract changes}
1182 A new likelihood can split an old probability cell. A new candidate operator can shrink $I_Q$. A new action can propagate a previously invisible discrepancy into the output. A new initial-code restriction can fail to initialize a quotient that still exists mathematically. Each revision therefore needs a named compatibility check. The smallest representation for an old contract is not an entitlement to make new claims without acquiring the missing distinctions.
1183
1184 None of these facts obliges a learner to retain every detail. In the noisy sensor, four joint masses replace an eight-world prior. In the structured linear example, two predictor coordinates replace three physical coordinates. Both savings are exact under their respective contracts. What must be preserved is the relation between the discarded information and the future operations, not discarded information for its own sake.
1185
1186 \subsection{A revision changes specific claims, not every claim at once}
1187 The sensor-to-predictor construction provides one ledger for revision. Its probability cells are indexed by $(s,\theta)$, while the hidden candidate index $n$ is represented only through the response allowance. Each row below describes a change to that same example, not a newly selected favorable model.
1188
1189 \begin{center}\small
1190 \begin{tabularx}{\textwidth}{@{}P{.25\textwidth}YY@{}}\toprule
1191 Revision & What remains justified & What must be re-established\\\midrule
1192 Change only $N$ & The likelihood-profile partition and physical model. & Rounded history, memory error, probability-field size, and the resulting decision margin.\\
1193 Let the reference depend on $n$ & Old predictions under the old reference. & New profile cells and their masses. The old four masses cannot universally supply a split.\\
1194 Admit a larger return coupling & The original observation update when its likelihoods are unchanged. & The future-response allowance and posterior risk. A former threshold may no longer be certified.\\
1195 Retain only the two marginals & The present target and convention distributions. & The association required by later evidence. Equal marginals need not determine an update.\\
1196 Treat a copied report as fresh & The recorded original observation. & The claimed conditional sampling law. Repetition in storage is not another independent measurement.\\
1197 Replace a fixed model by switching & Results explicitly proved for the larger switching class, when their common bounds hold. & A restricted-initial-state fixed-model prediction need not survive this change.\\\bottomrule
1198 \end{tabularx}
1199 \end{center}
1200
1201 A failed old certificate can mean that its premises no longer apply, not that the earlier theorem was false. A valid new risk assessment may conclude that no action meets the requested threshold. Abstention then preserves the stated claim instead of relabeling an uncertain answer as certain. No automatic dependency extraction from arbitrary programs is asserted here.
1202
1203 \section{Open theoretical problems beyond the first edition}\label{sec:open}
1204 The first edition closes a restricted account of evidence, corrective memory, uncertain dynamics, and finite-horizon quantitative use. A complete theorem does not require an implemented general agent. It does require that the assumptions delimit the conclusion rather than merely decorate it.
1205
1206 \paragraph{Sharper approximate observable agreement.} The block bound gives a sufficient norm-based certificate, not an optimal abstraction metric. Cancellation, structured candidate correlations, and action-language restrictions can permit smaller errors than the common nonnegative comparison detects. Characterizing the least attainable error or the smallest approximate state remains a distinct problem.
1207
1208 \paragraph{Economical long-horizon probability memory.} The positive-likelihood estimate can grow rapidly with the horizon. It does not exploit statistical forgetting, contraction, or favorable evidence. Adaptive precision, support-aware safeguards, and stronger model conditions may permit better retained-memory guarantees. Such refinements must preserve the distinction between posterior risk, realized error, and frequentist coverage. The current record-size bound does not bound temporary arithmetic or total runtime.
1209
1210 \paragraph{Restricted operation languages and infinite model families.} The exact linear results admit every action word. An automaton restricting those words changes the observable-equivalence problem and the relevant minimum. Infinite parametric families require a certified finite spanning argument, polynomial identity, or another uniform device. Sampling a few parameter values does not supply that device.
1211
1212 \paragraph{Model admission and state-changing evidence.} Adding candidate worlds requires an explicit allocation of prior probability. A previous posterior does not determine that allocation. Noisy observations that change the hidden state require transition filtering, not only multiplication by a static likelihood. Those extensions need their own correction-memory and approximation theorems.
1213
1214 \paragraph{Learning the premises.} Candidate systems, likelihoods, calibration, and structural bounds remain supplied mathematical data in this edition. Determining them from interaction, proving useful sample and search complexity bounds, and establishing a learned implementation's causal use are further research questions. They are not prerequisites that erase the completed conditional results.
1215
1216 \paragraph{Independent assurance.} Prose proofs, exact finite illustrations, source comparison, and PDF rebuilding provide different forms of internal evidence. They do not establish independent peer review, a proof-kernel certificate, or an externally authenticated run. Those assurance layers can be developed without changing what the present statements assert.
1217
1218 \clearpage
1219 \section{Conclusion}\label{sec:conclusion}
1220 Grounded abstraction relates a target, its possible realizations, accessible evidence, and the future operations a retained state must support. It is neither complete reconstruction by default nor confidence in a convenient coordinate system.
1221
1222 Incomplete knowledge can support exact continuing use. A likelihood-profile record preserves correction while dropping nuisance identity. Different linear systems can share one observable quotient. A reference predictor can reproduce common outputs without matching the unknown physical trajectory, provided the available record can initialize it.
1223
1224 Approximate use needs additional structure. Finite probability fields introduce rounding error at each update. A likelihood allowance and positive floor control its finite-horizon amplification. A hidden coordinate can be arbitrarily unstable when return is exactly absent, yet even a small positive return can become consequential. The common block bound and the rounded-memory bound meet only through a specified loss for one response and one posterior.
1225
1226 The integrated sensor illustrates that conjunction. Its probability record does not recover the hidden candidate, and its predictor does not silently identify the physical state. It nevertheless supports an explicit posterior decision within a certified allowance. Changing the observation law, precision, or return coupling changes a named obligation rather than granting universal reuse of an old certificate.
1227
1228 The first edition therefore supplies a theory of which claims survive what experience leaves unresolved, how a useful memory can preserve later correction, and when a reduced predictor remains justified across continued use. Its unresolved learning and implementation questions are visible applications of that theory, not claims supplied by the word grounded.
1229
1230 \FloatBarrier\clearpage
1231 \appendix
1232 \section{Statement map and source relationships}\label{app:claims}
1233 \begin{small}\begin{longtable}{@{}P{.13\linewidth}P{.44\linewidth}P{.35\linewidth}@{}}\toprule
1234 Result & Mathematical role & Status and boundary\\\midrule\endhead
1235 \ref{prop:law} & Law-level and support-level identification. & Elementary factorization, proved here. No sample-rate claim.\\
1236 \ref{thm:grounding} & One evidence-initialized exact predictive realization. & Classical quotient argument with explicit initialization. Finite declared models.\\
1237 \ref{thm:trichotomy} & Reinterpretation, acquisition, impossibility, and nonadaptive cost. & Exact for total nondestructive finite tests. Destructive tests excluded.\\
1238 \ref{thm:correction} & Coarsest memory preserving every admitted correction. & A powerset behavioral quotient. Evidence family is intersection closed.\\
1239 \ref{cor:occupancy} & Exact memory count for partition evidence. & All candidate subsets and exactly the atom-union evidence algebra. Logical states, not byte-optimal code.\\
1240 \ref{prop:testing} & Finite-record error and information processing. & Classical two-point bound, proved here. Fixed actual protocol.\\
1241 \ref{thm:radius} & Minimax coordinate ambiguity and a coverage certificate. & Unconstrained real-vector center. Coverage and model accuracy are premises.\\
1242 \ref{prop:onestep} & Linear response identifiable exactly on the calibration span. & All linear extensions admissible. Exact inputs and outputs.\\
1243 \ref{thm:core} & Maximal domain of identifiable full-state continuation. & Finite-dimensional common calibration span and fixed extension families.\\
1244 \ref{prop:approx} & Error propagation from a nominal invariant domain. & Local discrepancy plus a separate ambient growth bound.\\
1245 \ref{thm:likelihoodmemory} & Minimal likelihood-profile memory for target correction. & Fixed finite likelihoods, fresh conditional observations, all priors, and report probabilities retained.\\
1246 \ref{cor:memorymigration} & Exact reconstruction after memory-contract change. & Same finite world set and every prior. Restricted prior families can differ.\\
1247 \ref{prop:noenlargement} & Nonzero outputs do not enlarge unrestricted calibration. & All independent linear extensions admitted, fixed during an execution.\\
1248 \ref{thm:pairtest} & Finite fixed-model output agreement and a witness word. & Finite specified matrix family and all operation words.\\
1249 \ref{thm:commonquotient} & Common observable quotient from propagated discrepancy. & Agreement on the whole space, not only a special initial set.\\
1250 \ref{thm:linearpredictor} & Evidence initialization and minimum linear state dimension. & Allowed initial subspace, linear record, linear predictor class.\\
1251 \ref{prop:roundbayes} & Quantized probability fields and one-step Bayes perturbation. & A normalized finite simplex and positive likelihood floor. Retained fields, not total workspace.\\
1252 \ref{thm:finiteprecision} & Finite-horizon correction under rounding and profile error. & Static worlds, common observed history, valid likelihoods, and a specified denominator.\\
1253 \ref{thm:blockleakage} & Visible discrepancy with hidden feedback. & Common norm bounds and initial allowances. Infinite sum needs the strict comparison condition.\\
1254 \ref{thm:jointrisk} & One posterior decision from memory and response bounds. & Same cells, response, history, and bounded Lipschitz loss. No external coverage inferred.\\\bottomrule
1255 \end{longtable}\end{small}
1256
1257 \clearpage
1258 \section{Small exact illustrations and reproduction}\label{app:checks}
1259 Three small exact suites check the declared constructions with integers, sets, rational arithmetic, and $\mathbb F_2$. The retained observable suite compares paired row-space closure with direct word enumeration, tests common-quotient and initialization criteria, and compares likelihood-profile updates with raw-world Bayes updates. It includes explicit switching, hidden-return, zero-probability, and memory-migration controls. The two retained suites are unchanged. The first-edition suite additionally checks quantized probability records, matched adaptive updates, block-error recurrences, and the joint sensor decision. These are bounded implementation checks, not universal proofs or agent experiments.
1260
1261 Run \texttt{python code/run\_checks.py}. The JSON records state each domain and result. Nine Python-generated analytical figures use floating point only for drawing. The supplied Bash build uses their vector assets. Review notes record the actual proof, source, rendering, and clean-rebuild scope. No independent review, complete novelty audit, or proof-assistant certificate is claimed.
1262
1263 \addcontentsline{toc}{section}{References}
1264 \begin{thebibliography}{14}\fontsize{9.5}{11}\selectfont\setlength{\itemsep}{3pt}\setlength{\parskip}{0pt}
1265 \bibitem{understanding} Komorebi P. \emph{Machine Understanding: Representation, Explanation, and Transfer}. First consolidated edition, version 1.0.0, Operation Komorebi, 8 October 2026. Supplied project manuscript and source archive.
1266 \bibitem{selfimproving} Komorebi P. \emph{Self-Improving Intelligence: Representation, Discovery, and Recursive Revision}. First consolidated edition, version 1.0.0, Operation Komorebi, 8 October 2026. Supplied project manuscript and source archive.
1267 \bibitem{resolution} Komorebi P. \emph{Sufficient Resolution}. Standardized traditional paper, Operation Komorebi, 2026. Finite behavioral models, hidden memory, reconstruction, and calibration. Source inspected in the project Library.
1268 \bibitem{rothenberg} T. J. Rothenberg. Identification in parametric models. \emph{Econometrica} 39(3):577--591, 1971. \href{https://www.jstor.org/stable/1913267}{doi:10.2307/1913267}.
1269 \bibitem{psr} M. L. Littman, R. S. Sutton, and S. Singh. Predictive representations of state. \emph{Advances in Neural Information Processing Systems 14}, 1555--1561. Conference 2001, proceedings 2002. \href{https://papers.nips.cc/paper_files/paper/2001/hash/1e4d36177d71bbb3558e43af9577d70e-Abstract.html}{Proceedings record}.
1270 \bibitem{angluin} D. Angluin. Learning regular sets from queries and counterexamples. \emph{Information and Computation} 75(2):87--106, 1987. \href{https://doi.org/10.1016/0890-5401(87)90052-6}{doi:10.1016/0890-5401(87)90052-6}.
1271 \bibitem{informativity} H. J. van Waarde, J. Eising, H. L. Trentelman, and M. K. Camlibel. Data informativity: a new perspective on data-driven analysis and control. \emph{IEEE Transactions on Automatic Control} 65(11):4753--4768, 2020. \href{https://arxiv.org/abs/1908.00468}{arXiv:1908.00468}.
1272 \bibitem{causal} A. Geiger, D. Ibeling, A. Zur, M. Chaudhary, S. Chauhan, J. Huang, A. Arora, Z. Wu, N. Goodman, C. Potts, and T. Icard. Causal abstraction: a theoretical foundation for mechanistic interpretability. \emph{Journal of Machine Learning Research} 26(83):1--64, 2025. \href{https://jmlr.org/papers/v26/23-0058.html}{Publication record}.
1273 \bibitem{stateid} P. van den Bos and F. Vaandrager. State identification for labeled transition systems with inputs and outputs. 2019. \href{https://arxiv.org/abs/1907.11034}{arXiv:1907.11034}. Cited for the testing framework, not as a source of the present three-case construction.
1274 \bibitem{blackwell} D. Blackwell. Equivalent comparisons of experiments. \emph{Annals of Mathematical Statistics} 24(2):265--272, 1953. \href{https://doi.org/10.1214/aoms/1177729032}{doi:10.1214/aoms/1177729032}.
1275 \bibitem{tzeng} W.-G. Tzeng. A polynomial-time algorithm for the equivalence of probabilistic automata. \emph{SIAM Journal on Computing} 21(2):216--227, 1992. \href{https://doi.org/10.1137/0221017}{doi:10.1137/0221017}. Cited for the established finite linear-algebra equivalence method.
1276 \bibitem{petreczky} M. Petreczky, L. Bako, and J. H. van Schuppen. Realization theory of discrete-time linear switched systems. \emph{Automatica} 49(11):3337--3344, 2013. \href{https://doi.org/10.1016/j.automatica.2013.07.022}{doi:10.1016/j.automatica.2013.07.022}. Author preprint: \href{https://arxiv.org/abs/1103.1343}{arXiv:1103.1343}.
1277 \bibitem{legland} F. Le Gland and N. Oudjane. Stability and uniform approximation of nonlinear filters using the Hilbert metric and application to particle filters. \emph{Annals of Applied Probability} 14(1):144--187, 2004. doi:10.1214/aoap/1075828050. Cited for filter stability and approximation, not as a source of the present static finite-record bound.
1278 \bibitem{girard} A. Girard and G. J. Pappas. Approximate bisimulation relations for constrained linear systems. \emph{Automatica} 43(8):1307--1317, 2007. doi:10.1016/j.automatica.2007.01.019. Cited for observable system approximation; the discrete block comparison is proved directly here.
1279 \end{thebibliography}
1280 \end{document}
Other PDFs for this work
Original file and source record
This copy matches the recorded source file. Its publication here does not change the work’s review status.
SHA-256: 544549a8fa2be3613adb3d75e1117396527962de27b7fa31a844497c643f6a2a