Paper VIIIReading edition

F. Global small-core recompression from ordered thin SVD data

Reading tools
Reading libraryFind statementsInspect Lean
Switch work

Saved reading

Read side by side

This HTML chapter includes reviewed punctuation corrections. View the correction record.

Start reading

Resources & source

Original TeX with line links · Download TeX

The wording and mathematics follow the retained manuscript. This reading format does not add a proof review or extend Lean coverage.

Skip contents and start reading

F Global small-core recompression from ordered thin SVD data

This chapter retains the substantive mathematical pages of verification block 6 (v0.6.0). Its dated audit and pending-status passages describe that historical checkpoint; the final status is 56 of 56 registered finite items under the recorded hypotheses. Later chapters supersede earlier pending statements. All compiler and regression counts in this chapter are inherited records, not fresh runs for this edition.

F.1 Compact factors from actual column spaces

Modules CompactRangeFactors and SmallCoreTransfer Let

\[ L\in{\mathbb C}^{m\times t},\qquad R\in{\mathbb C}^{n\times t},\qquad A=LR^*. \]

Use the ordinary Euclidean inner products on the coordinate spaces. Define

\[ S_L=\operatorname{range}(L),\quad r_L=\dim S_L, \qquad S_R=\operatorname{range}(R),\quad r_R=\dim S_R. \]

The implementation constructs an orthonormal basis of each actual range subspace. Let \(Q_L\) and \(Q_R\) be the matrices of the corresponding isometric inclusions. Express the range-restricted input maps in these bases to obtain \(R_L,R_R\).

The checked identities are

\[ \boxed{Q_L^*Q_L=I,\quad L=Q_LR_L,\quad R_L=Q_L^*L,} \]

with the analogous identities on the right. The dimension theorem is not an input:

\[ \boxed{r_L={\operatorname{rank}} L,\qquad r_R={\operatorname{rank}} R.} \]

The coordinate factors have full row rank. The construction therefore handles rank-deficient input factors without retaining artificial column directions.

Define the small core by actual multiplication,

\[ G=R_LR_R^*\in{\mathbb C}^{r_L\times r_R}. \]

Finite matrix associativity and adjoint identities give

\[ \boxed{A=Q_LGQ_R^*,\qquad {\operatorname{rank}} G={\operatorname{rank}} A.} \]

The rank identity follows from both multiplication inequalities and the left inverse obtained by compression. It is not inferred from agreeing dimensions.

Zero factors and empty spaces. No positive-rank or nonempty-coordinate hypothesis is imposed. If a range is zero, its orthonormal basis has an empty index type. The factorization uses the resulting rectangular empty matrices. A separate theorem proves that the compact dimension is zero exactly when the original factor is zero.

Relation to QR. The argument only needs orthonormal columns and exact reconstruction. A compact QR factorization supplies these properties, but triangularity of its coordinate factor is irrelevant to the recompression theorem. The formal construction uses an exact orthonormal range basis; it does not claim Householder steps, pivot selection or floating-point stability. A supplied noncompact orthonormal factorization is also covered by the general transfer theorem, including extra zero singular directions.

F.2 Why a small-core optimum is a global optimum

Module SmallCoreNorms; arbitrary ambient competitors For rectangular isometries \(Q,V\) define

\[ \mathcal L(G)=QGV^*,\qquad \mathcal C(B)=Q^*BV, \qquad Q^*Q=I,\quad V^*V=I. \]

The following statements are proved for the actual matrix rank and actual matrix norms:

\[ \mathcal C(\mathcal L(G))=G, \qquad {\operatorname{rank}}\mathcal L(G)={\operatorname{rank}} G, \qquad {\operatorname{rank}}\mathcal C(B)\leq{\operatorname{rank}} B, \]
\[ \boxed{{\left\lVert\mathcal L(G)\right\rVert}_\nu={\left\lVert G\right\rVert}_\nu, \qquad {\left\lVert\mathcal C(B)\right\rVert}_\nu\leq{\left\lVert B\right\rVert}_\nu, \quad \nu\in\{2,\mathrm F\}.} \]

For the spectral norm, the proof uses the Gram matrix identity

\[ (QG)^*(QG)=G^*G \]

and the \(C^*\)-norm square identity, together with right-side adjoint symmetry. Compression follows from submultiplicativity and the isometry norm bound, including empty spaces.

For the Frobenius norm, trace cyclicity proves left and right isometric invariance. The proof also establishes the projection identity

\[ {\left\lVert B-QQ^*B\right\rVert}_{\mathrm F}^{2} ={\left\lVert B\right\rVert}_{\mathrm F}^{2}-{\left\lVert Q^*B\right\rVert}_{\mathrm F}^{2}. \]

Nonnegativity of the left side gives left compression contractivity; the right version follows by adjoints. No norm-preservation or contractivity hypothesis is inserted.

Suppose \(G_k\) is a best rank-at-most-\(k\) approximation to \(G\) in either norm. Take an arbitrary ambient matrix \(B\) with \({\operatorname{rank}} B\leq k\). Compression is an admissible small-core competitor and

\[ \begin{aligned} {\left\lVert\mathcal L(G)-\mathcal L(G_k)\right\rVert}_\nu &={\left\lVert G-G_k\right\rVert}_\nu\\ &\leq{\left\lVert G-\mathcal C(B)\right\rVert}_\nu\\ &={\left\lVert\mathcal C(\mathcal L(G)-B)\right\rVert}_\nu\\ &\leq{\left\lVert\mathcal L(G)-B\right\rVert}_\nu. \end{aligned} \]

This is the key global bridge: \(B\) is not required to lie in the supplied row and column spaces. The next two pages discharge the intermediate small-core optimality obligation, rather than leaving it as a hypothesis in the final theorem.

F.3 Spectral optimality from a kernel witness

Modules DiagonalTruncation and SpectralOptimality Let \(\sigma_1\geq\cdots\geq\sigma_d\geq0\) and

\[ D={\operatorname{diag}}(\sigma_1,\ldots,\sigma_d),\qquad D_k={\operatorname{diag}}(\sigma_1,\ldots,\sigma_{\min(k,d)},0,\ldots,0). \]

Lean uses indices beginning at zero; the formulas on this page use the conventional one-based notation. The rank of \(D_k\) is proved to be at most \(k\), even when retained singular values are zero.

For \(k<d\), take any \(d\times d\) matrix \(B\) of rank at most \(k\). Restrict its domain to the first \(k+1\) coordinates using the actual coordinate inclusion \(J\). Since

\[ {\operatorname{rank}}(BJ)\leq{\operatorname{rank}} B\leq k<k+1, \]

rank-nullity supplies a nonzero vector \(z\) with \(BJz=0\). The vector \(y=Jz\) is nonzero, satisfies \(By=0\) and is supported in the first \(k+1\) coordinates. The injection and the support property are checked separately.

Monotonicity of the diagonal entries gives

\[ {\left\lVert Dy\right\rVert}^{2} =\sum_{i=1}^{k+1}\sigma_i^{2}|y_i|^{2} \geq\sigma_{k+1}^{2}{\left\lVert y\right\rVert}^{2}. \]

Because \((D-B)y=Dy\), the operator-norm inequality implies

\[ \sigma_{k+1}{\left\lVert y\right\rVert} \leq{\left\lVert(D-B)y\right\rVert} \leq{\left\lVert D-B\right\rVert}_2{\left\lVert y\right\rVert}. \]

Cancellation of the strictly positive norm of \(y\) proves

\[ \boxed{\sigma_{k+1}\leq{\left\lVert D-B\right\rVert}_2.} \]

The norm of the actual diagonal residual \(D-D_k\) equals \(\sigma_{k+1}\), so \(D_k\) attains the lower bound. If \(k\geq d\), the residual is zero and optimality follows from norm nonnegativity.

No optimality oracle. The nonzero kernel vector, its coordinate support and the diagonal norm bound are all derived. No Eckart–Young inequality, best-rank property or singular-tail formula is assumed. The final rectangular SVD result follows by the isometric transfer proved on the preceding page.

F.4 Frobenius optimality from kernel weights

Modules KernelFrame and FrobeniusOptimality For an arbitrary competitor \(B\) with \({\operatorname{rank}} B\leq k\), construct an orthonormal matrix \(Q\) spanning its actual kernel. Then

\[ BQ=0,\qquad Q^*Q=I,\qquad q=\dim\ker B=d-{\operatorname{rank}} B. \]

Define the row weights

\[ w_i=\sum_{j=1}^{q}|Q_{ij}|^2. \]

The proof derives

\[ \boxed{0\leq w_i\leq1,\qquad \sum_iw_i=q\geq\max(d-k,0).} \]

The upper bound uses contraction of \(Q^*\) on a coordinate vector. The weight sum follows from the trace of \(Q^*Q\) and rank-nullity.

For any nonnegative decreasing sequence \(a_i\), weights with these properties satisfy

\[ \sum_i a_iw_i\geq\sum_{i>k}a_i. \]

This finite weighted inequality is itself proved. For \(k<d\), use \(\mu=a_{k+1}\) and compare the summands to tail weights \(v_i=0\) for \(i\leq k\) and \(v_i=1\) otherwise:

\[ a_iv_i+\mu(w_i-v_i)\leq a_iw_i. \]

For a retained coordinate the inequality uses \(a_i\geq\mu\) and \(w_i\geq0\). For a tail coordinate it uses \(a_i\leq\mu\) and \(w_i\leq1\). Summation and \(\sum w_i\geq\sum v_i\) give the result.

Set \(a_i=\sigma_i^2\). Right compression cannot increase the Frobenius norm, and \(BQ=0\), hence

\[ \begin{aligned} {\left\lVert D-B\right\rVert}_{\mathrm F}^{2} &\geq{\left\lVert(D-B)Q\right\rVert}_{\mathrm F}^{2}\\ &={\left\lVert DQ\right\rVert}_{\mathrm F}^{2} =\sum_i\sigma_i^2w_i \geq\sum_{i>k}\sigma_i^2. \end{aligned} \]

Direct calculation of \(D-D_k\) attains equality. Thus the best-rank Frobenius assertion is proved from kernel geometry and finite sums, independently of the spectral lower-bound proof. Repeated and zero singular values require no uniqueness claim.

F.5 Thin output factors and the final theorem

Modules CompactTruncation and SmallCoreRecompression For the actual core \(G=R_LR_R^*\), supply ordered thin SVD data

\[ G=W{\operatorname{diag}}(\sigma)Z^*,\qquad W^*W=I, \qquad Z^*Z=I,\qquad \sigma_1\geq\cdots\geq\sigma_d\geq0. \]

These are precisely the fields of the formal SVD structure. It contains no rank-optimality or tail-error field. A derived theorem checks the Gram eigenvector equation

\[ G^*GZ=Z{\operatorname{diag}}(\sigma_1^2,\ldots,\sigma_d^2). \]

Let \(h=\min(d,k)\) and retain exactly the first \(h\) column indices. The rectangular square-root mask has entries

\[ M_{ij}=\begin{cases}\sqrt{\sigma_j},&i=j,\\0,&i\ne j,\end{cases} \qquad 1\leq i\leq d,\quad 1\leq j\leq h. \]

Lean proves its index cardinality and \(MM^*=D_k\). Define

\[ \boxed{L_k=Q_LWM,\qquad R_k=Q_RZM.} \]

The product equals \(Q_LWD_kZ^*Q_R^*\) and has rank at most \(k\). The principal theorem proves, for every ambient \(B\) with \({\operatorname{rank}} B\leq k\),

\[ \boxed{{\left\lVert LR^*-L_kR_k^*\right\rVert}_\nu\leq{\left\lVert LR^*-B\right\rVert}_\nu, \quad\nu\in\{2,\mathrm F\}.} \]

It also gives the exact errors

\[ {\left\lVert LR^*-L_kR_k^*\right\rVert}_2= \begin{cases}\sigma_{k+1},&k<d,\\0,&k\geq d,\end{cases} \qquad {\left\lVert LR^*-L_kR_k^*\right\rVert}_{\mathrm F} =\left(\sum_{i>k}\sigma_i^2\right)^{1/2}. \]

Both the squared and square-root Frobenius formulas are checked. All these statements are combined in KomorebiPaperVIII.SmallCore.small_core_optimal_recompression.

Endpoints. Rank zero produces the zero output; \(k\geq d\) reconstructs the original product. An empty SVD certificate is constructed for a zero core, and diagonal SVD certificates are constructed explicitly. Zero singular values are never inverted. At repeated singular values the result asserts optimality, not uniqueness of the minimizer.

F.6 Source map and verification

One completed manuscript item; 79 supporting declarations

Small-core recompression modules and supporting declarations
ModuleMain purposeTheorems
SmallCoreNormsIsometric norms, compression, rank19
CompactRangeFactorsActual compact column factors7
SmallCoreTransferGlobal best-rank transfer7
KernelFrameActual kernel and row weights8
DiagonalTruncationRank and exact diagonal errors9
FrobeniusOptimalityWeighted-tail lower bound5
SpectralOptimalityPrefix-kernel lower bound7
CompactTruncationThin square-root factors5
SmallCoreRecompressionMain theorem and Gram relation6
RecompressionEndpointsZero and full-retention cases6
TotalTheorem 5.6 and its support79

Cumulative Lean run. All 40 local modules were compiled in a newly created output directory under Lean 4.34.0-rc2. Each exited with code zero and warnings were fatal. The 392 named theorem reports and 66 separately counted construction reports match the inventory exactly. Dependencies are confined to propext, Classical.choice and Quot.sound, or subsets thereof. False equality and admitted-proof controls were both rejected.

Pinned dependency. The actual Mathlib Git revision and manifest revision both match aeb72f1e9981b6d35b426b16dca7759be3e7ba06. The supplied compiled Mathlib cache was reused. It was not independently rebuilt or rechecked. Recovery verified all seven offline archive parts and the combined archive hash.

Infrastructure. Forty-three unit tests passed: 17 verifier tests, 12 fifth-block compatibility tests updated to the current totals, and 14 sixth-block tests. The original fifth-block fixed-count test file and metadata are preserved. Exact audit coverage, dependency order, no-bypass scans, classical-input boundaries and absence of optimality fields in the SVD structure are tested.

Failures retained. Of 31 captured development checks, 21 failed before correction and ten accepted drafts supplied the new modules. Failures concerned proof elaboration, finite-index/cardinality APIs, dependent rewrites, norm scopes, and warning diagnostics. Their inactive source snapshots and logs are retained separately from the successful fresh cumulative run. An initial interactive runtime launch was unsupported; noninteractive assembly succeeded.

F.7 Regressions, reproduction, and claim boundary

Exact mathematical guarantees versus numerical implementations Independent numerical checks. A deterministic NumPy complex128 mirror tested 182 input-factor pairs at 638 truncation cases. The cases include rectangular matrices, rank-deficient and zero factors, empty spaces, repeated singular values, rank zero, and ranks beyond the core width. Comparison used both the small core and an independently computed ambient SVD reference. There were 3,190 arbitrary rank-bounded competitors, nine invalid-input rejection controls and two checks demonstrating failure when essential assumptions are removed.

The largest relative tail/reconstruction discrepancy was below \(3.7\times10^{-15}\), against a declared \(2\times10^{-9}\) tolerance. The mirror uses numerical rank thresholds and a numerical SVD to construct column bases. It is not compiled or extracted Lean code, a proof for all inputs, or a GPU benchmark. The formal result uses exact ranks and exact factorization equations.

Reproduce from the extracted source root.

python3 scripts/verify_integrity.py
python3 -m unittest discover -s scripts -p 'test_*.py' -v
python3 scripts/verify.py --kit /path/to/portable-kit \
    --out verification/recheck --timeout 240
python3 scripts/run_sixth_regressions.py \
    --out verification/recheck_numerical.json

The unit tests and numerical mirror require NumPy. The Lean verification path needs Python 3.10 or later and the separately supplied pinned Linux x86-64 kit. Local compiled interfaces are regenerated. The runner also supports bounded batches with --max-checks and hash-checked --resume. A partial checkpoint is not a pass.

What is complete. The 56-item manuscript-proved register is covered under the recorded hypotheses. The original theorem says to take orthonormal factors and a core SVD. The new construction and proof discharge the recompression conclusion from those exact factorization equations. In particular, no best-approximation assertion or error formula is hidden in an input certificate.

What is not claimed. General SVD existence or a numerical SVD implementation is not newly formalized. The four classical entries remain separately tracked; the ordered-SVD-data optimality argument now has checked support, while the CG algorithm theorem, floating-point product model and simultaneous-decomposition input are not newly proved in full. No new generic matrix-multiplication exponent, floating-point stability theorem or hardware speedup follows from this release.

The original manuscript, bibliography, source package and all five earlier supplements are preserved. Historical CPU/GPU measurements, earlier compiler execution suites and Papers I–VII in full were not rerun. Prose-to-formal correspondence is an explicit mathematical review, not an automated theorem equating a sentence with a Lean type.

Source and conversion record

Source SHA-256: 7179ee3328fb901301208b53884220c69e8c87cb54218919c6fb71cacc4c646a

Unsupported prose commands stop the build. The mathematical expression sequence is checked against the source, with manuscript macros expanded for display.

Conversion records

Notation in Paper VIII

Look up a symbol without leaving this chapter. Select text before opening help to search for it.

Search this work’s notation.

    Symbols can have different meanings in different passages. Read each result in its own context.

    Open the full notation index