Summary (Overview)
- Main result: The paper proves that the tensor rank of matrix multiplication over is at least 21, i.e., , combined with an explicit 23-term decomposition giving the interval .
- Novel proof strategy: The proof combines quotient-rank (occupation) bounds with a split-flattening argument. At a hypothetical length of 20, these constraints force equality in matrix-rank subadditivity, which yields cross-factor algebraic relations that lead to a contradiction.
- Key structural insight: The forced matrix-rank profile makes the ranks of split-flattened summands sum to exactly 27 (the full rank), forcing a direct-sum decomposition and pairwise-annihilating idempotent relations.
- Formal verification: The complete proof, including all finite quotient bounds and certificates, is formalized in the Lean theorem prover, with all 13,438 modules passing kernel verification.
- Research provenance: The proof was developed by "Qiushi Engine," an autonomous AI research system, whose full research trajectory is documented alongside the paper.
Introduction and Theoretical Foundation
The paper addresses a fundamental open problem in algebraic complexity theory: determining the minimum number of scalar multiplications needed for matrix multiplication. While Strassen's seven-product algorithm for matrices [1] and Laderman's 23-product algorithm for matrices [2] are known, the exact minimum for over remained open.
The theoretical framework combines several ingredients:
Tensor rank definition: The multiplication tensor is defined as
where and . A decomposition of length is an identity
Occupation inequality (Lemma 2.2): For a subspace and a length- decomposition, if , then
Split flattening: The -split flattening maps the tensor to a matrix which is a permutation matrix of rank 27. For a simple tensor, with .
The prior state of the art included Bläser's substitution argument giving the classical lower bound 19 [5], and Wang's automated framework raising the binary lower bound to 20 [8]. Wang later obtained the same numerical lower bound of 21 via capacity-constrained profile enumeration [4], but the present paper identifies a different, more structural obstruction.
Methodology
The proof proceeds through several distinct stages:
1. Finite quotient bounds
The paper establishes three families of quotient-rank bounds using a frozen catalogue of 496 subspace representatives under the group of tensor symmetries (which has 56,448 elements):
- Line bounds: for every nonzero
- All-high plane bounds: For the eight two-dimensional orbits consisting of planes whose three nonzero matrices all have rank at least two, the quotient rank is at least 19
- Affine-plane span bounds: for certain three-dimensional subspaces
These bounds are derived through a combination of:
- Contraction bounds: For with , contraction gives a matrix with , yielding
- Substitution rules: A standard method where nonzero slices force elimination of summands while preserving a flattening rank lower bound
- Integer occupation certificates: Systems of inequalities on quotient classes whose infeasibility is proved via branch trees with nonnegative multiplier combinations
2. Geometric reduction
For a hypothetical length-20 decomposition, the line cap forces all 20 first factors to be distinct. The all-high plane bounds force any two distinct high-rank factors (rank ≥ 2) to satisfy (Lemma 4.1).
The affine row or column coset lemma (Lemma 4.2) then shows that the set of high-rank factors must lie in an affine row or column coset. After normalization by tensor symmetries:
3. Forced profile
The affine-plane capacities (bound 17) imply for each affine plane . Since every five-element subset of contains a four-point affine plane (Lemma 4.3), this forces . Combining with the rank budget gives the forced profile (Proposition 4.4):
4. Saturation and contradiction
The rank-additive saturation lemma (Lemma 5.1) states: if is invertible, , and , then
The product formula (Lemma 5.2) gives the crucial identity:
This leads to the invertibility obstruction (Proposition 5.3): in a decomposition with nonzero factors and , at most one first factor is invertible. But the forced profile requires three invertible first factors (rank 3), a contradiction.
Empirical Validation / Results
The paper's main theorem is:
Theorem 1.1: Every exact bilinear algorithm for matrix multiplication over uses at least 21 scalar multiplications:
Key quantitative results include:
Finite quotient bounds (Proposition 3.1):
- , for all nonzero
- The eight all-high plane orbits (indices 484–491) have (later strengthened to 19)
- The affine-plane spans have
Occupation system sizes: The eight systems (3.10) each have 127 variables and 29,210 rows, with the integer branch certificates having:
| Plane | Live variables | Source rows | Zero-forcing rows | Leaves |
|---|---|---|---|---|
| 484 | 43 | 1,665 | 84 | 569 |
| 485 | 41 | 421 | 86 | 40 |
| 486 | 41 | 262 | 86 | 14 |
| 487 | 48 | 668 | 79 | 89 |
| 488 | 41 | 413 | 86 | 32 |
| 489 | 32 | 371 | 95 | 43 |
| 490 | 43 | 713 | 84 | 115 |
| 491 | 49 | 726 | 78 | 120 |
Consequences for saturated decompositions (Corollary 6.1): At length 22 with all first factors nonzero and saturated (rank sum 27), the only possible profiles are:
Formal verification: All 13,438 modules passed Lean kernel verification, with 89 terminal declarations replayed in six groups totaling 305,731 replayed declarations. The axiom dependencies are confined to .
Theoretical and Practical Implications
Theoretical significance: This work establishes a new lower bound technique that goes beyond the standard substitution and restriction methods. The key innovation is the conversion of first-factor occupation constraints into cross-factor algebraic relations via the saturation mechanism. The rank-additivity saturation lemma (Lemma 5.1) is proved over an arbitrary field and is a reusable standalone result.
The proof structure reveals a general principle: when occupation bounds force equality in a rank-subadditivity inequality, the resulting direct-sum structure imposes algebraic constraints that can contradict the forced configuration. This "equality mechanism" could potentially be applied to other tensor rank problems.
Connection to related work: The row/column-coset lemma is identified as a special case of Hua's matrix-adjacency geometry [11]. The paper also provides a public comparison with Wang's proof [4] and a review draft in Tahir's repository [10], clarifying the distinct obstruction identified here.
Practical implications for algorithm search: The result constrains the search space for exact algorithms:
- Any 22-term algorithm must have A-slot profile or
- At most one first factor can be invertible in any saturated decomposition
- The positive rank excess at length 21 is characterized as (equation 6.2), identifying precisely where the argument must be extended
Formal verification implications: The complete Lean formalization demonstrates that complex computer-assisted proofs in algebraic complexity can be fully verified. The integer branch certificates and their exhaustive case splits are checked as proof terms within Lean, not trusted outputs of external solvers.
Conclusion
The paper proves through a structural argument that combines finite quotient bounds with algebraic saturation constraints. The proof is fully formalized in Lean, establishing a new benchmark for verified results in algebraic complexity.
Main takeaways:
- The lower bound 21 for matrix multiplication over is established via a novel structural argument
- The interval is confirmed with an explicit 23-term witness
- The saturation mechanism provides a reusable technique for converting rank-budget equalities into cross-factor algebraic obstructions
- Full formal verification in Lean ensures the correctness of all finite computations and certificates
Future directions: The paper identifies that extending the method to length 21 requires:
- Stronger occupation bounds or cross-factor relations that remain effective when the kernel has small positive dimension
- The interval 21–23 leaves both improved constructions and stronger lower bounds to be determined
The research trajectory documented in Section 8 provides insight into how the proof was discovered through autonomous research, from numerical experiments on deletion criteria, through quotient cores and completion problems, to the final saturation argument on the full tensor.
Related papers
- Towards a Statistical Understanding of Mixture-of-Experts
Mixture-of-experts performance hinges on a three-way tradeoff between approximation error, expert learning cost, and router estimation complexity, with shared experts and Top-K routing providing statistical gains only under specific geometric conditions.
- Evidence for Shared Routing Geometry and Dynamics in Sparse Mixture-of-Experts
After orthogonal gauge alignment, router-control states across MoE layers share a low-dimensional dynamical core, where a single linear transition captures most of layer-specific predictive power.
- A Constant-Competitive Algorithm for Dynamic Mixture-of-Experts Serving
A deterministic O(1)-competitive algorithm for dynamic mixture-of-experts serving is proven, matching randomized performance and closing the deterministic gap.