Summary (Overview)
- Novel problem formulation: The paper introduces "applicability-aware method selection" for formal theorem proving, distinguishing it from similarity-based retrieval. A method may look relevant to a theorem but not be applicable due to unmet prerequisites or mismatched targets.
- Self-advertisement mechanism: Before ranking, a model generates a problem-specific proposal for each candidate method, stating what part of the goal it targets, what action it would take, and what conditions that action requires. Vague or unsupported proposals are demoted.
- Method Contracts library: The authors construct 82 reusable methods from Putnam 2000–2014 as structured contracts pairing applicability descriptions with Mathlib anchors, checked Lean scaffolds, and expected proof obligations.
- Strong empirical results: Self-advertisement achieves 95.0% hit@5 on Putnam 2015–2025 (vs. 84.2% for the strongest reranker) and 91.7% on IMO ProofBench (vs. 88.3%), with coverage gains coming largely from methods that do not look similar to the problem.
- Downstream proof improvement: Adding the top-ranked contract to an Ax-Prover-style proof loop raises the proportion of proved problems from 5.8% to 12.5% on Putnam and from 10.0% to 15.0% on IMO ProofBench.
Introduction and Theoretical Foundation
Background and Motivation
Large language models can propose high-level approaches to mathematical problems, and recent theorem-proving systems use them to generate Lean code, check it, and revise it in response to feedback. However, before a prover can use a mathematical method, it must decide whether that method offers a useful step for the current goal. A suggestion such as "use induction" leaves open what to induct on, which part of the goal the method would address, and what remains to be proved.
Existing systems support formal proof construction at several levels:
- Premise selection and Mathlib search provide relevant definitions and theorems
- Proof retrieval offers examples of how related problems were solved
- Verifier-guided loops use Lean's errors to revise failed attempts
The central problem: surface similarity does not establish applicability. A retrieved inequality may require nonnegativity that has not been established, while a useful method may come from a problem that looks quite different on the surface.
Theoretical Framework
The paper formalizes the problem using the following structure. Let be a Lean goal with local context , and let be a finite library of method contracts. A contract has:
- Parameters
- Required conditions
- A target statement with an intended action
- An execution scaffold
- Residual obligations
A selector receives , , and the contract descriptions, and returns an ordered list .
Key definitions:
- Semantic applicability: A contract is applicable to if some correct proof of contains a step that instantiates at a binding
- Annotated set : reference contracts used in official solutions; when correct,
Methodology
Self-Advertisement
Self-advertisement replaces the question of how closely a contract resembles the goal with the question of how the contract would be used. In a single model call, the model reads the goal, its local context, and the selection-facing description of every contract, and returns a proposal for each contract. The proposal of contract commits to:
- A target , which instantiates in terms of the goal's own objects
- An action
- Required facts , which instantiate
- Verified material from the contract that supports this commitment
- Whether the contract offers itself (), its role , and an applicability score
Commitment Gate
A main nomination must pass the commitment gate:
where Spec holds when a target or action names a concrete object of the goal rather than a generic phrase. A main nomination that fails the gate is demoted to a supporting role.
Runoff
The runoff re-ranks the top contracts by comparing their proposals directly. In one pass of calls from the top of the window down, the model sees each contract, the contract above it, and the proposal that contract wrote earlier; it writes a proposal for the lower contract and judges whether it fits the proof better, swapping if so.
Contract Library Construction
The 82 contracts are built in three steps using GPT-5.6 Sol:
- Extraction: Extract methods from Putnam 2000–2014 reference solutions; authors review every extraction and merge
- Drafting: Draft both selection-facing and execution-facing sides of each contract
- Compilation: Every Lean artifact compiled with Lean v4.27.0 and Mathlib; all 82 contracts pass
Empirical Validation / Results
Main Results
Table 1 shows shortlist quality across all settings (excerpt):
| Selector | Putnam hit@5 | Putnam R@5 | IMO hit@5 | IMO R@5 |
|---|---|---|---|---|
| Qwen3-Emb-0.6B (no LLM) | .775 | .291 | .767 | .380 |
| Qwen3 + rerank (GPT-5.6 Terra) | .858 | .407 | .900 | .469 |
| Self-adv. (GPT-5.6 Terra) | .975 | .472 | .883 | .494 |
| Self-adv. + runoff (GPT-5.6 Terra) | .983 | .503 | .933 | .512 |
| Qwen3 + rerank (GPT-5.6 Luna) | .842 | .385 | .883 | .468 |
| Self-adv. (GPT-5.6 Luna) | .950 | .446 | .917 | .554 |
| Qwen3 + rerank (DeepSeek V4.1 Flash) | .842 | .371 | .850 | .449 |
| Self-adv. (DeepSeek V4.1 Flash) | .900 | .393 | .883 | .493 |
Key findings:
- Self-advertisement attains the highest recall@5 in all six backbone–benchmark settings
- On Putnam, it leads at hit@3, hit@5, and MRR under every backbone
- Rerankers remain more precise at rank 1 in most settings; the runoff narrows this gap (Putnam hit@1 rises from 62.5% to 72.5% with GPT-5.6 Terra, above the strongest reranker at 67.5%)
Applicability Beyond Similarity
Figure 2 demonstrates that many annotated methods that self-advertisement places in its top five are ranked outside the top five by similarity retrievers—often so dissimilar that they never enter rerankers' candidate pools, making them unrecoverable by any reranking backbone.
Downstream Proving
Table 2 reports proof success with GPT-5.6 Luna under a budget of 10 Lean compilations per problem:
| Method | Putnam ALG | Putnam ANA | Putnam DISC | Putnam All | IMO Basic | IMO Adv. | IMO All |
|---|---|---|---|---|---|---|---|
| AxProverBase | 9.1 | 3.3 | 4.3 | 5.8 | 20.0 | 0.0 | 10.0 |
| + Self-adv. contract | 9.1 | 10.0 | 17.4 | 12.5 | 26.7 | 3.3 | 15.0 |
Adding the top-ranked contract more than doubles success on Putnam and raises it by 50% on IMO ProofBench.
Theoretical Results
Proposition 1 (Conditional scaffold soundness): A Lean-checked scaffold of type
yields a checked proof of for any binding whose required conditions and obligations have checked proofs.
Proposition 2 (Information bound): If , then . The inequality can be strict when distinct goals share the same similarity representation but require different shortlists.
Corollary 1 (Candidate-pool ceiling): A two-stage selector's hit@k and recall@k are bounded by the first-stage selector's hit@m and recall@m, regardless of the second-stage model.
Proposition 3 (Top-k ranking regret): If scores are within of true weights under an increasing transformation, then expected recall regret is bounded: .
Proposition 4 (Multi-method coverage): Expected hit@k is monotone and submodular; a greedy selector attains at least times the optimum.
Theoretical and Practical Implications
Theoretical Implications
-
Similarity is insufficient for method selection: Proposition 2 formally shows that similarity-only selectors can assign identical representations to goals requiring different methods, creating an information-theoretic ceiling.
-
Two-stage reranking has inherent limits: Corollary 1 proves that rerankers operating on similarity-filtered candidate pools cannot recover methods the similarity stage missed—a structural bound, not a model limitation.
-
Different metrics need different rules: Expected recall@k is additive (sorting by is optimal), while expected hit@k is submodular (diversity-aware selection matters when multiple methods apply).
Practical Implications
-
Inspectable selection: Unlike rerankers that output only scores, self-advertisement produces concrete, checkable claims about each candidate's use (target, action, conditions), enabling human inspection and verification.
-
Library design matters: The Method Contract structure separates selection-facing descriptions from execution guidance, allowing the same library to serve both selection and proving stages.
-
Downstream proof improvement: The doubling of proof success on Putnam demonstrates that better method selection translates into more completed proofs within fixed compute budgets.
Conclusion
The paper presents self-advertisement, a method-selection approach that asks each Method Contract to propose a target, action, and required conditions for the current theorem. Key takeaways:
-
Coverage gains: Self-advertisement improves coverage of annotated methods in shortlists, including methods ranked low by lexical or embedding similarity, across Putnam and IMO ProofBench.
-
Downstream impact: Adding the top-ranked contract to a fixed-budget proof loop increases the number of problems proved on both benchmarks.
-
Two clear limits: Shortlist coverage does not guarantee a completed proof, and the downstream comparison adds the contract as a whole rather than isolating selection from execution guidance.
Future directions: Separate the contributions of selection vs. execution guidance, and help provers carry promising method proposals through to verified proofs.
Related papers
- LEVER: Adaptive Cost-Aware Proof Search Over AND/OR Graphs
LEVER makes proof quality objectives programmable during LLM proof search, cutting cost 34% while raising solve rates from 80% to 96% on PutnamBench.
- DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition
DivMoE achieves fine-grained MoE upcycling by combining domain-specialized experts with diversity-constrained routing, preventing routing collapse and outperforming all baselines across 15 benchmarks.
- Fisher-Guided Submodular Data Selection for Continual Pre-Training of Large Language Models
Fisher-guided gradient decomposition with submodular selection achieves 10x token efficiency over replay in continual pretraining, dominating Pareto frontiers on forgetting and adaptation.