LEAN × VERSO · EXPERIMENT 001
A checked design.
An open question.
What happens when an experiment challenges its own assumptions?
Follow a small research loop from a formally checked design to synthetic evidence and a better next question.
Synthetic evidence onlyTHE RESEARCH LOOP
Explore the experiment
Four treatments.
Two nuisance factors.
A 4 × 4 Latin square assigns each treatment exactly once in every row and column. The first round uses shift 0, giving four observations per treatment.
Rows and columns stand for fixed nuisance conditions. Balance is a mathematical property; it does not prove that a treatment works.
The certified family
SHIFT 0| Row | C0 | C1 | C2 | C3 |
|---|
All four shifts are checked in Lean. Shifts 1–3 become the follow-up in this example.
The model doesn’t
tell the whole story.
Python fits an additive blocked model to 16 seeded synthetic observations. Its residual RMS is 1.172399, above the demonstration rule’s threshold of 0.900.
The conditional 95% intervals below are diagnostic only. They are not valid coverage guarantees for this interaction fixture.
The rule sees observed diagnostics, not the simulator’s hidden parameters. It proposes shifts 1, 2, and 3 to complete coverage.
Initial treatment contrasts
N = 16Difference from T0 · conditional 95% intervals
Assumes an additive model and iid Gaussian noise. A large residual is a reason to investigate, not a discovery claim.
Read the exact report ↗A different question
comes into focus.
Three additional certified squares produce 48 new observations. All four shifts together cover every row, column, and treatment combination exactly once.
Now each row-specific T3 − T0 comparison includes all four columns. Row 3 shows a much larger synthetic contrast.
Which row conditions modify the treatment-3 effect, and does that pattern replicate with independent blocks?
T3 − T0, within each row
N = 64Four columns represented in each treatment mean
These are descriptive estimates. Stable column effects are assumed; drift, carryover, or column interactions could still matter.
Read the interpretation limits ↗A DIFFERENT STANDARD FOR EACH CLAIM
What is actually known?
The notebook keeps proof, computation, observation, and judgment separate. Select a category to inspect its boundary.
UNDER THE NOTEBOOK
A small, inspectable chain
- 01 / AUTHOR
Verso Manual
Lean-native document with checked code cells and recorded proof-state hovers.
- 02 / CHECK
Lean kernel
Balance, counts, complete coverage, and an exact integer additive identity.
- 03 / OBSERVE
Python harness
A seeded generator, blocked analysis, and a bounded data-only proposal.
- 04 / RECORD
Provenance
Hashed sources and artifacts, recomputed analysis, and rejection of stale inputs.
Proof fields are erased during execution. Exported JSON is data, not a portable proof certificate. Hashes check consistency; they are not signatures.
READ IT. RUN IT. CHANGE IT.
The source is the notebook.
Lean 4.34.0 and Verso are pinned. The local harness uses Python 3.11+ and its standard library. No model, API key, GPU, or Python packages are required.
You’ll need elan, Git, Python, and a C toolchain. Run only code you trust: the Lean/Python runner uses your local privileges and is not a sandbox.
git clone https://github.com/alok/lean-research-notebook.git cd lean-research-notebook git checkout a96aa5e3d5fb03e101aa519eba7bfb74ce7a7d06 lake update python3 scripts/reproduce.py python3 -m unittest discover -s tests -v
Generate the full Verso notebook locally, including proof hovers and the complete provenance record.
Context & credits
Directed by Alok Singh; developed with AI assistance. The project extends Verso and adapts its Apache-licensed saved-cell and traversal pattern, originally by David Thrane Christiansen, © 2024–2025 Lean FRO LLC.
Inspired by Microsoft’s Quine announcement, with the NOVA paper as a scientific-tool orchestration precedent. This project has no Quine integration, trained AI, biology data, or efficacy claim. Blueprint, ProofWidgets, and a persistent Lean REPL are future possibilities, not implemented features.
Source snapshot a96aa5e3 · Exact numerical report · Source review