Research line: compiling a teacher into tables (R4G1)

This was the project's first idea. Watch an ordinary language model (the "teacher"), compile what it does into lookup tables and a graph, and run those on a laptop with no multiplications. It worked as a compiler: it copied the teacher's top choice about as often as the teacher's own tables did. It never wrote coherent text on its own, which is why the project moved on.

Catalog idr4g1-transformerless
Time span21 Jul to 27 Sep 2026 (24 records undated, mostly design and reference documents)
MilestoneNone recorded (74 of 74)
Records74
Outcomesplan 21 · negative 19 · positive 15 · inconclusive 5 · process 5 · review 4 · tooling 3 · diagnostic-stop 1 · ops 1
StatePARKED (R4G1 graph); the frozen integer runtime is kept as a separate contract

Counts: archive/catalog.jsonl. Terms follow the glossary; ACTIVE, READY and PARKED are defined on the mechanism board.

flowchart LR
  A["Jul<br/>Plans, runtime contract,<br/>graph format"] --> B["Aug<br/>Retrieval fix; ratified<br/>29.52% baseline"]
  B --> C["20 to 24 Aug<br/>Prompt, planning and<br/>free-running tests fail"]
  C --> D["23 to 27 Sep<br/>Ordinary lexical model;<br/>packed storage"]
  D --> E["Superseded by the<br/>native and discrete lines"]

From a compiler that copies a teacher to the point where the objective had to change.

What it set out to do

Compile a teacher into an integer-only graph (called R4G1) that a CPU can run with no floating point, no multiplications and no allocation while serving. Its rules are in inference_contract.md. Compilation itself may use a teacher; only the served runtime must be lawful.

What happened, in order

  1. July. Planning documents, a runtime contract and a format for the graph. The cyclic phase-clock design was an open proposal that authorized no work (phase clock). Held-out Hopf routing used only 7 of 512 sectors (record).
  2. August: retrieval and baselines. Three retrieval negatives turned out to be one measurement bug: a dead cosine term. With a content query, mean reciprocal rank rose from 0.7179 to 0.8542 (reassessment). A certified GPT-2 dense teacher ran at 0.704 times the conventional cost against a 3.0 gate, bit-exactly (record). The attested SmolLM2 baseline was ratified at 29.5203% top-1 (21,293 of 72,130 positions) against 28.1214% for the older runtime (record). A one-token skip-mix lane followed the reference in 41 of 87 favorable pairs, then in 58 of 87 after the candidates were injected, clearing the 53-of-87 bar (spot check, fix).
  3. 20 to 24 Aug: the walls. The best prompt-conditioning arm gained +16.2 per mille against a 20 per mille floor (bake-off). No sealed final partition existed for planning, so reasoning was NOT ESTABLISHED (certification). The skip-mix lane worsened free-running cycle collapse from 710 to 1000 per mille, so corrective rounds were not launched (reachability).
  4. 23 to 27 Sep: the ordinary lexical model. One shared Generate, Copy and Stop model passed 32 of 32 authored preflight cases but was 2.25 bits per target worse than a tuned count table (result). Doubling joint-fit steps added only +0.025 bits against a 0.30 bar (joint fit). Packed 4-bit storage kept eight output pairs identical and cut retained coefficient bytes from 6,702,340 to 847,876 (87.35%) (comparison).

Key results

ResultKindSource
Greedy decode matched the teacher on 29.5203% of 72,130 positions (older runtime 28.1214%)measurementnormative scorer
Content-query retrieval: mean reciprocal rank 0.8542 against 0.7179 (a measurement bug had hidden it)measurementreassessment
Prompt conditioning, best arm +16.2 per mille against a 20 floormeasurementbake-off
Served ordinary lexical model 2.25 bits per target behind a count tablemeasurementresult
Packed storage cut retained coefficient bytes by 87.35% with identical outputs on eight pairsmeasurementcomparison

What it taught

The teacher set the ceiling, not the store (lesson 5 in what the project knows). A metric that read zero, or a cosine term that never fired, hid real results, so check the instrument first (lesson 1). Gains measured while the teacher's text was supplied never became coherent text the model wrote itself (lesson 3). Exact integer export and bit-exact serving work (lesson 17), and the project kept that contract. Dormant mechanisms were kept behind gates, never deleted (lesson 16).

Current state

PARKED. The R4G1 graph never produced coherent free text and needs a transformer teacher, which the current rules ban. What happens to its crates is an open owner question (docs/labs/repo-renormalization-2026-10-19/audit/mechanisms/board.md, D36 item 3). The integer runtime contract remains the model for D11 serving (the integer-only serving decision) (M4 line).

Go deeper: the generated catalog page lists all 74 records.