e(d) = [w₀ − d²/w₀, −d] + Unit-Residual SwiGLU Carry Hinge. Also 6p Strict nn.Parameter (#1).
zcbtrak) / 8p (kswain98) · -33.3% params
e(d) = [w₀ − d²/w₀, −d] + Unit-Residual SwiGLU Carry Hinge. Also 6p Strict nn.Parameter (#1).
zcbtrak) / 8p (kswain98) · -33.3% params
tbukic M10S-36p) · -22.2% params
SiLU(w₀(a+1))b − SiLU(w₀)b + Sink-Normalized Carry Z_m ≡ 10/9.
nn.Parameter
Ψ = [1, C_in] ⊗ C_out (rank = 256, strictly 800 scalars).
Tiny800 Stage C) · -0.2877 BPB
xz -9e (14,300 B), bzip2 -9 (14,282 B), gzip -9 (14,610 B)
D₄, Kronecker self-tiling, Jordan interior flood-fill & Cellular Automata.
| Model / Submission | Task & Track | Unique Params | Accuracy (10,010) | Status |
|---|---|---|---|---|
| Apex-Mult-4P (Ours) | 10×10 Multiply (Constructive) | 4 | 100.00% (10010/10010) | #1 MULT |
| Apex-Mult-6P (Ours) | 10×10 Multiply (Strict nn.Parameter) |
6 | 100.00% (10010/10010) | #1 STRICT |
| Apex-Add-4P (Ours) | 10+10 Addition (Constructive) | 4 | 100.00% (10010/10010) | #1 RECORD |
| Apex-Add-6P Strict (Ours) | 10+10 Addition (Strict nn.Parameter) |
6 | 100.00% (10010/10010) | #1 STRICT |
| zcbtrak / warlockee (6p) | 10+10 Addition (Constructive) | 6* | 100.00% (10010/10010) | Prev #1 |
| kswain98 (8p) | 10+10 Addition (Strict) | 8 | 100.00% (10010/10010) | Prev Strict |
| Apex-Add-28P (Ours) | 10+10 Addition (Trained Subspace) | 28 | 100.00% (10010/10010) | #1 TRAINED |
| Apex-Add-34P (Ours) | 10+10 Addition (Trained Gauge) | 34 | 100.00% (10010/10010) | EXACT GAUGE |
| tbukic M10S-36p | 10+10 Addition (Trained) | 36 | 100.00% (10010/10010) | Prev Trained #1 |
In the original Tiny800 Stage C 1-billion-token run, validation cross-entropy hit an asymptotic floor of 3.9812 BPB because its linear readout y_t = C_out h_t could only span a 30-dimensional subspace of the 256-byte vocabulary.
Omega-800 constructs the degree-2 Kronecker tensor-product readout Ψ = [1, C_in]ᵀ ⊗ C_out ∈ ℝ²⁵⁶ˣ²⁷⁰ (rank(Ψ) = 256) from the exact same frozen seed=42 buffers, reaching 3.6935 BPB in 77.0 seconds.
Omega-rANS eliminates neural weight storage overhead: both compress() and decompress() initialize the identical seed=42 Kronecker basis and execute synchronized online Exponentiated-Gradient + SGD updates after every decoded byte, beating gzip -9, bzip2 -9, and xz -9e (PRESET_EXTREME).
| Benchmark Corpus | Raw | gzip -9 | bzip2 -9 | xz -9e | Omega-rANS |
|---|---|---|---|---|---|
| Tiny800 Val Curriculum A | 16,384 B | 3,724 B | 3,579 B | 3,640 B | 3,353 B (#1) |
| Tiny800 Val Curriculum B | 16,384 B | 3,590 B | 3,428 B | 3,528 B | 3,300 B (#1) |
| Tiny800 Val Curriculum C | 16,384 B | 3,675 B | 3,504 B | 3,608 B | 3,292 B (#1) |
| Monograph & Proofs Suite | 10,338 B | 3,621 B | 3,771 B | 3,524 B | 3,586 B |
| AGGREGATE TOTAL (BPB) | 59,490 B | 14,610 B (1.96) | 14,282 B (1.92) | 14,300 B (1.92) | 13,531 B (1.8196 BPB) |