README.md
7.0 kB · markdown
Codebook
- The codebook experiment: a catalog of atoms in three classes, greedy matching pursuit under a minimum-description-length score on four bit images of side 243, and the bits each class buys, with
zlibbeside it as the control. The honest quantity is bits saved againstzlib, never compression achieved. - Class K, Kronecker tiles: all 16 base-2 plane designs at level 1 and their Kronecker squares, and the 101 nonempty square-group orbits of the 511 nonempty base-3 plane codes at level 1 and level 2, so
2 x 2,4 x 4,3 x 3and9 x 9. A code is the cell bitmask of core, bitbase*(i mod base) + (j mod base), and the base-2 carpet rendered at side 3 is base-3 code 495. - Class M, magic designs: the two-letter words over the tile-source letters
carpet 7, net 14, htree 3, vtree 5, void 9of magic at side pairs(3,5),(5,3),(3,7),(7,3), so15 x 15and21 x 21,magic(3,5)among them.magic(3,5,7)has side 105 and does not fit a32 x 32window, so the three-letter words are out by the size rule. - Class L, life frames: eight named rules of automata on a wrapped
16 x 16grid, from one centre cell and seven seeded random grids, generations 1 to 6. - The three families are de-duplicated as one catalog before anything is counted: 718 atoms built, 25 duplicates and 26 dead frames dropped, 667 kept.
- The corpora: the tree's own render
bang dim 2, code 7at level 5; the first 7382 bytes ofresearch/README.mdunpacked MSB first and reshaped square; uniform bits from a printed seed; and a bilevel natural-image proxy, the radial gradient1 - rordered-dithered by the4 x 4Bayer matrix. The text row's bit counts follow whatever bytes that file currently holds; its verdict, that nothing is placed, does not. - The score, in bits: a placement of an atom of
ncells withdmismatches costslog2(A) + log2(P) + log2(n+1) + log2(C(n,d)), whereAis the catalog size andPthe legal positions for that atom, and replaces thenraw bits of its window. The uncovered plane is coded raw or enumeratively,log2(U+1) + log2(C(U,u)), whichever is shorter, plus one flag bit; the placement count costslog2(N+1); the encoder emits either the pursuit or the placement-free description, whichever is shorter, plus one mode bit. The code is decodable as written and its bit counts are real-valued, an idealised arithmetic code. - The pursuit: placements never overlap, the mismatch count of every atom at every position comes from one FFT correlation plus an integral image, and the greedy takes candidates in descending saving per cell. The saving per placement key is run beside it and printed, because it is strictly worse.
- Every corpus asserts its reconstruction: the atoms, their mismatch masks and the uncovered bits rebuild the corpus cell for cell. The FFT mismatch count is checked against a direct window comparison on 800 sampled placements. The saving decomposes exactly as atom bits minus header plus residual credit.
- The identification half runs the rearrangement of Van Loan and Pitsianis: a matrix cut into
p x qblocks becomes thepqbyp'q'matrix of vectorised blocks,R(B (x) C) = vec(B) vec(C)', so the nearest Kronecker product is the rank-one SVD ofRand the singular values are the data's Kronecker spectrum. The study reads the code off the thresholded rank-one factor at four splits, peels a five-letter magic word, and sweeps a bit-flip rate against the recovered code. - A block-mean detector is run beside it as an independent baseline, because its failure point is a closed form in the fill law and not a measurement.
RUN
uv run python research/lab/py/codebook/codebook.py- Domain: 667 atoms at catalog depth 2 and 970 at depth 5, four corpora of
243 x 243 = 59049bits, up to 3453145 scored candidate placements per corpus, and 51 noise levels at 40 seeds each; about thirty seconds, prints only, writes nothing.
WITNESSES
- information.md the object: the rearrangement
Rat splitbase^level, the identityR(B (x) C) = vec(B) vec(C)^T, andsigma_1 = ||A||_Fon a render of one design. - information.md identification:
sigma_1 = 181.0193withsigma_2/sigma_1of9.938e-16, 3.215e-15, 1.387e-16, 6.608e-16at splits3, 9, 27, 81on the level-5 carpet, the factors the carpet at levels1, 2, 3, 4outside and4, 3, 2, 1inside, the code495at the3 x 3split. - information.md identification: the peel of
carpet(3), void(3), net(3), htree(3), vtree(3)at side 243 into495, 341, 186, 455, 365, withsigma_2/sigma_1of5.1e-16, 7.1e-16, 1.6e-16, 7.9e-17. - information.md identification: the noise dial over 51 rates at 40 seeds each, the rank-one factor 40/40 to
p = 0.30, 12/40 at0.31, 0/40 from0.32, the block mean 40/40 to0.26, 39 at0.27, 25 at0.28, 0 from0.29. - information.md identification: the block-mean closed form
f/(1 + 2f) = 0.277638atf = (8/9)^4 = 0.624295, derived from the fill law and not from the sweep. - information.md identification:
sigma_2/sigma_1of0.0000, 0.1524, 0.2205, 0.2738, 0.3087, 0.3242atp = 0.00, 0.10, 0.20, 0.30, 0.40, 0.50, the recovered code495through the first four and511at the last two. - information.md the codebook: 718 atoms built, 25 duplicates and 26 dead frames dropped, 667 kept, split
15, 101, 15, 101Kronecker,50, 50magic,335life. - information.md the codebook: the cell floor,
log2(667) = 9.3815andlog2(59049) = 15.8496, no atom below 31 cells ever placed, 131 of the 667 dead by arithmetic. - information.md the codebook: the four-corpus table, ones
32768, 26434, 29658, 15330,zlib9256, 27232, 59096, 6304, codebook26468, 58607, 59067, 37521, so-17212, -31375, +29, -31217, with deflate expanding the random stream by 47 bits. - information.md the codebook: the tree render at 569 placements, 51864 of 59049 cells covered, a placement-free 58559,
K/M/L = 26536, 0, 5755of 32292 atom bits,bang dim 2, base 3, code 495at 432 placements for 21387 bits,bang dim 2, base 3, code 7at 72 for 3565 andbang dim 2, base 3, code 511at 32 for 1584, andrule birth [1 3 5 7], survive [1 3 5 7], wrapat density8/256for 5755. - information.md the codebook: the halftone's 188 placements at
K/M/L = 1171, 2147, 16246, its five life frames running density0.0312to0.0977. - information.md the codebook: the two greedy keys, 569 placements for a 32581 saving at
26536, 0, 5755against 137 for 16435 at1980, 5994, 5755. - information.md the codebook: the depth ladder, atoms
667, 768, 869, 970atlog2 A9.3815, 9.5850, 9.7632, 9.9218, codebook bits26468, 7418, 2305, 44, againstzlib-17212, +1838, +6951, +9212, placements569, 125, 33, 1, the random control at-18and zero placements throughout. - information.md where the numbers live: up to 3453145 candidate placements scoring positive on one corpus, the FFT mismatch count against a direct window comparison on 800 sampled placements with no failures, and an exact reconstruction asserted on every corpus.