dilated-receptive-fields.md
6.1 kB · markdown
Dilated receptive fields
- 2026-09-23 [Proved] For a linear dilated stack at levels
j < Lwith dilationb^j, independent randomC x Ctaps, each zero-mean with iid entries of variancesigma_k^2or, at most one per level, the identity plus such a matrix,E norm(dy_t/dx_(t-n))^2 = norm(u)^2 r_Q(n), whereq_k = [k is the residual] + C sigma_k^2andr_Q(n) = [z^n] prod_(j < L) Q(z^(b^j))is the weighted base-bdigit count; the undilated single-channel zero-mean case is Luo et al., section 2.2. Witness: notes/dilations.md, The field is a digit count. - 2026-09-23 [Verified] Monte Carlo over
4000random8-channel8-level stacks reproducesr_Qwith median relative error0.020and correlation0.9989over511lags forQ = 1 + z + z^2, and0.022and0.9999over256lags forQ = 1 + c(1 + z)atc = 1/2; the pure stack's z-scores run heavy-tailed,1.96%of its lags past3. Witness: lab/py/dilated-receptive-field gradient. - 2026-09-23 [Proved] For
Q = 1 + z + z^2andb = 2the field is Stern's diatomic sequence,r(n) = s(n + 1)for0 <= n < 2^L(A002487), mirrored asr(n) = r(2^(L+1) - 2 - n)above, recomputed exactly forL = 1..20. Witness: notes/dilations.md, Stern in the plain stack; lab/py/dilated-receptive-field count. - 2026-09-23 [Proved] The maximum of the
Q = 1 + z + z^2,b = 2field at levelLis the Fibonacci numberF_(L+1), attained atn = m - 1withm = (2^(L+1) + (-1)^L)/3. Witness: notes/dilations.md, Stern in the plain stack. - 2026-09-23 [Verified] The maximum
F_(L+1)sits at exactly the four lagsm - 1,3 . 2^(L-1) - m - 1and their mirrors forL = 3..20, at682, 852, 1194, 1364forL = 10. Witness: lab/py/dilated-receptive-field count. - 2026-09-23 [Proved] Exactly
2L + 1lags of theQ = 1 + z + z^2,b = 2field carry a single path,2^k - 1and2^(L+1) - 1 - 2^kfork = 0..L,21atL = 10. Witness: notes/dilations.md, Stern in the plain stack; lab/py/dilated-receptive-field count. - 2026-09-23 [Refuted] The single-path lag count
2(L + 1) + 1for theQ = 1 + z + z^2,b = 2field: it counts the centre2^L - 1three times, and the exact census reads2L + 1at everyL = 1..20. Witness: lab/py/dilated-receptive-field count. - 2026-09-23 [Proved] Peak over mean of the
Q = 1 + z + z^2,b = 2field isF_(L+1)(2^(L+1) - 1)/3^L, and its ratio from levelLtoL + 1tends to2 phi/3 = 1.07869, rational at every level,1.07143atL = 3and1.14815atL = 4; peak over mean is3.0853atL = 10and6.5835atL = 20. Witness: notes/dilations.md, Stern in the plain stack; lab/py/dilated-receptive-field count. - 2026-09-23 [Proved] The depth limit
mu_Qof a dilated field with nonnegative block polynomialQat basebis absolutely continuous if and only if for every integerknot divisible bybsomeQ(e^(2 pi i k/b^i))vanishes,i >= 1, and is purely singular otherwise; for primeband rational gains the test is that some cyclotomicPhi_(b^i)dividesQ. Witness: notes/dilations.md, When the limit is smooth. - 2026-09-23 [Refuted] For prime
band real nonnegative gains, an absolutely continuous depth limit forces somePhi_(b^i)to divideQ:Q = (z^2 - sqrt2 z + 1)(z^4 + sqrt2 z^2 + 1)(1 + z + z^2)^2atb = 2has least coefficient2 - sqrt2, covers every oddkati = 3ori = 4, so its limit is absolutely continuous, and is nonzero at-1,i,e^(3 pi i/4)ande^(pi i/8), so noPhi_(2^i)divides it. Witness: notes/dilations.md, When the limit is smooth; lab/py/dilated-receptive-field limit. - 2026-09-23 [Proved] For
Q = 1 + z + z^2andb = 2the fold modulo1of the depth limit carries the Stern rows,s(2^L + j) = r(j - 1) + r(j - 1 + 2^L)for0 <= j < 2^L, checked forL = 1..20. Witness: notes/dilations.md, When the limit is smooth; lab/py/dilated-receptive-field count. - 2026-09-23 [Verified] The exact cyclotomic check agrees with the Fourier product
prod_i Q(e^(2 pi i t/b^i))/Q(1)on all35block polynomials,21uniform,6single-convolution residual,7double-convolution residual and(1 + z + z^2)^2, the product below1e-15on every absolutely continuous row and at least1.8e-3on every singular one, a check of the generator's arithmetic since both sides read the same roots. Witness: lab/py/dilated-receptive-field limit. - 2026-09-23 [Proved] A dilated stack of
K >= 2uniform taps at basebhas an absolutely continuous depth limit if and only ifbdividesK, and forL >= 2a constant field exactly whenK = b; atL = 1every uniform field is constant. Witness: notes/dilations.md, Four stacks. - 2026-09-23 [Proved] The residual block
Q = 1 + c(1 + z)atb = 2has a singular depth limit for every gainc > 0, while the pureK = 2stack is flat. Witness: notes/dilations.md, Four stacks. - 2026-09-23 [Proved] The double-convolution residual block
Q = 1 + c(1 + z + z^2)^2atb = 2has an absolutely continuous depth limit exactly atc = 1, wherePhi_4dividesQ; with equal gainsq_1,q_2across each convolution's taps the digit count covers the block andc = q_1 q_2. Witness: notes/dilations.md, Four stacks. - 2026-09-23 [Proved] The square stack of
3 x 3convolutions at dilations2^jin both axes, its nine taps of equal gain, has fields(m + 1) s(n + 1)on its lower quadrant, peakF_(L+1)^2, with(2L + 1)^2single-path cells. Witness: notes/dilations.md, Four stacks. - 2026-09-23 [Refuted] Steps to learn a lag-
ncopy task scale like1/r(n): a linearK = 3,b = 2,L = 8,8-channel stack under full-batch gradient descent takes median615steps atr = 1and94atr = 34, a factor6.5against34, log-log slope0.55. Witness: lab/py/dilated-receptive-field copy. - 2026-09-23 [Conjecture] Steps to learn a lag-
ncopy task in a linearK = 3,b = 2stack fall monotonically withr(n), roughly asr(n)^(-1/2): at the default initial scale eight medians, slope0.55, correlation0.984withlog 1/r; at half the scale slope0.40, correlation0.983over the same eight lags, one run capped and read as above the cap; the exponent moves with the scale. Witness: lab/py/dilated-receptive-field copy.