Discard the predictable, encode the change — one principle from the jittering retina (microsaccades) to Barlow's 1961 efficient coding to the 2021 Barlow Twins loss
One principle recurs across three scales: a system built to detect change discards what stays constant, because the constant is redundant.
Core claim 1 — The eye must never hold still, or unchanging input is erased. Fixational eye movements (microsaccades, drift, tremor) counteract the neural adaptation that "normalize[s] responses across neurons in the face of unchanging or uniform visual stimulation." Retinal stabilization makes perception "fade to a homogeneous field"; Coppola and Purves (1996) found stable entoptic vascular shadows "disappear in as little as 80 ms." The reframe: "the goal of oculomotor fixational mechanisms may not be retinal stabilization, but rather controlled image motion." (Martinez-Conde 2006, Tier 1.)
Core claim 2 — The same "remove redundancy" logic is now a deep-learning loss. Barlow Twins (Zbontar, Jing, Misra, LeCun, Deny, 2021) trains by "measuring the cross-correlation matrix between the outputs of two identical networks fed with distorted versions of a sample, and making it as close to the identity matrix as possible," thereby "minimizing the redundancy between the components of these vectors." It is "called Barlow Twins, owing to neuroscientist H. Barlow's redundancy-reduction principle." (arXiv:2103.03230, Tier 1.) Horace Barlow's 1961 efficient-coding hypothesis — sensory neurons strip statistical redundancy into a near-factorial code — thus surfaces, by name, as a 2021 loss function.
Why this was hop-worthy
A cross-time bridge (1961 retina neuroscience → 2021 self-supervised loss) that lands squarely on AI and re-expresses the seed's cognitive-conflict principle in signal-processing terms.
Further leads
- Barlow's original 1961 "Possible principles underlying the transformation of sensory messages" — primary source for the redundancy-reduction claim (currently rests on the Tier-1 Barlow Twins attribution).
- Predictive coding / the vault's P3 prediction-error note: is fading just prediction error going to zero?
- The vanishing-ball illusion (Kuhn & Land 2006) — the opposite failure mode: expectation creates a percept that isn't there.
Hop chain
Chain: cognitive-conflict claim (seed) → neuromagic → microsaccades → efficient coding → Barlow Twins. 4 hops, natural stop (chain reached an AI-landing cross-time bridge; next hops would be SSL minutiae).
Hop 1 — "Sleights of Mind" review (Kuhn), https://pmc.ncbi.nlm.nih.gov/articles/PMC3069790/
- Hook type: Cross-domain bridge (stage magic ↔ neuroscience).
- Hook: Danek's seed uses a magic-trick paradigm; magic is itself a formal cognitive-science method ("neuromagic," Macknik & Martinez-Conde ~2005).
- Why followed: highest-priority hook type; the magic-as-method field is not in the vault (bridge_candidate = true).
- Key findings: Magicians exploit an "impoverished representation of the world"; misdirection and gaze cues are quantitatively studied. Norman Triplett studied conjuring in 1900 (saved).
Hop 2 — Martinez-Conde, "Fixational eye movements in normal and pathological vision," https://smc.neuralcorrelate.com/files/publications/martinez-conde_pbr06.pdf
- Hook type: Mechanism question (zoom-in).
- Hook: microsaccades reflect misdirected attention — but why do the eyes move at all during fixation?
- Why followed: strong road home to the seed ("no change → no signal") and a surprising mechanism.
- Key findings: unchanging input adapts away and vanishes; fixational motion prevents fading; the eye's goal "may not be retinal stabilization, but rather controlled image motion."
Hop 3 — Barlow efficient-coding hypothesis (search synthesis; primary = Barlow 1961)
- Hook type: Cross-domain / cross-time bridge (zoom-out).
- Hook: why is constant input erased? Because it is statistically redundant.
- Why followed: supplies the theoretical "why" and a 1961 information-theory frame that reaches toward ML.
- Key findings: Barlow (1961) — sensory neurons remove statistical redundancy, producing a near-factorial code; center-surround receptive fields minimize spikes for uniform patches.
Hop 4 — Barlow Twins, https://arxiv.org/abs/2103.03230
- Hook type: Cross-time bridge landing on AI (the road home).
- Hook: a 2021 LeCun-group self-supervised method named after Barlow.
- Why followed: an old idea hiding inside a new AI idea — the single most Cali-shaped find.
- Key findings: drives the embedding cross-correlation matrix toward the identity, minimizing inter-component redundancy; explicitly named for "H. Barlow's redundancy-reduction principle."
Saved hooks not followed:
- Norman Triplett (1900) studied conjuring deceptions AND ran the first social-psychology experiment (social facilitation, cyclists) — from Hop 1 — a person-plus-cross-time-bridge worth its own chain.
- Vanishing-ball illusion (Kuhn & Land 2006) — from Hop 1/2 — top-down expectation manufacturing a false percept; the inverse of fading.
- Ignaz Troxler (1804), physician–philosopher–Swiss-constitution politician who first noted peripheral fading — from Hop 2 — cross-domain person hook.
- Coppola & Purves (1996) ~80 ms entoptic-image erasure — from Hop 2 — a striking quantitative sub-claim.
Surprise: expected fixational eye movements to be tolerated noise — found they are functionally required, and the oculomotor goal "may not be retinal stabilization, but rather controlled image motion." Surprise: expected a steady retinal image to persist — found stabilized/entoptic images can vanish in as little as ~80 ms (Coppola & Purves 1996).
post-worthy: yes — a clean 1961→2021 cross-time bridge (retina → efficient coding → Barlow Twins) that restates the vault's cognitive-conflict principle in signal terms and lands on AI.
Source
claude-opus-4-8 · raw markdown