---
title: "Deep neural networks exhibit critical learning periods — a temporary input deficit early in training can permanently cap the final skill, timed by onset and length like animal critical periods"
type: "claim"
status: "seedling"
audit_status: "capture-verified (Achille, Rovere & Soatto 2019 read at capture level by the batch worker; queen's independent re-extraction of arXiv:1711.08856 not yet run)"
source_url: "https://arxiv.org/abs/1711.08856"
source_title: "Critical Learning Periods in Deep Neural Networks"
source_author: "Alessandro Achille, Matteo Rovere, Stefano Soatto"
source_date: 2019
source_venue: "Critical Learning Periods in Deep Networks, ICLR 2019 (arXiv:1711.08856)"
source_quote: "Similar to humans and animals, deep artificial neural networks exhibit critical periods during which a temporary stimulus deficit can impair the development of a skill. The extent of the impairment depends on the onset and length of the deficit window, as in animal models"
source_tier: 1
provenance: "Promotion from 10-inbox/raw/2026-07-11-hop-deep-net-critical-periods.md, 2026-07-12"
origin: "batch"
derived_from: "10-inbox/raw/2026-07-11-hop-deep-net-critical-periods.md"
writer_model: "claude-opus-4-8"
date_created: "2026-07-12T00:00:00.000Z"
tags: ["critical-periods","deep-learning","training-dynamics","neuroscience","plasticity","cross-domain-bridge"]
---


A temporary corruption of a deep network's inputs *early* in training can
permanently cap its final skill, and the size of the damage scales with *when*
the deficit begins and *how long* it lasts — not with the total amount of
degraded exposure. Achille, Rovere & Soatto (2019) show this directly: "deep
artificial neural networks exhibit critical periods during which a temporary
stimulus deficit can impair the development of a skill … The extent of the
impairment depends on the onset and length of the deficit window, as in animal
models." Restore clean inputs after the window has closed and the network never
fully recovers, even with unlimited further training.

This mirrors, in an artificial system, the developmental critical periods of
biology — most sharply the monocular-deprivation result that a healthy but
deprived eye loses cortical territory forever if the deprivation falls inside an
early window ([[claim-monocular-deprivation-permanently-rewires-visual-cortex]]).
The two systems share the same onset/length-dependent signature, which is why
the finding reads as a cross-domain, cross-time bridge: a 1960s cat-vision result
describing how a 2019 net fails.

The claim as stated here is validated against *animal* critical periods; whether
a deep net's critical-period timing has ever matched a *human* one (e.g.
amblyopia) is a separate, open loop-closure question
([[question-deep-net-critical-period-predicts-human-amblyopia-timing]]). The
*mechanism* behind the phenomenon — a rise-then-fall of information rather than
any biological machinery — is treated separately in
[[claim-critical-periods-arise-from-information-plasticity-not-biology]]. The
"early layers lose the ability to change" character also rhymes with the
vanishing-gradient pathology ([[claim-vanishing-gradient-chain-rule-pathology]]),
though the two are distinct failure families. The CNN substrate these experiments
run on descends architecturally from the same Hubel–Wiesel neuroscience the
biological anchor comes from ([[claim-fukushima-1979-neocognitron-first-cnn]]).