---
title: "Is the 'low-dimensional subspace that constrains adaptation' one shared mathematical object across neural manifolds and LLM intrinsic dimension — or three analogies that share a shape?"
type: "question"
status: "open"
writer_model: "claude-opus-4-8"
date_raised: "2026-07-12T00:00:00.000Z"
tags: ["neural-manifolds","dimensionality","cross-domain-convergence","fine-tuning","learning","large-language-models"]
---


This is the saved hook behind [[observation-low-dimensional-subspace-constrains-adaptation-brains-and-nets]]. The same shape — useful adaptation confined to a low-dimensional subspace of a much larger space — recurs across three literatures:

- **Neural manifolds** in motor cortex ([[claim-sadtler-2014-within-manifold-bci-learning-fast-outside-resists]]): the low-D structure is the covariance/principal subspace of population firing.
- **Plastic recurrent networks** ([[claim-feulner-clopath-2021-rnn-reproduces-manifold-learning-asymmetry]]): the low-D structure is the activity subspace an RNN's recurrent weights already support.
- **LLM fine-tuning** ([[claim-aghajanyan-2020-fine-tuning-low-intrinsic-dimension]]): the low-D structure is the intrinsic dimension of a fine-tuning *objective* in weight space — a different space (parameters, not activations) from the first two.

The observation note deliberately refuses to assert these are the same math, exactly as [[question-gradient-geometry-one-object-or-three-analogies]] refuses it for gradient geometry. The open questions:

1. **Same object?** Is there a formal reduction linking an activation-space neural manifold to a parameter-space intrinsic dimension — e.g. via the tangent/Jacobian map from weights to activity, or via the Fisher-information geometry that also underlies [[question-gradient-geometry-one-object-or-three-analogies]]? Or are activation-subspace and weight-subspace low-dimensionality genuinely distinct phenomena?
2. **Why does it recur?** The capture noted the Platonic Representation Hypothesis (networks converging on shared low-D representations) as an adjacent candidate explanation for *why* low-D structure is ubiquitous. Worth chasing as a possible mechanism.

**Candidate empirical next move (a direct test of the analogy):** are LLM "within-manifold" edits (low-rank LoRA updates) safe while "outside-manifold" edits cause catastrophic forgetting — the AI mirror of Sadtler's within-/outside-manifold asymmetry? If so, the bridge is more than metaphor. If a genuine reduction or a clean empirical parallel is found, this cluster may warrant a "low-dimensional-adaptation" MOC.

---

**Progress — 2026-07-25 (partial; question stays open).** Promotion of `10-inbox/raw/2026-07-19-is-the-low-dimensional-subspace-that-constrains-adaptation.md` substantially advances **sub-question 1 ("same object?")** and leaves **sub-question 2 ("why does it recur?" / Platonic Representation Hypothesis)** and the empirical within-/outside-manifold test untouched — so this is a progress note, not a closure.

What settled on sub-question 1, from four new claim-notes reading the primary definitions on each side:
- The neuroscience notion is defined on *activity* — [[claim-jazayeri-ostojic-2021-neural-manifold-intrinsic-dimension-parametrizes-activity]] (minimal continuous variables parametrizing the population activity manifold).
- The LLM notion is defined on *weights* — [[claim-li-2018-intrinsic-dimension-objective-landscape-codimension-parameter-space]] (codimension of a solution set in parameter space; the ancestor of Aghajanyan/LoRA). These are **different mathematical objects on different spaces.**
- ML *already* overloads "intrinsic dimension" onto two constructs — [[claim-ansuini-2019-two-intrinsic-dimensions-representation-vs-weight-space]] — and only the *representation-space* (activation) one is the same type of object as the neuroscience manifold; the famous fine-tuning/LoRA one is not.
- The only located formal bridge is ML-internal — [[claim-gelora-2024-representation-intrinsic-dimension-lower-bounds-lora-rank]] (representation ID lower-bounds LoRA rank) — and a targeted search found **no** paper bridging neuroscience manifold ID to LLM weight-space ID, recorded as `[unverified — could not confirm/deny after search]`: evidence of absence, not proof of non-equivalence.

**Net:** the definitional and mechanism evidence weighs toward "analogies that share a shape" over "one shared object," but as evidence of absence it cannot close the door on a reduction. Sub-question 1 is answered *provisionally against* a shared object; the question stays `open` for sub-question 2 and the empirical test, and because a bounded negative search is not a proof.