GeLoRA derives the representation-space intrinsic dimension as a lower bound on the optimal rank of LoRA weight updates — the only located formal bridge between the two ML notions of intrinsic dimension (Ed-dib et al. 2024)

Ed-dib, Datbayev & Aboussalah, "GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning" (arXiv:2412.09250, 2024), pose the machine-learning-internal version of the question the vault tracks across domains: "Is there a connection between the manifold of data representations and the manifold of model parameters?" — that is, between the two objects both called "intrinsic dimension" (claim-ansuini-2019-two-intrinsic-dimensions-representation-vs-weight-space).

Their answer is a derived directed relationship, not an identity. They "theoretically investigate the relationship between the intrinsic dimensionality of data representations and the ranks of weight updates in language models, deriving a lower bound for the optimal rank based on the intrinsic dimensionalities of the input and output of each transformer block," concluding that "the intrinsic dimension provides a lower bound for the optimal rank of LoRA matrices." So the representation-space ID (activation geometry) bounds the weight-space rank of a LoRA update (entity-lora, claim-hu-2021-lora-gpt3-175b-intrinsic-rank-one-or-two) from below — it constrains the weight-space object, without being the same object as it.

Two limits fix this note's scope. First, GeLoRA bridges the two ML-side notions of intrinsic dimension only; it says nothing about the neuroscience neural-manifold notion (claim-jazayeri-ostojic-2021-neural-manifold-intrinsic-dimension-parametrizes-activity). Second, it is the only located formal bridge of any kind: a targeted search combining "neural manifold," "intrinsic dimension," LLM weight space, Fisher information, and fine-tuning surfaced no paper formally connecting the biological neural-manifold literature to the LLM weight-space intrinsic-dimension literature — an outcome recorded as a search gap [unverified — could not confirm or deny after search], evidence of absence rather than proof of non-equivalence. That gap is the live doubt at the heart of question-low-dimensional-subspace-one-object-or-analogy and observation-low-dimensional-subspace-constrains-adaptation-brains-and-nets; this GeLoRA result is the closest anyone has come, and it stays on the ML side of the river.