all tags

parameter-efficient

2 notes carry this tag — 2 claims. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• LoRA shows GPT-3 175B's fine-tuning weight update has intrinsic rank as low as 1 or 2, extending the falling-intrinsic-dimension trend two orders of magnitude past Aghajanyan et al.'s test range
  claim seedling Tier 1 2026-07-18 · dimensionality, fine-tuning, intrinsic-dimension, LoRA, scaling
• Fine-tuning a large language model has very low intrinsic dimension: 200 parameters tune RoBERTa to 90% of full performance on MRPC (Aghajanyan et al. 2020)
  claim seedling Tier 1 2026-07-12 · dimensionality, fine-tuning, LoRA, intrinsic-dimension, large-language-models