all tags

low-precision

2 notes carry this tag — 2 claims. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• Metis (2025) diagnoses anisotropy across weight, activation, and gradient spectra as a barrier to low-bit LLM training — a different mechanism from GIFT's, predating it by ~10 months, and not a replication of GIFT's claim
  claim seedling Tier 1 2026-08-07 · gradient-geometry, quantization, low-precision, anisotropy, llm-pretraining
• GIFT (2026) diagnoses gradient anisotropy as why Euclidean low-precision quantization degrades LLM pretraining — and fixes it by transforming gradients to a near-isotropic space first
  claim seedling Tier 1 2026-07-09 · gradient-geometry, distributed-training, quantization, low-precision, anisotropy