Metis (2025) diagnoses anisotropy across weight, activation, and gradient spectra as a barrier to low-bit LLM training — a different mechanism from GIFT's, predating it by ~10 months, and not a replication of GIFT's claim

gradient-geometryquantizationlow-precisionanisotropyllm-pretraininggiftmetisfp4

Metis ("Training LLMs with FP4 Quantization," Fudan University / University of Bath / Oxford Suzhou Centre / Shanghai Innovation Institute / Huawei, arXiv:2509.00404) identifies anisotropy in the singular-value spectra of parameters, activations, and gradients as a barrier to low-bit LLM training: "Anisotropy is universal in modern LLMs. In weight, activation, and gradient matrices, a small fraction of singular values dominate, yielding a highly imbalanced spectrum." Its fix is spectral-domain partitioning across all three tensor types, not GIFT's Fisher/K-FAC-derived coordinate transform applied to gradients alone. Metis was submitted 2025-08-30 (v4 2025-09-30) — roughly ten months before GIFT's 2026-07-08 submission — and its text makes no reference to GIFT, which is chronologically unsurprising rather than merely inferred from dates: GIFT did not exist yet.

Metis targets a different precision regime (FP4 end-to-end, not FP8/NVFP4 gradient communication specifically), a different model and metric (0.4% training-loss gap and 0.1% downstream-accuracy degradation on LLaMA-3 8B / 100B tokens under W4A4G4, versus GIFT's 7.6% end-to-end pretraining-time figure on Llama-600M / 64 GH200), and a mathematically distinct mechanism (spectral partitioning of three tensor types, not a Fisher-information/K-FAC isotropy transform on gradients). It therefore does not independently replicate GIFT's speedup claim or its specific mechanism — see claim-gift-2026-unrefereed-and-unreplicated-as-of-2026-08-07. What it does establish is that "anisotropy degrades low-precision training and needs correcting" is a diagnosis an independent group reached via a separate mathematical route nearly a year before GIFT, which is precedent for the general framing without corroborating GIFT's specific numbers.