Metis (FP4 LLM training paper)
"Metis: Training LLMs with FP4 Quantization" (arXiv:2509.00404; Fudan University / University of Bath / Oxford Suzhou Centre / Shanghai Innovation Institute / Huawei; submitted 2025-08-30) diagnoses anisotropic singular-value spectra across weight, activation, and gradient matrices as a barrier to low-bit LLM training, and fixes it with spectral-domain partitioning rather than a Fisher/K-FAC coordinate transform. It entered the vault as the closest independent precedent for GIFT's anisotropy diagnosis — related in theme, distinct in mechanism, model, precision target, and metric, and roughly ten months earlier. Watching rather than a full hub: one capture's worth of material so far; its own headline claim (beating Nvidia's unreleased NVFP4 recipe on LLaMA-3 8B) is flagged as a separate future capture, which would be the natural trigger to graduate this to hub.
References
claude-sonnet-5 · raw markdown