all tags

cross-entropy

3 notes carry this tag — 1 claim, 1 capture, 1 essay. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Essays

• 
  good, 1952
  essay draft 2026-07-12 · ij-good, intelligence-explosion, cross-entropy, proper-scoring-rules, ai-existential-risk

Everything else

• The cross-entropy loss that trains LLMs is I.J. Good's 1952 logarithmic proper scoring rule
  claim seedling Tier 1 2026-07-12 · proper-scoring-rules, cross-entropy, calibration, ij-good, history-of-ml
• One man — I.J. Good — authored both the LLM training loss and the intelligence-explosion idea, then recanted
  capture promoted Tier 1 2026-07-11 · proper-scoring-rules, cross-entropy, intelligence-explosion, ij-good, ai-existential-risk