all tags

information-theory

15 notes carry this tag — 1 moc, 9 claims, 1 observation, 1 question, 3 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• The unseen is measurable — but only so far — how the count of things seen exactly once estimates what a sample missed, why the same estimator keeps being independently rederived, and where the estimate provably runs out
  topic map 2026-08-27 · statistics-of-the-unseen, good-turing, chao1, singletons, hapax-legomena
• Verify the n·log n unseen-prediction horizon and its 'best possible' optimality against Orlitsky, Suresh & Wu (PNAS 2016) and Valiant & Valiant
  capture promoted 2026-08-25 · statistics-of-the-unseen, good-turing, extrapolation-limit, information-theory, primary-source-verification
• Orlitsky, Suresh & Wu's n·log n unseen-prediction horizon is proven optimal by a matched minimax lower bound, not just an achievability result
  claim seedling Tier 1 2026-08-25 · statistics-of-the-unseen, good-turing, extrapolation-limit, information-theory, minimax-lower-bound
• Valiant & Valiant's real, non-concurrent antecedent to the n·log n family is their own 2011 STOC paper, proving a matching O(n/log n) sample complexity for entropy and support-size estimation — a different problem than species-count prediction
  claim seedling Tier 1 2026-08-25 · statistics-of-the-unseen, extrapolation-limit, information-theory, sample-complexity, priority-and-lineage
• Valiant & Valiant's 2015 estimator independently reaches the same n·log n extrapolation range as Orlitsky, Suresh & Wu, but by an error metric the rival paper calls exponentially weaker in the hardest regime
  claim seedling Tier 1 2026-08-25 · statistics-of-the-unseen, extrapolation-limit, information-theory, sample-complexity, priority-and-lineage
• Miller's 1956 'channel capacity of absolute judgment' sets an information-theoretic ceiling on how many categories a single-dimension rating scale can carry
  claim seedling Tier 1 2026-08-15 · information-theory, psychophysics, history-of-psychology, source-evaluation, epistemics
• Samet's 1975 critique of the Admiralty Code argued for more rating categories, not fewer — citing Bendig (1954) that a nine-point scale transmits more information than a five-point one
  claim seedling Tier 1 2026-08-15 · intelligence-tradecraft, source-evaluation, admiralty-code, information-theory, psychophysics
• The Admiralty Code's six-level scales sit in the same information-theoretic lineage as the question of how many categories absolute judgment can carry — Miller (1956) through Bendig (1954) to Samet (1975)
  observation seedling Tier 1 2026-08-15 · cross-time-bridge, information-theory, psychophysics, intelligence-tradecraft, source-evaluation
• Miller's 1956 'channel capacity of absolute judgment' is the buried information-theoretic reason a 1975 Army report argued the Admiralty Code's rating scales were too coarse
  capture promoted Tier 1 2026-08-11 · intelligence-tradecraft, information-theory, psychophysics, epistemics, source-evaluation
• Barlow's 1961 chapter states the redundancy-reduction hypothesis explicitly, in his own words, as the operating principle of sensory relays
  claim budding Tier 1 2026-07-27 · neuroscience, efficient-coding, redundancy-reduction, information-theory, sensory-coding
• Does Barlow's 1961 primary actually state the redundancy-reduction / factorial-code hypothesis as the vault attributes it?
  capture promoted Tier 1 2026-07-23 · neuroscience, efficient-coding, redundancy-reduction, horace-barlow, factorial-code
• Barlow's 1961 efficient-coding hypothesis holds that sensory neurons recode input to strip statistical redundancy
  claim budding Tier 1 2026-07-12 · neuroscience, efficient-coding, redundancy-reduction, information-theory, sensory-coding
• From n samples, the unseen can be predicted only about n·log n observations further, and that horizon is provably the best possible (Orlitsky, Suresh & Wu 2016)
  claim seedling Tier 1 2026-07-12 · statistics-of-the-unseen, good-turing, extrapolation-limit, completeness, information-theory
• Verify the n·log n unseen-prediction horizon and its 'best possible' optimality against Orlitsky, Suresh & Wu (PNAS 2016) and Valiant & Valiant
  question answered 2026-07-12 · verification, statistics-of-the-unseen, extrapolation-limit, information-theory, source-criticism
• Oaksford and Chater recast the Wason selection task as optimal data selection, turning a classic 'human error' into rational choice
  claim seedling Tier 1 2026-07-09 · rationality, bayesian-cognition, cognitive-science, reasoning, wason-selection-task